Nursing Research PDF

**Week 1, chap 1 & 4: "Role of Research to Support Nursing Practice"** **Nursing research** - A systematic, rigorous, logical way to acquire knowledge to support the way nursing care is provided - Importance of research in nursing practice stems from Florance Nightingale who noted con...

**Week 1, chap 1 & 4: "Role of Research to Support Nursing Practice"** **Nursing research** - A systematic, rigorous, logical way to acquire knowledge to support the way nursing care is provided - Importance of research in nursing practice stems from Florance Nightingale who noted connections between sanitary conditions and death rates among wounded soldiers - In the early 20th century, the scientific method was developed to determine a systematic way to create knowledge and understanding about the world - Research is used to generate and test new theory related to nursing practice **Evidence informed nursing:** analysis of science information to make decisions about patients. **Evidence informed decision making:** is what I have available in order to inform care ej. hospital protocols, postpartum nursing research/review literature **Research process** - **Problem statement:** situation or problem that has emerged from practice. What are the best strategies to prevent youth smoking? - **Hypothesis:** your prediction - A **clinical question** is practical and specific, guiding patient care decisions (e.g., *\"What is the best antibiotic for pneumonia in elderly patients?\"*). - A **research question** is broader and investigative, aiming to generate new knowledge (e.g., *\"How does antibiotic resistance impact pneumonia treatment outcomes?\"*). Clinical questions help make **immediate** care decisions, while research questions explore **why or how** something happens over time. **Clinical question 3 elements:** 1. Situation 2. Intervention 3. Outcome   **Research Design:** is the how we did it, how does it look like. - Is it feasible? - Is it qualitative or quantitative? +-----------------------------------+-----------------------------------+ | Quantitative | Qualitative | +===================================+===================================+ | Objective | Subjective | | | | | Concrete | Interpretive | | | | | measured | Descriptive | +-----------------------------------+-----------------------------------+ +-----------------------------------+-----------------------------------+ | Quantitative | Qualitative | +===================================+===================================+ | Uses research questions and | Uses open ended questions. | | hypotheses to guide research | | | projects. | Requires the researcher to | | | interpret data to form thematic | | Includes variables: | ideas. | | | | | - Independent (X= the cause) | - You reach a saturation level | | | | | - Dependent (Y= the effect) | | | variables. | | | | | | X (amount of study time) → Y | | | (exam score)X (type of fertilizer | | | used) → Y (plant growth) | | +-----------------------------------+-----------------------------------+ **Research methods:** your recipe of how you are going to do your study - Selection and number of participants - Data Collection Methods - Surveys - Interviews - Document review - Data Analysis Strategies - Statistical Analysis - Thematic Analysis **Dissemination of research:** sharing results to inform and improve practice. **Qualitative research -- locations** Phenomenon Abstract, intro or both --------------------------- ----------------------------------------- Purpose Abstract, intro or others Literature review Intro, discussion or both Design Abstract, intro, methods, design Sample Methods, sample, subjects, participants Legal - ethical issues Procedures, description of sample Data collection procedure Data collection or procedures Data analysis Methods, data analysis Results Abstract, results, findings Discussion Discussion Recommendations At end of article  **Quantitative research -- locations** +-----------------------------------+-----------------------------------+ | Research problem | Abstract, intro (not labelled) or | | | in problem | +===================================+===================================+ | Purpose | Abstract, intro ot both, end of | | | literature review, discussion, | | | purpose | +-----------------------------------+-----------------------------------+ | Literature review | Intro (not labelled), literature | | | review, or related literature. | | | | | | Variables may appear as titles | +-----------------------------------+-----------------------------------+ | Theoretical framework, | Literature review, | | | theoretical/conceptual framework | | Conceptual framework, or both | | +-----------------------------------+-----------------------------------+ | Hypothesis/research questions | Intro, hypothesis, research | | | questions, results | +-----------------------------------+-----------------------------------+ | Research design | Intro (stated or implied), | | | methods | +-----------------------------------+-----------------------------------+ | Sample: type and size | Size: Methods, sample, subjects, | | | participants | | | | | | Type: stated or implied in any of | | | previous headings under size | +-----------------------------------+-----------------------------------+ | Legal -- ethical issues | Methods, sample, subjects, | | | participants | +-----------------------------------+-----------------------------------+ | Instruments (measurement tools) | Methods, instruments, measures | +-----------------------------------+-----------------------------------+ | Validity and reliability | Methods, instruments, measures, | | | procedures (stated or implied) | +-----------------------------------+-----------------------------------+ | Data -- collection procedure | Methods, procedure, data | | | collection | +-----------------------------------+-----------------------------------+ | Data analysis | Methods, procedure, data analysis | +-----------------------------------+-----------------------------------+ | Results | Results | +-----------------------------------+-----------------------------------+ | Discussion of findings and new | Discussion | | findings | | +-----------------------------------+-----------------------------------+ | Implication, | Combined with discussion or | | | separated | | Limitation, & | | | | | | Recommendation | | +-----------------------------------+-----------------------------------+ | References | At end of article | +-----------------------------------+-----------------------------------+ | Communicating research results | In research articles, poster and | | | paper presentations | +-----------------------------------+-----------------------------------+ A screenshot of a questionnaire Description automatically generated **Critical appraisal:** objectively determine the strength, quality, and consistency of evidence; these characteristics help you determine the applicability of the evidence to research, education, or practice.  **7 Levels of evidence** A diagram of a pyramid Description automatically generated May not say explicitly, might be in "methods" **Week 2, chapters 3 &5: "Searching, Reviewing and Critiquing the Literature**" A **literature review** is a summary and analysis of existing research on a specific topic. It identifies key findings, gaps, and trends, helping to understand the current state of knowledge and guide future research. What's its value? **Bias in literature review:** When you focus solely on studies that confirm your assumptions and beliefs about a topic. Done through: - **Published Journal articles** (main source): - Research studies - Systematic reviews - **Textbooks and books** - **Dissertations\*** - **Conference papers** - **Grey literature** A **dissertation** is a long, formal research paper or project required for a doctoral or master\'s degree. **Primary Sources (Original Research)** - Research studies - Dissertations - Conference papers **Secondary Sources (Summarize, Interpret, or Analyze Primary Sources)** - Systematic reviews - Textbooks and books - Published journal articles (if they are review articles, meta-analyses, or theoretical discussions) - Grey literature (depends on the type; reports and white papers often summarize research rather than conduct it) A **primary source** presents **original** research (they did the study), while a **secondary source** interprets or summarizes other research findings. (info from other than the original) - **Primary Source** = original, primary source; authors of the study - **Secondary Source** = getting the information from someone other than the original author. - May be necessary (ex. source is written in another language or not available to you) - Risks: may lead to misinterpretation and misrepresentation **Grey literature:** refers to **unpublished** research like reports or theses. It\'s harder to access and verify but can still be useful. You can't prove the sources. Probably not peer-reviewed, not widely disseminated/shared, sources are harder to verify, unjustified, even coming from a big-name company, they are not referencing anything. **(CINAHL) Cumulative Index to Nursing and Allied Health Literature** **Boolean Operators:** simple word used to complete or exclude keywords in a search (AND, OR, NOT). **Wild cards:** (pg. 96) **\*** = Nurs\*. Multiple characters **\#** = ped -\> pe\#a, color -\>colo\#r = x word that can be spelled different **?** = for "ne?t". A word that you don't know the middle/missing letter is  A paper with text on it Description automatically generated **Critical Appraisal of Research Articles** x7 Considerations: - Where is the article published? - Is the journal peer-reviewed? - Who are they and what are their credentials? - What knowledge and expertise do they have in the area of research? - What is the phenomenon of interest and is it clearly communicated? - Are the research questions clearly communicated? - Do they align with the methods used in the research study? - Will the findings from the study contribute to knowledge in the field of nursing? - Is there congruency between the methodology and methods used? - Is there a [theoretical framework] that guides the research process? - Is the method adequate for addressing the phenomenon of interest? - Were participants chosen appropriate for informing the research? - Was there anyone overlooked or excluded? - Are the data collection and analysis procedures explained? - Qualitative Studies: - Is **[saturation level]** of data described? - Are the participants voices adequately represented? - Does data analysis process offer an interpretation of the data, conceptual framework or theory? - Quantitative Studies: **[clear measuring tool is identified]** - Is the data collected using valid and reliable instruments? - Is the sample representative of the population being studied - Do the analysis techniques match the data collection strategies - Does the research discuss how they promoted rigour, validity or trustworthiness?  Nurses improve quality care and patient safety through accurate documentation, evidence-based practice, (CDSS) clinical decisions support systems use, and reduced complications. **Week 3: Exploring Prominent Paradigms and Theoretical Frameworks that Guide Nursing Research. Chap 2 & Journal** **Nursing Knowledge that Informs Practice** **Empirical and Theoretical Knowledge** - Serves as a guide for evidence-informed practice - Theoretical knowing is concerned with developing or testing theories or ideas that nurses and researchers have about how the world operates - Theoretical knowing is informed by empirical knowing which involves observations of reality - All research is based on philosophical beliefs about the world and they are based on a worldview or what we call Paradigm **Paradigm x3 (on pink below)** - [Ways of viewing the world ] - Form the foundation from which research is undertaken - Includes a set of assumption about reality, how knowledge is created and what is valuable to learn - Some nursing researchers gravitate towards one specific paradigm; however, remember that [our research question and process should drive the selection of a paradigm] - All aspects of a research study must flow from the chosen paradigm - Three prominent paradigms in nursing are [positivism/post-positivism, constructivism, and critical theory]. **Terminology to Understand Paradigms** A screenshot of a computer Description automatically generated 1. **Positivism/Post-Positivism Paradigm** **Ontology/Epistemology:** (*what's it is, why exist?)* - **Post-Positivism:** - Aims for objectivity and impartiality (**producing unbiased and generalizable research**) - Focuses on [cause and effect] (**causality**) - **emphasizes the use of empirical data to understand the world** - Rejects the idea that we can see the world perfectly as it is because we are human beings and are subject to error and bias - Full objectivity and impartiality cannot always be relied upon - **recognizes the limitations of empirical data and emphasizes the importance of subjectivity in research**. - Scientists are required to put aside their biases see the world as it "really" is - Triangulation of data and replicating of findings encouraged - Intense scrutiny of research and ejection of poorly conducted research **Positivism/Post-Positivism Paradigm** **Aim:** to explain, predict and [control] **Methods:** - Dominantly quantitative methods are used - Experimental and non-experimental approaches are used - Includes research questions and hypotheses as well as accounting and controlling factors that might influence the research process 2. **Constructivism** **Ontology/Epistemology:** - Objectivity is not possible nor desirable as [knowledge is co-created] - Focuses on understanding human experiences, social and cultural constructs, values, perspectives and language - The ways which we understand our world are largely dependent on our perceptions and context - Research emphasizes the [meaning ascribed/assigned to the human experience] - There are multiple truths and truth is relative to the context **Constructivism Paradigm** **Aim:** Understand social realities and interpretations of meaning **Methods:** - Predominantly Qualitative in nature requiring interpretation of interview data, document or artifact review (pictures, words, art, etc.) - Research is a process of interaction between the researcher and participant \*Also referred to as *[interpretivism or relativism]* 3. **Critical Theory** *(social imbalances -- truth comes by who has the power)* **Ontology and Epistemology:** - Reality is constructed by those in power at a particular time and place - Objectivity is not a desired outcome, perceptions influence knowledge generation and creation - Understanding is shaped by numerous social, political, economic and cultural factors - Gender, sexual orientation, class and economic status, race and ethnicity, ability, geographical location, etc. - [Requires the researcher to understand how power imbalance associated with these factors influence health and well-being outcomes] - Specific critical theories include: *[feminist theory, critical race theory, intersectionality, etc.]* **Critical Theory Paradigm** **Aim:** Emancipation (*collective and individual liberation, freeing someone from oppression/limitations*) and social change, reconstruction of what we know **Methods:** - Inquiry requires a dialogue between the researcher and participant - Dialogue is transformative, and brings forwards the historical context behind experiences of suffering, conflict and collective struggle - Predominantly Qualitative in nature and may include interviews and review of documents and artifacts **Research Methods Qualitative (review)** - Qualitative Research:  - Systemic, interactive research method used to describe and interpret life experiences - Emphasis is on capturing personal perception of the study participants (studying the human experience) - What is the experience of managing chronic conditions in the community from the perspectives of older adults, family caregivers, and health care providers working in a variety of settings? - Quantitative Research - Explore, describe and explain a phenomenon or generate theory - Testing for the presence of specific relationships, assessing for group differences, clarifying cause and effect interactions or explaining how effective a nursing intervention was - Involve precise and controlled measurement techniques to gather data and they are analyzed statistically - Is there a difference in prevention of osteoporosis in at-risk survivors of breast cancer who receive a combination of long-term progressive strength training exercises and vit D in comparison with those who do not receive this treatment?  **Types of Research Methods** - Mixed Methods Research - Design of the study includes [both quantitative and qualitative methods] - Common in program evaluation, organizational studies and policy development - Supports triangulation (multiple sources) of data **Ladder of Abstraction** **Frameworks to Guide Research** - Research and practice are linked with theory - **Conceptual framework "Road map of our study":** - **Helps you to visualize your project and put it into action (define variables etc)** - A structure or assembly of concepts that is used as a map or scaffolding (guidance) of ideas for a study. - Provides an understanding of a phenomenon of interest and identifies what factors are most significant as we examine various aspects of health. - **Theoretical framework:** - **Describes theories underpinning the research problem** - Unified set of interrelated concepts that explains or predict phenomena - Theory guides practice and research - Research can be used to test a theory and theory building Kolb's **Functions of a Framework** - **Inductive reasoning:** Start with details of experience and move to a general picture. - Ie. More qualitative research uses literature and theory to guide research process development but will usually not use the theory for data analysis. - **Deductive reasoning:** Start with a general picture and move to a specific direction; uses two or more concepts. - Ie. More quantitative research staring with general picture and then testing the theory to confirm cause/effect relationships. **Inductive:** - Specific to general. - Observations Generalization. - Develops theories from data - *I see three cats with whiskers → All cats must have whiskers.* **Deductive:** - General to specific. - Theory Conclusion. - Tests theories with data - *All birds have wings → A robin is a bird → A robin has wings*. **Theories to Guide Research** Prominent theoretical frameworks used to guide nursing theory include: - Systems theory - Self-efficacy theory - Social determinants of health framework - Pain theory - Nursing Theory - Watson's Philosophy of Transpersonal Caring - Paplau's Theory of Interpersonal Relations **Concepts and Variables** - Concepts: - Image or symbolic representation of an abstract idea (ex. Pain, Environment, Socioeconomic status, Learning) - They are a major component of theory and convey the abstract ideas within a theory - Variable: - Property that is being studied and something that changes or varies over time or with an intervention - Studies often are conducted to understand how changes in one variable impact another (independent and dependent variables) **Evaluating and Critiquing the Use of Theory in Research** - Is the framework identified clearly? - Where would it be discussed in a research article? - Is the framework consistent with a nursing perspective? - Does the framework align with the phenomena being studied? - Are the concepts and variables clearly defined? - Is there a logical, consistent link between the framework and concepts being studied? - Are the study findings examined in relation to the framework? **Practice Questions:** - Where is the literature review typically found in a research report: a. In the abstract b. In the discussion section c. Following the methods section d. After the introduction at the beginning of the report - Which of the following statements identifies how the literature review supports and links to the research process e. Literature review guides all steps of the research process. *Is a summary of what others have already discovered about a topic. It organizes the main ideas and studies so you can understand what's been done before and how your work fits in or adds something new.* f. Literature review is necessary only in defining the problem statement. g. Literature review provides a vehicle to disseminate the findings of the study. h. The value of the literature review is limited to finding gaps or inconsistencies in the knowledge base - Which of the following is an appropriate method of ***"weeding out"*** irrelevant sources when conducting an electronic search for articles for the literature review on a selected topic? i. Avoiding articles from clinical journals j. Avoiding articles that do not include the term "study" in the title k. Selecting on those articles to read whose abstracts indicate to align with your clinical question. *Reading abstracts is a quick and effective way to assess relevance before delving into full articles.* l. Colleting and critically readings all articles published in the last 5 years that related to the topic area - What is commonly referred to as scientific knowledge? m. Ethical n. Personal o. Empirical: *Scientific knowledge is based on empirical evidence, derived from observation, experimentation, and systematic data collection.* p. Aesthetic **Week 4: Quantitative Research Design and Methodology. Chap: 10,11,12**  **1. How are conceptual and theoretical frameworks used differently in quantitative vs qualitative research?** - **Quantitative Research:** - **Theoretical Frameworks:** Researchers use a **pre-existing, unified theory** (e.g., systems theory or self-efficacy) to guide their study, explaining and predicting phenomena. It structures research and guides hypothesis testing. - **Conceptual Frameworks:** Less common but sometimes used to organize variables and concepts. - **Qualitative Research:** - **Conceptual Frameworks [(road map):]** Often **emerge during the study**, guiding exploration of ideas. These frameworks are flexible and grounded in literature but allow for new insights to develop. - **Theoretical Frameworks [(blueprint):]** Rarely used at the start; if used, they are more to **sensitize** the researcher to existing theories rather than structure the study. **Key Difference:** Quantitative research uses pre-defined frameworks to test theories, while qualitative research uses frameworks more flexibly to explore and understand phenomena. **2. Which research method (qualitative or quantitative) does inductive vs deductive reasoning align with?** - **Deductive Reasoning:** - **Definition:** Starts with a theory and tests it through specific observations. - **Alignment:** Aligns with **quantitative research** because it focuses on hypothesis testing based on established theories. - **Inductive Reasoning:** - **Definition:** Begins with specific observations and builds toward a general theory or pattern. - **Alignment:** Aligns with **qualitative research** because it explores meanings and experiences, often with open-ended data collection. **Key Difference:** Deductive reasoning starts with theory (quantitative), while inductive reasoning builds theory from data (qualitative). **Theoretical** vs **Conceptual Framework**: **Aspect** **Theoretical Framework** **Conceptual Framework** --------------------- ------------------------------------------------------------------------- ------------------------------------------------------------------------------------- **Definition** A unified set of interrelated concepts to explain or predict phenomena. A structure of concepts that guides the study, often built from existing knowledge. **Purpose** Explains and predicts relationships between variables. Organizes concepts and ideas to explore a phenomenon. **Development** Developed based on established theory. Developed from literature, often flexible and emergent. **Use in Research** Guides hypothesis testing and measurement of variables. Guides exploration and understanding of the study topic. **Example** *Self-efficacy theory in health behavior studies.* *Exploring how social support impacts mental health outcomes.* **Timing** Precedes the research; established before data collection. Can evolve during the research process. - **Theoretical Framework** = **Objective, hypothesis testing** (often quantitative: surveys, experiments). - **Conceptual Framework** = **Subjective, exploration** (often qualitative: interviews, focus groups). **QUANTITATIVE PROCESS** **Elements of research design:** 1. Participants (who) 2. Observations (what) 3. Measurement of time (when) 4. Selection of participants (where) 5. Role of investigator  **Variables:** 1. **Independent Variable (X):** The cause. - **Experimental research:** It's manipulated (e.g., testing IM vs. oral medication). - **Non-experimental research:** Naturally occurring - not manipulated (e.g., smokers vs. non-smokers). 2. **Dependent Variable:** The effect - Observed outcome that changes based on the independent variable (e.g., lower pain ratings after oral medication). 3. **Control Variable:** Variables kept constant to ensure results are accurate (e.g., using patients with the same diagnosis). **Internal validity** *[(**cause-effect test**):]* Checks whether the independent variable (cause) truly caused the change in the dependent variable (effect), without interference from other factors. **Threads to internal validity:** *(we are trying to reduce bias)* 1. History - Other events going on at the same time - Ex. Traumatic event occurs while collecting data from a group of participants,COVID 2. Maturation (getting older or growth, development) - Biological or psychological process that occur within the individual - Ex. Age change, significant life event that occur during data collection process (ex. Pregnancy, loss of parent, etc.) 3. Testing - Taking a test multiple times 4. Instrumentation *(tool has to be the same x everyone, height measure with different things - wrong)* - Changes in way observations or instruments impact obtained measurement - Ex. Several researchers collecting data or observing for an event 5. Mortality/Attrition - Loss of participants - Selection bias **External Validity** refers to how well study findings [can be generalized] to other settings, populations, or times. Determines how generalizable and applicable study findings are to different settings, populations, and situations, and identifies any limitations in their broader use. Threads: [selection effects, reactive effects, measurement effects. ] - **Without internal validity**, there's no basis for generalizing (external validity). no internal = no external. **Quantitative design types:** 1. **Experimental/ "randomized control trial" best kind** - **Types of designs:** 1.True experimental 2.Solomon four-group 3.After-only - **Characteristics:** - Randomization - Control - Manipulation - **Rules out threads** - **Identifies cause and effect relationships between variables** 2. **Quasiexperimental (mix)** - **Types of Quasi-experimental designs:** 1. Nonequivalent control group design 2. After-only nonequivalent control group design 3. One-group pretest-posttest design 4. Time series design **Randomization is gone here** - Tests cause and effect when full control isn't possible - **Control** may be limited due to the nature of the study or participant availability. - [It **may not have randomization or a control group**.] - However, it still **includes an experimental treatment**. - This design is used when true experimental methods can't be applied. **Aspect** **Evaluation Research** **Example** ------------------------- ---------------------------------------------------- -------------------------------------------------------------------------------------- **Purpose** Evaluate outcomes of programs/interventions **Designs Used** \- **Experimental**: Full control possible Testing new med on pts \- **Quasi-Experimental**: Limited control Real -- world **protocols, strategies** (education) or **planning** (pain mngt, d/c) \- **Non-Experimental**: Observational Observing pt recovery after surgery in a single unit overtime **Common Applications** Testing new programs, improving care **Goal** Measure effectiveness, support quality improvement 3. **Non-experimental** **Types:** **1.Survey Studies** *(perception)* - Descriptive - Exploratory - Comparative **2.Correlational** *(relationship)* **3.Developmental Studies** *(time-based)* - Cross-Sectional  - Longitudinal  - Retrospective **4.Methodological** *(measurement tools)* - Methodological research - Systematic Reviews - Integrative Reviews - Secondary Analysis - [Examine events, people or situations as they naturally occur], or test relationships and differences among variables - Independent variable is not manipulated - Control within study still considered *SURVEY STUDIES (perception)* Classification: - Descriptive - Exploratory - Comparative - Collect information like **opinions, attitudes, or facts**. - These studies use **descriptive** and **inferential (prediction) statistics** to find **relationships** between variables - Goal is to identify **differences** between them, not prove cause and effect. - Can be qualitative or quantitative [Not testing cause -- effect, but 1 variable change or relation to another] *CORRELATIONAL STUDIES -- (relationship)* - Examines the relationship between two or more variables. - Does **not** test for causation, only how one variable changes in relation to another. - Used to test hypotheses about the relationship between variables. - Example: Investigating if more study hours lead to better test scores. *DEVELOPMENT STUDIES (time-based)* - Types: 1. **Cross-sectional**: One slide of something. Data collected [at one point in time], not over time (e.g., one-time survey on health). 2. **Longitudinal**: Data collected over several time points from the same group (e.g., monitoring diabetic children over years). 3. **Retrospective**: Looks at past events or exposures (independent variables- cause) to understand their impact on current outcomes or conditions (dependent variables - effect), e.g., studying long-term effects of [smoking] (independent) on the development of [cancer] (dependent). \- Examine changes overtime, looking at relationships between variables at different points *METHODOLOGICAL RESEARCH (measurement tools)* - About making and testing tools like [surveys] to collect data - **Psychometrics** = theory and development of measurement instruments (surveys or questionnaires) and measurement techniques  - Helps create better ways to measure things, like a [scale] to check nurses' confidence in their work **Additional types of quantitative studies** 1. **Secondary analysis:** - Researcher reanalyzes the data from a (experimental or nonexperimental) study for a completely different purpose. - Would still have a research question and hypothesis - Ex. Take an existing data set from a previous study and ask a new question 2. **Epidemiological studies:** - Examine factors affecting the health and [illness of populations in relation to their environment.] - Investigate the distribution, determinants, and dynamics of health and disease. - Are often [prevalence or incidence focused] 3. **Review of literature:** - Systematic Reviews: [Summarize research] on a topic using strict methods. - Meta-Analysis: [Combines] study [results to find] overall [trends.] - Integrative Review: Combines [both qualitative and quantitative] studies. - Why are they done? - To gather and analyze all available evidence to make informed decisions. - [Cochrane Collaboration] is an organization that ensures systematic reviews are high-quality and trustworthy. **Evaluating Quantitative Research** **Questions for Clinical appraisal (critique) of a research study** - General Critique Criteria: - How does the literature review process and theoretical frameworks inform the design of a quantitative research study? - Additional Critiquing Criteria: - What design is used? - Is the design experimental, quasiexperimental or non-experimental? - Is the problem one of a cause-and-effect relationship? - Is the method used appropriate for the problem? - Is the design suited to the study setting? - Study design appropriate? - Control measures match design? - Design reflects feasibility? - Design flows from research question, framework, literature review, hypothesis? - Control of threats to internal validity? - Control of threats to external validity? - Can you link the design to the appropriate level of the evidence hierarchy? - Experimental Critiquing Criteria - What experimental design is used? Is it appropriate? - How are randomization, control, and manipulation applied? - Are there reasons to believe that alternative explanations exist for the findings? - Are all threats to validity, including mortality, addressed in the report? - Quasiexperimental Critiquing Criteria - What quasiexperimental design is used? Is it appropriate? - What are the most common threats to the validity of the findings? - What are the plausible alternative explanations for the findings? Are they addressed? - Does the author address threats to validity acceptably? - Are limitations addressed?