Research Methods: Non-Experimental & Quasi-Experimental

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to Lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is a primary characteristic of quasi-experimental designs?

  • A control group is often present with treatment and comparison.
  • Experimental manipulation is always present with random assignment.
  • Participants are always randomly assigned to conditions.
  • They resemble experiments but lack random assignment or a control group. (correct)

What is a limitation of correlational studies?

  • They often provide strong internal validity.
  • They cannot identify relationships between variables.
  • They may draw incorrect conclusions without careful analysis. (correct)
  • They are less valid than experimental studies.

Which of the following describes the one group pre/post test design?

  • The same group is tested before and after a treatment implementation. (correct)
  • The dependent variable is measured only after the treatment.
  • The treatment is applied to two different groups for comparison.
  • It requires control groups for stronger internal validity.

What does an interrupted time series design involve?

<p>Multiple measurements interrupted by a treatment at set intervals. (A)</p> Signup and view all the answers

What is a notable weakness of the one group post-test design?

<p>It lacks a comparison group, compromising internal validity. (C)</p> Signup and view all the answers

What do direct replications primarily focus on?

<p>Replicating key results from a specific study (A)</p> Signup and view all the answers

Which factor is NOT a metric of reproducibility?

<p>Publication bias (D)</p> Signup and view all the answers

What are questionable research practices (QRPs)?

<p>Shortcuts that distort findings and threaten replicability (B)</p> Signup and view all the answers

What is the 'file drawer effect' primarily associated with?

<p>Positive results being more likely published (A)</p> Signup and view all the answers

Which of the following is a principle of open science?

<p>Pre-registration of studies (A)</p> Signup and view all the answers

Why do experiments generally have lower replication rates compared to correlational studies?

<p>Academic pressures to generate innovative ideas may lead to shortcuts. (B)</p> Signup and view all the answers

What does systematic empiricism emphasize in the scientific method?

<p>Learning through careful observation and analysis (B)</p> Signup and view all the answers

Which of the following best describes empirical questions?

<p>Questions that can be answered through direct observation (C)</p> Signup and view all the answers

Which measure of central tendency is preferable when data is skewed?

<p>Median (B)</p> Signup and view all the answers

What is the primary purpose of using scatterplots?

<p>To visualize associations between multiple continuous variables (B)</p> Signup and view all the answers

What kind of artifact is caused by having an extremely improbable data point?

<p>Outlier (D)</p> Signup and view all the answers

In an experimental design, what is the independent variable?

<p>The variable that is manipulated (C)</p> Signup and view all the answers

Which of the following accurately describes a placebo?

<p>An inert substance that resembles the treatment (D)</p> Signup and view all the answers

What does the term 'regression to the mean' refer to?

<p>Extreme data points becoming less extreme in subsequent measures (D)</p> Signup and view all the answers

Which of the following best describes the 'third variable problem'?

<p>A phenomenon explained by the relation of a third variable (D)</p> Signup and view all the answers

What is the role of control variables in an experiment?

<p>They are held constant to minimize their effect. (B)</p> Signup and view all the answers

What distinguishes effect size claims from statistical associations?

<p>Effect size claims describe the strength of a relationship. (C)</p> Signup and view all the answers

What is 'block randomization' in experimental design?

<p>A method ensuring all conditions occur once before any repeat. (B)</p> Signup and view all the answers

What is a key risk associated with within-subjects research?

<p>Order effects (C)</p> Signup and view all the answers

What is the purpose of counterbalancing in an experiment?

<p>To prevent order effects (D)</p> Signup and view all the answers

Which of the following best describes moderations in research?

<p>They describe how the relationship between two variables depends on the level of a third variable. (A)</p> Signup and view all the answers

Which statement correctly defines construct validity?

<p>It assesses whether an experiment accurately measures the intended variables. (A)</p> Signup and view all the answers

What characterizes a double-blind study?

<p>Neither researchers nor participants know the conditions or hypotheses. (A)</p> Signup and view all the answers

What is meant by false positivity in research outcomes?

<p>When an effect is incorrectly observed due to chance. (B)</p> Signup and view all the answers

What does the term 'spurious correlation' refer to in research?

<p>A coincidental association between two variables unlikely to replicate. (D)</p> Signup and view all the answers

What is a primary challenge associated with non-experimental designs?

<p>They cannot fully conclude causality from the data collected. (D)</p> Signup and view all the answers

What is the role of demand characteristics in a research study?

<p>To obscure true participant behavior. (A)</p> Signup and view all the answers

Which method ensures that every condition appears in each position only once?

<p>Latin square design (D)</p> Signup and view all the answers

What is the primary focus of a factorial design in research?

<p>It allows for the exploration of multiple independent variables simultaneously. (B)</p> Signup and view all the answers

Which statement best describes participant observation?

<p>The researcher becomes actively involved in the group being studied. (D)</p> Signup and view all the answers

In a switching replication design, what is a key feature?

<p>Only one group receives treatment initially, and then the roles switch. (A)</p> Signup and view all the answers

What is meant by 'central tendency' in a dataset?

<p>The middle point around which data values cluster. (D)</p> Signup and view all the answers

Which of the following best describes a mixed-factorial design?

<p>A design combining within-subjects and between-subjects approaches. (B)</p> Signup and view all the answers

What does the term 'participant reactivity' refer to in behavioral observation?

<p>Participants changing their behavior because they know they are being observed. (B)</p> Signup and view all the answers

What is a main effect in the context of factorial design?

<p>The effect of one independent variable on the dependent variable. (D)</p> Signup and view all the answers

What is a central characteristic of qualitative research methods like case studies?

<p>They provide a descriptive, in-depth analysis of specific individuals or groups. (A)</p> Signup and view all the answers

In regards to data distribution, what does a 'normal distribution' exhibit?

<p>An equal number of values above and below the mean. (C)</p> Signup and view all the answers

What is the purpose of a coding scheme in behavioral observation?

<p>To organize and categorize observed behaviors for analysis. (C)</p> Signup and view all the answers

For which of the following types of research would archival research be most suitable?

<p>When analyzing previously collected data. (C)</p> Signup and view all the answers

What is the significance of inter-rater reliability in behavioral studies?

<p>To verify the accuracy of coding schemes by comparing different observers' ratings. (D)</p> Signup and view all the answers

What does the term 'synergistic interaction' refer to in factorial design?

<p>When the effect of one independent variable is reduced by the presence of another. (D)</p> Signup and view all the answers

Flashcards

Non-experimental Research

Research where variables cannot be directly manipulated, often used to study relationships between factors.

Quasi-experiment

Studies involving a treatment or intervention, but participants are not randomly assigned to groups, leading to potential biases.

One Group Pre/Post Test Design

A study where a variable is measured before and after a treatment, but only in one group, making it difficult to rule out alternative explanations.

Interrupted Time Series Design

A research design using multiple measurements over time, interrupted by a treatment. It helps to establish trends, but alternative explanations still exist.

Signup and view all the flashcards

Nonequivalent Groups Design

A quasi-experiment that compares two groups (one treated, one not) without random assignment. It's susceptible to group differences.

Signup and view all the flashcards

Mean

The average of a dataset, susceptible to distortion by outliers.

Signup and view all the flashcards

Median

The middle value in a sorted dataset, resistant to outliers.

Signup and view all the flashcards

Mode

The value that appears most frequently in a dataset.

Signup and view all the flashcards

Scatterplot

A visual representation of the relationship between two or more variables, often used to identify trends and patterns.

Signup and view all the flashcards

Outlier

A data point that is significantly different from other data points in a dataset. They can influence the mean and skew results.

Signup and view all the flashcards

Independent Variable

A variable that is manipulated or changed by the researcher in an experiment.

Signup and view all the flashcards

Dependent Variable

The variable that is measured in an experiment.

Signup and view all the flashcards

Random Assignment

The process of assigning participants to different experimental groups in a way that ensures equal chance to each condition.

Signup and view all the flashcards

Control Group

A group in an experiment that does not receive the treatment or intervention, used as a baseline for comparison.

Signup and view all the flashcards

Placebo

A fake treatment or substance that resembles the real treatment but has no active ingredients.

Signup and view all the flashcards

Interrupted Time-Series Design with Nonequivalent Groups

A research design involving multiple measurements over time, both before and after an intervention, in two or more groups that are not equivalent.

Signup and view all the flashcards

Pretest-Posttest Design with Switching Replication

A research design where one group receives a treatment and another doesn't. Both groups are measured before and after the treatment. After the initial measurements, the groups switch roles: the control group gets the treatment, while the original treatment group continues.

Signup and view all the flashcards

Switching Replication with Treatment Removal

Similar to switching replication design, but the treatment is removed from the first group instead of switched. It involves a measurement of the dependent variable after the removal to see if the change is reversed.

Signup and view all the flashcards

Naturalistic observation

Observing behaviors in their natural environment without interference. It can be done secretly or openly.

Signup and view all the flashcards

Participant Reactivity

Participants behave unnaturally because they are aware they are being observed.

Signup and view all the flashcards

Participant observation

Observing behaviors by becoming an active participant in the environment or group being studied.

Signup and view all the flashcards

Structured observation

Observing behaviors with specific parameters set by the researcher. May or may not occur in a natural setting.

Signup and view all the flashcards

Field experiment

Manipulating a variable in a natural setting to observe its effects.

Signup and view all the flashcards

Coding scheme

An organized system of categories and examples used to identify and document behaviors during observation.

Signup and view all the flashcards

Content analysis

A coding system used to identify keywords, phrases, or ideas in a text or other data.

Signup and view all the flashcards

Factorial design

An experimental design with two or more independent variables.

Signup and view all the flashcards

Factor

Each independent variable in a factorial design. Each factor must have at least two levels.

Signup and view all the flashcards

Interaction

When two or more variables collectively influence an outcome. It moderates the association between another variable and the outcome.

Signup and view all the flashcards

Main effect

The effect of a single independent variable on the dependent variable while controlling for other independent variables.

Signup and view all the flashcards

Mixed-Factorial Design

A factorial design that combines within-subjects and between-subjects approaches. At least one independent variable is manipulated between subjects, and at least one is manipulated within subjects.

Signup and view all the flashcards

Between-Subjects Research

A research design where each participant is assigned to only one experimental condition. This helps to avoid order effects but may require a larger sample size.

Signup and view all the flashcards

Within-Subjects Research

A research design where each participant experiences all experimental conditions. This can be more efficient but risks order effects.

Signup and view all the flashcards

Order Effects

A confound that arises when the order of experimental conditions influences the dependent variable. These can include practice effects, carry-over effects, and contrast effects.

Signup and view all the flashcards

Carry-over Effects

A type of order effect where the experience of one condition influences the participant's performance on a subsequent condition even though they are different.

Signup and view all the flashcards

Contrast Effects

A type of order effect where participants' experience with the different conditions influences their perception of the study. This can reveal the study hypothesis.

Signup and view all the flashcards

Counterbalancing

A technique used to control for order effects by creating different sequences of experimental conditions and presenting them randomly to participants.

Signup and view all the flashcards

Full Counterbalance

A type of counterbalancing where each participant completes every possible order of conditions.

Signup and view all the flashcards

Partial (Random) Counterbalancing

A type of counterbalancing where the order of conditions is randomly determined for each participant. It's a more practical approach than full counterbalancing.

Signup and view all the flashcards

Latin Square Design

A specific type of counterbalancing where every condition appears in each ordinal position only once. It creates a matrix where each condition appears once in each row and column.

Signup and view all the flashcards

Replication

The process of repeating a study to see if the same results are obtained. This helps to increase confidence in the original findings.

Signup and view all the flashcards

Direct Replication

A type of replication where the original study is recreated as closely as possible to see if the results are consistent.

Signup and view all the flashcards

Questionable Research Practices (QRPs)

The use of shortcuts by researchers that can distort the accuracy of study findings. Examples include p-hacking, selective reporting, and misleading conclusions.

Signup and view all the flashcards

P-hacking

A type of QRP where researchers manipulate statistical analyses to get a significant result, even if the data doesn't actually support it.

Signup and view all the flashcards

Publication Bias

The tendency for studies with positive results to be more likely to be published than those with null results, which can create a distorted view of the field.

Signup and view all the flashcards

Open Science

A movement towards more transparent and accountable scientific practices, including pre-registration of studies, sharing materials and data, and publishing null findings.

Signup and view all the flashcards

Empirical

A systematic process of gathering information through observation and experience. This forms the basis of the scientific method.

Signup and view all the flashcards

Empirical Questions

A type of research question that can be answered by systematically observing the world.

Signup and view all the flashcards

Study Notes

Non-Experimental and Quasi-Experimental Research

  • Non-experimental research is useful when manipulating variables is impossible.
  • Correlational studies provide evidence but be cautious about drawing conclusions.
  • Quasi-experiments resemble experiments but lack random assignment or a control group.
  • Time-lagged designs help eliminate bidirectional causality but not other confounds.
  • One-group post-test design measures DV after treatment, weakest design.
  • One-group pre/post-test measures DV before and after treatment in one group.
  • Interrupted time series design involves repeated measurements before and after an intervention.
  • Nonequivalent groups design compares groups not randomly assigned.
  • Posttest-only nonequivalent groups design compares treated and control groups without a pretest.
  • Pretest-posttest nonequivalent groups design compares treated and control groups with pretests and posttests.
  • Switching replications design has a built-in replication and controls for time effects.
  • Switching replications with treatment removal design has first group get treatment, then stops, and second group gets treatment, then measure DV over time.

Behavioral Observation

  • Naturalistic observation: observing behavior in a natural setting without interference.
  • Participant reactivity: participants act unusually due to awareness of observation.
  • Participant observation: researcher immerses themselves in the observed setting.
  • Structured observation: researcher establishes parameters for observation.
  • Field experiment: manipulation of variables in a natural setting.
  • Coding scheme: organized system for classifying observed behaviors.
  • Content analysis: identifying occurrences of keywords, phrases, or ideas.

Factorial Design

  • Factorial design: experiment with more than one independent variable.
  • Factors: each independent variable.
  • Cells: unique combinations of IV levels.
  • Interaction: combined effect of IVs on the DV.
  • Main effects: individual effect of each IV on the DV.
  • Synergistic interaction: IV1 effect is magnified by IV2.
  • Buffered interaction: IV1 effect ceases with IV2.
  • Crossover interaction: IV1 effect reverses with IV2.

Quantitative and Qualitative Research

  • Case studies: in-depth investigation of a single individual or group, not generalizable.
  • Small N designs: detailed study of few participants, high internal validity, low external validity.
  • Applied behavioral analysis: rewarding/punishing behaviors to understand behaviors.
  • Reversal (ABA) Design: baseline, treatment, and reversal.
  • Multiple treatment reversal designs: introducing several treatments.
  • Alternating treatments: alternating multiple treatments.
  • Multiple baseline design: baseline for participants, treatments introduced successively.
  • Archival research: analyzing existing data.

Describing Data

  • Categorical data: nominal or ordinal scales (frequency tables, bar graphs).
  • Continuous data: interval or ratio scales (histograms).
  • Central tendency: mean, median, mode.
  • Spread: range, IQR, standard deviation.
  • Distribution: normal distribution (bell curve), skewed distributions.

Experimental Design

  • Independent variable: what researchers change.
  • Dependent variable: what researchers measure.
  • Control: keeping extraneous variables from influencing results.
  • Random assignment: each participant has equal chance of being in any condition.
  • Block randomization: all conditions occur once before repetition.

Non-Experimental Design

  • Non-experimental design: measures variables but does not manipulate them.
  • Spurious correlations: coincidental associations.
  • Correlation evidence does not imply causation.
  • Reverse causation: effect can also be cause.
  • Third-variable problem: another variable affects both studied variables.
  • Moderation: conditional association between variables.

Open Science

  • False positives and false negatives affect scientific results.
  • Reproducibility: independent researchers arrive at same conclusions.
  • Questionable research practices (QRPs) threaten replicability.
  • Publication bias: tendency for positive results to be published more frequently.
  • Open science: transparency and accountability in research.

Scientific Method

  • Systematic empiricism: learning through planned observation, recording, and analysis.
  • Empirical questions: questions about the world that can be studied empirically.
  • Public knowledge: large-scale collaboration to test and correct errors.
  • Goals of science: description, prediction, explanation.
  • Good research questions: interesting, useful, and feasible.
  • Theories: broad explanatory descriptions, hypotheses: specific, testable predictions.
  • Descriptive research: what is occurring.
  • Analytics research: what might explain something.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Quiz Team

Related Documents

More Like This

Use Quizgecko on...
Browser
Browser