Lecture 11 & 12 PSYCH2018

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is the primary purpose of archival research?

To evaluate experimental designs through real-world applications

To develop new theories based on qualitative observations

To analyze previously collected data to answer empirical questions (correct)

To conduct new experiments on original data

In the naturalistic observation study conducted at the science museum, which gender received more explanations of science concepts from parents?

Daughters

Sons (correct)

Only fathers explained to children

Both genders equally

Which type of analysis can be combined with archival research?

Longitudinal analysis

Case study analysis

Cross-sectional analysis

Factor analysis (correct)

What is a characteristic of quasi-experimental designs?

They involve less control than true experimental designs Signup and view all the answers

What is a key aspect of thematic analysis in qualitative research?

It identifies patterns of responses in qualitative data. Signup and view all the answers

Which research design includes the use of previously collected data?

Archival research Signup and view all the answers

What is typically included in nonequivalent control group designs?

Often both pretests and posttests Signup and view all the answers

What does meta-analysis focus on in relation to multiple studies?

Assessing effect sizes across multiple studies. Signup and view all the answers

What is a potential ethical dilemma in applied research?

Maintaining participant anonymity and consent Signup and view all the answers

What problem is unique to within-subjects designs in applied research?

Handling uncontrolled order effects and attrition Signup and view all the answers

What factor was identified as influencing how individuals at the homeless shelter thought of themselves?

The duration of their homelessness Signup and view all the answers

In the context of archival research, what is a common issue that can arise?

There can be missing data and bias. Signup and view all the answers

What dual function does applied research serve?

Solving practical problems while enhancing theoretical knowledge Signup and view all the answers

Which step is NOT part of the thematic analysis process?

Conduct randomized trials Signup and view all the answers

What does regression to the mean refer to in the context of quasi-experimental designs?

The tendency of extreme scores to move towards the average on subsequent measurements Signup and view all the answers

In the archival research example concerning patient recovery rooms, what was the independent variable?

Room view Signup and view all the answers

What distinguishes participant observation from naturalistic observation?

In participant observation, the observer joins the group being observed. Signup and view all the answers

Which of the following best describes the concept of 'emic' in observational research?

An insider's perspective aiming to understand a phenomenon from the viewpoint of participants. Signup and view all the answers

What is one primary challenge associated with observational research methods?

Inability to clearly establish cause-and-effect relationships. Signup and view all the answers

What role do behavior checklists play in observational research?

They help mitigate observer bias by standardizing data collection. Signup and view all the answers

Why is archival research considered non-experimental?

It primarily relies on already existing data rather than individual experimentation. Signup and view all the answers

What is a significant ethical concern in observational research?

Informed consent and privacy of participants. Signup and view all the answers

What does thematic analysis in qualitative research focus on?

Identifying patterns and themes in qualitative data. Signup and view all the answers

How does meta-analysis contribute to research evaluation?

It aggregates results from multiple studies to assess replication of findings. Signup and view all the answers

In the context of interrupted time series designs, which outcome is aimed to be achieved?

To evaluate overall trends in data over time. Signup and view all the answers

Which of the following represents a feature of nonequivalent control group designs?

Groups selected from different populations. Signup and view all the answers

What is an example of a variation in interrupted time series designs?

Incorporating a second measurement not influenced by the intervention. Signup and view all the answers

What makes a nonequivalent control group study differ from a true experiment?

Lack of random assignment to groups. Signup and view all the answers

In evaluating the effectiveness of an incentive plan on productivity, which type of design is most appropriate?

Interrupted time series design. Signup and view all the answers

Which of the following statements about regression to the mean is accurate in the context of quasi-experimental designs?

It can obscure the effects of an intervention. Signup and view all the answers

Which of the following best describes a characteristic of the program evaluation in quasi-experimental contexts?

It may involve comparing affected areas with control areas. Signup and view all the answers

What is the main purpose of formative evaluation in program evaluation?

To monitor the implementation of a program while it is in progress Signup and view all the answers

In the example regarding the workplace wellness programs, which strategy emerged as the most cost-effective?

Emphasizing social support and follow-up for participants Signup and view all the answers

What type of designs are typically used in summative evaluation?

Quasi-experimental designs Signup and view all the answers

What was indicated by the findings related to error rates based on training hours in Prof. Ryan's I/O Days study?

24 hours of training did not provide better results than 8 hours Signup and view all the answers

What critical aspect is considered when analyzing cost-effectiveness between programs?

Comparative costs of equally effective programs Signup and view all the answers

Which of the following statements best describes the role of quasi-experimental designs in applied research?

They are used when random assignment is not feasible Signup and view all the answers

What was one of the key findings related to cost per error from the training program analysis?

Each error costs significantly more than the training investment Signup and view all the answers

Which method is NOT part of the needs analysis process for program planning?

Pilot testing of the program Signup and view all the answers

Study Notes

Non-Experimental Design: Observational and Archival Methods

Chapter Objectives:
- Differentiate naturalistic and participant observation methods.
- Articulate problems in observational research, and how researchers address them.
- Explain thematic analysis as a qualitative data evaluation tool.
- Define archival research and explain why it's non-experimental.
- Describe advantages and limitations of archival research.
- Outline data analysis methods for observational and archival research.
- Describe how meta-analysis evaluates research replication.

Observational Research in Anthropology

Emic Perspective: An insider's view, understanding a phenomenon from the perspective of those directly involved (similar to participant observation).
Etic Perspective: An outsider's view, using existing theories to describe or explain observed phenomena (similar to naturalistic observation).

Naturalistic Observation

Focus: Describing behaviors in natural settings.
Observer Role: Unobtrusive; habituation (observer getting used to being observed) is assumed.
Examples:
- Snack selection at movie theaters.
- Gender differences in bar-setting fights.
- Helping behaviors in preschool settings.

Participant Observation

Focus: Experimenter joins the group being observed.
Challenges: Data recording issues, ethical issues, and reactivity (the group changing due to the researcher's presence).
Example: Festinger's cult study (Box 10.1).

Challenges of Observational Methods

Absence of Control: Strong claims can be difficult to falsify due to the lack of direct control.
Observer Bias: Minimized through the use of behavioral checklists, interobserver reliability (agreement between observers), and careful attention to time and event sampling.
Participant Reactivity: Reduced using unobtrusive measures.
Ethics: Addresses issues of consent and privacy (Box 10.2).

Analyzing Qualitative Data (Thematic Analysis)

Method: Identifying patterns in qualitative data.
Steps:
- Familiarize yourself with the data.
- Code the data.
- Search for themes.
- Review themes.
- Define and name themes.
- Write a report.

Archival Research

Data Source: Data previously collected for other purposes.
Analysis Often Involves: Content analysis, factor analysis, meta-analysis.
Characteristics: Susceptible to missing data and bias; however, there is no reactivity issue.
Example 31 Details: Patient recovery room, focusing on the impact of view of a park on the patient.

Analyzing Archival Data

Methods:
- Factor Analysis: Identifies clusters of tests/items forming factors.
- Meta-Analysis: Analyzing effect sizes across multiple studies on a similar topic to understand consistency and magnitude of effects.
- Research Example 31 and analysis: Includes the layout of a room with different characteristics of experimental and control rooms. Analysis determines the independent and dependent variables.

Quasi-Experimental Designs and Applied Research

Chapter 11 Key Terms:
- Quasi-experimental design, nonequivalent control group design, regression to the mean, interrupted time series, program evaluation, needs analysis, formative, summative evaluation, cost-effectiveness analysis.

Beyond the Laboratory

Applied Research Functions:
- Solves real-world problems.
- Develops knowledge.
- Evaluates theory.
Research Example 33 Color-Coded Nutrition Labels: Improved non-dieters' use of color-coded labels, which influences health evaluation of food.

Applied Psychology in Historical Context

Historical Context Issues: Pressure to apply basics to practical issues and challenges of research validity.
Examples and Issues: Study of the effects of caffeine on sleep, the importance of careful methodology, including randomization, controls, blinding, and placebos.

Design Problems in Applied Research

Ethical Dilemmas: Potential coercion, consent issues, violation of privacy.
Trade-offs: Balancing internal validity (showing cause and effect within a study), and external validity (generalizing findings to other situations outside the study)
Between-Subjects Designs: Difficulties creating equivalent groups.
Within-Subjects Designs: Uncontrolled order effects, subject attrition.

Quasi-Experimental Designs

Focus: Applicable when random assignment is not possible/problematic.
Key Characteristics: Lack of complete control, no random assignment.
Examples: Single-factor nonequivalent groups designs, ex post facto factorial designs, P x E factorial designs, correlational research.

Nonequivalent Control Group Designs

Focus: Comparisons between groups without random assignment.
Key Components: Pretests and posttests. Random assignment to groups is not possible.
Potential Challenges: Groups may be different at the outset influencing results. Regression to the mean (extreme scores on the first measurement shifting towards the mean on subsequent measures).
Example 34: Study of the effect of "play streets" program on the level of physical activity in children.

Interrupted Time Series Designs

Focus: Trend analysis in a single group over time, before and after an intervention. Useful for evaluating the impact of a treatment (an intervention) over time.
Basic Components: Measures before and after an intervention.
Challenge: Isolating the intervention's impact from other factors (history effects, selection effects etc.)
Example 36: Examining productivity effects of an incentive plan, and accounting for other factors to isolate the impact of the incentive plan.

Program Evaluation

Focus: Assessing the effectiveness of large-scale programs.
Types: Formative (ongoing monitoring during program implementation), summative (evaluating the overall effectiveness).
Example: Connecticut speeding study using regression to look at effectiveness.

Needs Analysis

Focus: Identifying program needs.
Methods: Data collection: Census data, Surveys of resources, potential users, Key informant surveys, Focus groups, Community forums, Workplace Example
Example: DuPont Case study- Examined employee data, surveyed existing programs and and employee knowledge of healthy behavior.

Cost-Effectiveness Analysis

Focus: Weighing costs and benefits of different programs.
Relevance: Useful for comparing equally effective programs that have varied costs.
Considerations: Program cost, effective outcome, and potential costs.
Example: Large-scale fitness programs versus more impactful social support strategies

Summary

Applied Research: Sheds light on causes and solutions.
Quasi-Experimental Designs: Used when random assignments are not possible.
Program Evaluation: Used to assess the effectiveness of large programs.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Description

Test your knowledge on various research methods including archival research, quasi-experimental designs, and thematic analysis. This quiz covers important concepts and ethical dilemmas faced in applied research. Perfect for students studying research methodology.