Podcast
Questions and Answers
What was the conclusion about the magnitude of replication effects compared to original effects?
What was the conclusion about the magnitude of replication effects compared to original effects?
What was the main issue with the results of previously significant studies upon replication?
What was the main issue with the results of previously significant studies upon replication?
What proportion of original effect sizes were found to be within the 95% CI of replication effect sizes?
What proportion of original effect sizes were found to be within the 95% CI of replication effect sizes?
What is NOT a conclusion that can be drawn from the reproducibility project?
What is NOT a conclusion that can be drawn from the reproducibility project?
Signup and view all the answers
What is a potential implication of the reproducibility project's findings?
What is a potential implication of the reproducibility project's findings?
Signup and view all the answers
What is the consequence of flexibility in data collection, analysis, and reporting in empirical research?
What is the consequence of flexibility in data collection, analysis, and reporting in empirical research?
Signup and view all the answers
What is the result of combining four common researcher degrees of freedom?
What is the result of combining four common researcher degrees of freedom?
Signup and view all the answers
What is the purpose of the disclosure-based solution proposed by the authors?
What is the purpose of the disclosure-based solution proposed by the authors?
Signup and view all the answers
What is the characteristic of scientific ideals that is opposite of facts and being true?
What is the characteristic of scientific ideals that is opposite of facts and being true?
Signup and view all the answers
What is the consequence of undisclosed flexibility in data collection and analysis?
What is the consequence of undisclosed flexibility in data collection and analysis?
Signup and view all the answers
What is a key characteristic of scientific findings?
What is a key characteristic of scientific findings?
Signup and view all the answers
What was the focus of Bem's research in 2011?
What was the focus of Bem's research in 2011?
Signup and view all the answers
What is the term for the process of science correcting its own errors?
What is the term for the process of science correcting its own errors?
Signup and view all the answers
Study Notes
A. That social psychology is in crisis due to the lack of reproducibility of results B. Replication effects were half the magnitude of original effects, previously significant studies found substantially less significant results upon replication . C. Replication effects were double the magnitude of original effects, previously significant studies found substantially less significant results upon replication and approx. half of the original effect sizes were in the 95%CI of replication effect sizes. D. Replication effects were double the magnitude of original effects, previously significant studies found substantially less significant results upon replication and approx. half of the original effect sizes were outside of the 95%CI of replication effect sizes.
Research Flexibility and False-Positive Rates
- Flexibility in data collection, analysis, and reporting can lead to high false-positive rates in empirical research, despite a nominal 5% false-positive rate (p ≤ 0.05)
- Four common researcher degrees of freedom can lead to a 61% false-positive rate
- Researchers can exploit these degrees of freedom to accumulate and report statistically significant evidence for a false hypothesis
Scientific Ideals
- Scientific findings are tentative and open to scrutiny and replication
- Confirmation of findings is essential, and self-correction is necessary to ensure reliable results
- Science focuses on methodology, not determining what is true or not
- Replication is necessary to ensure reliable results
History of Social Psychology
- Jacob Cohen's 1962 study "The Statistical Power Of Abnormal-Social Psychological Research: A Review" found:
- Very low power to detect small effects (18% power)
- Modest power to detect medium effects (48% power)
- Good power to detect large effects (83%)
- Cohen created the measure of effect size known as Cohen's d
- Power is the likelihood of finding an effect
Classic Studies
- Milgram's 1963 study "Behavioral study of obedience" had a moderate effect size but a small sample size (N = 40)
- Zajonc's 1968 study "Attitudinal effects of mere exposure" had a small sample size (N = 22)
Research Integrity
- Stapel's 2011 study was found to have fabricated data, leading to the loss of his job and degree
- Bem's 2011 study "Feeling the Future: Experimental Evidence for Anomalous Retroactive Influences on Cognition and Affect" was found to have issues with methodology and interpretation
- Wagenmakers et al.'s 2011 study emphasized the importance of exploration, confirmation, Bayesian testing, and peer review in self-correcting science
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Description
This quiz explores the main findings of the reproducibility project, focusing on the reliability of results in social psychology. The project aims to replicate previous studies to test their validity.
