45 Questions
What does the sampling distribution show?
Correlations of close to zero
What does setting $\alpha$ to $p = .05$ mean in relation to the null hypothesis?
Accepting that 5% of the time the true population is zero
What is the Type I Error also known as?
A False Positive
What does sampling error refer to?
Error due to taking a sample from a population
What is the purpose of using the properties of sampling distributions in NHST?
To determine the likelihood of obtaining a particular test statistic
What is the opposite of a Type I Error?
Type II Error (A False Negative)
What does the null hypothesis testing (NHST) not use to test the null hypothesis?
Simulations
What does the sampling distribution allow us to see?
The relative probability of obtaining correlations of different strengths
What is the likelihood of obtaining a particular test statistic in NHST related to?
The well-known properties of sampling distributions
What is the most likely thing to be found in the sampling distribution?
Correlations of close to zero
What is the opposite of a False Positive in hypothesis testing?
A False Negative
What is the likelihood of obtaining a particular test statistic in NHST based on?
The properties of sampling distributions
What is one reason for the replication crisis in psychology?
Bias toward publishing research with significant results
What is a type 1 error also known as?
False positive
What is recommended to improve the reliability of psychological research?
Include effect sizes in addition to p-values
What is a Cohen’s d used for?
Measuring the difference between two means expressed in standard deviations
What does reporting exact p-values aim to address?
Reinforcing the idea that meeting the alpha criterion is crucial
When should nonparametric tests be employed?
When data violate assumptions of parametric tests
What is a potential problem when making multiple comparisons in ANOVA?
Increased probability of observing false positives
What is one solution to address the problem of multiple comparisons in ANOVA?
Apply Bonferroni correction to the p-values
What does the Bonferroni correction involve?
Multiplying the p-values by the number of comparisons
What is the Holm correction?
An alternative approach to correcting for multiple comparisons
What is the main problem with relying solely on p-values for decision making?
It does not provide information about effect size
What can happen as sample size increases, even for small effects?
Small effects can become statistically significant
What is a potential problem when making multiple comparisons in ANOVA?
Increased probability of observing a false positive
What is the purpose of using the properties of sampling distributions in NHST?
To determine the likelihood of obtaining a particular test statistic
What does setting $\alpha$ to $p = .05$ mean in relation to the null hypothesis?
Accepting a 5% chance of a false positive under the null hypothesis
What is the likelihood of obtaining a particular test statistic in NHST related to?
The null hypothesis being true
What is one reason for the replication crisis in psychology?
Bias toward publishing research with significant results
What is the opposite of a Type I Error?
False Negative
What is recommended to improve the reliability of psychological research?
Including effect sizes in addition to p-values
What does the null hypothesis testing (NHST) not use to test the null hypothesis?
Effect sizes
What can happen as sample size increases, even for small effects?
Small effects become statistically significant
What is a Cohen’s d used for?
Measuring the difference between two means expressed in standard deviations
What is the most likely thing to be found in the sampling distribution?
Test statistics
When should nonparametric tests be employed?
When data violate the assumptions of parametric tests
What is the purpose of including effect sizes when reporting findings?
To provide information about the relative strength of the observed effect
What is a potential issue with only reporting p-values in terms of the alpha criterion?
It reinforces the idea that meeting the alpha criterion is the sole basis of statistical decision making
What is the main reason for the replication crisis in psychology according to the text?
Lack of understanding of NHST and p-values
What is the recommended approach for making multiple comparisons in ANOVA to address the increased probability of a false positive?
Apply a correction such as the Bonferroni correction
What is the primary drawback of relying solely on p < .05 to determine the significance of findings?
It does not provide information about the strength of the observed effect
What is the purpose of teaching students about NHST and p-values in research methods classes?
To improve students' ability to interpret research findings
What is the primary disadvantage of parametric tests such as t-tests and ANOVA?
They rely on assumptions about distribution properties
What is the recommended alternative if data violate the assumptions of parametric tests?
Use nonparametric tests
What is the main issue with the bias toward publishing research with significant results?
It contributes to the difficulty of replicating findings
Test your critical reading skills with this quiz on Cornell Notes and probability testing. Brush up on your understanding of sampling distribution and its implications through this quiz.
Make Your Own Quizzes and Flashcards
Convert your notes into interactive study material.
Get started for free