Statistical Significance and Post-Hoc Tests

Play an AI-generated podcast conversation about this lesson

What is the consequence of applying a stricter criterion to accept an effect as significant in hypothesis testing?

Increased statistical power

Increased Type II error

Reduced Type I error

Reduced statistical power (correct)

What is the purpose of using the Bonferroni corrected t-test in multiple comparisons?

To adjust for unequal sample sizes

To decrease the alpha level (correct)

To increase the alpha level

To test for homogeneity of variance

Which post-hoc test is considered a good choice when sample sizes are near equal?

ANOVA

Bonferroni

Tukey HSD (correct)

Games-Howell

What is a consideration when choosing a post-hoc test?

All of the above Signup and view all the answers

What is the purpose of using multiple comparison tests like Tukey HSD and Bonferroni?

To reduce the Type I error rate Signup and view all the answers

What is presented in a post-hoc table generated by JASP?

Pair-wise comparisons with mean differences, standard errors, t-tests, and p-values Signup and view all the answers

What is a main advantage of using SEM error bars over standard deviation in plotting error bars?

It aids in inferential statistics, specifically in determining significant differences between means Signup and view all the answers

What can be inferred if the SEM error bars of two groups do not overlap?

We cannot be sure if the means are significantly different Signup and view all the answers

Why would performing multiple t-tests be an inappropriate approach in comparing the means of three groups?

It would increase the risk of type I errors Signup and view all the answers

What is an alternative to SEM error bars offered by JASP?

Confidence interval error bars Signup and view all the answers

What is the purpose of adding a third group, 'Decaf drink', in the experiment?

To answer the question of whether the effect is due to caffeine, coffee smell, or expectation Signup and view all the answers

What is the advantage of using ANOVA over multiple t-tests in comparing the means of three groups?

It controls the family-wise error rate Signup and view all the answers

What is the primary advantage of using ANOVA instead of multiple t-tests?

ANOVA circumvents the problem of accumulating α levels Signup and view all the answers

In an ANOVA analysis with two independent variables, what is the maximum number of levels each variable can have?

There is no restriction on the number of levels, but it depends on the research question Signup and view all the answers

In a study with two independent variables, what is the advantage of using ANOVA?

It is used to analyse experiments with more than one independent variable Signup and view all the answers

What is the consequence of performing multiple t-tests instead of using ANOVA?

The probability of Type I error accumulates with each additional test Signup and view all the answers

What is a limitation of ANOVA in terms of interpreting results?

ANOVA cannot tell us which specific groups differ statistically Signup and view all the answers

In ANOVA, what are the sources of variability among participants?

Extraneous variables and individual differences Signup and view all the answers