Statistical Significance and Post-Hoc Tests

Play an AI-generated podcast conversation about this lesson

What is the consequence of applying a stricter criterion to accept an effect as significant in hypothesis testing?

Increased statistical power
Increased Type II error
Reduced Type I error
Reduced statistical power (correct)

What is the purpose of using the Bonferroni corrected t-test in multiple comparisons?

To adjust for unequal sample sizes
To decrease the alpha level (correct)
To increase the alpha level
To test for homogeneity of variance

Which post-hoc test is considered a good choice when sample sizes are near equal?

ANOVA
Bonferroni
Tukey HSD (correct)
Games-Howell

What is a consideration when choosing a post-hoc test?

All of the above (D) Signup and view all the answers

What is the purpose of using multiple comparison tests like Tukey HSD and Bonferroni?

To reduce the Type I error rate (A) Signup and view all the answers

What is presented in a post-hoc table generated by JASP?

Pair-wise comparisons with mean differences, standard errors, t-tests, and p-values (B) Signup and view all the answers

What is a main advantage of using SEM error bars over standard deviation in plotting error bars?

It aids in inferential statistics, specifically in determining significant differences between means (B) Signup and view all the answers

What can be inferred if the SEM error bars of two groups do not overlap?

We cannot be sure if the means are significantly different (B) Signup and view all the answers

Why would performing multiple t-tests be an inappropriate approach in comparing the means of three groups?

It would increase the risk of type I errors (C) Signup and view all the answers

What is an alternative to SEM error bars offered by JASP?

Confidence interval error bars (D) Signup and view all the answers

What is the purpose of adding a third group, 'Decaf drink', in the experiment?

To answer the question of whether the effect is due to caffeine, coffee smell, or expectation (C) Signup and view all the answers

What is the advantage of using ANOVA over multiple t-tests in comparing the means of three groups?

It controls the family-wise error rate (C) Signup and view all the answers

What is the primary advantage of using ANOVA instead of multiple t-tests?

ANOVA circumvents the problem of accumulating α levels (C) Signup and view all the answers

In an ANOVA analysis with two independent variables, what is the maximum number of levels each variable can have?

There is no restriction on the number of levels, but it depends on the research question (D) Signup and view all the answers

In a study with two independent variables, what is the advantage of using ANOVA?

It is used to analyse experiments with more than one independent variable (D) Signup and view all the answers

What is the consequence of performing multiple t-tests instead of using ANOVA?

The probability of Type I error accumulates with each additional test (C) Signup and view all the answers

What is a limitation of ANOVA in terms of interpreting results?

ANOVA cannot tell us which specific groups differ statistically (B) Signup and view all the answers

In ANOVA, what are the sources of variability among participants?

Extraneous variables and individual differences (A) Signup and view all the answers