Psychometrics: Test Validity and Reliability

Study Notes

Test Validity

Refers to the extent a test measures what it is supposed to measure.
Content validity ensures all subtests and items address the specific material intended (e.g., a chapter test only covers that chapter's material).
Criterion-related validity indicates a test's ability to predict performance on tasks that require intelligence, as agreed upon by most people.
Concurrent validity assesses if a test yields scores that are comparable to other established valid tests.
Construct validity demonstrates that a test accurately reflects the theoretical construct it is based on, supported by empirical evidence.

Test Reliability

Test reliability indicates that a test consistently measures what it aims to measure across different administrations.
Test-retest reliability involves administering the same test to the same group on different occasions and comparing scores, noting potential practice effects.
Parallel-forms reliability entails using a different version of the same test to measure consistency.
Split-half reliability is determined by dividing the test into two halves and ensuring their scores correlate.
Internal consistency checks the correlation between different items of the same test to determine reliability.
Inter-rater reliability assesses the agreement of results between different test administrators.

Standardisation and Norms

Standardised tests are administered to a large and representative sample of the population under similar conditions and instructions, ensuring fairness.
Norms provide mean scores of specific groups (ideally matched by age, background, etc.), allowing for valid comparisons among test takers.
Cultural bias can lead to lower scores for individuals from cultures different from the one on which the test was originally standardised.

Description

This quiz explores key concepts in psychometrics, focusing on the validity and reliability of tests. Learn about different types of validity, such as content, criterion-related, and construct validity, as well as various reliability measures. Perfect for students studying psychology or assessment methods.