Psychology Chapter 9: Validity for Decisions

Criterion-Related Validity

• Criterion-related validity tests the correlation between test scores and success outcomes, assessing the effectiveness of a test in minimizing decision errors and justifying testing costs.
• Uses measures of success or outcomes to evaluate individual decisions based on test results.
• An invalid test can result in ineffective and unfair decisions, highlighting the importance of validating tests.

Importance of Criteria

• Appropriate criteria must be selected for a valid criterion-related validity strategy.
• A criterion measures the accuracy of predictions and typically represents the outcomes that decisions aim to achieve, such as job performance correlating with test scores.

Decisions vs. Predictions

• Distinction exists between decisions (choosing actions) and predictions (estimating outcomes), though they are conceptually linked.
• Accurate predictions directly inform better decisions, e.g., high job performance test scores leading to successful hiring choices.

Validation Strategies Overview

• Two primary methods for assessing criterion-related validity: predictive validation and concurrent validation.
• Both strategies focus on establishing the correlation between test scores and criteria but differ in timing and implementation.

Predictive Validation Strategies

• Involves using test scores from a sample without direct application in decision-making, allowing for later correlation with actual performance outcomes.
• Steps include gathering scores from applicants and subsequently measuring their job performance to establish predictive validity.

Predictive Validation: Advantages and Disadvantages

• Advantages include simplicity and scientific accuracy in estimating correlations between scores and criteria within a population.
• Disadvantages stem from impracticality, as the population in studies must resemble the general applicant pool, and ethical concerns arise when decisions are based on incomplete information, leading to potential negative consequences for individuals and organizations.

Concurrent Validation Strategies

• Conducted at a single time point, it involves measuring both test scores and performance assessments simultaneously.
• While generally practical, it may not fully capture the predictive relationship due to lack of temporal separation between variables.