Podcast
Questions and Answers
What does face validity refer to?
What does face validity refer to?
The extent to which a measure appears to have validity.
What is validity in psych testing?
What is validity in psych testing?
Agreement between a test score or measure and the quality it is believed to measure.
What is content validity?
What is content validity?
Determining if items on a test are directly related to what they are assessing.
To establish content validity, one must define the __________ of the test.
To establish content validity, one must define the __________ of the test.
What is criterion validity?
What is criterion validity?
List the first step in the process of establishing criterion validity.
List the first step in the process of establishing criterion validity.
What does predictive validity assess?
What does predictive validity assess?
What is concurrent validity?
What is concurrent validity?
What is a validity coefficient?
What is a validity coefficient?
The square of the validity coefficient is known as the coefficient of __________.
The square of the validity coefficient is known as the coefficient of __________.
What does the coefficient of determination R² ask?
What does the coefficient of determination R² ask?
What is the result of cross-validation?
What is the result of cross-validation?
Flashcards are hidden until you start studying
Study Notes
Validity
- Validity is the agreement between a test score or measure and the quality it is believed to measure.
- Face validity is the extent to which a measure appears to have validity. It does not offer evidence to support conclusions drawn from a test.
- Content validity determines if items on a test are directly related to what they are assessing. Validity is logical.
- Process of establishing content validity
- Define the domain of the test
- Select a panel of qualified experts (not item writers)
- Panel participates in the process of matching items to the domain
- Collect and summarize data from the matching process
- Process of establishing content validity
- Criterion validity uses a current test to infer some performance criterion that is not being directly measured. Criterion validity is supported by high correlations between test scores and well-defined measures.
- Process of establishing criterion validity
- Identify the criterion and measurement method
- Identify a representative sample
- Give the test to the sample and obtain criterion data
- Determine the strength of the relationship (correlation) between the test score and criterion performance
- Process of establishing criterion validity
- Predictive validity measures how well a test predicts criterion performance in the future.
- Concurrent validity assesses the simultaneous relationship between a test and a criterion.
- Validity coefficient is the relationship between a test and the related criterion (r ). It is the extent to which the test is valid for making statements about the criterion.
- Coefficient of determination (R²) is the validity coefficient squared. It is the relationship between the variation in the criterion and knowledge of a test score.
- Questions that the coefficient of determination (R²) asks: How much variation in Y will we be able to predict on the basis of X? What percentage of data points will fall in the regression (prediction line)?
- Cross validation results in a worse prediction, more error in the prediction, and fewer points falling on the regression/prediction line, but could still be useful.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
