30 Questions
What is the formula to calculate the variance of the observed score?
var(X) = var(T) + var(eX)
What is the reason why we cannot calculate reliability exactly?
Because we cannot measure the variance of the true scores
What is the relationship between the two observations x1 and x2 assumed to be in estimating reliability?
They are related to each other to the degree that they share a true score
What does the covariance of X1 and X2 represent in the context of estimating reliability?
The variance of the true score
What is the formula to calculate the covariance of X1 and X2?
Covariance (X1, X2) = sd(X1) * sd(X2)
What is the definition of the variance of the measure?
The sum of the squared deviations of the scores from their mean, divided by the number of scores
What is the primary purpose of predictive validity?
To evaluate the ability of a measure to predict something it should be able to predict
What is an example of concurrent validity?
A measure of work-related empowerment that shows higher scores for managers and lower scores for their workers
What is the primary purpose of convergent validity?
To show that measures that should be related are in reality related
What is the purpose of discriminant validity?
To show that measures that should not be related are in reality not related
What is necessary to argue for construct validity?
Both convergent and discriminant validity
What is the relationship between the six measures in the figure?
Three measures are related to self-esteem and three are related to locus of control
What does internal consistency reliability estimate?
The consistency of results across items within a test
In a pilot study, what can be established to test inter-rater reliability?
The consistency of results across different observers
What is the appropriate measure of inter-rater reliability when the measurement consists of categories?
Percent of agreement
What is the purpose of calculating the correlation between the ratings of two observers?
To estimate inter-rater reliability for continuous ratings
In what type of study can inter-rater reliability be established?
Pilot study
What is the formula to calculate the percent of agreement?
Number of agreements / Total number of observations
What does the Oa value in the kappa calculation represent?
The observed agreement between Rater A and Rater B
What is the purpose of the Ea value in the kappa calculation?
To calculate the expected agreement between the two raters
What is the interpretation of a kappa value of.43?
The two raters have moderate agreement
What is the purpose of test-retest reliability?
To measure the stability of a measure over time
How is test-retest reliability calculated?
By calculating the correlation between the two measures taken at different times
What is the advantage of using kappa to measure inter-rater reliability?
It takes into account the possibility of chance agreement
What is the main assumption underlying parallel-forms reliability?
That the underlying trait does not change between time 1 and time 2
What is the purpose of calculating the average inter-item correlation in internal consistency reliability?
To estimate the average correlation between each item and the total score
What is the advantage of using the Spearman-Brown formula in split-half reliability?
It allows for the estimation of reliability using a single test administration
What is the main difference between parallel-forms reliability and internal consistency reliability?
The focus on stability across forms versus internal consistency
What is the purpose of administering both forms of the test to the same people in parallel-forms reliability?
To get a correlation between the two forms
What is the main limitation of the split-half method of estimating reliability?
It does not provide a direct estimate of reliability
Test your understanding of research methods in psychology, including predictive validity, concurrent validity, and criterion-related validity. This quiz covers the different types of validity and how they are used to evaluate measures in psychology research.
Make Your Own Quizzes and Flashcards
Convert your notes into interactive study material.
Get started for free
