Practice Quiz Chapter 5 PDF

1. What theory is based on the idea that a person's test scores vary from testing to testing because of variables in the testing situation? a) Item Response Theory b) Domain Sampling Model c) Generalizability Theory (Correct) d) True Score Model 2. In the context of reliability, what is the 'u...

1. What theory is based on the idea that a person's test scores vary from testing to testing because of variables in the testing situation? a) Item Response Theory b) Domain Sampling Model c) Generalizability Theory (Correct) d) True Score Model 2. In the context of reliability, what is the 'universe'? a) The global population of test-takers b) The total possible test score c) The average test score d) The particular test situation leading to a specific test score (Correct) 3. What does a Coefficient of Generalizability represent? a) The influence of particular facts on the test score (Correct) b) The correlation between two different test scores c) The ratio between the true score variance and the total variance d) The level of agreement between two or more scorers 4. What is a 'Decision Study' designed to inform? a) How test scores should be used and how dependable those scores are as a basis for decisions (Correct) b) How to increase the number of items in a test c) How to correct for attenuation d) How to conduct a discriminability analysis 5. What does the 'Domain Sampling Model' consider? a) The problems created by using a limited number of items to represent a larger and more complicated construct (Correct) b) The degree to which a test measures a single factor c) The extent to which a test measures different factors d) The effects of the test administration on the test scores 6. What does 'Item Response Theory' use to focus on the range of item difficulty that helps assess an individual’s ability level? a) A large number of items b) A computer (Correct) c) A small number of complex items d) A diverse group of test-takers 7. According to the Classical Test Theory, what does each person have that would be obtained if there were no errors in measurement? a) An observed score b) A true score (Correct) c) An error score d) A variance score 8. In terms of reliability, what does 'error' imply? a) There will always be some inaccuracy in our measurements (Correct) b) There will always be a significant amount of inaccuracy in our measurements c) There will never be any inaccuracy in our measurements d) The test is unreliable 9. What does 'X = T + E' represent in Classical Test Theory? a) The observed score is the sum of the true score and the error (Correct) b) The true score is the sum of the observed score and the error c) The error is the sum of the observed score and the true score d) The variance is the sum of the true score and the error 10. What does a 'Reliability Coefficient' indicate? a) The ratio between the true score variance on a test and the total variance (Correct) b) The correlation between the observed score and the true score c) The influence of particular facts on the test score d) The degree of correlation among all the items on a scale 11. What happens to the reliability when the test length increases? a) The reliability increases (Correct) b) The reliability decreases c) The reliability remains the same d) The reliability becomes unpredictable 12. What does the Kuder-Richardson technique consider? a) All possible ways of splitting the items (Correct) b) All possible ways of rearranging the items c) All possible ways of increasing the items d) All possible ways of scoring the items 13. What does the Spearman-Brown formula allow you to estimate? a) What the correlation between the two halves would have been if each half had been the length of the whole test (Correct) b) What the correlation between the two halves would have been if each half had been different c) What the correlation between the two halves would have been if each half had been the same length d) What the correlation between the two halves would have been if each half had been shorter 14. What does Cronbach Alpha estimate? a) The internal consistency of tests in which the items are not scored as 0 or 1 (Correct) b) The internal consistency of tests in which the items are scored as 0 or 1 c) The external consistency of tests in which the items are not scored as 0 or 1 d) The external consistency of tests in which the items are scored as 0 or 1 15. What does the term 'Domain Sampling' refer to? a) Sampling a diverse group of test-takers b) Sampling a wide range of test scores c) Defining a domain that represents a single trait or characteristic, and each item is an individual sample of this general characteristic (Correct) d) Defining a domain that represents multiple traits or characteristics, and each item is an individual sample of these general characteristics 16. What are 'Dynamic' characteristics? a) Traits, states, abilities relatively unchanging b) Traits, states, abilities presumed to be ever-changing as a function of situational and cognitive experiences (Correct) c) Traits, states, abilities that are constant over time d) Traits, states, abilities that are independent of situational and cognitive experiences 17. What does a 'Speed Test' imply? a) The test is homogenous, means that it is easy but short time (Correct) b) The test is heterogenous, means that it is complex and long time c) The test is homogenous, means that it is complex but short time d) The test is heterogenous, means that it is easy but long time 18. What are 'Criterion-Referenced Tests' designed to provide? a) An indication of where a testtaker stands with respect to some variable or criterion (Correct) b) An indication of where a testtaker stands with respect to the global population of test-takers c) An indication of where a testtaker stands with respect to the total possible test score d) An indication of where a testtaker stands with respect to the average test score 19. What is the key feature of 'Homogeneity' in the context of test items? a) The test items measure different factors b) The test items measure a single trait (Correct) c) The test items measure multiple traits d) The test items measure no particular trait 20. What does 'Error Variance' refer to? a) Variance from true differences b) Random irrelevant sources (Correct) c) Variance from false differences d) Relevant systematic sources