14 Questions
What is the usability or practical value of a test called?
utility
What is the consistency of a test in measuring what it is supposed to measure called?
reliability
What is the measure of how well an test discriminates between high and low ability levels called?
item-discrimination index
What is the process of assigning numbers to different levels of a trait being measured?
scaling
What is the economic, financial, or budget-related factors affecting test known as?
Costs
A test measuring performance against a specific standard is known as a criterion-referenced test.
True
Match the following terms with their definitions:
Angoff method = Method for setting cut scores that uses judgments by an expert panel. Item pool = Collection of potential test items for selection in a final test. Item analysis = Method where test items presented are based on performance.
What term is used to describe the usefulness or practical value of a test?
utility
What is the term used for the consistency of a test in measuring what it is supposed to measure?
reliability
What term is used for the degree to which a test measures what it purports to measure?
validity
What are the economic, financial, or budget-related factors affecting tests referred to as?
costs
What term is used for the profits, gains, or advantages associated with using a test?
benefits
Which statistical technique explores relationships between test scores and natural groups?
Discriminant Analysis
Match the test setting approach with its description:
Approach for setting cut scores considering applicant scores and positions to fill. = Method of predictive yield Statistical technique to explore relationships between test scores and natural groups. = Discriminant Analysis The initial phase of deciding on the purpose and scope of a test. = Test conceptualization
Study Notes
Test Development and Validation
- Utility: The usefulness or practical value of a test, considering factors like costs and benefits.
Types of Tests
- Criterion-Referenced Test: Measures performance against a specific standard.
- Norm-Referenced Test: Compares performance to a norm group.
- Speed Tests: Designed to measure performance under time constraints.
Item Development and Analysis
- Item Pool: A collection of potential test items for selection in a final test.
- Item Analysis: Examination of test items to evaluate difficulty, reliability, and validity.
- Item-Response Theory (IRT): Method for arranging items by difficulty.
- Item-Mapping Method: IRT-based method often used in academic applications.
- Bookmark Method: IRT-based method used in academic applications.
Scaling and Scoring
- Scaling: Converting a scatterplot to provide likelihood indications.
- Expectancy Data: Data that involves converting a scatterplot to provide likelihood indications.
- Cumulative Scoring: Scoring method where higher scores indicate higher-ability or trait level.
- Ipsative Scoring: Evaluating test takers on different scales within the same test.
- Category Scoring: Scoring where individuals meet specific criteria for categorization.
Test Development Process
- Test Conceptualization: The initial phase of deciding on the purpose and scope of a test.
- Test Tryout: Evaluation of a test on a sample similar to intended test-takers.
- Pilot Work: Preliminary research and testing of a test prototype.
- Test Revision: Process of updating or modifying a test to improve its reliability, validity, or relevance.
- Cross-Validation: Revalidation of a test on a new sample of test takers.
- Co-Validation: Validating multiple tests simultaneously using the same sample.
Cut Scores and Standard Setting
- Cut Score: A reference point derived as a result of a judgment used to divide data into classifications.
- Relative Cut Score: A reference point set based on norm-related considerations.
- Angoff Method: Method for setting cut scores that uses judgments by an expert panel.
- Known Groups Method: Method for setting cut scores based on performance data from known groups.
- Method of Predictive Yield: Approach for setting cut scores considering applicant scores and positions to fill.
Test Development and Validation
- Utility: The usefulness or practical value of a test, considering factors like costs and benefits.
Types of Tests
- Criterion-Referenced Test: Measures performance against a specific standard.
- Norm-Referenced Test: Compares performance to a norm group.
- Speed Tests: Designed to measure performance under time constraints.
Item Development and Analysis
- Item Pool: A collection of potential test items for selection in a final test.
- Item Analysis: Examination of test items to evaluate difficulty, reliability, and validity.
- Item-Response Theory (IRT): Method for arranging items by difficulty.
- Item-Mapping Method: IRT-based method often used in academic applications.
- Bookmark Method: IRT-based method used in academic applications.
Scaling and Scoring
- Scaling: Converting a scatterplot to provide likelihood indications.
- Expectancy Data: Data that involves converting a scatterplot to provide likelihood indications.
- Cumulative Scoring: Scoring method where higher scores indicate higher-ability or trait level.
- Ipsative Scoring: Evaluating test takers on different scales within the same test.
- Category Scoring: Scoring where individuals meet specific criteria for categorization.
Test Development Process
- Test Conceptualization: The initial phase of deciding on the purpose and scope of a test.
- Test Tryout: Evaluation of a test on a sample similar to intended test-takers.
- Pilot Work: Preliminary research and testing of a test prototype.
- Test Revision: Process of updating or modifying a test to improve its reliability, validity, or relevance.
- Cross-Validation: Revalidation of a test on a new sample of test takers.
- Co-Validation: Validating multiple tests simultaneously using the same sample.
Cut Scores and Standard Setting
- Cut Score: A reference point derived as a result of a judgment used to divide data into classifications.
- Relative Cut Score: A reference point set based on norm-related considerations.
- Angoff Method: Method for setting cut scores that uses judgments by an expert panel.
- Known Groups Method: Method for setting cut scores based on performance data from known groups.
- Method of Predictive Yield: Approach for setting cut scores considering applicant scores and positions to fill.
Test your knowledge of psychological measurement and statistics concepts, including test validity, score interpretation, and data analysis.
Make Your Own Quizzes and Flashcards
Convert your notes into interactive study material.
Get started for free
