Podcast
Questions and Answers
What is the usability or practical value of a test called?
What is the usability or practical value of a test called?
utility
What is the consistency of a test in measuring what it is supposed to measure called?
What is the consistency of a test in measuring what it is supposed to measure called?
reliability
What is the measure of how well an test discriminates between high and low ability levels called?
What is the measure of how well an test discriminates between high and low ability levels called?
item-discrimination index
What is the process of assigning numbers to different levels of a trait being measured?
What is the process of assigning numbers to different levels of a trait being measured?
Signup and view all the answers
What is the economic, financial, or budget-related factors affecting test known as?
What is the economic, financial, or budget-related factors affecting test known as?
Signup and view all the answers
A test measuring performance against a specific standard is known as a criterion-referenced test.
A test measuring performance against a specific standard is known as a criterion-referenced test.
Signup and view all the answers
Match the following terms with their definitions:
Match the following terms with their definitions:
Signup and view all the answers
What term is used to describe the usefulness or practical value of a test?
What term is used to describe the usefulness or practical value of a test?
Signup and view all the answers
What is the term used for the consistency of a test in measuring what it is supposed to measure?
What is the term used for the consistency of a test in measuring what it is supposed to measure?
Signup and view all the answers
What term is used for the degree to which a test measures what it purports to measure?
What term is used for the degree to which a test measures what it purports to measure?
Signup and view all the answers
What are the economic, financial, or budget-related factors affecting tests referred to as?
What are the economic, financial, or budget-related factors affecting tests referred to as?
Signup and view all the answers
What term is used for the profits, gains, or advantages associated with using a test?
What term is used for the profits, gains, or advantages associated with using a test?
Signup and view all the answers
Which statistical technique explores relationships between test scores and natural groups?
Which statistical technique explores relationships between test scores and natural groups?
Signup and view all the answers
Match the test setting approach with its description:
Match the test setting approach with its description:
Signup and view all the answers
Study Notes
Test Development and Validation
- Utility: The usefulness or practical value of a test, considering factors like costs and benefits.
Types of Tests
- Criterion-Referenced Test: Measures performance against a specific standard.
- Norm-Referenced Test: Compares performance to a norm group.
- Speed Tests: Designed to measure performance under time constraints.
Item Development and Analysis
- Item Pool: A collection of potential test items for selection in a final test.
- Item Analysis: Examination of test items to evaluate difficulty, reliability, and validity.
- Item-Response Theory (IRT): Method for arranging items by difficulty.
- Item-Mapping Method: IRT-based method often used in academic applications.
- Bookmark Method: IRT-based method used in academic applications.
Scaling and Scoring
- Scaling: Converting a scatterplot to provide likelihood indications.
- Expectancy Data: Data that involves converting a scatterplot to provide likelihood indications.
- Cumulative Scoring: Scoring method where higher scores indicate higher-ability or trait level.
- Ipsative Scoring: Evaluating test takers on different scales within the same test.
- Category Scoring: Scoring where individuals meet specific criteria for categorization.
Test Development Process
- Test Conceptualization: The initial phase of deciding on the purpose and scope of a test.
- Test Tryout: Evaluation of a test on a sample similar to intended test-takers.
- Pilot Work: Preliminary research and testing of a test prototype.
- Test Revision: Process of updating or modifying a test to improve its reliability, validity, or relevance.
- Cross-Validation: Revalidation of a test on a new sample of test takers.
- Co-Validation: Validating multiple tests simultaneously using the same sample.
Cut Scores and Standard Setting
- Cut Score: A reference point derived as a result of a judgment used to divide data into classifications.
- Relative Cut Score: A reference point set based on norm-related considerations.
- Angoff Method: Method for setting cut scores that uses judgments by an expert panel.
- Known Groups Method: Method for setting cut scores based on performance data from known groups.
- Method of Predictive Yield: Approach for setting cut scores considering applicant scores and positions to fill.
Test Development and Validation
- Utility: The usefulness or practical value of a test, considering factors like costs and benefits.
Types of Tests
- Criterion-Referenced Test: Measures performance against a specific standard.
- Norm-Referenced Test: Compares performance to a norm group.
- Speed Tests: Designed to measure performance under time constraints.
Item Development and Analysis
- Item Pool: A collection of potential test items for selection in a final test.
- Item Analysis: Examination of test items to evaluate difficulty, reliability, and validity.
- Item-Response Theory (IRT): Method for arranging items by difficulty.
- Item-Mapping Method: IRT-based method often used in academic applications.
- Bookmark Method: IRT-based method used in academic applications.
Scaling and Scoring
- Scaling: Converting a scatterplot to provide likelihood indications.
- Expectancy Data: Data that involves converting a scatterplot to provide likelihood indications.
- Cumulative Scoring: Scoring method where higher scores indicate higher-ability or trait level.
- Ipsative Scoring: Evaluating test takers on different scales within the same test.
- Category Scoring: Scoring where individuals meet specific criteria for categorization.
Test Development Process
- Test Conceptualization: The initial phase of deciding on the purpose and scope of a test.
- Test Tryout: Evaluation of a test on a sample similar to intended test-takers.
- Pilot Work: Preliminary research and testing of a test prototype.
- Test Revision: Process of updating or modifying a test to improve its reliability, validity, or relevance.
- Cross-Validation: Revalidation of a test on a new sample of test takers.
- Co-Validation: Validating multiple tests simultaneously using the same sample.
Cut Scores and Standard Setting
- Cut Score: A reference point derived as a result of a judgment used to divide data into classifications.
- Relative Cut Score: A reference point set based on norm-related considerations.
- Angoff Method: Method for setting cut scores that uses judgments by an expert panel.
- Known Groups Method: Method for setting cut scores based on performance data from known groups.
- Method of Predictive Yield: Approach for setting cut scores considering applicant scores and positions to fill.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Related Documents
Description
Test your knowledge of psychological measurement and statistics concepts, including test validity, score interpretation, and data analysis.
