Language Assessment Principles Flashcards

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What does 'test usefulness' refer to?

The scoring criteria for assessments

The total number of items in a test

The content of the test

The use you put an assessment to (correct)

What are test specifications?

An outline of a test that includes a description of its content, item types, tasks, skills to be included, how the test will be scored, and how it will be reported to students.

Define elicitation modes.

The mode in which questions or prompts are asked in assessment (either oral or written).

What are response modes?

The mode in which students respond in assessment (either oral or written). Signup and view all the answers

What is a level check?

Items in an assessment intended to test objectives. Signup and view all the answers

Define probe in the context of assessment.

Items in an assessment that go a little beyond the objectives. Signup and view all the answers

What is the purpose of warm-up/wind-down items?

Non-scored items in an assessment designed to set students at ease. Signup and view all the answers

What are selective responses?

Items on a test that the test-taker chooses from a set of responses. Signup and view all the answers

Define supply in assessment.

A type of response on an assessment that has test-takers choose from a set of responses. Signup and view all the answers

What is a stem in a test item?

The 'body' of the item that presents a stimulus. Signup and view all the answers

What do options/alternatives refer to in a multiple-choice test?

The choices in a multiple choice test (typically labeled A, B, C, D). Signup and view all the answers

Define key in a multiple choice test.

The correct response in a multiple choice test. Signup and view all the answers

What are distractors in a multiple choice test?

The answer choices in a multiple choice test that are not correct. Signup and view all the answers

What does item facility refer to?

The extent to which an item is easy or difficult for the proposed group of test-takers. Signup and view all the answers

Define item discrimination.

The extent to which an item differentiates between high- and low-ability test-takers. Signup and view all the answers

What does item response theory study?

The study of test and item scores based on assumptions concerning the mathematical relationship between abilities (or other hypothesized traits) and item responses. Signup and view all the answers

What is distractor efficiency?

The extent to which the distractors 'lure' a sufficient number of test-takers, especially lower-ability ones. Signup and view all the answers

Define standards-based assessment.

Procedures that have been specifically designed to test certain competencies. Signup and view all the answers

What are performance levels?

Standards. Signup and view all the answers

What are benchmarks?

Standards. Signup and view all the answers

What does CASAS stand for?

The Comprehensive Adult Student Assessment System. Signup and view all the answers

Define SCANS.

Secretary's Commission in Achieving Necessary Skills. Signup and view all the answers

What is high-stakes testing?

Refers to the gate-keeping function that standardized tests perform. Signup and view all the answers

What does consequential validity refer to?

The aftereffects and possible social and societal results from a particular assessment or measure. Signup and view all the answers

Define test bias.

Refers to a test design, or the way results are interpreted and used; tests are biased if they systematically disadvantage certain groups of students over others. Signup and view all the answers

What is test-driven learning?

Can happen when students know that one single measure of performance will have a definitive effect on their lives. Signup and view all the answers

Define test-driven teaching.

Can happen when teachers also have high-stakes for a test; teachers can experience undue pressure. Signup and view all the answers

Study Notes

Assessment Terminology and Concepts

Test Usefulness: Refers to the practical application of assessments to achieve specific educational outcomes.
Test Specifications: A comprehensive outline detailing assessment content, item types, scoring methods, and student reporting.
Elicitation Modes: Methods in which questions or prompts are delivered during assessments (oral or written).
Response Modes: The formats in which students reply in assessments, including oral and written responses.
Level Check: Assessment items designed to evaluate specific educational objectives.

Assessment Item Types

Probe: Items that assess knowledge beyond basic objectives, gauging deeper understanding.
Warm-up/Wind-down: Non-scored questions used to ease students' anxiety before or after assessments.
Selective Response: Test items where students choose from a list of provided responses.
Supply: A response type requiring test-takers to select from predetermined options.

Assessment Structure

Stem: The part of an assessment item that presents the question or prompt.
Options/Alternatives: The potential answers in a multiple-choice format, usually labeled A, B, C, and D.
Key: The correct answer in a multiple-choice item.
Distractors: Incorrect answer choices designed to challenge test-takers in multiple-choice assessments.

Item Analysis

Item Facility: Measures how easy or difficult an item is for a particular group of test-takers.
Item Discrimination: Evaluates how well an item differentiates between high- and low-achieving students.
Item Response Theory: Explores the relationship between abilities and responses to assessment items.

Assessment Effectiveness

Distractor Efficiency: Assesses the effectiveness of distractors in misleading test-takers, particularly those with lower ability.
Standards-Based Assessment: Focused procedures designed to evaluate specific competencies set in educational standards.
Performance Levels: Criteria or standards that define expected achievement in assessments.

Assessment Standards

Benchmarks: Established reference points or standards used to measure educational performance.

Specific Assessment Programs

CASAS: The Comprehensive Adult Student Assessment System, evaluating ESL programs across the U.S.
SCANS: A set of workplace competencies developed by the Secretary's Commission on Achieving Necessary Skills.

Testing Impact

High-Stakes Testing: The significant consequences that standardized tests impose on students, determining advancement or opportunity.
Consequential Validity: The social and systemic effects resulting from a given assessment's implementation.
Test Bias: The systematic disadvantage certain groups face due to test design or interpretation, adversely affecting students from diverse backgrounds.

Learning and Teaching Dynamics

Test-Driven Learning: Positive motivation among students when performance on a test directly impacts their future opportunities.
Test-Driven Teaching: Pressure on educators due to high-stakes tests, potentially leading to narrowed curricular focus.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Description

Explore key concepts in language assessment with these flashcards. Learn about test usefulness, specifications, and elicitation modes. Perfect for educators and students involved in language testing practices.