Assessment Types and Reliability
63 Questions
1 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to Lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What does 'ipsative assessment' mean?

Comparing present performance against the prior performance of a person being assessed.

What is a norm-referenced assessment?

An assessment that compares a student's performance to a sample of that student's peers.

What is a criterion-referenced assessment?

An assessment that compares a student's performance with a preset standard.

What is a Standardized Assessment?

<p>Formal assessments that follow a standard approach and set protocol for delivery.</p> Signup and view all the answers

What is the importance of the bell curve in assessments?

<p>It allows us to compare our client's performance on assessments with average performance.</p> Signup and view all the answers

What is central tendency?

<p>The middle point of the distribution for a group</p> Signup and view all the answers

What is the measure of validity in assessments?

<p>It determines how much the performance of the group deviates from the mean</p> Signup and view all the answers

What is reliability in assessments?

<p>The reproducibility of rest results and the amount of varying results that are not due to error</p> Signup and view all the answers

What is Intrarater reliability?

<p>One rater, multiple trials</p> Signup and view all the answers

What is Internal consistency?

<p>The degree of agreement between the items in a test that measure an underlying trait</p> Signup and view all the answers

What are some examples of internal consistency tests?

<p>All of the above (D)</p> Signup and view all the answers

What does validity in assessment refer to?

<p>the extent to which a test measures or predicts what it is supposed to</p> Signup and view all the answers

What is face validity?

<p>Ensures the measure is testing what it's intended to measure and that the items are plausible</p> Signup and view all the answers

What is content validity?

<p>Ensures the measurement instrument is reflective of a specific domain of content</p> Signup and view all the answers

What is discriminant validity?

<p>Level of disagreement when two tests are measuring a trait, behavior or characteristic</p> Signup and view all the answers

What is criterion validity?

<p>Implies that the results of one test can be used as a substitute test for the established gold standard criterion test</p> Signup and view all the answers

What is predictive validity?

<p>The outcome of a target test can be used to infer a future outcome</p> Signup and view all the answers

What is ecological validity?

<p>Implies that the results of a test can be true in real-world circumstances</p> Signup and view all the answers

What is cultural bias in most standardized assessments?

<p>Most standardized tests were made primarily based on the white, middle-class population</p> Signup and view all the answers

What are the components of the OT process?

<p>Evaluation, Intervention, Re-evaluation, Outcomes (C)</p> Signup and view all the answers

What is always the main focus of the OT process?

<p>Occupation</p> Signup and view all the answers

What is screening?

<p>To check for the presence of a deficit or need for OT evaluation</p> Signup and view all the answers

What is assessment?

<p>Non-standardized or standardized — used to get measurable data used for intervention planning</p> Signup and view all the answers

What is evaluation?

<p>The gathering and analyzing of info to plan an intervention</p> Signup and view all the answers

What does 'grading up' in therapy mean?

<p>making the activity harder</p> Signup and view all the answers

What does 'grading down' mean in therapy?

<p>making the activity easier</p> Signup and view all the answers

Why do we "grade" activities in therapy?

<p>To find the &quot;just right challenge&quot;</p> Signup and view all the answers

What is activity analysis in therapy?

<p>Generic properties of an activity</p> Signup and view all the answers

What is client-focused activity analysis in therapy?

<p>highly individualized analysis of the personal way in which an activity or occupation is performed in real-life contexts by a specific individual</p> Signup and view all the answers

What is a good strategy to obtain the parent and child perspectives during an interview?

<p>Mode shifting</p> Signup and view all the answers

How are interpersonal characteristics observed in young children?

<p>Their behaviors, reactions, and responses</p> Signup and view all the answers

What is the most important part of a pediatric evaluation?

<p>Interpretation</p> Signup and view all the answers

What is the PMI strategy?

<p>Plus, Minus, Interesting</p> Signup and view all the answers

What does "occupation as a means" mean in therapy?

<p>the client engaging in activities, exercises, etc. during therapy that will help them reach their end goal occupation</p> Signup and view all the answers

What is a COAST goal?

<p>client, occupation, assistance level, specific condition, timeline</p> Signup and view all the answers

What does the "little f" in COASTf mean?

<p>Frequency</p> Signup and view all the answers

What does the "S" in SOAP note stand for?

<p>Subjective</p> Signup and view all the answers

What is reevaluation in the OT process?

<p>Analysis of the client's response to intervention</p> Signup and view all the answers

What are outcomes within the OT process?

<p>Identified results of OT intervention</p> Signup and view all the answers

What is evidence in the OT process?

<p>Theory, research, therapist experience, client preference</p> Signup and view all the answers

What is OTPIM?

<p>Provides OTs with an occupation-centered reasoning structure that enables them to effectively implement quality services that reflect their unique area of expertise</p> Signup and view all the answers

What is a "bottom-up" approach in therapy?

<p>Body functions —&gt; occupational performance</p> Signup and view all the answers

What is a "top-down" approach in therapy?

<p>Occupational performance —&gt; occupations —&gt; performance analysis —&gt; speculate about how occupational elements transact and influence performance</p> Signup and view all the answers

What is a "top-to-bottom-up" approach in therapy?

<p>Gather client concerns —&gt; occupations —&gt; look at body function —&gt; speculate about how BF, contextual factors, or environmental factors are impacting performance</p> Signup and view all the answers

What is Minimal Detectable Change (MDC)?

<p>the amount of change that just exceeds the standard error of measurement of an instrument</p> Signup and view all the answers

What is a Confidence Interval (CI)?

<p>A range of values that likely includes the true value (the safety net that you have to get in to be confident that there is real change)</p> Signup and view all the answers

What is a Correlation coefficient?

<p>a statistical index of the relationship between two things (from -1 to +1)</p> Signup and view all the answers

What is the minimal clinical importance difference?

<p>The smallest difference in score in the domain of interest which patients perceive as beneficial in which would mandate in the absence of troublesome side effects and excessive cost, change in the patient's management</p> Signup and view all the answers

What is a normative sample?

<p>a group of individuals who were given the test to identify standards of performance at specific age levels</p> Signup and view all the answers

What is a percentile score?

<p>indicates the percentage of people who score at or below the score one has obtained</p> Signup and view all the answers

What is a Rasch score?

<p>The model ranks items on the test from easiest to most difficult creating a linear scale, performance can be assessed in light of an item's difficulty rather than against a normative sample</p> Signup and view all the answers

What is a standard score?

<p>A score that expresses an individual's position relative to the mean, based on the standard deviation</p> Signup and view all the answers

What are benchmarks?

<p>One long-term goal with smaller, chronological steps towards the goal</p> Signup and view all the answers

What is interpretation in the OT process?

<p>The most important aspect of the OT process</p> Signup and view all the answers

What is the compensatory model in therapy?

<p>Compensating for decreased performance skills</p> Signup and view all the answers

What is the educational and teaching model in therapy?

<p>Sharing knowledge related to occupational performance, experience, and participation includes strategies to support occupational skills and knowledge related to adaption strategies</p> Signup and view all the answers

What is the acquisitional model in therapy?

<p>Acquiring, redeveloping, or maintaining performance skills for overall occupational performance</p> Signup and view all the answers

What is the restorative model in therapy?

<p>Restoring underlying impairments of body structures</p> Signup and view all the answers

What is the preparatory model in therapy?

<p>Using tasks or exercises to prepare the client for occupations and activities</p> Signup and view all the answers

What is a remediation approach in therapy?

<p>Enhancing client factors to improve occupational performance</p> Signup and view all the answers

What is a mixed models approach?

<p>Using 2 or more interventions at a time</p> Signup and view all the answers

What is motor control?

<p>How the CNS directs and carries out movements</p> Signup and view all the answers

What is motor learning?

<p>Strategies and techniques used to teach others how to move</p> Signup and view all the answers

Flashcards

Ipsative assessment

Compares current performance to a person's past performance.

Norm-referenced assessment

Compares a student's performance to a sample of their peers.

Criterion-referenced assessment

Compares student's performance to a predetermined standard.

Standardized assessment

Formal assessment following a set protocol and instructions.

Signup and view all the flashcards

Non-standardized assessment

Informal assessment with no structured instructions.

Signup and view all the flashcards

The bell curve

A visual representation of the distribution of scores, with most scores clustering around the average.

Signup and view all the flashcards

Central tendency

The middle point of scores in a distribution.

Signup and view all the flashcards

Validity

Measures whether a test accurately measures what it's supposed to.

Signup and view all the flashcards

Reliability in assessments

Consistency and reproducibility of test results over time.

Signup and view all the flashcards

Intrarater reliability

Consistency of one rater's scores across multiple assessments.

Signup and view all the flashcards

Internal consistency

How well a test's items measure the same underlying concept.

Signup and view all the flashcards

Inter-rater reliability

Agreement between multiple raters assessing the same client.

Signup and view all the flashcards

Split-halves

A method of internal consistency where a test is divided in half, and scores are compared.

Signup and view all the flashcards

Alternate form

Checking consistency between two different versions of the same test.

Signup and view all the flashcards

Cronbach a

A statistical measure of internal consistency.

Signup and view all the flashcards

Face validity

Whether the test seems logical and appropriate for its measurement.

Signup and view all the flashcards

Content validity

Checks if the test covers the full range of content it intends to measure.

Signup and view all the flashcards

Construct validity

Ensures that the assessment measures the theoretical concept it claims to measure.

Signup and view all the flashcards

Convergent validity

Shows agreement between two tests measuring the same construct.

Signup and view all the flashcards

Discriminant validity

Shows disagreement between two tests that measure different constructs.

Signup and view all the flashcards

Criterion validity

Measures how well a new test predicts results of a well-established test.

Signup and view all the flashcards

Concurrent validity

Comparison of a new test to a well-established test given at the same time.

Signup and view all the flashcards

Predictive validity

How well a test predicts future performance.

Signup and view all the flashcards

Ecological validity

Measures if a test's results apply to real-world situations.

Signup and view all the flashcards

OT process

Evaluation, intervention, re-evaluation, and outcomes.

Signup and view all the flashcards

Occupation

The main focus of occupational therapy.

Signup and view all the flashcards

Screening

Brief check for possible need for OT evaluation.

Signup and view all the flashcards

Assessment

Gathering data through standardized or non-standardized tools.

Signup and view all the flashcards

Evaluation

Analyzing gathered information for intervention planning.

Signup and view all the flashcards

Grading up

Making an activity more challenging.

Signup and view all the flashcards

Grading down

Making an activity easier.

Signup and view all the flashcards

Grading

Finding the "just right challenge" for the client.

Signup and view all the flashcards

Activity analysis

Analyzing the components and demands of an activity in general.

Signup and view all the flashcards

Client-focused activity analysis

Analyzing an activity within the context of a specific client's needs and preferences.

Signup and view all the flashcards

Study Notes

Assessment Types

  • Ipsative Assessment: Compares current performance to past performance of the same individual.
  • Norm-Referenced Assessment: Compares a student's performance to a sample of peers.
  • Criterion-Referenced Assessment: Compares a student's performance to a predetermined standard.
  • Standardized Assessment: Follows a set protocol for delivery.
  • Non-standardized Assessment: Lacks formal administration and scoring guidelines.

Assessment Reliability and Validity

  • Reliability: Reproducibility of results, minimizing errors.
  • Intrarater Reliability: One rater, multiple trials.
  • Interrater Reliability: Multiple raters, one client.
  • Internal Consistency: Agreement among test items measuring a trait (e.g., split-halves, Cronbach's alpha).
  • Validity: Measures what it's intended to measure.
  • Face Validity: Items appear plausible and measure the intended concept.
  • Content Validity: Assessment covers the relevant domain of content.
  • Construct Validity: Measures the theoretical components of a construct.
  • Convergent Validity: Agreement between tests measuring the same construct.
  • Discriminant Validity: Disagreement between tests measuring different constructs.
  • Criterion Validity: Results can substitute for a gold standard criterion.
  • Concurrent Validity: Criterion measure and target test administered simultaneously.
  • Predictive Validity: Target test predicts future outcomes.
  • Ecological Validity: Results generalize to real-world situations.

Cultural Considerations

  • Cultural Bias in Standardized Assessments: Most standardized tests originate from a limited population (primarily white, middle-class).

Occupational Therapy Process

  • OT Process Components: Evaluation, intervention, re-evaluation, outcomes.
  • Central Focus of OT: Occupation.
  • Screening: Checks for deficits.
  • Assessment: Gathers data for intervention planning (standardized or non-standardized).
  • Evaluation: Gathers and analyzes data to plan intervention.
  • Grading Up/Down: Adjust activity difficulty (harder or easier).
  • Activity Analysis: Generic properties of an activity.
  • Client-Focused Activity Analysis: Individualized activity analysis in real-world contexts.
  • Parent/Child Perspective: Use "mode shifting" for a thorough understanding.
  • Pediatric Evaluation Key: Client interpretation is critical.
  • PMI Strategy (Plus, Minus, Interesting): Analyzing client strengths, weaknesses, and considerations.
  • Occupations as a Means/End: Means (exercises towards the goal) or End (goals themselves)

Goal Setting and Measurement

  • COAST Goal: Client, Occupation, Assistance Level, Specific Condition, Timeline.
  • COAST(f) Goal: adds Frequency to COAST
  • S (Subjective): Client interview, occupational profile.
  • O (Objective): Biomechanical assessment, clinical observations.
  • A (Assessment): Analysis combining subjective and objective information.
  • P (Plan): Long-term and short-term goals.
  • Re-evaluation: Client response to intervention.
  • Outcomes: Results of OT intervention.
  • Evidence: Theory, research, experience, client preference.
  • OTPIM: Occupation-centered reasoning structure for OT services.

Models of Intervention

  • Bottom-up: Body function → occupational performance.
  • Top-down: Occupational performance → occupations → performance analysis.
  • Top-to-bottom-up: Client concerns → occupations → Body function analysis impacts on occupational performance.
  • Minimal Detectable Change (MDC): Amount of change exceeding measurement error.
  • Confidence Interval (CI): Range likely including the true value.
  • Standard Error of Measurement (SEM): Expected range of error for test scores.
  • Correlation Coefficient: Statistical index of relationship (-1 to +1).

Types of Scores and Data

  • Minimal Clinical Important Difference: Change considered beneficial.
  • Normative Sample: Group providing performance standards.
  • Percentile Score: Percentage scoring below a certain score.
  • Rasch Score: Ranking test items from easiest to hardest.
  • Standard Score: Position relative to the mean using standard deviation.
  • Benchmarks: Long-term goals with smaller chronological steps.
  • Compensatory Model: Compensating for skill deficits.
  • Educational/Teaching Model: Sharing knowledge and adaptation strategies.
  • Acquisitional/Restorative/Preparatory Models: Focusing respectively on acquiring, restoring, and preparing.
  • Remediation: Enhancement of client factors.
  • Mixed Models: Combining multiple approaches.

Other Concepts

  • Motor Control: Central Nervous System directing and executing movements.
  • Motor Learning: Strategies for teaching movement.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Quiz Team

Description

This quiz covers different types of assessments including ipsative, norm-referenced, criterion-referenced, standardized, and non-standardized assessments. It also explores the concepts of reliability and validity in assessments, detailing intrarater and interrater reliability, as well as internal consistency and validity measures.

More Like This

Use Quizgecko on...
Browser
Open
Browser
Browser