Week 4 - Psychometrics PDF

Week 4 Psychometrics PSY 2234 Fall 2024 Overview Measurement Qualities Reliability Validity Standardization Types of Measurement Clinical Interviews Clinical Observations Clinical Tests Projective Tests Intelligence Measures Response Inv...

Week 4 Psychometrics PSY 2234 Fall 2024 Overview Measurement Qualities Reliability Validity Standardization Types of Measurement Clinical Interviews Clinical Observations Clinical Tests Projective Tests Intelligence Measures Response Inventories Biological Measures Measurement Implications Tests are used for Diagnosing mental illness and disability Creating treatment plans Knowing which interventions work Awarding funding Hiring people for jobs College admissions Awarding places on teams Measurement Implications Ergo, extremely important to make sure tests are accurate and useful Three facets Reliability Validity Standardization Reliability The extent to which a measure gives consistent and clear results Ex: if you’re measuring extraversion… Do people who score high on your test also score low on introversion? Do people score the same when they’re in a bad mood vs. a good mood? Are there similar response patterns for questions about parties vs. questions about gatherings? Does it replicate? Validity The extent to which a test measures what it intends to measure Ex: if you’re measuring extraversion… Does it capture every aspect of extraversion, from sociability to leadership? Does it avoid measuring irrelevant factors, like intelligence? Does it have a clear definition of extraversion? Does it predict who is likely to enjoy loud parties? Face Validity The quality of a test being obvious to test- takers about what it intends to measure Not always a desirable quality Not actually a form of validity Standardization The extent to which a measure can be given the same way to different people in different settings across different administrators Ex: if you’re measuring extraversion… If the participant has a question about an item, how will it be answered? Will the test always be given in English? Will you check for English fluency? Should the test be taken in groups or alone? Is there an online version? An in-person one? Are they the same? Types of Measurement Types of Measurement Clinical Interviews Face-to-face, based on observations of clients’ verbal and nonverbal behaviors Clinical Tests Written down, based on clients’ choice among certain options Clinical Observations No direct communication, based on clients’ behavior in context Clinical Interviews Can be unstructured or structured Clinical Interviews Can be unstructured or structured “Tell me about yourself” Clinical Interviews Can be unstructured or structured Mental Status Exam (Mini) Mental Status Exam Observe the volunteer’s verbal behavior Observe the volunteer’s nonverbal behavior Observe my (the questioner)’s behavior Clinical Observations Clinical Observations Client engages in behavior Clinician observes client Clinician takes notes Clinical Observations Naturalistic observation Client observed in everyday environments Ex: Parents agree to keep camera in home for 1 week Analog observation Participant observed in the lab Ex: Children brought into lab and watched through 2-way mirror as parent leaves Self-monitoring Client given a device and asked to record own behavior Ex: For 1 month, client taps a button on their phone every time they feel a self-harm urge Clinical Observations Clinical Observation Threats Overload Too much going on, makes it hard to get everything (e.g. crowded classroom) Observer Drift Over time, observer gets less accurate (e.g. boredom/tiredness during 8-hour shift) Reactivity Client knows they’re being observed, so changes behavior (e.g. home observations) Clinical Observation Threats Clinical Tests  Clinical Tests minimal validity, excellent validity, replicability replicability Projective Tests Inventories Biological Measures Intelligence Tests  Clinical Tests minimal validity, excellent validity, replicability replicability Projective Tests Inventories Biological Measures Intelligence Tests Projective Tests Clinician gives client an ambiguous (unformed) stimulus Client asked to respond to stimulus Clinician writes down client’s response, tries to draw conclusions Projective Tests Rorschach Projective Tests Rorschach Thematic Apperception Test Projective Tests Rorschach Thematic Apperception Test Word Association Test Chair Projective Tests Rorschach Thematic Apperception Test Word Association Test Draw-A-Person Test  Clinical Tests minimal validity, excellent validity, replicability replicability Projective Tests Inventories Biological Measures Intelligence Tests Intelligence Tests What is intelligence? Intelligence Tests Seek to measure g: general mental ability Intelligence Quotient (IQ) Tests Extremely high-stakes Used to determine Who gets educational support Who needs a proxy for legal decisions Who can go on trial for murder Who can live independently