Testing Issues with RT Assessment PDF

Testing Issues with RT Assessment RCTX 3254 East Carolina University  Overview Measurement Concepts Threats to Validity and Reliability Issues that Effect Measurement  Measurement The basic core of ALL research The assignment of numbers...

Testing Issues with RT Assessment RCTX 3254 East Carolina University  Overview Measurement Concepts Threats to Validity and Reliability Issues that Effect Measurement  Measurement The basic core of ALL research The assignment of numbers (or perceptions or behaviors) to occurrences Exactness and Precision in measurement are vital to the trustworthiness of your data. Consists of two basic processes: Conceptualization Operationalization  Conceptualization “Providing or assigning a conceptual or theoretical definition to a construct or concept” Consistencies in the literature New conceptualizations that challenge the norm Guided by researcher’s: Theoretical framework of science  Operationalization Operationalization-the process of taking a conceptual definition and making it more precise Linking it to more concrete indicators or operational definitions Provides more precise measurement Example (Loy & Dattilo, 2000): “Negative social interactions” “Verbal exchange between participant and a peer including negative vocal tone/sounds, derogatory vocalizations, or use of negative verbal content, and non verbal exchanges which include negative facial expressions, aggressive physical contact, or pulling away from another as to not share a toy(s)”  Levels of Measurement Nominal (NAME) Interval (EQUAL Categorical in nature INTERVALS) Distinct categories Equal distances Discrete- (2) Meaningful distances b/t ranks Continuous (unlimited values) Example: temperature Mutually exclusive Example: RATIO (# as RATIOS) Gender or Religious Interval + absolute/true zero Preference Example: Ordinal (ORDER) length or weight Common unit of measurement Variables that are ordered or ranked Judgment Strong to weak Very important to not important Not aware of distance b/t ranks No common unit Example: Class ranks Precision of Measurement The higher the Ratio type, the more precision Interval Every level up Precision includes properties of the previous Ordinal level Nominal  Examples Academic Year Nominal IQ scores Interval/Ratio Fatigue Ordinal GPA Interval/Ratio Hair color Nominal Type of Nominal neighborhood Ordinal Climate Measurement Threats to Reliability and Ambiguity-when Validity Maturation-natural change correlation is taken for in sample causation Mortality- dieing or quitting Apprehension- fear Regression toward mean- Compensation- $$ tendency toward middle influence scores Demoralization- boredom Rivalry- scores influenced Diffusion-mimic responses due to competition History- event occurs b/t Selection- volunteers self- pre-post select Inadequate Setting- setting or context operationalization- unclear contaminates definitions Treatment-Hawthorne Instrumentation- changing effect; people trying to of instrument gain attention Interaction-confounding treatments  “Clinical Reasoning” Cognitive process that involves professional thinking logically and coherently about the possible reasons and meanings related to a situation Expert judgment on the part of the therapist Focused on producing the best action in a particular situation Assessment & Codependency Issues Health relationship provides certain dependency issues Needs of CTRS can often be met in relationship Codependency affects objectivity of CTRS  Adapting Tests Visual Motor Gross Impairment Changing positions Increasing font size Size Contrasting of objects Colors to manipulate Central placement Language Limited Communication Interpretation Electronic Visual symbols devices rather or pointing than narrative boards Adapting tests & validity/reliability?  Honesty & Deception Random responding-random Malingering-conscious fabrication pattern or exaggeration of response of symptoms Honest responding-patient’s sincere attempt to Defensiveness-denial be accurate or minimization of symptoms Hybrid responding- combination of response Irrelevant Responding- response style reflects styles limited engagement in the process  Social Desirability When clients respond in a manner that makes them look good in the eyes of others Denial Defensiveness Crowne-Marlowe Test Repeating answers in different manner to test honest response  Self-disclosure An inability to disclose to a therapist Trust issues Limited rapport Inability to share, not dishonesty  Cultural Barriers Native American Beliefs within a culture that inhibits accurate assessment Limited eye contact Present-oriented time Willingness toparticipate Respect silence Arab Language barriers Match gender Cultural Bias- Reveal bad news when in stagesculture negatively impacts the outcome Include familyand/or interpretation of an spokesperson assessment Don’t force autonomy Hispanic Respect Gender Asian-American Social etiquette Greet elders first Open body posture  Summary Many issues beyond the control of the therapist can influence the reliability and validity of an assessment Understanding and controlling ahead of time can minimize their effects.