Psychological Assessment and Settings
31 Questions
0 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to Lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What types of questions are answered by psychologists through assessment?

Diagnosis, questions about an individual's cognitive abilities, personality traits, emotional functioning, and potential mental health concerns, including things like: 'Does this person have a learning disability?', 'What is the severity of their anxiety?', 'How is their cognitive function impacted by a brain injury?', 'Are they suitable for a particular job?', or 'What is the best course of treatment for their specific needs?'

In what settings do psychologists assess, and what is their primary responsibility in each?

Clinical settings: Diagnose mental health disorders and develop treatment plans. Educational settings: Assess learning disabilities, giftedness, and academic accommodations. Forensic settings: Evaluate criminal responsibility, competency, and risk assessment. Occupational settings: Conduct employee selection, leadership evaluations, and workplace mental health assessments. Counseling settings: Provide career guidance, personal growth assessments, and therapy-related evaluations.

What are the three properties of scales that make scales different from one another?

True zero point- there is a meaningful 0, magnitude (you can have more or less of the construct), and equal intervals (the space between scores is consistently meaningful).

Know the four scales of measurement and be able to differentiate between these scales

<p>Nominal (categories, none of the three properties), ratio (all three of the properties), interval (magnitude and equal intervals but lacks true zero, and ordinal (magnitude but lacks equal intervals and true zero).</p> Signup and view all the answers

What is a z score? How is it calculated?

<p>A z score is a measure of how many standard deviations something is away form the mean. You just subtract the data point from the mean and divide it by the SD</p> Signup and view all the answers

How are T scores different from Z scores?

<p>T scores are adjusted a little to account for a smaller sample size and add a little more room for error</p> Signup and view all the answers

What are the five characteristics of a good theory?

<p>Generalizable (broad scope), falsifiable, applicable (generative or fruitful), simple (acham's razor), systematic and coherent, and have explanatory power (explain as much as the variation between variables as possible)</p> Signup and view all the answers

What is the Pearson product moment correlation? What meaning do the values -1.0 to 1.0 have?

<p>It's r. It tells you the strength and the direction of the relationship between variables. -1 is a perfect negative correlation, 1 is a perfect positive correlation, 0 is no correlation</p> Signup and view all the answers

What is the standard error of estimate? What is its relationship to the residuals?

<p>It is the average amount or distance that all points fall from the regression line. Residual is the single distance between a point and the line, standard error is the sTANDARD DEVIATION of all those points form the line</p> Signup and view all the answers

What is the coefficient of determination? What is the purpose of the coefficient of determination?

<p>R squared, it shows us the amount of shared variance (i.e. the amount of variance predicted or described by the other variable)</p> Signup and view all the answers

What contributes to measurement error?

<p>Situational effects: environment, tester, administrator, test construction, (eliminate these!), Time sampling error- test/ retest, carryover effects, Internal consistency- alternate form reliability *look at split half reliability(spearman/brawn, KR20 (true/false), cronsbach alpha (for likert) for internal reliability, Inter rater reliability (look at kappa coefficient)</p> Signup and view all the answers

Test reliability is usually estimated in one of what three ways? Know the major concepts in each way.

<p>Test-retest, Alternate forms, internal reliability (, Split method w spearman-Brown, KR-20 for T/F, Cronbach alpha for likert), and inter-rater reliability (kappa coefficient)</p> Signup and view all the answers

What is a carryover effect?

<p>It's when taking the test once means your score will be different the second time (hurts test-retest)</p> Signup and view all the answers

Define parallel/alternate forms reliability. What are its advantages and disadvantages?

<p>It's hard to create ($$) but it does good at taking away carry over effects, rigorous</p> Signup and view all the answers

Define split half reliability. How is this measured?

<p>Split the test in meaningful twos and then compare (use spearman-brown)</p> Signup and view all the answers

What does the standard error of measurement do?

<p>It makes observed scores different than true scores. It kind of gives us an estimate for how observed scores will fluctuate around the true score</p> Signup and view all the answers

What factors should be considered when choosing a reliability coefficient?

<p>Ok dichotomous- KR-20 Continuous or liekrt scale- kronsbach alpha, Depending on the context- inter rater reliability (multiple raters), Test- restest (future predictions, should stay constant)</p> Signup and view all the answers

Why types of irregularities might make reliability coefficients biased or invalid?

<p>Carryover effects, not using the whole scale, floor or ceiling effects? Time sampling error- test-retest reliability, Item sampling and internal consitency errors</p> Signup and view all the answers

How can one address/improve low reliability?

<p>Get a bigger sample, kick out items that are poor or don't discriminate, (factor analysis etc..), Adjust for measurement error via structural equation modeling or spearman's corelation for attenuation</p> Signup and view all the answers

What are the stages of test development?

<p>Conceptualize, Test construction -scaling -write and score items, Test tryout, Item analysis, and TEst revision</p> Signup and view all the answers

What are the two major formats of summative scales, as given in lecture? What type of data do they create?

<p>Likert and category format they create interval data? Ordinal unless considered interval</p> Signup and view all the answers

In creating a category format, the use of what will reduce error variance?

<p>Clearly defined achor points!</p> Signup and view all the answers

When does the category format begin to reduce reliability?

<p>At like 9-10 point</p> Signup and view all the answers

What are the four questions that should be asked when generating a pool of candidate test items?

<p>What construct should the items cover, how many items, what are the demographics of my population? (making items clear and culturally specific), and how shall I word the items? (avoid double barrel etc..)</p> Signup and view all the answers

What are the four ways to score tests and how is each differentiated from the others?

<p>Cumulative socreing (summative scales like likert)- total score, Subscale scoring- subscales scored individually, class/ category scoring (DSMV)- diagnosed into a classification based on how much they meet criteria, Ipsative scoring (foreced choice)- subscale scores are compared to other subscale scores (individual against themselves)</p> Signup and view all the answers

Define item analysis. What two methods are closely associated with item analysis?

<p>Its seeing how good each item did at its job. You can analyse it's difficulty and its ability to differentiate. This helps you know if your questions were effective</p> Signup and view all the answers

Define item difficulty. What does the proportion of people getting the item correct indicate? How hard the item was

<p>(IDI- proportion who got it right) you want it halfway between chance and perfect</p> Signup and view all the answers

Define item discriminability. What is good discrimination? What are two ways to test item discriminability?

<p>Did getting the item right correlate with doing better on the test? You can use point-biscereal method (correlation between getting the question right and doing well on the test- closer to 1 the better! ) and extreme group method (Id= proportion correct in top quartile - proportion correct in bottom quartile)</p> Signup and view all the answers

Define and explain how the extreme group and point biserial methods differ.

<p>Look above</p> Signup and view all the answers

Define item characteristic curve. Know what information the X and Y axes give as well as slope

<p>Item characteristic curve, X axis- plot of ability (high vs low scorers), Y axis- probability of correct response on the item, good curve is like wide S, High positive slope is good. Negative slope is whaaaaa ???</p> Signup and view all the answers

Know ceiling effects, floor effects, and indiscriminant items

<p>Yessir, Ceiling effect- scores are concentrated at top of scale, Floor- bottom of scale -these limit variability and thus THE ABILITY TO DISCRIMINATE</p> Signup and view all the answers

Flashcards

Assessment Questions

Questions answered by psychologists to evaluate mental health and abilities.

Clinical Assessment

Diagnoses mental health disorders and develops treatment plans in clinical settings.

Educational Assessment

Evaluates learning disabilities and accommodations in educational settings.

Forensic Assessment

Evaluates criminal responsibility and risk assessment in forensic settings.

Signup and view all the flashcards

Occupational Assessment

Conducts evaluations related to job performance and mental health in occupational settings.

Signup and view all the flashcards

Ordinal Scale

Scale that shows magnitude but lacks equal intervals and true zero.

Signup and view all the flashcards

Interval Scale

Scale with equal intervals but no true zero.

Signup and view all the flashcards

Ratio Scale

Scale that includes all properties: magnitude, equal intervals, and a true zero.

Signup and view all the flashcards

Nominal Scale

Scale that categorizes without any numeric value or order.

Signup and view all the flashcards

Z Score

Indicates how many standard deviations a point is from the mean.

Signup and view all the flashcards

T Score

Modified score that accounts for sample size, providing more error margin.

Signup and view all the flashcards

Pearson Correlation

Measures the strength and direction of a relationship between two variables.

Signup and view all the flashcards

Standard Error of Estimate

Indicates how far points fall from the regression line.

Signup and view all the flashcards

Coefficient of Determination

Denoted as R squared; shows shared variance between variables.

Signup and view all the flashcards

Test Reliability

Degree to which a test consistently measures what it aims to measure.

Signup and view all the flashcards

Carryover Effect

Occurs when previous test exposure alters the outcome of subsequent tests.

Signup and view all the flashcards

Split Half Reliability

Divides a test into two parts to measure consistency between them.

Signup and view all the flashcards

Standard Error of Measurement

Represents the fluctuation of observed scores around true scores.

Signup and view all the flashcards

Item Analysis

Evaluates how well individual test items function in measuring concepts.

Signup and view all the flashcards

Item Difficulty

Measures how hard a test item is based on the proportion of correct responses.

Signup and view all the flashcards

Item Discriminability

Indicates how well a test item differentiates between high and low performers.

Signup and view all the flashcards

Ceiling Effect

Occurs when scores cluster at the top of the scale, limiting variability.

Signup and view all the flashcards

Floor Effect

When scores cluster at the bottom of a scale, restricting variability.

Signup and view all the flashcards

Cumulative Scoring

Total score accumulates points from summative scales like Likert.

Signup and view all the flashcards

Ipsative Scoring

Compares subscale scores against individual performance.

Signup and view all the flashcards

Extreme Group Method

Assesses item effectiveness by comparing highest and lowest scoring groups.

Signup and view all the flashcards

Point Biserial Method

Examines the relationship between item correctness and overall test performance.

Signup and view all the flashcards

Item Characteristic Curve

Graph showing the probability of a correct response at different ability levels.

Signup and view all the flashcards

Study Notes

Psychological Assessment

  • Psychologists use assessments to diagnose cognitive abilities, personality traits, emotional functioning, and potential mental health concerns.
  • Examples include: learning disabilities, anxiety severity, cognitive impact of brain injury, suitability for a job, and treatment planning.
  • Assessments use various psychological tests to gather information about strengths and weaknesses.

Settings and Responsibilities

  • Clinical settings: Diagnose mental health disorders and develop treatment plans.
  • Educational settings: Assess learning disabilities, giftedness, and learning accommodations.
  • Forensic settings: Evaluate criminal responsibility, competency, and risk.
  • Occupational settings: Conduct employee selection, leadership evaluations, and workplace mental health assessments.
  • Counseling settings: Provide career guidance, personal growth assessments, and therapy-related evaluations.

Properties of Scales

  • True zero point: A meaningful zero exists on the scale (e.g., absence of a trait).
  • Magnitude: More or less of the construct is possible to measure (e.g., more anxious).
  • Equal intervals: Equally spaced intervals on the scale represent equal differences in the construct (e.g., difference in anxiety levels).

Scales of Measurement

  • Nominal: Categorical data (e.g., gender, diagnosis). No inherent order or meaningful intervals between categories.
  • Ratio: Includes a true zero point, magnitude, and equal intervals (e.g., height, weight, reaction time).
  • Interval: Includes magnitude and equal intervals, but lacks a true zero point (e.g., temperature in Celsius).
  • Ordinal: Orders data by magnitude but does not have equal intervals (e.g., rank in a race, levels of agreement).

Z-Scores

  • A Z-score measures how many standard deviations a data point is away from the mean.
  • Calculated by subtracting the data point from the mean, and then dividing by the standard deviation.

Additional Topics

  • Good Theory Characteristics: Generalizable, falsifiable, applicable, simple, systematic, and coherent, with explanatory power.
  • Pearson Product Moment Correlation (r): Measures the strength and direction of a linear relationship between two variables. Values range from -1.0 to +1.0.
  • Standard Error of Estimate: Average distance between observed scores and predicted scores on a regression line.
  • Coefficient of Determination (R²): Proportion of shared variance between variables.
  • Measurement Error Contributing Factors: situational factors, testing conditions, time sampling error (test-retest), internal consistency errors (alternate forms), and rater errors (inter-rater reliability).
  • Test Reliability Estimation: Test-retest, alternate forms, internal consistency (e.g., split-half, Cronbach's alpha, KR-20), and inter-rater reliability methods.
  • Carryover Effects: Previous test-taking experience influencing subsequent scores.
  • Ceiling Effects: Scores concentrated at the maximum value due to item difficulty.
  • Floor Effects: Scores concentrated at the minimum value due to item difficulty.
  • Item Analysis: Assessing item difficulty (proportion answering correctly), item discrimination (correlation between item and total test score), identifying items that produce ceiling/floor effects or indiscriminant items.
  • Reliability Coefficient Selection Criteria: Data characteristics (dichotomous/continuous data) and intended use of the results

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Quiz Team

Related Documents

Hard Items On Exam 1 MC PDF

Description

Explore the various psychological assessments used in clinical, educational, forensic, occupational, and counseling settings. This quiz focuses on how these assessments help diagnose cognitive abilities, personality traits, and mental health concerns. Test your knowledge on the responsibilities and properties of scales in psychological testing.

More Like This

Psychology: Assessment and Diagnosis
8 questions
Clinical Assessment and Diagnosis
58 questions
Use Quizgecko on...
Browser
Browser