Norming and Standardization in Test Development
29 Questions
0 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is assessed by the kappa statistic?

  • Construct validity of the test
  • Level of agreement among several raters (correct)
  • Reliability of a test with dichotomous items
  • Internal consistency of the test
  • Which formula estimates the correlations between the two halves of a test if each half had been the length of the whole test?

  • Kappa statistic
  • Cronbach’s coefficient alpha
  • Kuder-Richardson 20 Formula
  • Spearman-Brown Formula (correct)
  • What does the odd-even system of dividing a test assess?

  • Inter-rater reliability
  • Scoring accuracy of the items
  • Internal consistency of the test (correct)
  • Construct validity of the test
  • Which statistic confirms substantial reliability in case the two halves of a test have unequal variances?

    <p>Cronbach’s coefficient alpha</p> Signup and view all the answers

    What does the Kuder-Richardson 20 Formula measure?

    <p>Reliability of a test with dichotomous items</p> Signup and view all the answers

    Which type of correlation is assessed by Cronbach’s coefficient alpha?

    <p>Zero correlation</p> Signup and view all the answers

    What factor can sway the outcome of psychological testing, according to the text?

    <p>Noisy testing room</p> Signup and view all the answers

    In what situation is flexibility in standardized testing procedures considered desirable or necessary?

    <p>Under certain circumstances</p> Signup and view all the answers

    What can impairments in hearing, vision, speech, or motor control do during psychological testing?

    <p>Distort test results</p> Signup and view all the answers

    What is a common pitfall mentioned in the text regarding psychological assessment students or novices?

    <p>Quick reading of the test manual is sufficient</p> Signup and view all the answers

    Why is it important to adhere to standardized testing procedures during psychological assessments?

    <p>To ensure reliable interpretation of test results</p> Signup and view all the answers

    What can alter the meaning of test results and render them invalid, according to the text?

    <p>&quot;Non-standardized testing procedures&quot;</p> Signup and view all the answers

    What is the main difference between a client-centered interview and a behavioral interview?

    <p>Client-centered interview focuses on external conditions, while behavioral interview focuses on choice and self-change</p> Signup and view all the answers

    What is the primary goal of a diagnostic interview?

    <p>To develop a specific diagnosis based on DSM-IVTR</p> Signup and view all the answers

    What characterizes structured clinical interviews?

    <p>They present specific sets of questions in a particular order</p> Signup and view all the answers

    What major systems of psychiatric functioning are assessed in the Mental Status Examination?

    <p>Appearance, attitude, and behavior</p> Signup and view all the answers

    Which assessment tool focuses on the presence or absence of cognitive impairment?

    <p>Mini Mental Status Exam</p> Signup and view all the answers

    What does Koppitz suggest is a possible indication of problems with socioemotional functioning?

    <p>Shading of face</p> Signup and view all the answers

    What do breasts in a drawing symbolize?

    <p>Dependency and maturity</p> Signup and view all the answers

    What is the significance of a tiny head in a drawing according to the text?

    <p>Suggests the figure is less than two inches tall</p> Signup and view all the answers

    What does a slanting figure, tilted by 15 degrees or more, indicate according to the text?

    <p>Severe psychopathology</p> Signup and view all the answers

    In terms of drawings, what do crossed eyes represent according to the text?

    <p>Threatening impulses</p> Signup and view all the answers

    What is the significance of shading hands and/or neck in a drawing, based on the text?

    <p>Anger expression</p> Signup and view all the answers

    Which process involves administering a test to a representative sample of test takers for the purpose of establishing norms?

    <p>Standardization</p> Signup and view all the answers

    What type of sampling method is based on common sense or ease but still maintains representativeness and avoids bias?

    <p>Non-probability sampling</p> Signup and view all the answers

    What type of norms involve having different normative groups for particular age groups?

    <p>Age-related norms</p> Signup and view all the answers

    What does Classical Test Score Theory assume about each person's true score?

    <p>It assumes that each person has a true score that would be obtained if there were no errors in measurement.</p> Signup and view all the answers

    Which process involves deriving norms and may be modified to describe a particular type of norm derivation?

    <p>Norming</p> Signup and view all the answers

    Why is it important to determine how a test taker compares with others when establishing norms for a test?

    <p>To determine the relative standing of the test taker</p> Signup and view all the answers

    Study Notes

    Inter-Rater Reliability

    • A measure has good inter-rater reliability if it yields identical ratings among several raters using nominal scales.
    • The kappa statistic is used to assess the level of agreement among raters.

    Internal Consistency

    • It measures the degree to which each test item measures the same construct.
    • It is the intercorrelations among the items.
    • If all items on a test measure the same construct, then it has good internal consistency.
    • Formulae used to measure internal consistency: Spearman-Brown, Kuder-Richardson, and Cronbach’s alpha.

    Formulae for Internal Consistency

    • Spearman-Brown Formula: estimates the correlations between the two halves of a test if each half had been the length of the whole test and had equal variances.
    • Cronbach’s coefficient alpha: confirms that a test has substantial reliability in case the two halves of a test have unequal variances.
    • Kuder-Richardson 20 (KR20) Formula: used for calculating the reliability of a test in which the items are dichotomous or scored as 0 or 1.

    Validity of Test Results

    • Test results can be affected by extraneous factors such as non-standardized administration, inexperienced examiner, noisy testing room, scared examinee, or careless scoring.
    • Standardized procedures in test administration are essential to ensure reliable test results.

    Clinical Interviewing

    • Client-centered interview: nondirective and unstructured, behaviors are brought about by choice and self-change.
    • Behavioral interview: directive and structured, environment or external conditions are the causes of behavior.
    • Diagnostic interview: to develop a specific diagnosis based on the DSM-IVTR, DSM-V, or ICD-10.
    • Informal or exploratory interview: to assess a person’s socioemotional functioning, coping styles, social support, etc.

    Types of Clinical Interviews

    • Structured Clinical Interviews: specific sets of questions are presented in a particular order, e.g. Schedule for Affective Disorders and Schizophrenia (SADS) and Child Assessment Schedule (CAS).
    • Mental Status Examination: reviews the major systems of psychiatric functioning, assessing domains such as appearance, attitude, behavior, mood and affect, speech, thought processes, thought content, perceptions, cognition, insight, and judgment.
    • Mini Mental Status Exam: a 30-point questionnaire used to assess the presence or absence of cognitive impairment.

    Draw-A-Person (DAP) Test

    • Stance: indicates concern regarding the need to control threatening impulses, degree of security the person feels in their environment.
    • Emotional Indications: power and strength, power strivings, left shoulder has feminine indications while right shoulder has male indications.
    • Koppitz's indications of problems with socioemotional functioning:
      • Poor integration of parts or figures
      • Shading of face
      • Shading of body and/or limbs
      • Shading of hands and/or neck
      • Gross asymmetry of limbs
      • Slanting figure, axis of figure tilted by 15 degrees or more
      • Tiny figure, two inches or less
      • Big figure, nine inches or more
      • Transparencies
      • Tiny head, less than 1/10th of the total figure
      • Crossed eyes, both eyes turn in or out

    Norming and Standardization

    • Norming: the process of deriving norms, may be modified to describe a particular type of norm derivation.
    • Standardization: the process of administering a test to a representative sample of test takers for the purpose of establishing norms.

    Sampling to Develop Norms

    • Probability sampling: the entire population is known, each individual has a specifiable probability of selection, and sampling occurs by a random process based on probabilities.
    • Non-probability sampling: the population is not completely known, individual probabilities cannot be known, and the sampling method is based on common sense or ease but still maintains representativeness and avoids bias.
    • Certain tests have different normative groups for particular age groups, e.g. most IQ tests.
    • Agerelated norms are used when the norms of a particular age group cannot be used on a younger or older age group.

    Classical Test Score Theory

    • Assumes that each person has a true score that would be obtained if there were no errors in measurement.
    • Measuring instruments are imperfect, therefore the observed score for each person almost always differs from the person’s true ability or characteristic.

    Studying That Suits You

    Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

    Quiz Team

    Description

    Learn about the processes of norming and standardization in test development, as well as the importance of sampling methods. Understand how norms are derived and how tests are administered to establish norms.

    More Like This

    Use Quizgecko on...
    Browser
    Browser