Psychological Testing and Assessment

Psychological Testing and Assessment

• Testing refers to everything from test administration to score interpretation.
• The term was aptly used in World War I for screening military recruits.
• Assessment emerged in World War II, marking a distinction from the more general "testing".
• The U.S. Office of Strategic Services used varied tools, including psychological tests, for personnel selection.
• The OSS model inspired the "assessment center" approach to personnel evaluation.
• Psychological assessment involves gathering and integrating data to make psychological evaluations with tools like tests and interviews.
• Varieties of assessment are modified to fit particular areas.

Types of Assessment

• Educational assessment evaluates skills relevant to success in school.
• Retrospective assessment uses tools to draw conclusions about past psychological aspects.
• Remote assessment gathers data from subjects who are not physically present.
• Ecological Momentary Assessment (EMA) evaluates problems and variables in real-time, "in the moment."
• Collaborative psychological assessment involves assessors and assessees working as partners.
• Therapeutic psychological assessment encourages therapeutic self-discovery
• Dynamic assessment is an interactive approach with evaluation, intervention, and further evaluation.
• Psychological testing measures variables with designed devices to obtain behavior samples.

Testing Characteristics

• Testing aims to obtain numerical data about an ability or attribute.
• Testing can be individual or group-based
• Evaluators typically total correct answers with little regard for the process behind them.
• Testers are interchangeable without affecting outcomes.
• It typically requires technician-like skills to administer, score, and interpret tests.
• It yields a test score or series of scores.

Assessment Characteristics

• Assessment aims to answer questions or solve problems using evaluation tools.
• Assessment is individualized and focuses on how individuals process information.
• Assessors are key in selecting tools and drawing conclusions.
• It typically requires educated tool selection, evaluation skills, and data integration.
• Assessment entails a logical problem-solving approach using multiple data sources.

Measurement Tools

• A psychological test is a device designed to measure psychology-related variables.
• Format encompasses the form, plan, structure, arrangement, and layout of test items.
• A score is a numerical or non-numerical summary of performance.
• Scoring involves assigning codes or statements to test performance.
• A cut score is used to divide data into classifications.
• Psychometric soundness refers to the technical quality of a test.
• Utility refers to the usefulness of a test for a purpose.
• Interviews gather information through direct communication.
• Panel interviews involve multiple interviewers. Motivational interviewing is a client-centered dialogue that enhances motivation.
• Portfolios are samples of one's abilities and accomplishments used for evaluation.
• Case history data includes records and transcripts.
• Case studies are reports about a person or event based on case history data.
• Groupthink occurs when forces drive decision-makers to consensus.
• Behavioral observation monitors actions using visual or electronic means.
• Naturalistic observation occurs in settings where behavior is expected.
• Role-play tests involve acting in simulated situations.

Computers as Tools

• Scoring can be done on-site (local processing) or at a central location (central processing).
• Simple scoring reports are less detailed than extended scoring reports
• Interpretive reports include interpretive statements.
• Consultative reports provide expert opinions.
• Integrative reports use previously collected data.
• Computer Assisted Psychological Assessment (CAPA) refers to computer assistance for the test user.
• Computer Adaptive Testing (CAT) tailors the test to the test taker's ability.

Advantages of Computerized vs Paper Tests

• Online platforms grant test administrators greater access to potential test users due to the Internet's global reach.
• Test data scoring and interpretation tends to occur more quickly than is the case on-paper.
• The costs linked to Internet testing tend to be lower than what is associated with the costs of Paper-and-pencil tests.
• The Internet makes it easier to test people living in isolated populations and people with disabilities that might face hardship getting to a test center.
• "Test-client Integrity" (Naglieri et al.) verifies the test taker's identity online

Test Stakeholders

• Test developers create tests or other methods of assessment.
• Test users are professionals who use psychological tests and assessments.
• Test takers take the test.

Factors that Affect Test Takers

• Test anxiety levels can affect results.
• The extent to which test takers agree with the assessment rationale.
• Test takers' willingness to cooperate.
• Physical or emotional pain.
• Physical discomfort.
• Alertness levels.
• Predisposition to agree or disagree. Receipt of prior coaching.
• Importance attributed to portraying themselves in a desired light.
• Luck in answering multiple-choice questions.

Additional Factors

• Psychological autopsies reconstruct a deceased person's psychological profile.
• Society and evolving needs measurements developers require new tests.
• Organizations sponsor test development for personnel certification and other reasons.

Contexts for Assessments

• School ability tests identify children with special needs.
• Achievement tests evaluate learning.
• Diagnosis involves descriptions based on evidence.
• Diagnostic tests identify areas of deficit.
• Informal evaluations are nonsystematic assessments that inform opinions.
• Clinical settings, including private psychotherapy and schools, uses tests.
• Psychotherapy researchers assess the effectiveness of treatments.
• Psychologist-consultants provide their expert opinions for various companies.

Assessment in Other Settings

• Court-appointed psychologists provide opinions on competency.
• Prison psychologists evaluate rehabilitation.
• Counseling settings aim to improve adjustment and productivity.
• Geriatric settings assess quality of life
• Business and military settings use tests for employment decisions.
• Marketing psychologists gauge consumer preferences.

Ethical Standards

• Use appropriate tests for the individual being tested.
• Keep the test contents secure.
• Use prepared and trained personnel.
• Ensure suitable testing environment.
• Maintain rapport with the examinee.
• Convey test results clearly.
• Use agreed scoring criteria.
• Interpret data ethically.

Assessment of People with Disabilities

• The objective is to obtain employment or earn professional credentials.
• "Alternate assessment" adapts or adjusts to accommodate disabilities.
• "Accommodation" adapts a test or procedure to make it suitable for an assessee with needs.
• Test catalogues, manuals, reference volumes, and professional books provide authoritative information

Historical Considerations

• 2200 B.C.E.: Imperial examinations were established in China.
• Middle Ages: Measurement procedures were devised around determining the presence of a league with the Devil.
• Renaissance: Christian von Wolff anticipated psychology as a science with measurable properties (1732, 1734).
• 1859: Charles Darwin's work on natural selection spurred interest in heredity research, led by Francis Galton.
• Wilhelm Max Wundt founded the first experimental psychology lab at University of Leipzig- where assessment was important.
• James McKeen Cattell studied individual differences.
• Charles Spearman developed the concept of test reliability
• Victor Henri suggested mental tests could measure higher mental processes.
• Emil Kraepelin experimented with formal word association tests
• Lightner Witmer founded clinical psychology

Social Considerations

• The 20th century saw the measurement of intelligence and personality advanced.
• Culture is defined as socially transmitted behaviors, beliefs, and products of a population.
• Henry H. Goddard used Binet's test in the United States.
• Culture-specific tests began to appear.

Cultural Sensitivity in Assessment

• Communication between assessor and assessee is key.
• Assessors should note the level of exposure to and assimilation into the dominant culture to which the test adheres.
• Verbal and nonverbal communication should be taken into consideration
• Standards of evaluation are culturally relative, as can judgments of psychological traits.
• Tests and other evaluative measures administered should account for individual and group basis.

Legal and Ethical Tests

• Vocational assessment must be sensitive to legal and ethical mandates.
• Affirmative action promotes equal education and employment opportunities.
• Public policy is shaped by psychological tests in high-profile contexts
• Laws are rules for the good of society- ethics are principles of right conduct- standards are the level of care provided by said professionals
• In regards to Legislation- minimum competency tests must be in accordance with the standards at the state level

Legal Ramifications of Testing

• Truth-in-testing legislation provides test takers information on evaluation criteria.
• Quota systems select applicants from certain backgrounds.
• Discrimination favors majority groups, while reverse discrimination favors minority groups.
• Disparate treatment is intentional discrimination, while disparate impact is unintentional.
• "Judge-made law" stems from decisions by courts.

Standards of a Good Tester

• Psychologists may serve as expert witnesses.
• Test users are sensitive to legal and ethical mandates.
• Affirmative action combats discrimination and promotes equal opportunity
• Laws promote the good of society, and ethics are good conduct.
• Code of professional ethics is accepted by profession members, and defines care standards.

The Concerns of the Public

• Minimum competency testing programs and truth-in-testing legislation are considerations of the public
• Testing people with disabilities presents unique challenges with regard to transforming the test, scorable results and interpreting the date
• The Rights of Testtakers
  • Test takers have the right to:
    • Informed consent
    • Be informed of test findings The right to privacy and confidentiality The right to the least stigmatizing label

Test User Qualifications

- Adequate test interpretation includes
    - Tests with manual instructions
    - Statistics
   - Psychology of adjustment, and guidance

-The test or aid requires supervised experirence

Test development concerns

• developing/selecting tests
• Interpreting scores
• Fairness Reporting scores

Norms Referenced Tests

• norms-referenced tests derive meaning from test scores by evaluating an individual testtaker's score to scores of group of testtakers
• test scores in relation to some comparison group of testtakers which is the common goal of tests
• Norms refer to behavior that is standard, and the like
• A sample is a portion of the universe of people deemed to be representative of the whole population.

Types of Sampling

• stratified sampling all in proportion to the current occurence of these stata in the population of the people there on random
• Stratified-Random Random testing that includes members of the population -A group of samples to help make a statement
• Types of Norms include
  • Age -Grade
  • Local Standards

Culture influence in testing

• Do not lose sight of Culture - responsible test users

Concept of Reliability

X to represent an observed score T to represent a true score E to represent error X+T=E A statistic useful in describing sources of test score variance for the formula squared

Random Error

Random Error -Random measurement target variable -Source of error that is hard to measure -Variables in process Systematic error -Consistant proprotnate to the test -Sources of error depend on time of day Item Sampling -Varities among test Test and Malingering -Level of lighting

Reliability Estimates

Split Test half is good for measuring test to reliability. -Test retake Estimate is required with test test reliability

• Factors that may affect test reliability include -Whether it is homogeneous
• The test is being designed is preumeed to being dynamic

Power verses speed test

Power: The amount of the test being timed Speed: Speed is being tested

Validation for Measurements

Test

• Is is valid? Or is it NOT valid? Concerns a culture and content on the
• Is it measuring what is proposed?
• Relates more to what test apears to test takers that what the measurements are accurate

Ecological validity

• What the best measurs at this time