PSY2174 Week 19: Psychometrics Introduction

• The content covers Psychological Assessment & Psychometrics, Week 19 (Lecture #1) for PSY2174 module set in Monday, 27th January 2025
• The module provides an introduction to the subject
• There are 5 learning outcomes

Module Team

• Dr Stephen Earl is the module coordinator and holds lectures/seminars
• Contact Dr Earl at [email protected], Room SSB4224 (Sarah Swift Building), office hours: Mondays 2-4 pm
• Dr. Andre Soares holds lectures/seminars
• Contact Dr. Soares at [email protected], Room: SSB3209 (Sarah Swift Building), office hours by request

Module Aims

• Introduce central concepts of measurement and psychometrics
• Assist in developing an understanding of psychological assessment and psychometrics within psychology
• Understand the impact of varying factors on psychological assessment
• Provide a solid understanding to carry forward into dissertation module

Learning Outcomes

• Demonstrate understanding of psychological assessment & psychometric testing in psychology
• Demonstrate knowledge of how statistics are applied to psychometric testing
• Statistics can administer, score, and interpret a psychometric test to assess an individual's personality, ability, and/or intelligence
• Examine the impact of individual differences & contextual factors on psychological testing
• Evaluate and apply assumptions/principles of questionnaire development
• Understand the design, evaluation, test construction, validity, and reliability
• Integrate theory and practice in psychometric assessment and how to work within professional and ethical frameworks relating to assessment

(Psychological) Testing

• Measurement/testing is fundamental within psychology, exploring how people differ in abilities and attributes
• Application: How do differences impact behavior, treatments, and practice
• Psychological Testing aim is understanding human behavior and human nature
• Measurement also represents an obstacle because concepts in psychology are abstract, ambiguous, and invisible
• Testing, scores obtained on tests offer information about human behavior
• Recommendations can be made based on findings, with impacts on important decisions

Tests Practical Examples

• Clinical tests identify psychological disorders to prescribe medication/treatment
• Forensic tests are used to assess the extent of a psychological disorder for reduced criminal sentences
• Business tests may use personality inventories or knowledge tests during recruitment
• Education test are used to understand students' learning
• Sport & exercise are used to understand why an athlete is underperforming (e.g., anxiety; confidence, motivation)

Psychometrics

• Psychometrics aim to quantify what tests measure by telling you what is needed to be known
• Psychometrics measure what is trying to be measured in order to obtain the same results if used repeatedly
• Psychometrics critically think about measurement (i.e., the test themselves)
• The module introduces the central concepts/methods of psychometrics
• How psychologists conceptualize human behavior & individual differences
• Test construction and how numbers are used to score tests
• How tests use different questions and determine reliability and validity
• The relevant statistics related to different aspects of psychometrics

Key Questions

• What does it mean to attribute scores on characteristics?
• (e.g., intelligence, self-esteem, memory, anxiety, confidence)
• How do we know that a specific psychological test/scores are trustworthy?
• How confident can one be when interpreting an individual's test score?
• What kind of information should one seek to evaluate the quality of a test?
• What types of different psychological tests/ measurements are there?
• How are numbers used differently in the scoring of test
• What are some of the challenges to psychological measurement?
• How can we interpret the statistical psychometric information of tests?

Reliability and Validity

• There are two fundamental psychometric concepts; reliability and validity
• Reliability refers to the consistency and replicability of a measure, ensuring consistent results if using the same measure with the same people, and the test scores are consistent with individuals
• Validity is the degree to which a test measures what it is supposed to measure
• Validity is to ensure one is measuring what they should be measuring while providing accurate data

Statistics Module Overview

• Goal of the module is to gain an understanding of psychological testing, psychometric concepts, and methods to evaluate psychometric concepts and what numbers actually mean
• The module will consider some statistics and one does not need to be able to run statistical tests
• Its important to understand the theories and concepts, and how psychometric concepts are evaluated

Module Structure

• The blackboard site contains all the required material for the module; outlining Module Outline, Teaching Team, Module Resources, Assessments, Lecture Materials, and Seminar Materials Module Handbook
• Includes essential information for the module as a basic reference including Module aims, Learning outcomes, Staff details and Lecture format

Module Teaching

• There are two 1-hour weekly lectures, on Monday 11am - 12noon (Room INB0114 - Isaac Newton Building) and Friday 11am - 12noon (Room INB0114 - Isaac Newton Building)

• There are two seminars (Weeks 23 & 28) which will require you to check your individual timetable

• The lectures will cover the modules main key readings

• There will be 22 lectures in total with a lecture topic outline in the module handbook

• There will be no lectures in Week 25 (Assessment 1 - MCQ) and Weeks 30 & 31 (Easter break)

• The lectures will be roughly half psychometric theory and application

• Lectures will be recorded using Panopto software, available on Blackboard

• Try and attend all lectures so you are able to understand the coming content

Seminars

• There are two seminars (Weeks 23 & 28), you need to check your timetable for exact date/time
• Facilitated by Stephen Earl & Andre Soares
• Seminar 1 (Week 23) focuses on conceptual/theoretical applications of psychometrics
• Seminar 2 (Week 28) is dedicated to the final written report and includes previously finished write-ups as examples to use during the session

Online Drop-In

• Delivered by Stephen Earl and Andre Soares, offering the opportunity to discuss Assessment 2

Assessment

• There are two module assessments available. Refer to Blackboard's "Assessment" and Module Handbook for more information
• The assessments include a Multiple Choice Quiz (MCQ) and a Written Report

Multiple Choice Questions

• The test consists of 40 questions to complete within 40 minutes
• The exam is open from 9am until 5pm on Tuesday March 11th with further details provided throughout the module, online via Blackboard
• Contains four potential answers for each question, with 40% of the module grading related to this assessment
• Support for these questions are in Assessment 1: Support, in which practice questions are available on blackboard
• The assessment covers all content in the first half of the module
• MCQ also tests the understanding of the theory behind psychological testing

Written Report

• The test is to be 2000 words
• Submission closes at 4pm on 9th May 2025, and it must be uploaded via TurnitIn on Blackboard
• It is 60% of the overall grade.
• There are "Assessment 2" support folders available in Blackboard along with writing help and referencing

Discussion Boards

• There are discussion boards available on the module Blackboard site for students to ask questions on, and Andre and Stephen Earl will be able to help
• Discussions are not to be anonymous, but anonymous feedback can be sent via the School of Psychology Sport Science & Wellbeing Blackboard site

Core Textbooks

• There are two core texts for the module
  • Furr, R. M. (2021/22) Psychometrics: An Introduction -The library has an e-book available
    • The lectures will indicate each weeks chapters -This is textbook used to guide the lecture
  • Urbina, S. (2014) Essentials of psychological testing. -The library has hard copies plus an E-Book edition
    • Specific chapters will be indicated for each week

Furr (2021/22) Overview

• This is a guide and covers various concepts, theories, and statistics.
• Topic overviews include Psychometrics, Basic Concepts Of Measurement, Reliability, Validity, Threats To Quality, Item Response Theory and Generalizability Theory

Urbina (2014) Textbook Overview

• The book includes extension information and an over of view to the subject:
• Introduction To Psychological Tests, Essential Statistics For Testing, Essentials Of Test Score Interpretation, Reliability/Validity, Test Item/Ethical Considerations

Additional Reading

• Please also see the module handbook and reading list for additional resources:
  • Further texts from;
  • Field, A. P. (2017). Discovering Statistics Using IBM SPSS
  • Kaplan, R. M., & Saccuzzo, D. P. (2017). Psychological Testing: Principles, Applications, And Issues
  • Miller, L. A., & Lovler, R. L. (2018). Foundations Of Psychological Testing: A Practical Approach
  • Research Association (2014). Standards For Educational And Psychological Testing
  • Embertson, S. E., & Reise, S. P. (2013). Item Response Theory For Psychologists
• Consider validated published measurements, the papers will become helpful as the module continues on, assisting you with the written report.

Lecture Summary

• An overview of the teaching staff, the objects of the module (psychometric validity), the teaching approach and two seminars, the key reading and the available assessment criteria

Questions

• In case of enquires, send your message to at [email protected]
• Lecture: Friday 11am, Room INB0114 covering The Importance of Psychological Testing