PSY1SFP ITRIP Lecture 2 - Concepts and Measurements PDF

PSY1SFP 10/3/2024 Scientific Foundations Of Psychological Science Lecture 2: Concepts and Measurement in Psychological Science Dr Melanie Murphy [email protected] Key readings: Navarro DJ and Foxcroft DR (2022). learning statistics with jamovi: a tutorial for psychology students and other begi...

PSY1SFP 10/3/2024 Scientific Foundations Of Psychological Science Lecture 2: Concepts and Measurement in Psychological Science Dr Melanie Murphy [email protected] Key readings: Navarro DJ and Foxcroft DR (2022). learning statistics with jamovi: a tutorial for psychology students and other beginners. (Version 0.75). Section 1.1, Sections 1.3 to 1.5 Section 2.1 and Section 2.3 Optional reading Field, A (2018). Discovering statistics using IBM SPSS statistics. Chapter 1 -section 1.6.2 (starts pg. 10) 1 THE MAIN THEMES OF SFP… What are the underlying principles driving the practice of psychology as an evidence-based, scientific discipline? Philosophy of Psychology w ith Annukka C ultural and Ethical Psychology w ith Bec, M el and M att How did what we now call the discipline of psychology evolve, what is it now and where is it heading? What principles do we need to consider and adhere to in order to ensure psychological research is inclusive, and respects and protects the individual? History of Psychology w ith Annukka Research in Psychology w ith M el How to we practically apply these techniques to objectively collect and analyse data in psychology to inform practice? 2 RESEARCH IN PSYCHOLOGY (ITRIP) Applied principles of experimental design and analysis How do we define what we want to study? How do we measure what we want to study? How do we decide what these measures tell us? How do we communicate what this means for theory? How does this translate to practice? 3 Mel Murphy 1 PSY1SFP 10/3/2024 By the end of SFP This will make sense! …You might even think this is funny (or not). Field (2017) 4 Focus of 1st part of ITRIP Field (2017) 5 WHY TALK ABOUT CONCEPTS AND MEASUREMENT? Scientific communication Theory development Definition Language Outcomes Observable, quantifiable 6 Mel Murphy 2 PSY1SFP 10/3/2024 EVIDENCE-BASED DEFINITIONS ARE IMPORTANT: THEORY DEVELOPMENT PERSPECTIVE Ideas Theory Prediction Explanation ! 7 CONSIDERATIONS OF THE SCIENTIFIC METHOD Christensen, L., Johnson, R., Johnson, R. B., Turner, L., Christensen, L., Johnson, R., Johnson, R. B., & Turner, L. (2015). Research methods, design, and analysis ebook pdf, global edition. Pearson Education, Limited. (p. 21) 8 EVOLUTION OF THEORY THROUGH RESEARCH C hristensen, L., Johnson, R., Johnson, R. B., Turner, L., C hristensen, L., Johnson, R., Johnson, R. B., & Turner, L. (2015). Research m ethods, design, and analysis ebook pdf, global edition. Pearson Education, Lim ited. (p. 36) 9 Mel Murphy 3 PSY1SFP 10/3/2024 From theory to hypothesis A K Theory N O C B X F Y Operationalisation Real World Hypothesis y = f (x) (Ong 2014) 10 WHAT IS A CONCEPT? A family of related conceptions (‘things’) May be simple and concrete (wealth, fitness) or complex and abstract (happiness, compassion) Clarity of concept depends on our agreement about “relatedness” of the conceptions (“things”) 11 COMPLEX CONCEPTS OFTEN OVERLAP... Happiness Arousal Anxiety Anger (Ong 2014) 12 Mel Murphy 4 PSY1SFP 10/3/2024 WHAT ARE THESE? 13 14 WHAT DOES THIS GUY EAT? 15 Mel Murphy 5 PSY1SFP 10/3/2024 MEANING OF CONCEPTS In reality, concepts (e.g., “cool”) have no real (intrinsic) meaning are represented by our shared experience and knowledge change over time (evolve with use) 16 Working with concepts Theory (Nominal definition) (Operational definition) Real World (Ong 2014) 17 WHY SO MUCH FUSS ABOUT CONCEPTS? Operationalization: Measurable Variables: Reliability: Validity: Experimental Control: Defining abstract concepts in measurable terms, allowing for empirical observation. Ensuring clarity on how to translate theoretical ideas into concrete, observable variables. Identifying and defining variables that can be quantified or observed. Enabling researchers to collect numerical data, facilitating statistical analysis. Ensuring consistency and stability in measurement. Employing reliable measures that yield consistent results upon repetition. Ensuring that a measurement accurately reflects the intended concept. Valid measures effectively capture the underlying construct without introducing bias. Minimizing external influences to isolate the impact of the variable under investigation. Facilitating the establishment of cause-and-effect relationships. 18 Mel Murphy 6 PSY1SFP 10/3/2024 THE FUSS ABOUT CONCEPTS? TRANSLATION AND COMMUNICATION Hypothesis Testing: Replicability: Sampling: Measurement Scales: Statistical Measures: Quantitative Analysis: Formulating clear and testable hypotheses based on measurable concepts. Ensuring that research findings can be duplicated by other researchers. Selecting a representative subset of a population for study. Strengthening the reliability and generalizability of scientific knowledge. Enhancing the external validity and generalizability of research findings. Employing statistical indices such as mean, median, standard deviation, etc., to summarize and describe data. Facilitating the comparison of results and the identification of patterns in the data. Utilizing statistical methods to analyze and interpret numerical data. Using statistical tests to assess the significance of observed differences or relationships. Understanding different scales of measurement (nominal, ordinal, interval, ratio) and their implications for data analysis. Choosing appropriate measurement scales based on the nature of the variables. Enabling researchers to draw objective conclusions and identify patterns in the data. 19 EVIDENCE-BASED DEFINITIONS ARE IMPORTANT: PRACTICAL AND ETHICAL PERSPECTIVES Limit bias and assumptions Evidence vs Assumptions Lived experience vs expectation Reduce researcher bias Improved definition Improve accuracy Measurement Interpretation Conclusions “Inclusive practice” Perspective of individual Considering each of these factors improves theory and application 20 ASSESSMENT 3: MENTI ACTIVITY Let’s start developing our own research question What do you think of when you consider the concept of wellbeing? What other concept would be interesting/useful to investigate in relation to wellbeing? Or go to: https://www.menti.com/al213qur5or9 Or enter code: 2670 5700 at www.menti.com 21 Mel Murphy 7 PSY1SFP 10/3/2024 FOR TUTORIAL DISCUSSION THIS WEEK: FROM THE WORD CLOUD, WHAT DO WE SEE AS KEY ELEMENTS OF WELLBEING? What kinds of questions could we ask to understand wellbeing? How should we define our indicators? What is the best method to assess these indicators? What other factors should be considered? If we were to create questionnaire, what would be good to know in order to understand the sample? Demographics? Nominal/categorical variables? 22 Defining and measuring a concept For Example, Compassion Nominal Definition Willingness to help others in need (and in trouble) Operational Definition (i.e., quantifiable) Help lost children find their parents Put a tiny bird back in its nest Donate regularly to charity appeals …. (and so on) Note: number of items validated provide a ‘score’ 23 Operational Definitions Single indicators (simple concepts) Heart rate (arousal) Pupillary dilation (interest) Blood cortisol (stress) Multiple indicators (complex concepts) Spielberger State-Trait inventory (anxiety) Rosenberg Self-Esteem scale (self-esteem) Beck Depression inventory (depression) 24 Mel Murphy 8 PSY1SFP 10/3/2024 Measuring Concepts - Single Indicators popularity of album number of downloads alcohol consumption liquor bottles for collection amount of foot traffic wear on floor and steps interest in photo number of ‘likes’ on Insta 25 Single Indicators (cont..) popularity of movies IMDB ratings controversy of issue Reposts on Facebook neighbourhood safety Crime statistics concern for punctuality Accuracy of watch setting 26 Measuring Concepts - Multiple Indicators On the whole, I am satisfied with myself. At times I think I am no good at all. I feel that I have a number of good qualities. I am able to do things as well as most other people. I feel I do not have much to be proud of. I feel that I’m a person of worth, at least on an equal plane with others. I certainly feel useless at times. I wish I could have more respect for myself. All in all, I am inclined to feel that I am a failure. I take a positive attitude toward myself. [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] What do you think this scale measures? 27 Mel Murphy 9 PSY1SFP 10/3/2024 Multiple Indicators (cont..) Are you preoccupied with gambling (e.g., reliving past experiences, devising winning strategies, thinking of ways to get money to gamble)? Have you tried unsuccessfully to control, cut back or stop gambling? Have you been restless or irritable on occasions when you cut back or stop gambling? Do you, at times, gamble to escape problems, relieve stress or other bad feelings? Having lost money, have you returned another day to get even? Have you lied to someone to conceal the extent of your gambling? Has your gambling jeopardized important relationships, or study or job opportunities? What do you think this scale measures? 28 CONSTRUCTS Constructs are concepts made measurable. They are usually multiple-indicator measures of complex concepts (e.g., IQ, sensation seeking, emotional intelligence, self-esteem). Their meanings may esoteric to an area of study (e.g., psychology) and may not be appreciated in general usage. IQ is a construct that measures the concept of intelligence. Example: 29 Example: IQ (10 or more subscales) Verbal IQ Information Vocabulary Arithmetic Comprehension Similarities Performance IQ Picture arrangement Picture completion Block design Object assembly Digit symbol Note: Though verbal and performance components can be used separately, their correlation is moderately high (e.g., r =.70). In other words, they overlap by about to a certain extent. 30 Mel Murphy 10 PSY1SFP 10/3/2024 MEASUREMENT OF A CONCEPT Scale How is it classified or quantified? Reliability Is it reproducible? Validity Does it behave as we expect? Reading: Field, A (2017). Chapter 1 -section 1.6.2(starts pg. 10) 31 M03_HOWI4994_03_SE_C03.QXD LEVELS OF MEASUREMENT 10/11/10 15:00 Page 46 Nominal (or categorical) Ordinal (or ranked) 46 Interval Ratio PART 1 THE BASICS OF RESEARCH FIGURE 3.1 The different types of scales of measurement and their major characteristics 32 Dichotomous, binomial or binary variables These are merely variables which are measured using just two different values. (The term dichotomous is derived from the Greek meaning equally divided or cut in two: dicho is Greek for apart, separate or in two parts while ‘-ous’ is Latin for characterised by.) For example, one category could be ‘friend’ while the other category would be anyone else. Multinomial variables When a nominal variable has more than two values it is described as a multinomial, polychomous or polytomous variable (poly is Greek for many). We could have the four categories of ‘friend’, ‘family member’, ‘acquaintance’ and ‘stranger’. Each value or category of a dichotomous or multinomial variable needs to be identified or labelled. For example, we could refer to the four categories friend, family member, acquaintance and stranger as category A, category B, category C and category D. We could also refer to them as category 1, category 2, category 3 and category 4. The problem with this is that the categories named in this way have been separated from their original labels – friend, family member, acquaintance and stranger. This kind of variable may be known as a nominal, qualitative, category, categorical or frequency variable. Numbers are simply used as names or labels for the different categories. We may have to use numbers for the names of categories when analysing this sort of data on a computer. The only arithmetical operation that can be applied to dichotomous and multinomial variables is to count the frequency of how many cases fall into the different categories. NOMINAL (CATEGORICAL) SCALE Rule (A ≠ B ≠ C) Quantitative variables When we measure a quantitative variable, the numbers or values we assign to each person A ‘naming’ or labelling variable or case represent increasing levels of the variable. These numbers are known as scores since they are represent amounts of something. A simple example of a quantitative variable Things in one category different from things in another category in terms of attributes. Can be very arbitrary Examples sex (XX, XY…+)/ gender (male, female, A, T, +) occupation (plumber, electrician …) country of birth (Australia, US …) political party (Liberal, Labor …) 33 Mel Murphy 11 PSY1SFP 10/3/2024 EXAMPLE 1: MEASURING HAPPINESS Nominal Are you happy now? (please tick ONE box only) No Yes 🙁 😃 34 ORDINAL (RANK) SCALE Rule (A < B < C) Things in one category are more or less than things in another category in terms of units of an attribute that is specified but not quantified Examples hotel rankings (1 to 6 stars) academic grades (A to D, or N) how much you like a person (1 – 10) Musical notes 35 EXAMPLE 2: MEASURING HAPPINESS Ordinal (Verbal Rating Scale) How happy are you now? (please tick ONE box only) not at all slightly moderately very extremely 36 Mel Murphy 12 PSY1SFP 10/3/2024 RESEARCH AND CLINICAL MEASURES 37 INTERVAL AND RATIO SCALES Rule (A – B = B - C) Things in one category are more or less than, and to some comparable extent, things in another category in terms of units of one attribute that is quantified Ratio scales have a true (meaningful) zero Examples Time (R) IQ (I) Temperature (I) Weight (R) 38 EXAMPLE 3: MEASURING HAPPINESS Interval (Visual Analogue Scale) How happy are you now? (please tick anywhere along the line) not at all extremely 39 Mel Murphy 13 PSY1SFP 10/3/2024 RESEARCH AND CLINICAL MEASURES 40 RESEARCH AND CLINICAL MEASURES Saccades and fixations: Example of saccades and fixations while reading a sentence. We do not move our eyes smoothly across the text. Reading consists of forward and backwards saccades and fixations. American Academy of Ophthalmology. Saccades and fixations. https://www.aao.org/image/saccades-fixations Accessed March 2024. 41 A HIGHER LEVEL OF MEASUREMENT We strive for a higher level of measurement wherever possible because: it provides more information it is more precise it is easier to statistically analyse the data because there are more statistical tests available for interval / ratio data 42 Mel Murphy 14 PSY1SFP 10/3/2024 CONCEPT CHECK: KEY CHARACTERISTICS OF GOOD RESEARCH DESIGN Match the Term with the Correct Meaning 43 SUMMARY Concepts Definitions Measurement Shared understanding of phenomena Given meaning Based on understanding, a set of agreed upon characteristics More precise definition allows for more accurate measurement Comprehensive Strive for precision Objective observation Replication 44 NEXT WEEK: RELIABILITY AND VALIDITY 45 Mel Murphy 15