Research Question: Surveys, Validity, and Reliability
20 Questions
0 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to Lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

Which research method is best suited for exploring the relationship between self-concept clarity and interest in joining a fraternity or sorority?

  • Qualitative interview
  • Correlational study (correct)
  • Experimental study
  • Observational study

A correlational study can establish cause-and-effect relationships between variables.

False (B)

What is the primary purpose of using a 'scale' in research?

To measure a variable

A response bias where a person tends to agree with every statement in a scale, regardless of the item's content, is known as ______ response set.

<p>acquiescent</p> Signup and view all the answers

Match the following types of validity with their definitions:

<p>Content Validity = The degree to which the items are representative of the range of material that should have been covered. Criterion Validity = How strongly the scale relates to a particular outcome or behavior. Construct Validity = Extent to which the scale actually measures the construct intended. Face Validity = Degree to which the scale appears to measure such interest.</p> Signup and view all the answers

What does 'self-concept clarity' refer to in the context of the research?

<p>How clear and certain a person is about who they are. (B)</p> Signup and view all the answers

Using a single question to measure a variable is always the best approach to ensure accuracy.

<p>False (B)</p> Signup and view all the answers

What technique is used to handle reverse-coded items before summing participant responses on a scale?

<p>Reverse-coding</p> Signup and view all the answers

__________ is the statistic used to measure the strength of an association between two variables.

<p>Correlation</p> Signup and view all the answers

Match the following research terms to their definitions:

<p>Reliability = The measure's consistency. Validity = The measure's accuracy. Internal Consistency = Degree to which individual items in the scale interrelate or connect with one another. Test-Retest Reliability = Measure's temporal stability, or ability to produce similar measurements across different time periods.</p> Signup and view all the answers

Why is it essential to evaluate a scale's reliability before assessing its validity?

<p>Because an unreliable scale cannot be valid. (B)</p> Signup and view all the answers

High face validity always indicates a strong and unbiased measurement.

<p>False (B)</p> Signup and view all the answers

What type of validity is concerned with how well a scale measures the intended construct and not extraneous concepts?

<p>Construct validity</p> Signup and view all the answers

A scale demonstrates strong __________ validity if it does not correlate with measures of unrelated variables.

<p>discriminant</p> Signup and view all the answers

Match the terms with the description

<p>Simple Random Sampling = Each first-year student has the same probability of being selected for our study. Stratified Random Sampling = Split our population into two or more subgroups based on some known characteristic and then use simple random sampling within each subgroup. Area Probability Sampling = Separate the population into subgroups based on geographic area and then randomly sample from each area Convenience Sampling = Distributing our survey to first-year students in the dining hall during breakfast.</p> Signup and view all the answers

What is the primary reason for using distractor items in a survey?

<p>To mislead participants about the true purpose of our survey (D)</p> Signup and view all the answers

It is always ethical to ask participants any questions as long as informed consent is obtained.

<p>False (B)</p> Signup and view all the answers

What is Cronbach's alpha used for?

<p>Assessing the internal consistency of a scale</p> Signup and view all the answers

The larger the __________, the greater the variability there is among the scores in a data set.

<p>standard deviation</p> Signup and view all the answers

Match the Correlation Values with Statements

<p>r = 0 = The variables are unrelated. r = 1 = Perfect positive relation: Knowing one variable perfectly predicts the other. r = -1 = Perfect negative relation: Knowing one variable, can predict the other's measurement, but in the opposite direction.</p> Signup and view all the answers

Flashcards

Associations in Research

Associations are systematic patterns that we find in data. For example, are the students most interested in going Greek the ones with the greatest self-concept clarity?

Self-Concept Clarity

Self-concept clarity reflects how clearly, confidently, and consistently people describe their sense of self.

Likert Scale

A Likert scale presents a series of statements which participants evaluate using a predetermined set of response alternatives.

Acquiescent Response Set

An acquiescent response set is a bias where a person tends to agree with every statement in a scale, regardless of the item's content.

Signup and view all the flashcards

Error of Central Tendency

The error of central tendency reflects some participants' tendency to avoid the highest and lowest ends of the response alternatives when making judgments.

Signup and view all the flashcards

Face Validity

Face validity : degree to which the scale appears to measure such interest.

Signup and view all the flashcards

Content Validity

Content validity reflects the degree to which the items are representative of the range of material that should have been covered

Signup and view all the flashcards

Construct Validity

Construct validity: extent to which the scale actually measures the construct we want.

Signup and view all the flashcards

Convergent Validity

Convergent validity, or the degree to which scores on the scale correlate with participants' scores on measures of other theoretically related variables.

Signup and view all the flashcards

Discriminant Validity

Discriminant validity-For a scale to have high discriminant validity, it should not correlate with measures of unrelated variables.

Signup and view all the flashcards

Criterion Validity

Criterion validity is how strongly the scale relates to a particular outcome or behavior. If people score high on our scale, they really should be more likely to join a Greek organization.

Signup and view all the flashcards

Concurrent Validity

Concurrent validity is present at the same time we measure the participants' attitudes.

Signup and view all the flashcards

Predictive Validity

Predictive validity coincides with a criterion that occurs in the future

Signup and view all the flashcards

external validity

External validity indicates our confidence in generalizing our study's finding

Signup and view all the flashcards

P-Value

We use the symbol p to indicate probability level. if the probability (p) is less than 5%, we conclude that our finding is statistically significant

Signup and view all the flashcards

Experimental studies

It involves manipulating or controlling one or more variables to see if they impact another variable

Signup and view all the flashcards

Study Notes

  • The chapter aims to differentiate correlational and experimental studies and describe how to test a research question using surveys, addressing biases, reliability, and validity.

Introduction to Research Question

  • Humans have a basic need to connect with others
  • College fraternities and sororities attract some students, while others view them negatively.
  • It is possible to argue the different viewpoints of the students in regards to fraternities - indicating a good research question.
  • The scientific method, including literature reviews, should be used to investigate the research question.

Reviewing Literature

  • First step in reviewing literature is to consider if Greek life members differ from non-members

Self-Concept

Differences in groups might influence decisions to join Greek life.

  • Self-concept clarity is how clearly people define themselves.
  • Some people easily list personality traits to define themselves, while others struggle.
  • Self-concept clarity reflects how clearly, confidently, and consistently people describe themselves

Search strategy for information

  • Research should not be limited to Pyschology specific databases
  • Use other resources such as ERIC (Education Resources Information Center)
  • Jennifer D. Campbell is a researcher who studies self-concept clarity. Studies with her should be reviewed

Study: Differences Between Greek and Non-Greek College Students

  • Study explored question of how women wanting to join a sorority differ from others.
  • First-year female students were surveyed multiple times during their first year of college.
  • Women wanting to rush a sorority had a higher need for exhibitionism, a willingness to attend parties where they did not fit in, and higher social self-esteem, but not higher overall self-esteem.

Study: Risky Drinking in College

  • Examined differences between students who did and did not join a Greek organization.
  • First-time students were surveyed at college orientation and at the end of the fall and spring semesters.
  • Students joining fraternities or sororities were more extraverted, valued partying, were more likely to engage in risky behaviors involving substance use.
  • Fraternities and sororities may attract students needing social interaction and sensation-seeking.

Study: Self-Efficacy and Learning in Sorority and Fraternity Students

  • Compares Greek and non-Greek students on self-efficacy and performance.
  • Self-efficacy: an individual's belief they can achieve a desired outcome.
  • Greek students had significantly higher self-efficacy.

Study: Greek Affiliation and Attitude Change in College Students

  • Examined changes in students over four years of college based on Greek affiliation.
  • Students were surveyed when starting college and upon graduation and categorized as "Greek," "ex-Greek," or independent.
  • Greek students were less autonomous in relation to family and peers and these differences existed before joining Greek organizations.
  • Initial differences account for changes in students while in college, not values of Greek organizations

Study: Self-Concept Clarity

  • People with low self-esteem have low self-concept clarity.
  • Low self-esteem participants were less extreme and confident in self-descriptions, suggesting less certainty.
  • Low self-esteem participants were less consistent in self-ratings over testing sessions.
  • Low self-esteem reflects less consistency in self-descriptions when comparing general and situation-specific ratings.
  • Low self-esteem participants showed less internal consistency in self-descriptions.

Study: Self-Concept Clarity Scale

  • Demonstrated SCC Scale is reliable and valid self-report measures of self-concept clarity

Study: Self-Concept Clarity's Role

  • Explored self-konwledge accuracy
  • Individuals with greater clarity have greater accuracy in self-knowledge, which indicates more agreement between self and others when rating personality traits and frequency of everyday behavior
  • Higher self-concept clarity allowed more accuracy in predicting actual behavior on a novel task.

Study: Relation Between Self-Concept Clarity

  • Explored relations between self-concept clarity, relationship satisfaction, and relationship commitment.
  • Individuals with higher concept clarity reported greater satisfaction and commitment with relationships and manipulating self-concept clarity.
  • Concept clarity had higher satisfaction and commitment than those in a condition with self-concept confusion.
  • Concept clarity is related to quality of romantic relationships.

Key Findings

  • College students joining fraternities and sororities differ from other students in personality traits and these differences predated joining
  • People have clearer, more accurate beliefs about themselves compared to others
  • Self-concept clarity relates to relationship satisfaction and commitment
  • No research specifically explores joining to fraternities

Study focus

  • Research question focuses on relationship between self-concept clarity with the interest of fraternity/sorority

Variable definitions

  • Self-concept clarity: how clear and certain a person is about who they are more able to give descriptions
  • Interest: Positive attitude toward joining a Greek organization

Research strategies:

  • Determine associations
  • Associations: Systematic patterns we find in data. Are the greatest interested in joining a group, the ones with a clearer picture of self?
  • Correlational studies: Best strategy to test associations between variables. Evaluates if changes align with changes in another.

A correlation

  • Statistic that measures the strength of association between two variables.
  • Enable a step further to examine relation to each other from examining "things" from a descriptive study.
  • Correlation does not determine or cause someone's intrest in joining a Greek organization.

Correlational studies

  • DO NOT allow drawing cause-and-effect
  • ONLY enables to explore variables relate to each other
  • Changing one variable causes changes in the other - needs experiment
  • Link needs to be established before making causal claims
  • Correlational studies help establish the link

Research collection:

  • Collect information about student's sense of self and intrest in joining a Greek organization
  • Individual's decision making processes might be understood using in depth interviews

Qualitative vs Quantitative Research

  • Qualitative might limit individual decisions
  • Qualitative research is useful without a specific variable
  • Quantitative data systematically collected from a group of individuals in order to apply data to larger populations

Qualitative Vs Quantitative research example

  • Researchers analyze college students self-concept clarity with intrest of joining a greek organization. To do this, group of college students will be asked.
  • Responses will evaluate associations of variables.

Research design

  • Determine how to measure variables: using self-report, what to ask
  • Researchers use open answers in qualitative
  • Potential questions include "How clear is your self-concept, you know, like, in general?"
  • Answers might include: "Crystal clear" or "Kinndd of hazy" or whatever

Closed ended questions

  • Participants have predetermined set of responses.
  • Could use likert scale: 1-7
  • Questions might be misunderstood- so it may not get accurate information

Variable complexity helps address these issues

  • Several questions or items measuring the same variable
  • A scale usally contains series of closed-ended questions
  • A Researcher sums a particpant's responses to questions to create a single score.
  • Random error is cancelled out when using multiple items rather than a single item.
  • The study will need two different scales: Self-concept clarity and if they have any intrest in joining greek life

Self-Concept Clarity (SCC) Scale

  • Reasearcher's routinely used already
  • Established measures reliable and valid
  • Published scaled helps because researchers have already established scale's quality and reliability

Other places to identify scales

  • Books and Online Guides
  • Example for Greek Life Study: Mental measurements yearbook

What is a likert scale?

  • Scale that measures one's attitude toward joining a fraternity or sorority
  • a summated ratings scale where the participants evaluate a series of statements using a set of response alternatives.

Types of judgements:

  • level of aggrement
  • frequency of occurance
  • Overall evolution
  • Each option has a descriptor label that corresponds with the data. The researcher uses value of all to measure particular variable.

Likert scale

  • Useful in Greek life study because its the same response
  • Participants will make judgements using same response, avoids confusion.
  • Phrasing items as statements to be judged instead of questions to be answered.
  • Best beginning is brainstorming by writing down items reflecting desired variable.

Biased brainstorming:

  • If preconveived or stereotypes - should collective some data about reasons joining a faternity and incorporatring a list.
  • Example potential Item: "Belonging to a Greek Organization Increases my chances of success"

Improve scale accuracy

  • By avoiding confusing your participants "Belonging to a Greek organization increases my chances of being successful."
  • Is being successful realated to 1) academic, 2) social, or 3) job prospects

Double-barreled item

  • Asks two diffrent things at the same time. "Joining a Fraternity or Sorority will help me meet my academic goals and meet others with similar goals."

Problem of confusing the participants

  • People can respond a midpoint or focus
  • If it's double barreled- item to avoid
  1. Joining a F/S will help me meet goals 2)belonging to F/S meet other students' goals

Avoid jargon, complex, or specfic terms they dont no

  • Example : "Rushing a faternity or sorority will make me more friends"

Account of reading level and vocab they understand

"Fraternities and Sorities are for 1) obtuse students who 2) distinctly lack erudite qualities"

Response set

  • Bias in how a person answers items to measure

Acquiescent Bias

  • agree with every statement

Reverse-coded

  • High scores have the opposite meaning
  • Original "Fraternities and Sorities offer a good way to spend time is changed to F/S are a waste of time"

Rephrasing statement

  • Don't say "not joining "
  • 1/2 scale opposite direction

Response alternative

  • Number of responsed partcipants
  • Simple respondes like true/false/yes/no are Forced choice which lead to several problems - 1) can't decide if a person has what response to choose 2) item is "true" and don't know

Third option

"Sometimes yes or sometimes no"

  • Selecting seems less extream average
  • Error of central tendency- means a tendancy to avoid highest/lowest end

More response is precision

  • How many question - test
  • 400 point will have illusion
  • Hard describe the data what can describe "Slightly disagree" with number

Alternatives and verbal descriptors

  • Agree/ Disagree
  • Important to show the variables correlate/relate

Calculating score

  • Use scales measure key variables: provide precision then items Participants like going Greek change with number
  • Simply summing responses = cannacling

Prevention method to stop canceling:

  • Reverse-coded response one scale
  • Assign numbers to the variable depending to know if it is working including reliability/validity
  • Must include key aspects like the affect on post college success

Face valitdity

" Does it test well and test people want?

Construct valitdty

" Do you want scale"?

Convergent Valitdty

"Scale scores correlate w/ measurement

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Quiz Team

Related Documents

Description

Explore correlational and experimental studies. Learn to test research questions using surveys, addressing biases. Understand reliability and validity in research. Review the scientific method, including literature reviews, to investigate research questions.

More Like This

Research Methods in Surveys
22 questions

Research Methods in Surveys

ProficientYtterbium avatar
ProficientYtterbium
Use Quizgecko on...
Browser
Browser