Research Question Types and Survey Design

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What type of question allows respondents to provide spontaneous answers, often rich in information?

Forced-choice questions

Open-ended questions (correct)

Leading questions

Likert scale

What issue is most likely to arise when questions are worded with double negatives?

Bias in responses

Increased clarity

Enhanced response accuracy

Reduced construct validity (correct)

What does 'Yea-saying' refer to in survey responses?

Respondents agree with every item (correct)

Respondents remain neutral on all items

Respondents disagree with every item

Respondents analyze each item thoughtfully

Which response pattern occurs when individuals provide the same response to all questions regardless of content?

Response set Signup and view all the answers

What is the main characteristic of the semantic differential format?

Respondents rate objects on a scale anchored by adjectives Signup and view all the answers

What is observer bias?

When the expectations of the observer influence their interpretation of study outcomes Signup and view all the answers

Which sampling method ensures that all members of the population have an equal chance of being included in the sample?

Probability sampling Signup and view all the answers

Which of the following best describes stratified random sampling?

Randomly selecting individuals from predetermined demographic categories Signup and view all the answers

What does the term 'confound' refer to in research?

An alternative explanation for a research question Signup and view all the answers

What type of research design involves participants being tested on the dependent variable before and after exposure to the independent variable?

Pretest/posttest design Signup and view all the answers

In systematic sampling, how is the sample selected?

By counting off from a predefined list using random numbers Signup and view all the answers

Reactivity in research occurs when participants alter their behavior due to what?

Knowing they are being observed Signup and view all the answers

Which type of variable is specifically manipulated by the researcher in an experiment?

Independent variable Signup and view all the answers

What is the main purpose of counterbalancing in studies?

To minimize order effects by varying the order of conditions Signup and view all the answers

What does a mediating variable explain in an association between two other variables?

It accounts for the change observed in the second variable Signup and view all the answers

What is the primary concern of the third variable problem in correlation studies?

The relationship may be explained by an unmeasured variable affecting both Signup and view all the answers

What differentiates snowball sampling from other sampling methods?

It relies on participants to recruit other participants Signup and view all the answers

What does a weak effect size indicate in research?

A negligible relationship between two variables Signup and view all the answers

What type of sampling uses readily available participants, often leading to a biased sample?

Convenience sampling Signup and view all the answers

What effect does being exposed to one condition have on participants in an experiment?

It can alter how they react to subsequent conditions. Signup and view all the answers

Which of the following best describes the purpose of regression analysis?

To predict the value of a dependent variable based on one or more independent variables. Signup and view all the answers

In the context of validity threats, what would be a significant concern for post-test only designs?

Lack of pre-test data to compare results. Signup and view all the answers

What is a characteristic of factorial design in experimental research?

It allows for the evaluation of interactions between multiple predictors. Signup and view all the answers

Which aspect of quasi-experiments is most critical for maintaining validity?

Managing selection biases and external factors. Signup and view all the answers

What is a major disadvantage of using open-ended questions in surveys?

Answers are challenging to categorize and analyze efficiently. Signup and view all the answers

Which of the following best describes 'fence sitting' in survey responses?

Providing indifferent responses to avoid picking a side. Signup and view all the answers

What effect do leading questions typically have on survey results?

They can influence responses by suggesting a specific answer. Signup and view all the answers

Which response pattern is characterized by individuals consistently agreeing with every survey item?

Acquiescence Signup and view all the answers

What can be a consequence of question order in surveys?

Early questions can influence understanding and answers to later questions. Signup and view all the answers

What is observer reactivity in psychological research?

When participants alter their behavior because they know they are being watched Signup and view all the answers

What is a biased sample most likely to result in?

Results that do not generalize well to the target population Signup and view all the answers

Which sampling method involves selecting individuals from specific demographic groups and then randomly choosing from those groups?

Stratified random sampling Signup and view all the answers

What is the role of a confound in a research study?

To serve as an alternative explanation for results Signup and view all the answers

What distinguishes random assignment from random sampling?

Random assignment places participants into different groups Signup and view all the answers

In a repeated measures design, what is a primary concern that researchers must address?

Order effects that might distort results Signup and view all the answers

What does an effect size of 0.50 indicate in research?

There is a moderate strength of association Signup and view all the answers

What is the main purpose of oversampling in research?

To ensure underrepresented groups are accurately reflected Signup and view all the answers

Which of the following best describes systematic sampling?

Every nth member of a population is selected randomly Signup and view all the answers

What does the term 'cross-lag correlation' relate to in research?

Examining if early measurement of one variable predicts later measurement of another Signup and view all the answers

In which sampling method are participants asked to refer others for the study?

Snowball sampling Signup and view all the answers

Which of the following is true regarding within-groups design?

All participants are exposed to all levels of the independent variable Signup and view all the answers

What does a mediating variable in research indicate?

It explains why two other variables are related Signup and view all the answers

What is the primary concern with self-selection in research?

It often limits sample diversity Signup and view all the answers

Study Notes

Question Types in Research

Open-ended questions: Allow respondents to answer freely, providing rich detail. These are less efficient due to needing categorization and coding.
Forced-choice questions: Respondents select the best option from a predefined set, often used for preferences or contemporary issues.
Likert scales: Respondents rate agreement with a statement on a scale, e.g., strongly agree to strongly disagree.
Semantic differential format: Respondents rate a target object on a numeric scale anchored by opposing adjectives, e.g., good-bad, strong-weak.
Leading questions: Phrased to elicit a specific response.
Double negatives: Questions with two negatives can confuse respondents, negatively impacting construct validity.

Survey Design Considerations

Question order: Early questions can influence later responses.
Response set: (Non-differentiation): Respondents consistently answer similarly to all questions.
Yea-saying/Acquiescence: Respondents tend to agree with all items, regardless of content.
Nay-saying: Respondents tend to disagree with all items, regardless of content.
Fence sitting: Respondents choose middle options, particularly with controversial items.
Social desirability bias: Respondents may answer dishonestly to avoid appearing socially undesirable.

Observer Bias and Effects

Observer bias: Observer expectations influence interpretation of outcomes.
Observer effects: Participant behavior adapts to match observer expectations.
Reactivity: Participants change behavior when aware of observation.

Sampling Methods

Population: All people or products of interest.
Sample: A smaller group from the population.
Biased/Unrepresentative sample: Certain population members are more likely to be selected.
Unbiased/Representative sample: All members have an equal chance of selection.
Convenience sampling: Selecting readily available participants.
Self-selection: Participants volunteer.
Probability sampling: Every member has an equal chance of selection.
Simple random sampling: Randomly selecting participants, like drawing names from a hat.
Cluster sampling: Selecting whole groups (clusters) randomly.
Multistage sampling: Combining cluster and random sampling.
Stratified random sampling: Random selection within pre-defined demographics.
Oversampling: Overrepresenting one or more groups.
Systematic sampling: Using a random number generator to select participants at intervals.
Quota sampling: Similar to stratified sampling, but not a random selection.
Snowball sampling: Participants refer others.
Purposive sampling: Recruiting specific participants.

Effect Sizes and Correlation

Effect size: Strength of association; larger values indicate more accurate predictions.
- Values of 0.10 or -0.10 are weak; 0.30 or -0.30 are moderate; and 0.50 or -0.50 are strong.
Construct and statistical validity: Important factors when evaluating association claims.
Moderating variable: The relationship between two variables changes with a third variable.
Cross-sectional correlations: Correlation of two variables measured simultaneously.
Autocorrelations: Correlation of one variable with itself at different time points.
Cross-lag correlations: Correlation between an earlier measure of one variable and a later measure of another (best for temporal precedence).
Third variable problem: A possible third variable explaining the correlation between two variables.
Multiple regression statistics: Beta and significance values assess associations.
Mediating variable: A variable that explains the relationship between other variables.

Experimental Design

Experiment: Manipulating a variable to measure its effect.
Independent variable: Variable that's manipulated.
Dependent variable: Variable affected by the independent variable.
Control variables: Variables held constant.
Confound: Alternative explanations for results (threat to internal validity).
Selection effects: Participant differences systematically affecting the independent variable groups.
Independent groups design: Different groups experience different levels of the independent variable.
- Posttest-only design: Random assignment, single dependent variable measure.
- Pretest-posttest design: Random assignment, dependent variable measured before and after.
Within-groups design: Same group experiences all levels of the independent variable.
- Concurrent measures design: All levels of IV presented simultaneously.
- Repeated measures design: Dependent variable measured multiple times.
Carryover effects: An effect from one condition affecting another.
- Practice effects: Changes in performance due to repetition.
- Counterbalancing: Presenting conditions in various orders to minimize order effects.
Order effects: The order of conditions impacting participant responses.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Description

Explore the various types of questions used in research, such as open-ended and Likert scale questions. Understand design considerations like question order and response bias. This quiz will test your knowledge of effective research survey techniques.