Survey Methods and Issues

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

Which of the following is NOT a feature to consider when writing survey questions?

Choosing appropriate response options

Defining research objectives

Incorporating complex jargon for clarity (correct)

Careful question wording

What is the purpose of quota sampling in research?

To focus on a single demographic for detailed analysis

To create a sample that mirrors the population's subgroup composition (correct)

To simplify the research process by selecting a random sample

To ensure every participant has an equal chance of selection

Which method is suitable for ensuring equivalent groups in an experiment?

Employing random assignment (correct)

Using a convenience sample

Observing existing groups

Selecting participants based on availability

What primarily determines internal validity in an experiment?

The presence of confounding variables Signup and view all the answers

What is a primary purpose of surveys?

To study relationships between variables Signup and view all the answers

What is the goal of establishing external validity in research?

To ensure findings can be generalized to other populations Signup and view all the answers

Which of the following is a disadvantage associated with surveys?

Potential for social desirability bias Signup and view all the answers

What type of questions should be avoided in surveys due to potential confusion?

Double-barreled questions Signup and view all the answers

Which scale type is NOT mentioned as a close-ended question option?

Likert scale Signup and view all the answers

What is an important aspect of finalizing a survey?

Ensuring the survey is free from errors Signup and view all the answers

In terms of survey administration, which of the following is a disadvantage of using internet surveys?

Potential for respondent distraction Signup and view all the answers

Which of the following represents a common error in question construction?

Using vague terms Signup and view all the answers

What is a characteristic of close-ended survey questions?

Responses are limited to specific options Signup and view all the answers

What is the primary difference between a population and a sample?

A population includes all members of a group, while a sample is a subset of that group. Signup and view all the answers

What does the confidence interval represent in statistical analysis?

The range of plausible values for the population value. Signup and view all the answers

Which sampling technique involves dividing a population into subgroups and randomly sampling from each subgroup?

Stratified random sampling Signup and view all the answers

Which type of sampling allows researchers to conduct studies with less money and time, but may lack generalizability?

Non-probability sampling Signup and view all the answers

What is a potential threat to external validity when conducting surveys?

Low response rate. Signup and view all the answers

What is an example of non-probability sampling?

Purposive sampling. Signup and view all the answers

Which sampling technique gives every member of the population an equal chance of being selected?

Simple random sampling Signup and view all the answers

What term refers to the members of the population that are accessible to participate in a study?

Sampling frame Signup and view all the answers

Study Notes

Surveys

Method for asking people about themselves and studying relationships between variables.
Can be qualitative or quantitative.
Close-ended questions have pre-determined answers while open-ended questions allow for free responses.

Surveys: Issues

Response sets: Respondents might answer questions in a particular manner due to social desirability.
Tendency to answer all questions in a similar manner: More prevalent with sensitive topics.
- Over-reporting: Respondents might overestimate their participation in socially acceptable behaviors. (e.g., exercise, charity donations)
- Under-reporting: Respondents might underestimate their participation in socially unacceptable behaviors. (e.g., drug use)

Constructing Good Questions

Clearly define research objectives as questions should be linked to them.
Common questions include those about attitudes, beliefs, facts, demographics, and behaviors.
Careful wording is crucial for clear communication.

Avoiding Poor Question Wording

Avoid using jargon, vague terms, poor sentence structure, overwhelming phrasing, and misleading information.
Avoid negative wording as it can be confusing.
Avoid unnecessary complexity and words that are not easily understood.
Avoid double-barreled questions that combine two separate questions into one.
Avoid loaded questions that contain emotionally charged words which can create bias.

Rating Scales

Used with close-ended questions.
Various types of scales:
- Graphic rating scale.
- Semantic differential scale.
- Non-verbal scale.

Finalizing the Survey

Survey must be neatly typed and error-free.
Scales should be consistent throughout the survey.
Start with interesting questions to keep respondents engaged.
Keep the questionnaire concise.

Administering the Survey

Methods:
- In-person to groups or individuals.
- Mail surveys.
- Internet surveys.
- Other technologies.

Administering the Survey: Pros and Cons

Pros:
- Less costly than interviews.
- Ensures anonymity.
Cons:
- Difficulty understanding questions.
- Potential for boredom and distraction.
- Ensuring all participants meet the study criteria.

Population vs Sample

Population: The entire set of events or individuals of interest.
Sample: A subset drawn from a population
Parameter: Numbers summarizing a population.
Statistic: Numbers summarizing a sample.

Population vs Sample: Applications

Statistics are used to make assumptions about populations.
Surveys rely on sampling as it is impossible to survey everyone in a population.
Researchers make inferences about populations based on samples.
Confidence intervals are used to represent the range of plausible values for the population value.

Evaluating Samples

External validity: Degree to which research findings can be generalized to the intended population.
Threats to external validity:
- Sampling frame: Members of the population accessible for participation.
- Response rate: Percentage of individuals who complete the survey.

Sampling Techniques

Two basic techniques:
- Probability Sampling.
- Non-probability Sampling.

Probability Sampling

Requires a complete list of all members of the population.
Types:
- Simple random sampling: Each member has an equal chance of being selected.
- Stratified random sampling: Population divided into subgroups (strata), then random samples are taken from each strata.
- Cluster sampling: Clusters are identified and randomly sampled from them.

Non-Probability Sampling

No complete list of population members.
Less time and money, but findings may not be generalizable.
Types:
- Convenience sampling: Samples whoever is most convenient.
- Purposive sampling: Samples individuals meeting predetermined criteria.
- Quota sampling: Sample reflects the numerical composition of different subgroups within the population.

Basic Experiments

Internal validity: Confidence in the cause and effect relationship.
High internal validity: Well-designed experiment confidently establishes the IV as the cause of the DV.
Low internal validity: Confounding variables present, making it unclear if the IV is solely responsible for the DV.
External validity: Deals with generalizability - ability to apply results to different populations.

Establishing Internal Validity

Using a well-designed research design.
Controlling for extraneous variables.

Basic Experiments: Designs

IV with two levels, creating two groups or conditions.
Basic steps:
- Selecting participants (probability or non-probability sampling).
- Assigning participants to IV levels (randomly, eliminating selection differences).
- Introducing the IV (with an operational definition).
- Measuring the DV (with an operational definition).
Three basic designs:
- Independent groups.
- Repeated measures.
- Matched pairs.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Description

Explore the intricacies of survey methodologies, including both qualitative and quantitative approaches. Learn about the challenges associated with survey responses, such as social desirability and question construction. This quiz focuses on crafting effective survey questions linked to research objectives.