Questionnaire Design and Development
24 Questions
0 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to Lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is a primary goal of grouping questions by topic in a questionnaire?

  • To maintain respondent interest throughout the survey. (correct)
  • To minimize the need for demographic questions.
  • To confuse respondents and test their attention.
  • To avoid repetition of similar questions.

What should ideally precede demographic questions in a survey?

  • Difficult questions about the survey topic.
  • A detailed explanation of the survey's purpose.
  • Interesting and engaging questions. (correct)
  • Questions about respondents' previous survey experiences.

How do pilot tests differ from pretests in survey methodology?

  • Pilot tests involve a larger sample and test full implementation procedures. (correct)
  • Pretests are focused on demographic questions only.
  • Pilot tests only evaluate question wording while pretests assess the entire survey process.
  • Pilot tests are conducted post-survey to assess outcomes.

What is the main purpose of focus groups in survey research?

<p>To facilitate group discussions and gather diverse perspectives. (C)</p> Signup and view all the answers

When should surveyors conduct pilot tests?

<p>Well in advance of fielding the survey. (B)</p> Signup and view all the answers

What should be avoided in survey design to enhance participant experience?

<p>Overloading respondents with difficult questions in succession. (C)</p> Signup and view all the answers

Why might surveyors test new questions during a pilot test?

<p>To determine how respondents react to different question formats. (D)</p> Signup and view all the answers

What type of feedback is typically sought during focus group discussions?

<p>Personal opinions on the survey topic and questions. (B)</p> Signup and view all the answers

What is the primary benefit of using focus groups before developing a survey questionnaire?

<p>To identify the topics that are salient to the population. (D)</p> Signup and view all the answers

Which of the following best describes a key characteristic of focus group discussions?

<p>The interaction among participants can influence responses. (C)</p> Signup and view all the answers

What does social desirability bias influence in survey responses?

<p>The accuracy of responses related to sensitive subjects. (A)</p> Signup and view all the answers

What does a pretest aim to achieve in the survey development process?

<p>To identify if participants interpret questions as intended. (D)</p> Signup and view all the answers

Which of the following statements is true regarding the use of focus groups?

<p>Focus group responses must be interpreted with caution due to group dynamics. (B)</p> Signup and view all the answers

How can question wording affect survey responses?

<p>It can influence the pattern of answers given. (B)</p> Signup and view all the answers

In pretesting, what feedback do surveyors typically seek from interviewers?

<p>Insights into the wording and sequence of questions. (D)</p> Signup and view all the answers

Which survey format tends to yield different results according to the Pew Research Center's experiment?

<p>Forced choice format compared to agree-disagree format. (C)</p> Signup and view all the answers

What kind of questions do moderators typically use during focus group discussions?

<p>Broad questions to encourage open discussion. (C)</p> Signup and view all the answers

What may respondents understate due to social desirability bias?

<p>Voting behavior. (C)</p> Signup and view all the answers

Why is it important to conduct a pretest in the actual setting of the survey?

<p>To mimic real survey conditions and identify potential issues. (B)</p> Signup and view all the answers

What is one way researchers can encourage honesty in responses regarding sensitive topics?

<p>Providing response options that reflect infrequent behavior. (B)</p> Signup and view all the answers

What technique is commonly used by moderators to gain deeper insights during focus groups?

<p>Following up broad questions with more specific inquiries. (A)</p> Signup and view all the answers

Which survey method is likely to result in greater social desirability bias?

<p>Telephone interviews. (C)</p> Signup and view all the answers

When is it important to use identical wording for survey questions?

<p>When replicating earlier surveys for consistency. (A)</p> Signup and view all the answers

Which of the following statements is true regarding the forced choice format?

<p>It can produce varied results based on respondents' educational backgrounds. (D)</p> Signup and view all the answers

Flashcards

Focus Group

A research method where a group of people discuss a topic, often used to understand how people view a concept before creating a survey.

Focus Group Moderator

The person leading a focus group discussion, guiding the conversation to elicit responses about a topic.

Focus Group Questions

Broad questions used to generate detailed answers and explore topics, often in qualitative research.

Survey Pretest

A trial run of a survey, using a small sample of the target population to identify issues before the actual survey.

Signup and view all the flashcards

Pretest Protocol

The specific procedures used during a survey pretest, replicating the conditions of the actual survey.

Signup and view all the flashcards

Survey Questionnaire

A set of questions designed to gather data from participants in a survey, which are often finalized after a pretest.

Signup and view all the flashcards

Qualitative Research

A research approach focused on understanding concepts or ideas related to a topic.

Signup and view all the flashcards

Generalizability of Results

The ability to apply the findings of a research study to a larger population.

Signup and view all the flashcards

Modifying survey context

Changing the surrounding questions in a survey can affect observed changes over time.

Signup and view all the flashcards

Logical survey order

Organize survey questions by topic and in a logical progression.

Signup and view all the flashcards

Engaging introductory questions

Begin with interesting questions to encourage respondent participation.

Signup and view all the flashcards

Avoid overwhelming respondents

Space out challenging questions in a survey.

Signup and view all the flashcards

Demographic questions (timing)

Place sensitive questions like income and age later in the survey.

Signup and view all the flashcards

Pilot tests

Testing a survey with a sample population to evaluate responses and procedures.

Signup and view all the flashcards

Pilot test purpose

Identify potential issues with questions or procedures and analyze differences among groups.

Signup and view all the flashcards

Pilot test implementation detail

Testing full procedures of a survey, such as letters, incentives, and callbacks.

Signup and view all the flashcards

Frequency of pilot testing

Pilot tests are conducted before the actual survey to allow for changes to the questionnaire or survey procedures.

Signup and view all the flashcards

Focus groups

Gathering people to discuss survey topics in a group setting to gather feedback.

Signup and view all the flashcards

Focus groups vs pilot tests

Focus groups involve discussions among a group, whereas pilot tests involve responses to specific questions from a sample.

Signup and view all the flashcards

Forced-choice format

Presenting respondents with a set of alternative statements to choose from instead of an agree-disagree scale.

Signup and view all the flashcards

Social desirability bias

The tendency of respondents to provide answers that they believe will make them appear more socially acceptable.

Signup and view all the flashcards

Question wording impact

Slight changes in question wording can change responses.

Signup and view all the flashcards

Alternative response options

Providing a range of possible answers that allow more honest responses, such as including options for infrequent attendance in a church attendance question.

Signup and view all the flashcards

Interviewer presence impact

Social desirability bias is greater when an interviewer is present, compared to self-administered surveys.

Signup and view all the flashcards

Values questions

Questions designed to measure beliefs and attitudes about various social concepts.

Signup and view all the flashcards

Survey question format

The type of response format in a questionnaire, e.g., agree/disagree, forced choice.

Signup and view all the flashcards

Voting behavior survey

Surveys about voting where options allow for circumstances preventing voting, as well as actual voting.

Signup and view all the flashcards

Alcohol/drug use data

Data collected on alcohol/drug use that is often impacted by social desirability bias, leading to underreporting.

Signup and view all the flashcards

Study Notes

Questionnaire Design

  • Questionnaire design is a crucial part of the survey process
  • Accurate questions are essential for measuring public opinions, experiences, and behaviors
  • Accurate random sampling and high response rates are useless if information is gathered from poor questions
  • Good questionnaire design involves writing effective questions and arranging them logically
  • Design is a multi-stage process requiring attention to numerous details
  • Questions can be asked in varying detail and formats
  • Earlier questions can influence later answers
  • Measuring changes over time is important, requiring consideration of prior surveys' methods
  • Pilot tests or focus groups are conducted in the early stages of design
  • Pretesting a survey is vital in evaluating response to the questionnaire
  • Extensive research over the past 30 years has shown that questionnaire creation is a science, not just an art

Question Development

  • Topics covered in a survey are identified first
  • Current events and relevant public issues guide survey questions
  • Tracking opinions over time is important, updated questions are crucial
  • Questionnaire development is a collaborative and iterative process
  • Drafts of the questionnaire are discussed, revised, and pretested
  • Each questionnaire is pretested, undergoing revisions before final use

Measuring Change Over Time

  • Surveys often track attitudes, opinions, and behavior over time.
  • Cross-sectional designs survey different people at different times
  • Longitudinal designs survey the same individuals over time.
  • Pew Research Center has a panel survey (American Trends Panel), started in 2014
  • Repeated questions can track changes in public opinion.

Open and Closed-ended Questions

  • Open-ended questions allow respondents to answer in their own words
  • Closed-ended questions provide pre-determined answer choices
  • The format affects how people answer questions
  • Open-ended questions can be used to identify common themes, which can be used in closed-ended questions

Question Wording

  • Clear and specific wording is critical for capturing accurate responses.
  • Respondents should interpret the question consistently
  • Small wording differences can significantly influence responses
  • The context of a question (e.g., prior questions) can influence answers
  • Double-barreled questions ask about multiple concepts; better to ask separate questions.

Question Order

  • The placement of questions significantly impacts answers.
  • Initial and subsequent questions can frame future questions
  • Specific questions before broad questions can bias answers.
  • Similar wording and contexts should be maintained when measuring trends over time.
  • Questionnaire questions should be ordered logically for easier comprehension and to avoid bias

Pilot Testing and Focus Groups

  • Pilot tests and focus groups are used to evaluate questionnaires with potential survey populations
  • Pilot tests examine the entire questionnaire implementation
  • Focus groups are used to gather large amounts of detailed information in person or online.
  • Focus group moderators often use open-ended questions to gather input
  • Pilot tests are used for evaluating the entire questionnaire, wording of questions, order of topics, etc.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Quiz Team

Related Documents

Survey Design Examples (Pew Research Centre) PDF

Description

Explore the essential principles of questionnaire design and question development in this quiz. Learn how effective questioning techniques and logical arrangements can significantly impact survey results. Understand the importance of pilot tests, pretesting, and the role of prior survey methods in crafting a successful questionnaire.

More Like This

Module 6 Questionnaire Design and Survey Data
22 questions

Module 6 Questionnaire Design and Survey Data

EnergeticFuchsia avatar
EnergeticFuchsia
Questionnaire Checking
40 questions

Questionnaire Checking

SharperFuchsia avatar
SharperFuchsia
Questionnaire Design Basics
10 questions

Questionnaire Design Basics

ToughFresno3824 avatar
ToughFresno3824
Designing a Questionnaire
37 questions

Designing a Questionnaire

RapidSard4268 avatar
RapidSard4268
Use Quizgecko on...
Browser
Open
Browser
Browser