Podcast
Questions and Answers
What is a primary goal of grouping questions by topic in a questionnaire?
What is a primary goal of grouping questions by topic in a questionnaire?
What should ideally precede demographic questions in a survey?
What should ideally precede demographic questions in a survey?
How do pilot tests differ from pretests in survey methodology?
How do pilot tests differ from pretests in survey methodology?
What is the main purpose of focus groups in survey research?
What is the main purpose of focus groups in survey research?
Signup and view all the answers
When should surveyors conduct pilot tests?
When should surveyors conduct pilot tests?
Signup and view all the answers
What should be avoided in survey design to enhance participant experience?
What should be avoided in survey design to enhance participant experience?
Signup and view all the answers
Why might surveyors test new questions during a pilot test?
Why might surveyors test new questions during a pilot test?
Signup and view all the answers
What type of feedback is typically sought during focus group discussions?
What type of feedback is typically sought during focus group discussions?
Signup and view all the answers
What is the primary benefit of using focus groups before developing a survey questionnaire?
What is the primary benefit of using focus groups before developing a survey questionnaire?
Signup and view all the answers
Which of the following best describes a key characteristic of focus group discussions?
Which of the following best describes a key characteristic of focus group discussions?
Signup and view all the answers
What does social desirability bias influence in survey responses?
What does social desirability bias influence in survey responses?
Signup and view all the answers
What does a pretest aim to achieve in the survey development process?
What does a pretest aim to achieve in the survey development process?
Signup and view all the answers
Which of the following statements is true regarding the use of focus groups?
Which of the following statements is true regarding the use of focus groups?
Signup and view all the answers
How can question wording affect survey responses?
How can question wording affect survey responses?
Signup and view all the answers
In pretesting, what feedback do surveyors typically seek from interviewers?
In pretesting, what feedback do surveyors typically seek from interviewers?
Signup and view all the answers
Which survey format tends to yield different results according to the Pew Research Center's experiment?
Which survey format tends to yield different results according to the Pew Research Center's experiment?
Signup and view all the answers
What kind of questions do moderators typically use during focus group discussions?
What kind of questions do moderators typically use during focus group discussions?
Signup and view all the answers
What may respondents understate due to social desirability bias?
What may respondents understate due to social desirability bias?
Signup and view all the answers
Why is it important to conduct a pretest in the actual setting of the survey?
Why is it important to conduct a pretest in the actual setting of the survey?
Signup and view all the answers
What is one way researchers can encourage honesty in responses regarding sensitive topics?
What is one way researchers can encourage honesty in responses regarding sensitive topics?
Signup and view all the answers
What technique is commonly used by moderators to gain deeper insights during focus groups?
What technique is commonly used by moderators to gain deeper insights during focus groups?
Signup and view all the answers
Which survey method is likely to result in greater social desirability bias?
Which survey method is likely to result in greater social desirability bias?
Signup and view all the answers
When is it important to use identical wording for survey questions?
When is it important to use identical wording for survey questions?
Signup and view all the answers
Which of the following statements is true regarding the forced choice format?
Which of the following statements is true regarding the forced choice format?
Signup and view all the answers
Study Notes
Questionnaire Design
- Questionnaire design is a crucial part of the survey process
- Accurate questions are essential for measuring public opinions, experiences, and behaviors
- Accurate random sampling and high response rates are useless if information is gathered from poor questions
- Good questionnaire design involves writing effective questions and arranging them logically
- Design is a multi-stage process requiring attention to numerous details
- Questions can be asked in varying detail and formats
- Earlier questions can influence later answers
- Measuring changes over time is important, requiring consideration of prior surveys' methods
- Pilot tests or focus groups are conducted in the early stages of design
- Pretesting a survey is vital in evaluating response to the questionnaire
- Extensive research over the past 30 years has shown that questionnaire creation is a science, not just an art
Question Development
- Topics covered in a survey are identified first
- Current events and relevant public issues guide survey questions
- Tracking opinions over time is important, updated questions are crucial
- Questionnaire development is a collaborative and iterative process
- Drafts of the questionnaire are discussed, revised, and pretested
- Each questionnaire is pretested, undergoing revisions before final use
Measuring Change Over Time
- Surveys often track attitudes, opinions, and behavior over time.
- Cross-sectional designs survey different people at different times
- Longitudinal designs survey the same individuals over time.
- Pew Research Center has a panel survey (American Trends Panel), started in 2014
- Repeated questions can track changes in public opinion.
Open and Closed-ended Questions
- Open-ended questions allow respondents to answer in their own words
- Closed-ended questions provide pre-determined answer choices
- The format affects how people answer questions
- Open-ended questions can be used to identify common themes, which can be used in closed-ended questions
Question Wording
- Clear and specific wording is critical for capturing accurate responses.
- Respondents should interpret the question consistently
- Small wording differences can significantly influence responses
- The context of a question (e.g., prior questions) can influence answers
- Double-barreled questions ask about multiple concepts; better to ask separate questions.
Question Order
- The placement of questions significantly impacts answers.
- Initial and subsequent questions can frame future questions
- Specific questions before broad questions can bias answers.
- Similar wording and contexts should be maintained when measuring trends over time.
- Questionnaire questions should be ordered logically for easier comprehension and to avoid bias
Pilot Testing and Focus Groups
- Pilot tests and focus groups are used to evaluate questionnaires with potential survey populations
- Pilot tests examine the entire questionnaire implementation
- Focus groups are used to gather large amounts of detailed information in person or online.
- Focus group moderators often use open-ended questions to gather input
- Pilot tests are used for evaluating the entire questionnaire, wording of questions, order of topics, etc.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Related Documents
Description
Explore the essential principles of questionnaire design and question development in this quiz. Learn how effective questioning techniques and logical arrangements can significantly impact survey results. Understand the importance of pilot tests, pretesting, and the role of prior survey methods in crafting a successful questionnaire.
