Survey Design Best Practices

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to Lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is the primary objective of including demographic questions in a survey?

  • To describe sample representation and segment results (correct)
  • To gather personal opinions about the survey topic
  • To ensure all respondents have a similar background
  • To create a more engaging survey experience

Which survey design approach focuses on gathering open-ended responses before more specific ones?

  • Pathway approach
  • Funnel approach (correct)
  • Screener questions
  • Closed-ended questions

What is a common mistake to avoid when developing survey questions?

  • Sequencing questions logically
  • Making questions too straightforward
  • Including loaded or ambiguous questions (correct)
  • Using closed-ended questions exclusively

What is one of the critical stages in the survey research process?

<p>Survey design (B)</p> Signup and view all the answers

Which type of survey component is considered an 'overall measure'?

<p>Questions tracking sentiment over time (B)</p> Signup and view all the answers

What is the main goal of the pathway approach in survey design?

<p>To follow the logical sequence of experiences (A)</p> Signup and view all the answers

Why should surveys be clear and concise?

<p>To effectively measure what they aim to evaluate (B)</p> Signup and view all the answers

Which type of question is primarily used in quantitative surveys?

<p>Closed-ended questions (B)</p> Signup and view all the answers

What type of survey question design typically starts broad and becomes more specific?

<p>Funnel approach (A)</p> Signup and view all the answers

Which scale of measurement involves a true zero point?

<p>Ratio (B)</p> Signup and view all the answers

What distinguishes a ratio scale from an interval scale?

<p>Ratio scales lack an absolute zero point. (D)</p> Signup and view all the answers

Which type of awareness question allows respondents to freely recall brands without cues?

<p>Unaided awareness (B)</p> Signup and view all the answers

Which of the following is a characteristic of Likert scales?

<p>They can have a neutral midpoint. (C)</p> Signup and view all the answers

Which of the following considerations is crucial when crafting survey response options?

<p>Balancing different scales (A)</p> Signup and view all the answers

What is the purpose of randomization in response options?

<p>To combat order bias. (D)</p> Signup and view all the answers

Which statement about interval scales is true?

<p>They show differences in values along the scale. (D)</p> Signup and view all the answers

What is a key reason for using branching questions in surveys?

<p>To skip irrelevant questions for certain respondents. (C)</p> Signup and view all the answers

Which type of scale should be used for measuring levels of education?

<p>Ordinal scale. (D)</p> Signup and view all the answers

How should demographic questions be positioned in a survey for optimum response?

<p>At the end to avoid discomfort. (B)</p> Signup and view all the answers

What issue might arise if negative labels are used in a Likert scale?

<p>It may confuse the range of responses. (A)</p> Signup and view all the answers

What is the recommended maximum length for most surveys to ensure quality responses?

<p>5-7 minutes (B)</p> Signup and view all the answers

What is the typical format for a balanced Likert scale?

<p>1 to 5 with equidistant options on either side of a neutral point. (A)</p> Signup and view all the answers

What characterizes stackable surveys?

<p>They are broken into a series of smaller surveys over time. (A)</p> Signup and view all the answers

Which factor influences the likelihood that respondents choose top-listed options?

<p>Order bias. (D)</p> Signup and view all the answers

Which type of measurement uses values that can be counted as distinct groups?

<p>Nominal measurements (A)</p> Signup and view all the answers

Which statement describes ordinal measurements?

<p>They can be ranked in a clear order. (B)</p> Signup and view all the answers

What is a significant drawback of longer surveys?

<p>They risk lower response rates and incompleteness. (C)</p> Signup and view all the answers

What factor may allow a survey to run longer than 5-7 minutes?

<p>The respondents' familiarity with the topic. (C)</p> Signup and view all the answers

What is an example of a brand attribute question?

<p>Do you believe our products are innovative? (C)</p> Signup and view all the answers

Which of the following is considered a mistake when crafting survey questions?

<p>Combining two questions into one (C)</p> Signup and view all the answers

What scale is commonly used to measure agreement with brand statements?

<p>1 to 5 scale (C)</p> Signup and view all the answers

What should survey questions avoid to maximize understanding?

<p>Leading and loaded questions (C)</p> Signup and view all the answers

How can questions be designed to avoid taxing respondents' memory?

<p>By avoiding detailed historical comparisons (B)</p> Signup and view all the answers

Why should 'not applicable' options be included in surveys?

<p>They allow respondents to express unfamiliarity with items. (C)</p> Signup and view all the answers

What problem is posed by overlapping response options in surveys?

<p>They create confusion for respondents. (C)</p> Signup and view all the answers

Which type of question is primarily used to gather strengths and weaknesses?

<p>Open-ended questions (D)</p> Signup and view all the answers

What is a characteristic of double-barreled questions?

<p>They contain multiple questions within one. (D)</p> Signup and view all the answers

What makes a question considered leading?

<p>It suggests a desirable response implicitly. (A)</p> Signup and view all the answers

What is a recommended practice when designing survey questions?

<p>Avoiding any form of social desirability bias. (C)</p> Signup and view all the answers

What is a common mistake associated with leading questions?

<p>They result in biased outcomes. (D)</p> Signup and view all the answers

What should be avoided when constructing survey items?

<p>Combining multiple issues into single questions. (B)</p> Signup and view all the answers

Flashcards

Survey Design

The most crucial part of survey research, aiming for a clear, concise instrument that accurately measures intended aspects.

Overall Measures

Include measures that evaluate sentiment regarding the subject being studied, assisting with tracking over time and correlation analysis.

Demographic Questions

Essential for most surveys, though unrelated to the primary research objective. They aid in describing sample representation and result segmentation.

Funnel Approach

A survey structure that begins with general questions and moves to more specific inquiries, useful for getting initial opinions before delving deep.

Signup and view all the flashcards

Pathway Approach

A survey structure by experience, organizing the questions in the order of experiences (e.g., a customer journey).

Signup and view all the flashcards

Screener Questions

Questions placed before core questions to filter out respondents who don't qualify for the survey.

Signup and view all the flashcards

Closed-ended Questions

Questions that limit responses to specific options, making surveys quantitative.

Signup and view all the flashcards

Online Survey Tools

Tools used commonly for conducting surveys, facilitating their accessibility.

Signup and view all the flashcards

Branching questions in surveys

Questions asked conditionally based on previous answers, only applied to a subset of respondents.

Signup and view all the flashcards

Demographic questions placement

Ideally placed at the end of a survey, unless used as screeners, to avoid initial respondent fatigue.

Signup and view all the flashcards

Survey Length

The duration of a survey should be short (5-7 minutes max) for better response completion rates and reduced drop-off.

Signup and view all the flashcards

Stackable survey

A long survey broken into smaller parts, dispersed over time.

Signup and view all the flashcards

Multi-channel survey

A survey distributed through multiple platforms for wider reach or enhanced engagement.

Signup and view all the flashcards

Categorical measurement

Values representing distinct groups based on a characteristic or label.

Signup and view all the flashcards

Nominal measurement

Categorical data with no inherent order.

Signup and view all the flashcards

Ordinal measurement

Categorical data with a clear order or ranking.

Signup and view all the flashcards

Customer Familiarity Scale

A scale from 1 to 5 used to measure how familiar customers are with a company or product. 1 represents not at all familiar, and 5 represents very familiar.

Signup and view all the flashcards

Descriptor Questions

Open-ended questions used to understand customer perceptions of a company (e.g., "What words would you use to describe [company]?" ).

Signup and view all the flashcards

Brand Attribute Ratings

Questions measuring the degree to which customers believe a brand possesses specific attributes (e.g., "How much do you agree that [company] is focused on quality?" ).

Signup and view all the flashcards

Leading/Loaded Questions

Questions that suggest a particular answer or contain biases.

Signup and view all the flashcards

Ambiguous Questions

Vague or unclear questions that can be interpreted in different ways leading to inaccurate results.

Signup and view all the flashcards

Survey Components

Survey components include overall measures and demographic questions. Survey approaches include funnel (broad to specific) and pathway (experience-ordered).

Signup and view all the flashcards

Scales of Measurement

Scales of measurement (categorical and continuous) apply to quantitative data. Categorical scales include nominal and ordinal. Continuous scales include interval and ratio.

Signup and view all the flashcards

Survey Response Options

Considerations for survey responses include: scale type (categorical or continuous), balancing scales, consistent comparisons, visual weight, response order, avoiding overlap, and including "not applicable/don't know" options.

Signup and view all the flashcards

Question Pitfalls

Avoid complex, leading, loaded, ambiguous, double-barreled survey questions.

Signup and view all the flashcards

Survey Uses

Surveys can gather feedback on new product directions (development), brand perceptions (unbiased), and customer/employee satisfaction (engagement).

Signup and view all the flashcards

Interval Scale

A measurement scale with clear order and exact differences between values.

Signup and view all the flashcards

Ratio Scale

A measurement scale with equal intervals and an absolute zero point.

Signup and view all the flashcards

Likert Scale

A survey response scale with options ranging from one extreme to another, sometimes with a neutral midpoint.

Signup and view all the flashcards

Balanced Likert Scale

A Likert scale ensuring equal representation of positive and negative options.

Signup and view all the flashcards

Order Bias

The tendency for respondents to choose options at the top of a list more often.

Signup and view all the flashcards

Ordinal Variables

Variables that can be ordered, but intervals between values are not equal.

Signup and view all the flashcards

Educational Levels

Representations of formal education attainment, like High School, Bachelor's, Master's or Doctoral.

Signup and view all the flashcards

Visual Weight

The perceived strength or importance a response option has based on presentation.

Signup and view all the flashcards

Interval Variable Scales

Scales that measure intensity (e.g., Likert scale). They can measure from positive to negative or negative to positive.

Signup and view all the flashcards

Not Applicable Options

Include options like 'not applicable', 'don't know', or 'unsure' when appropriate.

Signup and view all the flashcards

Overlapping Response Options

Avoid using options that overlap. Each option should be exclusive; so respondents can pick only one valid option.

Signup and view all the flashcards

Open-ended Questions

Questions designed to gather detailed answers, not just a simple choice from options.

Signup and view all the flashcards

Complex Questions

Questions with multiple parts or stipulations; don't confuse respondents.

Signup and view all the flashcards

Leading Questions

Questions that subtly suggest a particular answer; they bias the results.

Signup and view all the flashcards

Loaded Questions

Questions that might encourage a socially desirable answer (often influencing or pressuring the respondant).

Signup and view all the flashcards

Study Notes

Learning Objectives

  • Create surveys using best practices, including survey components, question sequencing, and appropriate length.
  • Identify and avoid common survey mistakes, such as complex, leading, loaded, ambiguous, and double-barreled questions.
  • Identify categorical and continuous measurement scales for survey response options.

Introduction to Survey Instruments

  • Surveys are a common form of primary research, frequently conducted online.
  • Surveys are primarily quantitative, using mostly closed-ended questions.
  • Surveys may also include open-ended questions for qualitative data.
  • Proper survey design is crucial for successful research.

Common Universal Survey Components

  • "Overall measures" are components used to gauge overall sentiment about a subject.
  • These measures can be used for tracking over time and correlation analysis.

Demographics Questions

  • Demographics questions, although not directly related to the research objective, are necessary for understanding sample representation.
  • Use sparingly and only if helpful for segmentation analysis (e.g., age, gender, education).

Question Sequencing

  • Funnel approach: Start with broad questions to gather general responses before more specific questions.
  • Order bias can occur if questions are asked in an inappropriate order.
  • Pathway approach: Structure the survey in the order of experiences and events (e.g., customer journey)

Types of Approaches (for questions)

  • Screener questions: Used to pre-qualify respondents for the remainder of the survey.
  • Branching questions: Questions that determine which subsequent questions are asked based on the respondent’s previous answers.

Survey Length

  • Survey length depends on the format and the topic's importance to the respondent.
  • Surveys should ideally be short, typically 5-7 minutes, to avoid incomplete responses.
  • Stackable surveys break down longer surveys into smaller ones over time.
  • Multi-channel surveys break down long surveys into smaller surveys conducted across multiple platforms.

Scales of Measurement

  • Categorical variables can be counted as groups/characteristics.
  • Continuous variables use numerical values and are placed in a logical order with equal distances between points.

Categorical Measurement

  • Nominal: Categories with no implied order. Example: eye color.
  • Ordinal: Categories with implied order. Example: educational attainment levels.

Continuous Measurement

  • Interval: Equal intervals between values/datapoints; Example: Temperature in Celsius.
  • Ratio: Same as interval but with a meaningful zero point. Example: weight

Likert Scales

  • Likert scales are commonly used to measure attitudes.
  • The scale provides a range of options (often 5 points) with anchors at both ends.
  • Scales can be balanced with options that span a positive to a negative extreme.

Visual Weight

  • If a scale has visually emphasized points, the respondent will be more likely to choose those options.
  • Avoid this by structuring scales such that all values are equally noticeable.

Order of Response Options

  • Responses often have order bias.
  • Randomize response order/options to mitigate the effect.

"Not Applicable" Options

  • Include "not applicable" options whenever necessary; forcing respondents to answer about something they aren't familiar with can skew results.
  • Ensure survey items are relevant to respondents.

Overlapping Response Options

  • Avoid overlapping response options to ensure clarity for respondents.
  • If options overlap, provide specific response options that do not overlap.

Open-Ended Questions

  • Useful to gather detailed responses, opinions, and experiences.
  • Useful in understanding strengths, weaknesses of a topic/service.
  • Useful for collecting ideas and thoughts regarding new product development.

Development Mistakes to Avoid

  • Avoid complex questions, leading questions, loaded questions, and ambiguous or double-barreled questions.
  • Avoiding taxing respondents’ memory and other pitfalls in the survey development process is advisable.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Quiz Team

Related Documents

More Like This

Survey Question Types Quiz
16 questions
Types of Quantitative Research
40 questions

Types of Quantitative Research

ProactiveSpessartine7234 avatar
ProactiveSpessartine7234
week 3
29 questions

week 3

AmusingMeteor9105 avatar
AmusingMeteor9105
Use Quizgecko on...
Browser
Browser