Surveys in Research Methods
48 Questions
0 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to Lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What factor contributes to the cost-effectiveness of web-based surveys compared to custom-developed ones?

  • Higher response rates
  • No need for data entry (correct)
  • Lower initial setup costs
  • Enhanced respondent engagement

How do respondents generally feel about providing sensitive information in electronic surveys compared to face-to-face interactions?

  • Less honest due to anonymity concerns
  • More dishonest when the topic is personal
  • More honest when it can be submitted anonymously (correct)
  • Equally honest regardless of format

What is a common misconception about the honesty of respondents in online surveys compared to paper surveys?

  • People are more likely to lie in online surveys. (correct)
  • Online surveys deter individuals from participating honestly.
  • There is no significant difference in honesty between both formats.
  • Responses in paper surveys are always more trustworthy.

What is a potential advantage of web-based surveys over e-mailed surveys?

<p>Greater anonymity for respondents (A)</p> Signup and view all the answers

What can reduce data entry errors in surveys?

<p>Automatic saving of responses (B)</p> Signup and view all the answers

In what situation are respondents likely to be more honest in their answers?

<p>When surveys can be submitted anonymously (A)</p> Signup and view all the answers

What is a challenge related to informed consent in online surveys?

<p>Respondents are less aware of their participation. (A)</p> Signup and view all the answers

Which factor affects the speed of analysis in web-based surveys?

<p>Automatic response saving (D)</p> Signup and view all the answers

What type of error occurs when survey questions are poorly worded or biased?

<p>Measurement error (B)</p> Signup and view all the answers

Which error is exemplified by a situation where the sampling frame is split evenly by gender, but the majority of responses come from one gender?

<p>Nonresponse error (A)</p> Signup and view all the answers

What can lead to coverage error in survey sampling?

<p>Surveying individuals without a comprehensive list (B)</p> Signup and view all the answers

What is an example of an ordered response?

<p>Ranking software applications from favorite to least favorite (D)</p> Signup and view all the answers

In which context is nonprobabilistic sampling often employed?

<p>When it's difficult to identify a central population (A)</p> Signup and view all the answers

Which type of question allows respondents to choose only one item?

<p>Closed-ended questions with ordered response (D)</p> Signup and view all the answers

What distinguishes unordered closed-ended questions from ordered ones?

<p>Choices have no logical or numeric order. (A)</p> Signup and view all the answers

Which method is NOT typically associated with nonprobabilistic sampling?

<p>Random digit dialing (D)</p> Signup and view all the answers

What is a common example of a Likert scale?

<p>A rating from 1 to 10 of overall satisfaction (D)</p> Signup and view all the answers

What is the primary reason that HCI researchers often use nonprobability sampling?

<p>The necessity to collect data individually (C)</p> Signup and view all the answers

Which best describes the impact of nonresponse error on research findings?

<p>It can lead to invalid conclusions if the missing data is systematically different. (A)</p> Signup and view all the answers

What is a primary challenge in obtaining a random sample in certain populations, such as individuals with HIV?

<p>Difficulty identifying and accessing potential respondents (A)</p> Signup and view all the answers

Which input method allows for multiple selections in a closed-ended question?

<p>Choosing favorite social media platforms (C)</p> Signup and view all the answers

Which of the following statements best describes the nature of survey data in HCI research?

<p>Surveys can be combined with other research methods for validity (B)</p> Signup and view all the answers

What is the primary goal of probabilistic sampling in research?

<p>Achieving accurate estimates of the population (D)</p> Signup and view all the answers

In the context of survey design, which phrase best describes a figure displaying ordered responses?

<p>A graphical representation of a Likert scale (C)</p> Signup and view all the answers

What distinguishes the research methodologies between social science and HCI fields?

<p>HCI researchers collect data on their own without strict random sampling (D)</p> Signup and view all the answers

What type of sampling methodologies are exemplified by the National Centre for Social Research in the UK?

<p>Rigorous, structured sampling methodologies (B)</p> Signup and view all the answers

What challenge might arise when creating web-based surveys with unordered response options?

<p>Different interface widgets must be implemented. (B)</p> Signup and view all the answers

What is NOT a characteristic of ordered closed-ended questions?

<p>They allow for multiple selection of answers. (C)</p> Signup and view all the answers

In what context are surveys commonly used by HCI researchers?

<p>In conjunction with other research methods without expecting representativeness (D)</p> Signup and view all the answers

What is a common misconception about sampling in HCI research?

<p>Only probability-sampled data can yield valid results (C)</p> Signup and view all the answers

How are survey responses treated in recent HCI research papers, according to the discussed practices?

<p>Surveys are complemented by various qualitative methods (C)</p> Signup and view all the answers

What is a notable feature of survey research within the HCI community?

<p>There is acceptance of convenience samples (A)</p> Signup and view all the answers

What is a key factor in increasing the response rate of a survey?

<p>Establishing credibility through trusted authorities (B)</p> Signup and view all the answers

Which step is NOT part of the suggested multistep contact process for increasing survey response rates?

<p>Conducting face-to-face interviews (D)</p> Signup and view all the answers

Why is it important to identify the source of the survey?

<p>To establish authority and credibility (C)</p> Signup and view all the answers

What is one method to simplify the return of a paper survey?

<p>Providing a self-addressed return envelope with postage (B)</p> Signup and view all the answers

What should be considered when determining the number of survey responses needed?

<p>The goal of the survey and the sampling method (B)</p> Signup and view all the answers

What is the purpose of a final contact using a different mode?

<p>To increase the likelihood of response through novelty (D)</p> Signup and view all the answers

What is the main idea behind multiple reminders in electronic surveys?

<p>To increase the probability of a response (D)</p> Signup and view all the answers

Which method is NOT recommended for making contacts with nonrespondents?

<p>Sending the final survey through the same postal method (C)</p> Signup and view all the answers

What is the primary purpose of conducting a pilot study for a survey tool?

<p>To ensure the questions are clear and unambiguous (D)</p> Signup and view all the answers

Which of the following is NOT a stage in the three-stage process of pretesting a survey?

<p>Analysis of survey marketing effectiveness (C)</p> Signup and view all the answers

In the context of pilot testing, what role do knowledgeable colleagues play?

<p>They evaluate the clarity of the survey tool before testing with users (D)</p> Signup and view all the answers

What aspect of a survey tool's interface can significantly affect its usability?

<p>The font face, size, and spacing used on paper surveys (B)</p> Signup and view all the answers

What often happens in practice, even though a three-stage pilot testing process is ideal?

<p>Minimal level of pilot testing is performed with limited colleague input (B)</p> Signup and view all the answers

What is the ultimate goal of the pilot study once potential respondents complete the survey?

<p>To identify confusing or misleading questions (B)</p> Signup and view all the answers

When evaluating paper-based surveys, which layout aspect is crucial?

<p>Use of grids and spacing (B)</p> Signup and view all the answers

What quality of the survey tool is assessed through interviews with potential respondents?

<p>Clarity and motivational qualities of the questions (D)</p> Signup and view all the answers

Flashcards

Sampling Error

An error that occurs when there are not enough responses from those surveyed to make accurate population estimates.

Coverage Error

An error that occurs when not all members of the population of interest have an equal chance of being selected for the survey.

Measurement Error

An error that occurs when survey questions are poorly worded or biased, leading to data of questionable quality.

Nonresponse Error

An error that occurs when there are major differences between the people who responded to a survey and the people who were sampled.

Signup and view all the flashcards

Nonprobabilistic Sampling

A sampling technique where the probability of selecting a particular individual for the sample is unknown.

Signup and view all the flashcards

Snowball Recruiting

A nonprobabilistic sampling technique where participants are recruited through existing social networks.

Signup and view all the flashcards

Volunteer Opt-In Panels

A nonprobabilistic sampling technique where individuals volunteer to participate in a survey.

Signup and view all the flashcards

Self-Selected Surveys

A nonprobabilistic sampling technique where individuals choose to participate in a survey often by clicking on links on a website or social media.

Signup and view all the flashcards

Probability Sampling

A type of sampling where each member of the population has an equal chance of being selected.

Signup and view all the flashcards

Nonprobability Sampling

A type of sampling where the selection of participants is not based on random chance.

Signup and view all the flashcards

Convenience Sampling

A type of nonprobability sampling where researchers choose participants based on their accessibility and convenience.

Signup and view all the flashcards

General Social Survey

A survey designed to gather data from a large, representative sample of the population, often using probability sampling methods.

Signup and view all the flashcards

Social Science Research

A research community that often relies on large, well-structured data sets collected through probability sampling, like the General Social Survey.

Signup and view all the flashcards

Human-Computer Interaction (HCI) Research

A research community where researchers often collect their own data using smaller, nonprobability samples, such as convenience sampling.

Signup and view all the flashcards

Survey Validity

The extent to which a study's findings can be generalized to the broader population.

Signup and view all the flashcards

Ensuring Validity in Nonprobability Samples

Techniques used to ensure the accuracy and reliability of findings in studies using nonprobability sampling methods, like those common in HCI research.

Signup and view all the flashcards

Ordered Response

A type of question where respondents choose from a list of options that have a logical order, like "strongly agree" to "strongly disagree".

Signup and view all the flashcards

Unordered Response

A type of question where respondents choose from a list of options that do not have a logical order, like "MS-Word" or "Google Docs".

Signup and view all the flashcards

Closed-ended question (Single Selection)

A question format where respondents select only one option from a list.

Signup and view all the flashcards

Closed-ended question (Multiple Selection)

A question format where respondents can select multiple options from a list.

Signup and view all the flashcards

Likert Scale

A type of question where respondents rate their agreement or disagreement with a statement on a scale from 1 to 5, 7, or 9.

Signup and view all the flashcards

Closed-ended Question

A type of survey where respondents are prompted to select their preferred option from a list.

Signup and view all the flashcards

Open-ended Question

A type of question where respondents are free to provide their own answer, not limited to predetermined options.

Signup and view all the flashcards

Satisfaction Scale

A type of question that helps understand how satisfying or frustrating an experience is, using a scale from 1 to 9.

Signup and view all the flashcards

Survey Motivation

The process of establishing survey study credibility and importance to encourage participation.

Signup and view all the flashcards

Authority Endorsement

Using trusted individuals or organizations to endorse the survey to increase participation.

Signup and view all the flashcards

Ease of Return

Making it easy for survey participants to return their response.

Signup and view all the flashcards

Multistep Contact

Multiple contacts with respondents to increase participation.

Signup and view all the flashcards

Precontact Letter

The first contact with potential survey respondents.

Signup and view all the flashcards

Final Contact

The final contact made with respondents to ensure they receive the survey.

Signup and view all the flashcards

Different Delivery Method

Using a different communication method for the final contact.

Signup and view all the flashcards

Multiple Reminders

Repeating reminders and providing the survey instrument multiple times for online surveys.

Signup and view all the flashcards

Cost-effectiveness of web-based surveys

Web-based surveys are generally more efficient and cost-effective than paper surveys due to automated data collection and reduced data entry errors.

Signup and view all the flashcards

Response speed and analysis in web-based surveys

While response rates may be lower, the speed of responses and analysis is faster in web-based surveys compared to traditional paper surveys.

Signup and view all the flashcards

Honesty in online vs. paper surveys

There is no evidence to suggest that people are more dishonest in online surveys than in paper surveys. However, online communication is generally more honest when delivering bad news.

Signup and view all the flashcards

Anonymity and honesty in online surveys

Anonymised online surveys can increase honesty and self-disclosure, as respondents feel more comfortable sharing sensitive information.

Signup and view all the flashcards

Honesty in self-administered surveys

Self-administered surveys, including online surveys, generally lead to more honest answers to sensitive questions compared to interviews.

Signup and view all the flashcards

Informed consent in online surveys

Online surveys may require alternative methods for obtaining informed consent from participants, compared to traditional paper surveys.

Signup and view all the flashcards

Response speed and analysis in web-based surveys

While response rates may be lower, the speed of responses and analysis is faster in web-based surveys compared to traditional paper surveys.

Signup and view all the flashcards

Anonymity and honesty in online surveys

Anonymised online surveys can increase honesty and self-disclosure, as respondents feel more comfortable sharing sensitive information.

Signup and view all the flashcards

Pilot Study (Pretesting a Survey)

A preliminary test to assess the clarity and effectiveness of survey questions and the overall layout of the survey instrument. It helps ensure that the questions are understandable and unambiguous for respondents.

Signup and view all the flashcards

Evaluating Survey Questions

Examining the questions within a survey to ensure their clarity, understandability, and ability to elicit accurate information from respondents.

Signup and view all the flashcards

Evaluating Survey Interface

Assessing the overall layout and design of a survey, including the use of font, spacing, grids, and visual elements, to ensure a user-friendly and visually appealing experience for respondents.

Signup and view all the flashcards

Dillman's Three-Stage Pretesting Process

A three-step process for pretesting a survey, involving expert review, individual interviews with potential respondents, and a pilot study with full survey completion.

Signup and view all the flashcards

Expert Review of Survey Tool

Involving experts (colleagues and analysts) in reviewing the survey tool to identify potential flaws or areas for improvement in the questions and overall design.

Signup and view all the flashcards

Interviews with Potential Respondents

Interviews with potential respondents to evaluate the cognitive and motivational aspects of the survey questions. This step assesses if the questions are understandable, engaging, and likely to elicit truthful responses.

Signup and view all the flashcards

Pilot Study with Full Survey Completion

A comprehensive test involving potential respondents completing the entire survey under realistic conditions to identify potential flaws in the survey tool and its implementation procedures.

Signup and view all the flashcards

Necessity of Pilot Study

The importance of conducting a pilot study, even if it is a simplified version, to identify and address potential problems before the final survey is deployed.

Signup and view all the flashcards

Study Notes

Surveys

  • Surveys are a common research method used across various fields, including human-computer interaction (HCI).
  • They are used to describe populations, explain behaviors, and explore new areas.
  • Surveys can be structured, well-tested, and robust, resulting in valid data. However, poor design can lead to unreliable data.
  • A survey is a set of well-defined questions that individuals answer independently.
  • Surveys collect data quickly from large, geographically diverse populations.
  • Random sampling in surveys allows for statistically accurate population estimates.
  • Surveys are sometimes criticized for being too simple a method, used inappropriately for generalizations.

Benefits and Drawbacks of Surveys

  • Surveys are cost-effective for gathering data from a large number of people quickly.
  • Surveys are relatively unobtrusive compared to other methods.
  • They provide a broad overview of user interactions, problems, and actions.
  • Surveys are not suitable for in-depth analysis, gathering detailed information, or for testing specific usability issues within an interface.
  • Poorly designed surveys can produce unreliable data that does not generalize to other populations.
  • Survey questions related to user opinions or habits may be more prone to recall bias compared to factual questions.

Researching Photo Tagging and Sharing Behaviors

  • Combining surveys and computer-collected data allows for a more holistic understanding of user behavior.
  • Surveys can provide a general overview of behavior/attitude and motivations.
  • A survey on photo tagging behavior, for instance, allowed for more accurate data collection.
  • Random sampling methods allow for more representative samples of user populations.

Goals and Targeted Users for Survey Research

  • Surveys can be used for understanding large populations.
  • The targeted population of interest needs to be well-defined.
  • Clear criteria must be used in determining target population to effectively use surveys.
  • The demographics of the targeted users are important, for analyzing validity, representing, and ensuring a diverse population.
  • Identifying individuals or groups with particular characteristics (age, profession, disabilities etc.) is crucial.

Probabilistic Sampling

  • A census is the most accurate method for estimating a whole population, but it's expensive
  • Probabilistic sampling is used when conducting surveys, ensuring each participant has a specific likelihood of being selected.

Stratification

  • Stratified sampling involves dividing the target population into subgroups and taking a sample from each.
  • This approach is useful when subpopulations have unequal representation.
  • It ensures more representative subgroups within the sample.

Response Size

  • The sufficient response size depends on desired confidence level, margin of error.
  • A larger sample size reduces margin of error, increasing accuracy.

Nonprobabilistic Sampling

  • When a complete list of all target population members isn't available, nonprobabilistic approaches are preferred.
  • Nonprobabilistic samples include volunteer opt-in panels and self-selected surveys.
  • Demographic data and oversampling might be employed to improve validity in nonprobabilistic surveys.

Developing Survey Questions

  • Open-ended questions offer respondents flexibility but require more complex analysis.
  • Closed-ended questions provide quantifiable data, but require carefully crafted, unbiased options.
  • Common survey errors to avoid include double-barreled questions, negatively worded questions, and loaded phrasing.

Overall Survey Structure

  • Surveys should begin with clear instructions/guidelines for completing the survey.
  • Order of questions may be critical; for instance, sensitive questions are placed later.
  • White space, clear formatting, navigation, contact details, and consistent layouts promote clarity for respondents.

Pilot Testing the Survey Tool

  • Pilot testing helps in ensuring survey questions are clear/unambiguous and questions provide expected type of data/responses.
  • Testing should involve expert users/analysts and potential respondents, to evaluate any flaws/confusions/misleading questions immediately.

Existing Surveys

  • For efficient survey development, researchers can utilize existing validated HCI survey tools.
  • They can modify existing tools to fit research needs.

Paper or Online Surveys?

  • Paper or online surveys depend heavily on the access to the target sample.
  • Accessibility of tools and survey formats are crucial to participation of diverse audiences, including people with disabilities.
  • A combination of paper and online approaches might be suitable to potentially reach a broader range of participants.

Data Analysis

  • Survey data analysis methods vary based on the type of questions used (closed-ended or open-ended).
  • Quantitative data analysis focuses on descriptive statistics, which summarize data.
  • Qualitative data analysis involves deeper interpretation, including coding and thematic analysis, of open-ended responses.

Summary

  • Surveys are powerful tools but their use requires careful consideration of design, methodology, and intended implications.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Quiz Team

Related Documents

Surveys in Human-Computer Interaction PDF

Description

Explore the role of surveys as a key research method in various fields, including human-computer interaction. This quiz delves into the benefits and drawbacks of surveys, their design, and their impact on data reliability. Test your knowledge on how surveys gather data efficiently and their limitations.

More Like This

Exploring ICTs in Nigerian Mass Media
5 questions

Exploring ICTs in Nigerian Mass Media

InvigoratingExuberance avatar
InvigoratingExuberance
Phase 1 Survey Planning and Objectives
10 questions

Phase 1 Survey Planning and Objectives

ManeuverablePrehnite avatar
ManeuverablePrehnite
Data Collection Methods Overview
50 questions

Data Collection Methods Overview

MercifulSymbol avatar
MercifulSymbol
Survey Methods and Issues
21 questions

Survey Methods and Issues

LowCostBay avatar
LowCostBay
Use Quizgecko on...
Browser
Open
Browser
Browser