Research Methods: Online Surveys and Interviews

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to Lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is one method to reduce concerns about disguising research?

  • Including as many detailed questions as possible
  • Allowing respondents to remain anonymous
  • Letting respondents know the study is 'blind' and why (correct)
  • Avoiding any form of debriefing

Which of the following is a notable disadvantage of telephone interviewing?

  • Higher cost than personal interviews
  • Challenges related to mobile technology (correct)
  • Increased ability to connect with respondents
  • Improved response rates

Which of the following statements about personal interviews is false?

  • They tend to be time- and cost-intensive
  • They involve a direct, face-to-face conversation
  • They allow for great flexibility in questioning
  • They are typically low in interviewer bias (correct)

Which of the following is not a method for optimizing online surveys?

<p>Using complex technical terms (D)</p> Signup and view all the answers

What is a key advantage of online surveys compared to traditional methods?

<p>Typically quick and inexpensive (C)</p> Signup and view all the answers

Which of the following characteristics is true for online surveys?

<p>They have become increasingly popular in recent years (A)</p> Signup and view all the answers

What is a method for increasing engagement in online surveys?

<p>Keeping the survey interactive (C)</p> Signup and view all the answers

What is one key factor influencing response rates in online surveys?

<p>The perceived incentives for completion (D)</p> Signup and view all the answers

What is one of the most important actions to take before launching a questionnaire?

<p>Conduct a pretest (B)</p> Signup and view all the answers

Which of the following is a key consideration when creating closed-ended questions?

<p>Include an option for 'don't know' if applicable (A)</p> Signup and view all the answers

Which of the following does not apply to sampling error?

<p>Should be the focus as the single most important error (C)</p> Signup and view all the answers

Which wording practice should be avoided when formulating survey questions?

<p>Employing ambiguous language (C)</p> Signup and view all the answers

Which of the following is a source of error besides sampling error?

<p>Noncoverage (B)</p> Signup and view all the answers

What is a convenience sample?

<p>A sample taken from respondents readily available at a location (C)</p> Signup and view all the answers

Why is sampling error considered less troublesome compared to other errors?

<p>It can be estimated and accounted for (D)</p> Signup and view all the answers

What distinguishes a census from a sample?

<p>A census examines all population members, while a sample examines a subset (B)</p> Signup and view all the answers

Why is probability sampling preferred?

<p>It facilitates statistical inference about the population (B)</p> Signup and view all the answers

What is the primary goal in sample surveys regarding sources of error?

<p>To decrease total or overall error (B)</p> Signup and view all the answers

The degree of nonresponse in a survey is an indicator of what?

<p>Overall quality of the survey (D)</p> Signup and view all the answers

What is snowball sampling typically used for?

<p>Accessing special, hard-to-reach populations (D)</p> Signup and view all the answers

Which option describes a potential drawback of double-barrel questions?

<p>They can confuse respondents about what is being asked (D)</p> Signup and view all the answers

Which strategy is NOT effective in handling nonresponse?

<p>Ignoring nonresponse cases completely (D)</p> Signup and view all the answers

Which of the following statements about nonresponse is true?

<p>Nonresponse can be common even in large samples (D)</p> Signup and view all the answers

What is a common result of recording errors in a survey?

<p>Inaccurate data analysis (B)</p> Signup and view all the answers

What is the first step in preparing for regression analysis?

<p>Identify the Y and X variables (B)</p> Signup and view all the answers

Which statistical method is used to compare means between two categorical and one continuous variable?

<p>Independent samples t-test (C)</p> Signup and view all the answers

In regression output, what does Multiple R represent?

<p>The strength of the relationship between Y and X variables (C)</p> Signup and view all the answers

What is the role of the categorical variable in an independent samples t-test?

<p>To classify data into two groups (A)</p> Signup and view all the answers

What must be done to the X and Y variables before performing regression analysis?

<p>They must be adjacent and any missing values filled (B)</p> Signup and view all the answers

Which of the following statements is true regarding the use of pivot tables?

<p>They can examine relationships between both categorical and continuous variables. (D)</p> Signup and view all the answers

What does Multiple Regression involve?

<p>Two or more predictor variables (D)</p> Signup and view all the answers

Which of the following is not a characteristic of observational research?

<p>It accurately predicts future behaviors. (D)</p> Signup and view all the answers

Which of these factors is most likely to improve response rates?

<p>Survey length (A)</p> Signup and view all the answers

Which strategy is least effective in addressing respondent nonresponse?

<p>Place sensitive questions right up front (B)</p> Signup and view all the answers

Which of the following tasks should be performed in the data preparation stage to ensure quality?

<p>Checking for consistency across responses (B)</p> Signup and view all the answers

Which of the following is typically included in preliminary steps of data analysis?

<p>Editing or cleaning the data (A)</p> Signup and view all the answers

What method is commonly used to determine whether respondents are not thinking carefully about their answers?

<p>Identifying straight lining in their responses (D)</p> Signup and view all the answers

Which of these actions would best ensure that data quality standards are maintained?

<p>Converting all responses to consistent formats (D)</p> Signup and view all the answers

Which of the following techniques can enhance a survey's ability to lower nonresponse rates?

<p>Personalization of survey invitations (A)</p> Signup and view all the answers

What is critical to assess in the data preparation stage in order to maintain quality?

<p>Deleting records with high nonresponse rates (D)</p> Signup and view all the answers

What does the coefficient of multiple determination (R2) indicate?

<p>How much variation in the dependent variable is explained by the independent variables (C)</p> Signup and view all the answers

What type of variables does a Chi-Square Good-of-fit Test typically analyze?

<p>Categorical variables (B)</p> Signup and view all the answers

Which statement correctly describes the difference between univariate and multivariate analysis?

<p>Univariate analysis examines one variable at a time, while multivariate analysis looks at relationships among multiple variables. (C)</p> Signup and view all the answers

What is the purpose of a one-sample t-test?

<p>To compare the mean of a sample to a known value (A)</p> Signup and view all the answers

Which of the following is NOT one of the three MUST HAVES for effective communication?

<p>Using complex jargon for clarity (A)</p> Signup and view all the answers

What is meant by research reports serving as an archive?

<p>They are records of completed research for reference and future use. (A)</p> Signup and view all the answers

In regression analysis, which statistical measure is used along with the p-value to determine model significance?

<p>F statistic (A)</p> Signup and view all the answers

What is a fundamental rule in research presentations aside from knowing your audience?

<p>Thorough knowledge of the topic (D)</p> Signup and view all the answers

Flashcards

Dependent Variable (Y)

In a regression analysis, the variable that is being predicted or explained. It's the 'outcome' variable we are trying to understand.

Independent Variables (X)

In regression analysis, these are the variables that are used to explain or predict the dependent variable. They are the potential 'causes' or 'influencers' of the outcome.

Cross-Tabulation

A statistical technique used for examining the relationship between two categorical variables. It's often used to see how often different categories occur together.

Independent Samples t-test

A statistical test used to compare the mean of two groups where one variable is categorical and the other is continuous. It's used to determine if there's a significant difference in the means of the two groups.

Signup and view all the flashcards

Primary Research

A type of research where data is collected directly from individuals by asking questions.

Signup and view all the flashcards

Observation Research

A type of research where information is gathered by observing individuals or situations. It doesn't involve directly asking questions.

Signup and view all the flashcards

Why Questions

Qualitative research methods are most useful for understanding "why" something happens, exploring motivations and reasons behind actions and behaviors.

Signup and view all the flashcards

Debriefing in Research

One way to address concerns about deception in research is to debrief participants after data collection. This involves providing them with detailed information about the study's purpose, methods, and any withholding of information.

Signup and view all the flashcards

Personal Interviews

Personal interviews are face-to-face conversations used to gather detailed information from respondents. They offer high sampling control, flexibility, and allow for rich data collection, but they are time-consuming and expensive.

Signup and view all the flashcards

Online Surveys

Online surveys are administered through websites or other online platforms. They offer flexibility, visuals, and quick, inexpensive data collection, but response rates can be low.

Signup and view all the flashcards

Optimizing Online Surveys

Online surveys can be improved by keeping them short, optimizing for mobile devices, using simple questions, incorporating visuals, and conducting pretesting.

Signup and view all the flashcards

Blind Study

A common way to lessen concerns about disguised research is to inform respondents that the study is "blind" and explain the reasons for this approach.

Signup and view all the flashcards

Opt-out Option in Research

One way to address ethical concerns in research is to give respondents the option to opt out of participating in the study.

Signup and view all the flashcards

Flexibility vs. Response Rates in Online Surveys

A key characteristic of online surveys is their flexibility, allowing for visual content and complex questions. However, response rates can be low, which poses a limitation to this method.

Signup and view all the flashcards

Sampling Error

An error that occurs due to random chance when selecting a sample from a larger population. It can be influenced by the size of the sample.

Signup and view all the flashcards

Non-Sampling Error

Errors that occur during the data collection process, such as non-coverage, non-response, or response errors, and also include recording and administrative mistakes.

Signup and view all the flashcards

Non-Coverage Error

The failure to include all qualified elements of the defined population in the sampling frame. This can lead to biased results.

Signup and view all the flashcards

Non-Response Error

Failure to obtain information from some of the sample elements of the population. This can be due to refusal to participate or being unavailable.

Signup and view all the flashcards

Response Error

Occurs when individuals provide inaccurate responses, either intentionally or unintentionally. This can be due to misunderstanding the questions.

Signup and view all the flashcards

Recording Error

Errors that occur during data editing, coding, or analysis. These can be human errors or due to software malfunctions.

Signup and view all the flashcards

Administrative Error

Errors that occur during the administration of the research, such as sample selection or data collection management issues.

Signup and view all the flashcards

What is the primary focus of reducing in sample surveys?

The goal in sample surveys is to decrease ________ error, not any one source of error.

Signup and view all the flashcards

What are three ways to increase response rates?

Strategies that can increase the likelihood of people completing surveys.

Signup and view all the flashcards

Which of the following will NOT help lessen respondent nonresponse?

Placing sensitive questions at the beginning can make respondents feel uncomfortable and less likely to continue.

Signup and view all the flashcards

Name two tasks in the data preparation stage to ensure quality standards are met.

These tasks ensure data quality and consistency for valid analysis.

Signup and view all the flashcards

Preliminary steps in the data analysis phase involve which of the following steps?

These steps are essential for preparing the data for analysis.

Signup and view all the flashcards

What is a pretest and why is it crucial?

A pretest helps identify potential issues with your questionnaire before you launch it. This can include things like unclear questions, confusing instructions, and response options that do not adequately capture the range of answers. By identifying these issues early on, you can prevent wasting time and resources on a flawed questionnaire.

Signup and view all the flashcards

What are closed-ended questions and what are considerations when creating them?

Closed-ended questions provide a limited set of responses. These questions are designed to have only one answer and can be structured with scales, checkboxes, or drop-down menus. Two key considerations include ensuring that all possible responses are covered and that the responses are mutually exclusive to avoid any overlap in meaning.

Signup and view all the flashcards

Why is simple language important in designing survey questions?

Avoid using complex words or phrases that might confuse respondents. Focus on using simple language that everyone can understand easily. Simple language makes the questionnaire more accessible and increases the likelihood of accurate and reliable responses.

Signup and view all the flashcards

What is a census?

A census involves collecting data from every single member of the population you are studying. It provides a complete picture of the population, but can be very time-consuming and expensive.

Signup and view all the flashcards

What is a sample?

A sample is a smaller group of individuals or entities that represents a larger population. It allows researchers to gather information from a manageable subset, making it easier to study a phenomenon. Samples are often used to draw inferences about the entire population.

Signup and view all the flashcards

Why is probability sampling the preferred approach?

Probability sampling is considered the preferred approach because it allows researchers to estimate sampling error. This means they can determine the extent to which their results are representative of the population. This enables more accurate inferences about the overall population based on the sample data.

Signup and view all the flashcards

What is snowball sampling and when might it be used?

Snowball sampling is a special type of judgment sample that is used to reach specific, hard-to-find populations. It starts by identifying an initial set of individuals with specific characteristics and then asking them to refer other individuals with similar characteristics. This technique is particularly useful when studying niche groups or communities.

Signup and view all the flashcards

How does precision differ from confidence?

Precision refers to how close multiple measurements of the same thing are to each other. Confidence, on the other hand, expresses the certainty with which we can claim that the true value of a population falls within a specific range. Higher confidence levels indicate a greater degree of certainty in the findings.

Signup and view all the flashcards

Regression Analysis

A statistical technique used to understand the relationship between a set of independent (predictor) variables and a dependent (outcome) variable.

Signup and view all the flashcards

Coefficient of Multiple Determination (R2)

A statistic (R2) used in regression that represents the proportion of variation in the dependent variable that is explained by the independent variables. It essentially reveals how well the model fits the data.

Signup and view all the flashcards

F-statistic and p-value in Regression

A statistical test to see if the overall model is significant, meaning there's a significant relationship between the independent and dependent variables.

Signup and view all the flashcards

Chi-Square Goodness-of-Fit Test

A statistical test comparing observed frequencies of categorical variables to expected frequencies, to check if there is a significant difference between them.

Signup and view all the flashcards

Univariate Analysis

Analysis based on one variable at a time, describing patterns or characteristics of that single variable.

Signup and view all the flashcards

Multivariate Analysis

Analysis that examines the relationships between multiple variables, allowing for more complex understanding of data and its patterns.

Signup and view all the flashcards

One-Sample t-test

A statistical test comparing the mean of a sample of continuous data to a known value (population mean or historical mean).

Signup and view all the flashcards

Chi-Square Test of Independence

A statistical test that examines the relationship between two categorical variables. It tells you if there is a significant association between the categories of these variables.

Signup and view all the flashcards

Study Notes

CS 201 Exam 2 Review

  • Exam 2 review focuses on data analysis.

Data Analysis Review

  • Data analysis should begin by asking questions about the data.
  • Questions need to be answered by considering variables, the number of variables, and type of variables.
  • Examples of analysis considerations include:
    • How many members used the circuit?
    • What is the average monthly revenue?
    • Describe members' visits/pool usage.
    • How often do pool users visit AFC?
    • Is member fitness or social aspects more important?
    • Relationship between likelihood to recommend and visits?
    • Impact of age, likelihood to recommend, and education on fees.

Types of Analysis

  • Univariate Analysis: Focuses on a single variable, describing the data.
    • Examples: How many members used the exercise circuit, average monthly revenue of AFC?
  • Bivariate Analysis: Examines the relationship between two variables.
    • Examples: Pool users versus non-pool users visiting AFC, social aspects or fitness importance rating.
  • Multivariate Analysis: Examines the relationship among three or more variables.
    • Examples: Influence of age, likelihood to recommend, and education on fees.

Excel Commands

  • Count of members using exercise circuit: Use the =countif function.
  • Average monthly revenue: Use the average function.
  • Describe member visits: Run Descriptive Statistics Summary in Excel.
  • Compare pool users versus non-users: Run an independent samples t-test.
  • Compare social and fitness importance: Run a paired samples t-test.
  • Relationship between likelihood to recommend and visits: Use the =correl function for correlation.
  • Influence of age, likelihood to recommend, and education on fees: Use regression analysis.

Observation Research

  • Observation research is less versatile than other methods, observing behavior in the moment and not revealing "why." It cannot measure future intentions. It is highly accurate, but subjective.
  • It might require waiting for behaviors to occur.
  • Direct observation: Observing actual activity.
  • Indirect observation: Observing the outcome of activity.

Primary Research

  • Degree of structure, disguise, setting, and method of administration are factors to consider when designing primary research.
  • Questions should be standardized so responses and questions are consistent, with 'fixed alternative' being used instead of 'open-ended', wherever possible.
  • Highly structured questions are best when possible responses are known and limited in number.

Considerations for Developing Questionnaire Questions

  • Always ensure that questions are necessary and not too revealing.
  • If more than one question is needed to measure one piece of information, use multiple questions instead.
  • Make sure respondents have the necessary information to answer questions.
  • Consider whether respondents will be willing or able to provide the information.

Filter Questions

  • Filter questions are questions that determine if a respondent has the relevant knowledge or qualifies for the study.
  • They are used to screen respondents.

Questionnaire Pretesting

  • Pretesting your questionnaire before launching it is a crucial step.

Closed-Ended Questions

  • Include "don't know" options is important for closed-ended questions.
  • Responses must be exhaustive (including "other" options).
  • Responses need to be mutually exclusive to prevent confusion.
  • Be aware of response order bias.

Wording of Questions

  • Avoid simple words when possible.
  • Avoid ambiguous wording and phrasing.
  • Avoid leading questions that suggest an answer.
  • Avoid assuming respondent knowledge.
  • Avoid double-barrel questions that ask multiple things. (e.g., asking about multiple things simultaneously in a single question.

Nonprobability Sampling

  • Convenience, Judgment, and Quota sampling are types of non-probability sampling.

Census vs. Sample

  • Census: Collects data from every member of a population.
  • Sample: Collects data from a subset of a population.

Probability Sampling

  • Probability sampling is preferred because sampling error can be estimated.

Snowball Sampling

  • Snowball sampling is a judgment sampling technique to find special or hard-to-find populations.

Precision vs. Confidence

  • Precision measures the degree of error in an estimate.
  • Confidence measures the degree to which an estimate approximates the true value.

Sampling Considerations

  • Precision and variability affect sample size requirements, with a greater degree of precision and more variability requiring a larger sample size.
  • The size of the population does NOT affect sample size.

Sampling Frame

  • A sampling frame is a list of elements from which a sample is drawn.
  • Example: customer database, member directories.

Approaches to drawing a Sample

  • Probability sample: Every population element has a known chance of being selected. Examples include Simple Random, Systematic, Stratified, and Cluster sampling (including area).
  • Nonprobability sample: Relies on personal judgment. Examples include Convenience, Judgment, and Quota sampling

Target Population

  • The target population comprises all individuals or entities meeting specified criteria for a study.

Improving Precision

  • Increase the sample size.
  • Decrease the confidence level (e.g., from 95% to 90%).

Random Error

  • A temporary, personal, or measurement situation error.
  • Affects a measurement in irregular ways.
  • Difficult to control.

Data Preparation Stage

  • Convert all data to consistent units (e.g., months to years, dollars to cents).
  • Evaluate the degree of non-response and remove records with more than 50% missing data.
  • Check across responses for consistency.
  • Look for straight-lining (all responses being the same).
  • Check if branching questions were correctly followed.

Preliminary Data Analysis

  • Edit or clean the data.
  • Code and convert data into consistent symbols.
  • Execute frequency analysis.
  • Identify outliers.

Types of Primary Research

  • Descriptive: Describes a group or the relationship between variables.
  • Exploratory: Gains ideas or insights to define the problem or opportunity for study.
  • Causal: Determines cause-and-effect relationships.

Data Analysis Considerations

  • Determine the proper type of analysis (e.g., univariate, bivariate, multivariate).
  • Identify appropriate measurement levels (nominal, ordinal, interval, ratio).

Systematic Error

  • An error in measurement that affects it consistently. Also called constant error.

Chi-Square Good-of-Fit Test

  • A statistical test used with categorical variables to compare observed frequencies to expected frequencies.

Independent Samples t-test

  • A statistical test used to determine if there is a difference between the means of two groups when one variable is categorical and the other is continuous.

Correlation

  • Measures the degree of linear association between two continuous variables.
  • Correlation is not causation.

Regression

  • Identifies a "best fit" between predictor and outcome variables.
  • Shows the individual impact of predictor variables.
  • Provides a model that shows the combined impact of predictor variables (coefficient of multiple determination (R2)).
  • Uses an F-statistic and p-value to assess the model's significance.

P-value

  • A p-value is the probability of obtaining a given result if the null hypothesis was true in the population being studied.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Quiz Team

Related Documents

CS 201 Exam 2 Review PDF

More Like This

Research Methods in Surveys
22 questions

Research Methods in Surveys

ProficientYtterbium avatar
ProficientYtterbium
Data Collection Methods Quiz
9 questions
Data Collection Methods: Surveys
15 questions
Use Quizgecko on...
Browser
Browser