🎧 New: AI-Generated Podcasts Turn your study notes into engaging audio conversations. Learn more

Mastering Questionnaire Design and Analysis
36 Questions
2 Views

Mastering Questionnaire Design and Analysis

Created by
@StrikingSnowflakeObsidian

Podcast Beta

Play an AI-generated podcast conversation about this lesson

Questions and Answers

Which of the following is NOT a characteristic of effective questionnaire questions?

  • Ambiguity (correct)
  • Objectivity
  • Relevance
  • Clear wording
  • What is acquiescence bias?

  • The tendency to agree with all questions (correct)
  • The tendency to disagree with all questions
  • The tendency to give neutral responses
  • The tendency to skip questions
  • What is the difference between reliability and validity?

  • Reliability and validity are not important in questionnaire design
  • Reliability and validity are the same thing
  • Reliability refers to whether the scale measures what it is supposed to, while validity refers to the consistency of a measuring instrument
  • Reliability refers to the consistency of a measuring instrument, while validity refers to whether the scale measures what it is supposed to (correct)
  • What are some methods for evaluating test reliability?

    <p>Test-retest method, split-half method, and alternative forms method</p> Signup and view all the answers

    Which of the following is NOT a test of validity?

    <p>Discriminant validity</p> Signup and view all the answers

    Why is analyzing Likert scale data controversial?

    <p>Because the data is technically ordinal but is often analyzed using parametric tests</p> Signup and view all the answers

    What has Dr. Geoff Norman found about using parametric tests for Likert scale data?

    <p>They are generally more robust than nonparametric equivalents</p> Signup and view all the answers

    What should be reported to give an impression of the average response for Likert scale data?

    <p>The median</p> Signup and view all the answers

    Why should longer questions be avoided in questionnaire design?

    <p>They increase the chance of participants skimming through the questionnaire</p> Signup and view all the answers

    Why are specific and concrete questions better than general questions in questionnaire design?

    <p>They communicate the same meaning to all respondents</p> Signup and view all the answers

    What is a double-barreled question?

    <p>A question that combines two questions into one</p> Signup and view all the answers

    What should be avoided in questionnaire design to ensure questions are unambiguous?

    <p>Technical jargon</p> Signup and view all the answers

    Which of the following is NOT a characteristic of effective questionnaire questions?

    <p>Ambiguity</p> Signup and view all the answers

    What is acquiescence bias?

    <p>The tendency to agree with all questions</p> Signup and view all the answers

    What is the difference between reliability and validity?

    <p>Reliability refers to the consistency of a measuring instrument, while validity refers to whether the scale measures what it is supposed to</p> Signup and view all the answers

    What are some methods for evaluating test reliability?

    <p>Test-retest method, split-half method, and alternative forms method</p> Signup and view all the answers

    Which of the following is NOT a test of validity?

    <p>Discriminant validity</p> Signup and view all the answers

    Why is analyzing Likert scale data controversial?

    <p>Because the data is technically ordinal but is often analyzed using parametric tests</p> Signup and view all the answers

    What has Dr. Geoff Norman found about using parametric tests for Likert scale data?

    <p>They are generally more robust than nonparametric equivalents</p> Signup and view all the answers

    What should be reported to give an impression of the average response for Likert scale data?

    <p>The median</p> Signup and view all the answers

    Why should longer questions be avoided in questionnaire design?

    <p>They increase the chance of participants skimming through the questionnaire</p> Signup and view all the answers

    Why are specific and concrete questions better than general questions in questionnaire design?

    <p>They communicate the same meaning to all respondents</p> Signup and view all the answers

    What is a double-barreled question?

    <p>A question that combines two questions into one</p> Signup and view all the answers

    What should be avoided in questionnaire design to ensure questions are unambiguous?

    <p>Technical jargon</p> Signup and view all the answers

    Which of the following is NOT a characteristic of effective questionnaire questions?

    <p>Ambiguity</p> Signup and view all the answers

    What is the term used to describe the phenomenon where participants tend to agree with statements in a questionnaire?

    <p>Acquiescence bias</p> Signup and view all the answers

    What is the difference between reliability and validity in questionnaire design?

    <p>Reliability refers to the consistency of a measuring instrument, while validity refers to the accuracy of the measuring instrument</p> Signup and view all the answers

    Which of the following is NOT a method for evaluating the reliability of a test?

    <p>Content analysis method</p> Signup and view all the answers

    Which of the following is NOT a test of validity in questionnaire design?

    <p>Convergent validity</p> Signup and view all the answers

    What is the controversy surrounding the analysis of Likert scale data?

    <p>The data is technically ordinal but is often analyzed using parametric tests</p> Signup and view all the answers

    What is the recommended method for reporting the average response for Likert scale data?

    <p>Median</p> Signup and view all the answers

    According to Dr. Geoff Norman, what is the evidence for using parametric tests for analyzing Likert scale data?

    <p>There is compelling evidence to support using parametric tests for Likert scale data</p> Signup and view all the answers

    Why should longer questions be avoided in questionnaire design?

    <p>They are more difficult to answer and increase the chance of participants skimming through the questionnaire</p> Signup and view all the answers

    Why are double-barreled questions problematic in questionnaire design?

    <p>They combine two questions into one and can lead to agreement/disagreement with both parts of the item</p> Signup and view all the answers

    Which of the following response scales should be chosen carefully to avoid acquiescence bias?

    <p>Odd-numbered scales</p> Signup and view all the answers

    What is the correlation coefficient used for in evaluating the reliability of a test?

    <p>Measuring the strength of the relationship between two variables</p> Signup and view all the answers

    Study Notes

    Creating and Analyzing Questionnaires: Psychometrics

    • Creating effective questions for a questionnaire requires using clear wording that is brief, relevant, unambiguous, specific, and objective.
    • Ambiguous phrasing, double-barreled questions, leading questions, and technical jargon should be avoided in questionnaire design.
    • Response scales for Likert scales should be chosen carefully to avoid acquiescence bias, and some items should be reverse scored to ensure participants are thoughtful in their responses.
    • Reliability refers to the consistency of a measuring instrument, while validity refers to whether the scale measures what it is supposed to.
    • Tests can be evaluated for reliability using the test-retest method, split-half method, or alternative forms method, and the correlation coefficient can be used to measure the strength of the relationship between two variables.
    • Face validity, ecological validity, construct validity, and discriminant validity are all tests of validity that can be used to ensure the scale reflects the theoretical constructs on which it is based.
    • Analyzing Likert scale data can be controversial, as the data is technically ordinal but is often analyzed using parametric tests such as ANOVA, regression, and Pearson correlation.
    • Dr. Geoff Norman has found compelling evidence to support using parametric tests for Likert scale data, as they are generally more robust than nonparametric equivalents.
    • To give an impression of the average response for Likert scale data, the median should be reported, and parametric tests can be used to analyze Likert scale responses across participants.
    • Longer questions should be avoided, as they are more difficult to answer and increase the chance of participants skimming through the questionnaire.
    • Specific and concrete questions are better than general questions, as they communicate the same meaning to all respondents.
    • Double-barreled questions should be avoided, as they combine two questions into one and can lead to agreement/disagreement with both parts of the item.

    Studying That Suits You

    Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

    Quiz Team

    Description

    Do you want to create effective questionnaires for your research or business needs? This quiz on Creating and Analyzing Questionnaires: Psychometrics is designed to provide you with a comprehensive understanding of questionnaire design and the psychometric properties of measuring instruments. Learn how to create clear, specific, and objective questions, choose appropriate response scales, and analyze Likert scale data using parametric tests. Take this quiz to test your knowledge and improve your skills in questionnaire design and analysis.

    More Quizzes Like This

    Use Quizgecko on...
    Browser
    Browser