Podcast
Questions and Answers
Which of the following is NOT a characteristic of effective questionnaire questions?
Which of the following is NOT a characteristic of effective questionnaire questions?
- Ambiguity (correct)
- Objectivity
- Relevance
- Clear wording
What is acquiescence bias?
What is acquiescence bias?
- The tendency to agree with all questions (correct)
- The tendency to disagree with all questions
- The tendency to give neutral responses
- The tendency to skip questions
What is the difference between reliability and validity?
What is the difference between reliability and validity?
- Reliability and validity are not important in questionnaire design
- Reliability and validity are the same thing
- Reliability refers to whether the scale measures what it is supposed to, while validity refers to the consistency of a measuring instrument
- Reliability refers to the consistency of a measuring instrument, while validity refers to whether the scale measures what it is supposed to (correct)
What are some methods for evaluating test reliability?
What are some methods for evaluating test reliability?
Which of the following is NOT a test of validity?
Which of the following is NOT a test of validity?
Why is analyzing Likert scale data controversial?
Why is analyzing Likert scale data controversial?
What has Dr. Geoff Norman found about using parametric tests for Likert scale data?
What has Dr. Geoff Norman found about using parametric tests for Likert scale data?
What should be reported to give an impression of the average response for Likert scale data?
What should be reported to give an impression of the average response for Likert scale data?
Why should longer questions be avoided in questionnaire design?
Why should longer questions be avoided in questionnaire design?
Why are specific and concrete questions better than general questions in questionnaire design?
Why are specific and concrete questions better than general questions in questionnaire design?
What is a double-barreled question?
What is a double-barreled question?
What should be avoided in questionnaire design to ensure questions are unambiguous?
What should be avoided in questionnaire design to ensure questions are unambiguous?
Which of the following is NOT a characteristic of effective questionnaire questions?
Which of the following is NOT a characteristic of effective questionnaire questions?
What is acquiescence bias?
What is acquiescence bias?
What is the difference between reliability and validity?
What is the difference between reliability and validity?
What are some methods for evaluating test reliability?
What are some methods for evaluating test reliability?
Which of the following is NOT a test of validity?
Which of the following is NOT a test of validity?
Why is analyzing Likert scale data controversial?
Why is analyzing Likert scale data controversial?
What has Dr. Geoff Norman found about using parametric tests for Likert scale data?
What has Dr. Geoff Norman found about using parametric tests for Likert scale data?
What should be reported to give an impression of the average response for Likert scale data?
What should be reported to give an impression of the average response for Likert scale data?
Why should longer questions be avoided in questionnaire design?
Why should longer questions be avoided in questionnaire design?
Why are specific and concrete questions better than general questions in questionnaire design?
Why are specific and concrete questions better than general questions in questionnaire design?
What is a double-barreled question?
What is a double-barreled question?
What should be avoided in questionnaire design to ensure questions are unambiguous?
What should be avoided in questionnaire design to ensure questions are unambiguous?
Which of the following is NOT a characteristic of effective questionnaire questions?
Which of the following is NOT a characteristic of effective questionnaire questions?
What is the term used to describe the phenomenon where participants tend to agree with statements in a questionnaire?
What is the term used to describe the phenomenon where participants tend to agree with statements in a questionnaire?
What is the difference between reliability and validity in questionnaire design?
What is the difference between reliability and validity in questionnaire design?
Which of the following is NOT a method for evaluating the reliability of a test?
Which of the following is NOT a method for evaluating the reliability of a test?
Which of the following is NOT a test of validity in questionnaire design?
Which of the following is NOT a test of validity in questionnaire design?
What is the controversy surrounding the analysis of Likert scale data?
What is the controversy surrounding the analysis of Likert scale data?
What is the recommended method for reporting the average response for Likert scale data?
What is the recommended method for reporting the average response for Likert scale data?
According to Dr. Geoff Norman, what is the evidence for using parametric tests for analyzing Likert scale data?
According to Dr. Geoff Norman, what is the evidence for using parametric tests for analyzing Likert scale data?
Why should longer questions be avoided in questionnaire design?
Why should longer questions be avoided in questionnaire design?
Why are double-barreled questions problematic in questionnaire design?
Why are double-barreled questions problematic in questionnaire design?
Which of the following response scales should be chosen carefully to avoid acquiescence bias?
Which of the following response scales should be chosen carefully to avoid acquiescence bias?
What is the correlation coefficient used for in evaluating the reliability of a test?
What is the correlation coefficient used for in evaluating the reliability of a test?
Study Notes
Creating and Analyzing Questionnaires: Psychometrics
- Creating effective questions for a questionnaire requires using clear wording that is brief, relevant, unambiguous, specific, and objective.
- Ambiguous phrasing, double-barreled questions, leading questions, and technical jargon should be avoided in questionnaire design.
- Response scales for Likert scales should be chosen carefully to avoid acquiescence bias, and some items should be reverse scored to ensure participants are thoughtful in their responses.
- Reliability refers to the consistency of a measuring instrument, while validity refers to whether the scale measures what it is supposed to.
- Tests can be evaluated for reliability using the test-retest method, split-half method, or alternative forms method, and the correlation coefficient can be used to measure the strength of the relationship between two variables.
- Face validity, ecological validity, construct validity, and discriminant validity are all tests of validity that can be used to ensure the scale reflects the theoretical constructs on which it is based.
- Analyzing Likert scale data can be controversial, as the data is technically ordinal but is often analyzed using parametric tests such as ANOVA, regression, and Pearson correlation.
- Dr. Geoff Norman has found compelling evidence to support using parametric tests for Likert scale data, as they are generally more robust than nonparametric equivalents.
- To give an impression of the average response for Likert scale data, the median should be reported, and parametric tests can be used to analyze Likert scale responses across participants.
- Longer questions should be avoided, as they are more difficult to answer and increase the chance of participants skimming through the questionnaire.
- Specific and concrete questions are better than general questions, as they communicate the same meaning to all respondents.
- Double-barreled questions should be avoided, as they combine two questions into one and can lead to agreement/disagreement with both parts of the item.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Description
Do you want to create effective questionnaires for your research or business needs? This quiz on Creating and Analyzing Questionnaires: Psychometrics is designed to provide you with a comprehensive understanding of questionnaire design and the psychometric properties of measuring instruments. Learn how to create clear, specific, and objective questions, choose appropriate response scales, and analyze Likert scale data using parametric tests. Take this quiz to test your knowledge and improve your skills in questionnaire design and analysis.
