Podcast
Questions and Answers
Which of the following is NOT a characteristic of effective questionnaire questions?
Which of the following is NOT a characteristic of effective questionnaire questions?
What is acquiescence bias?
What is acquiescence bias?
What is the difference between reliability and validity?
What is the difference between reliability and validity?
What are some methods for evaluating test reliability?
What are some methods for evaluating test reliability?
Signup and view all the answers
Which of the following is NOT a test of validity?
Which of the following is NOT a test of validity?
Signup and view all the answers
Why is analyzing Likert scale data controversial?
Why is analyzing Likert scale data controversial?
Signup and view all the answers
What has Dr. Geoff Norman found about using parametric tests for Likert scale data?
What has Dr. Geoff Norman found about using parametric tests for Likert scale data?
Signup and view all the answers
What should be reported to give an impression of the average response for Likert scale data?
What should be reported to give an impression of the average response for Likert scale data?
Signup and view all the answers
Why should longer questions be avoided in questionnaire design?
Why should longer questions be avoided in questionnaire design?
Signup and view all the answers
Why are specific and concrete questions better than general questions in questionnaire design?
Why are specific and concrete questions better than general questions in questionnaire design?
Signup and view all the answers
What is a double-barreled question?
What is a double-barreled question?
Signup and view all the answers
What should be avoided in questionnaire design to ensure questions are unambiguous?
What should be avoided in questionnaire design to ensure questions are unambiguous?
Signup and view all the answers
Which of the following is NOT a characteristic of effective questionnaire questions?
Which of the following is NOT a characteristic of effective questionnaire questions?
Signup and view all the answers
What is acquiescence bias?
What is acquiescence bias?
Signup and view all the answers
What is the difference between reliability and validity?
What is the difference between reliability and validity?
Signup and view all the answers
What are some methods for evaluating test reliability?
What are some methods for evaluating test reliability?
Signup and view all the answers
Which of the following is NOT a test of validity?
Which of the following is NOT a test of validity?
Signup and view all the answers
Why is analyzing Likert scale data controversial?
Why is analyzing Likert scale data controversial?
Signup and view all the answers
What has Dr. Geoff Norman found about using parametric tests for Likert scale data?
What has Dr. Geoff Norman found about using parametric tests for Likert scale data?
Signup and view all the answers
What should be reported to give an impression of the average response for Likert scale data?
What should be reported to give an impression of the average response for Likert scale data?
Signup and view all the answers
Why should longer questions be avoided in questionnaire design?
Why should longer questions be avoided in questionnaire design?
Signup and view all the answers
Why are specific and concrete questions better than general questions in questionnaire design?
Why are specific and concrete questions better than general questions in questionnaire design?
Signup and view all the answers
What is a double-barreled question?
What is a double-barreled question?
Signup and view all the answers
What should be avoided in questionnaire design to ensure questions are unambiguous?
What should be avoided in questionnaire design to ensure questions are unambiguous?
Signup and view all the answers
Which of the following is NOT a characteristic of effective questionnaire questions?
Which of the following is NOT a characteristic of effective questionnaire questions?
Signup and view all the answers
What is the term used to describe the phenomenon where participants tend to agree with statements in a questionnaire?
What is the term used to describe the phenomenon where participants tend to agree with statements in a questionnaire?
Signup and view all the answers
What is the difference between reliability and validity in questionnaire design?
What is the difference between reliability and validity in questionnaire design?
Signup and view all the answers
Which of the following is NOT a method for evaluating the reliability of a test?
Which of the following is NOT a method for evaluating the reliability of a test?
Signup and view all the answers
Which of the following is NOT a test of validity in questionnaire design?
Which of the following is NOT a test of validity in questionnaire design?
Signup and view all the answers
What is the controversy surrounding the analysis of Likert scale data?
What is the controversy surrounding the analysis of Likert scale data?
Signup and view all the answers
What is the recommended method for reporting the average response for Likert scale data?
What is the recommended method for reporting the average response for Likert scale data?
Signup and view all the answers
According to Dr. Geoff Norman, what is the evidence for using parametric tests for analyzing Likert scale data?
According to Dr. Geoff Norman, what is the evidence for using parametric tests for analyzing Likert scale data?
Signup and view all the answers
Why should longer questions be avoided in questionnaire design?
Why should longer questions be avoided in questionnaire design?
Signup and view all the answers
Why are double-barreled questions problematic in questionnaire design?
Why are double-barreled questions problematic in questionnaire design?
Signup and view all the answers
Which of the following response scales should be chosen carefully to avoid acquiescence bias?
Which of the following response scales should be chosen carefully to avoid acquiescence bias?
Signup and view all the answers
What is the correlation coefficient used for in evaluating the reliability of a test?
What is the correlation coefficient used for in evaluating the reliability of a test?
Signup and view all the answers
Study Notes
Creating and Analyzing Questionnaires: Psychometrics
- Creating effective questions for a questionnaire requires using clear wording that is brief, relevant, unambiguous, specific, and objective.
- Ambiguous phrasing, double-barreled questions, leading questions, and technical jargon should be avoided in questionnaire design.
- Response scales for Likert scales should be chosen carefully to avoid acquiescence bias, and some items should be reverse scored to ensure participants are thoughtful in their responses.
- Reliability refers to the consistency of a measuring instrument, while validity refers to whether the scale measures what it is supposed to.
- Tests can be evaluated for reliability using the test-retest method, split-half method, or alternative forms method, and the correlation coefficient can be used to measure the strength of the relationship between two variables.
- Face validity, ecological validity, construct validity, and discriminant validity are all tests of validity that can be used to ensure the scale reflects the theoretical constructs on which it is based.
- Analyzing Likert scale data can be controversial, as the data is technically ordinal but is often analyzed using parametric tests such as ANOVA, regression, and Pearson correlation.
- Dr. Geoff Norman has found compelling evidence to support using parametric tests for Likert scale data, as they are generally more robust than nonparametric equivalents.
- To give an impression of the average response for Likert scale data, the median should be reported, and parametric tests can be used to analyze Likert scale responses across participants.
- Longer questions should be avoided, as they are more difficult to answer and increase the chance of participants skimming through the questionnaire.
- Specific and concrete questions are better than general questions, as they communicate the same meaning to all respondents.
- Double-barreled questions should be avoided, as they combine two questions into one and can lead to agreement/disagreement with both parts of the item.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Description
Do you want to create effective questionnaires for your research or business needs? This quiz on Creating and Analyzing Questionnaires: Psychometrics is designed to provide you with a comprehensive understanding of questionnaire design and the psychometric properties of measuring instruments. Learn how to create clear, specific, and objective questions, choose appropriate response scales, and analyze Likert scale data using parametric tests. Take this quiz to test your knowledge and improve your skills in questionnaire design and analysis.
