Podcast
Questions and Answers
What is a key advantage of using questionnaires in surveys?
What is a key advantage of using questionnaires in surveys?
Why is it important for researchers to be cautious when developing questionnaires?
Why is it important for researchers to be cautious when developing questionnaires?
What type of bias may lead to challenges in using questionnaires for surveys?
What type of bias may lead to challenges in using questionnaires for surveys?
Which factor can enhance openness in respondents when using questionnaires?
Which factor can enhance openness in respondents when using questionnaires?
Signup and view all the answers
What is a common limitation of questionnaires in surveys?
What is a common limitation of questionnaires in surveys?
Signup and view all the answers
Which method can help ensure comparability between different sub-groups or over time when using questionnaires?
Which method can help ensure comparability between different sub-groups or over time when using questionnaires?
Signup and view all the answers
What is one method to quantify the characteristics of non-responders to postal surveys?
What is one method to quantify the characteristics of non-responders to postal surveys?
Signup and view all the answers
In the survey of community pharmacists, what was the response rate?
In the survey of community pharmacists, what was the response rate?
Signup and view all the answers
What characteristic showed bias towards multiples being included in the pharmacy survey?
What characteristic showed bias towards multiples being included in the pharmacy survey?
Signup and view all the answers
Which deprivation level showed the highest proportion of responding pharmacies in the survey?
Which deprivation level showed the highest proportion of responding pharmacies in the survey?
Signup and view all the answers
What information was missing to determine if the survey was biased in terms of pharmacists' age/gender distribution?
What information was missing to determine if the survey was biased in terms of pharmacists' age/gender distribution?
Signup and view all the answers
What was used as a proxy measure to understand the age/gender distribution of pharmacists in the survey?
What was used as a proxy measure to understand the age/gender distribution of pharmacists in the survey?
Signup and view all the answers
Which stage of questionnaire development emphasizes the importance of ensuring options are clear and mutually exclusive?
Which stage of questionnaire development emphasizes the importance of ensuring options are clear and mutually exclusive?
Signup and view all the answers
What is a common issue to be avoided when designing questionnaires, as mentioned in the text?
What is a common issue to be avoided when designing questionnaires, as mentioned in the text?
Signup and view all the answers
Which question design involves diametrically opposed anchor statements and a number of boxes for responses?
Which question design involves diametrically opposed anchor statements and a number of boxes for responses?
Signup and view all the answers
What is a disadvantage of using open-ended questions in a survey, according to the text?
What is a disadvantage of using open-ended questions in a survey, according to the text?
Signup and view all the answers
Which distribution method for questionnaires is highlighted for having formatting consistency and not requiring internet access?
Which distribution method for questionnaires is highlighted for having formatting consistency and not requiring internet access?
Signup and view all the answers
What is the purpose of piloting and testing a questionnaire with a different population than the target group?
What is the purpose of piloting and testing a questionnaire with a different population than the target group?
Signup and view all the answers
In questionnaire development, what would be considered primarily when deciding between closed and open questions?
In questionnaire development, what would be considered primarily when deciding between closed and open questions?
Signup and view all the answers
What is a common limitation of Likert-type scales, as discussed in the text?
What is a common limitation of Likert-type scales, as discussed in the text?
Signup and view all the answers
What method can be used to test the validity of a questionnaire?
What method can be used to test the validity of a questionnaire?
Signup and view all the answers
What is one drawback of self-administered questionnaires mentioned in the text?
What is one drawback of self-administered questionnaires mentioned in the text?
Signup and view all the answers
Which technique can be used to help develop the content of a questionnaire?
Which technique can be used to help develop the content of a questionnaire?
Signup and view all the answers
What is the purpose of including open questions in a questionnaire?
What is the purpose of including open questions in a questionnaire?
Signup and view all the answers
In what situation is using two methods preferable according to the text?
In what situation is using two methods preferable according to the text?
Signup and view all the answers
What is a key characteristic of the UK Census mentioned in the text?
What is a key characteristic of the UK Census mentioned in the text?
Signup and view all the answers
Why is it important to consider similar work done before starting a survey?
Why is it important to consider similar work done before starting a survey?
Signup and view all the answers
Which stage involves developing the first draft of a questionnaire based on expert opinion or qualitative results?
Which stage involves developing the first draft of a questionnaire based on expert opinion or qualitative results?
Signup and view all the answers
What is included in the aim and objectives definition stage of using a questionnaire?
What is included in the aim and objectives definition stage of using a questionnaire?
Signup and view all the answers
What is one important consideration before starting a survey according to the text?
What is one important consideration before starting a survey according to the text?
Signup and view all the answers
What is the purpose of cognitive interviewing in survey research?
What is the purpose of cognitive interviewing in survey research?
Signup and view all the answers
Which type of validity assesses whether a questionnaire covers the constructs fully and measures what it intends to measure?
Which type of validity assesses whether a questionnaire covers the constructs fully and measures what it intends to measure?
Signup and view all the answers
What does inter-rater reliability ensure in survey research?
What does inter-rater reliability ensure in survey research?
Signup and view all the answers
How is test-re-test reliability assessed?
How is test-re-test reliability assessed?
Signup and view all the answers
Which type of bias in surveys is associated with deficiencies in the survey instrument?
Which type of bias in surveys is associated with deficiencies in the survey instrument?
Signup and view all the answers
What is a method to help maximize response rates in surveys?
What is a method to help maximize response rates in surveys?
Signup and view all the answers
Why is it important to understand the characteristics of non-responders in a survey?
Why is it important to understand the characteristics of non-responders in a survey?
Signup and view all the answers
What is the purpose of including additional questions in a pilot study of a survey questionnaire?
What is the purpose of including additional questions in a pilot study of a survey questionnaire?
Signup and view all the answers
Which type of validity determines whether people understand the way a survey instrument has been constructed?
Which type of validity determines whether people understand the way a survey instrument has been constructed?
Signup and view all the answers
What does internal reliability assess in a survey instrument?
What does internal reliability assess in a survey instrument?
Signup and view all the answers
Study Notes
Developing and Using Questionnaires
Advantages of Questionnaires
- Easily replicable
- Relatively quick to administer
- Relatively cheap
- Can cover a wide geographic area and large numbers
- Researcher has control over the focus of the questions and the answers
- Anonymity may encourage openness in respondents
- Can be analyzed quantitatively
Disadvantages of Questionnaires
- Very dependent on researcher’s perspectives
- Assumes the respondents understand what the questions mean
- May not be comparable between sub-groups or over time
- Non-responders may differ in their characteristics
- Need to consider relevant characteristics of responders and non-responders
Assessment of Questionnaire Validity and Reliability
Validity
- Face validity: does the instrument cover the constructs fully?
- Content validity: do people understand the instrument and is the content appropriate?
- Criterion-referenced validity: does the instrument measure what it's supposed to measure?
Reliability
- Inter-rater reliability: do users of the instrument administer it in the same way?
- Test-re-test reliability: does the instrument get the same results in the same population?
- Internal reliability: do items in the instrument covering similar constructs give similar results?
Bias in Surveys
Types of Bias
- Sampling bias: inappropriate sampling method
- Exclusion bias: incomplete sampling frame
- Measurement bias: instrument deficiencies
- Non-response bias: people don’t respond
Maximizing Response Rates
- Use multiple distribution methods
- Use multiple contacts and reminders
- Ensure high-quality covering letter and attractive appearance of the questionnaire
- Provide freepost envelopes and incentives
- Add endorsements from funding bodies, local NHS, or professional bodies
Dealing with Non-Responders
- Understand the characteristics of non-responders to quantify bias
- Compare characteristics of responders and non-responders
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Description
Learn about the advantages and disadvantages of using questionnaires, types of questions, methods of distributing questionnaires, assessing validity and reliability, minimizing bias, and gathering data for service development and needs assessment.
