40 Questions
What is a key advantage of using questionnaires in surveys?
They can cover a wide geographic area and large numbers
Why is it important for researchers to be cautious when developing questionnaires?
To avoid bias and ensure respondents understand the questions
What type of bias may lead to challenges in using questionnaires for surveys?
Non-response bias
Which factor can enhance openness in respondents when using questionnaires?
Anonymity of responses
What is a common limitation of questionnaires in surveys?
Assumptions about respondent understanding
Which method can help ensure comparability between different sub-groups or over time when using questionnaires?
Using fixed questions
What is one method to quantify the characteristics of non-responders to postal surveys?
Analyzing late responders
In the survey of community pharmacists, what was the response rate?
75%
What characteristic showed bias towards multiples being included in the pharmacy survey?
Pharmacy type
Which deprivation level showed the highest proportion of responding pharmacies in the survey?
Moderate
What information was missing to determine if the survey was biased in terms of pharmacists' age/gender distribution?
Both age and gender
What was used as a proxy measure to understand the age/gender distribution of pharmacists in the survey?
Pharmacist register data
Which stage of questionnaire development emphasizes the importance of ensuring options are clear and mutually exclusive?
Stage 3
What is a common issue to be avoided when designing questionnaires, as mentioned in the text?
Using double negatives
Which question design involves diametrically opposed anchor statements and a number of boxes for responses?
Semantic differential
What is a disadvantage of using open-ended questions in a survey, according to the text?
Fewer responses received
Which distribution method for questionnaires is highlighted for having formatting consistency and not requiring internet access?
Paper
What is the purpose of piloting and testing a questionnaire with a different population than the target group?
Identifying potential issues
In questionnaire development, what would be considered primarily when deciding between closed and open questions?
'Options' clarity and exclusivity
What is a common limitation of Likert-type scales, as discussed in the text?
'Agree/disagree' sensitivity loss
What method can be used to test the validity of a questionnaire?
Cognitive interviewing
What is one drawback of self-administered questionnaires mentioned in the text?
Low response rates
Which technique can be used to help develop the content of a questionnaire?
Focus groups
What is the purpose of including open questions in a questionnaire?
To analyze using qualitative methods
In what situation is using two methods preferable according to the text?
When confirming results
What is a key characteristic of the UK Census mentioned in the text?
Detailed picture of the entire population
Why is it important to consider similar work done before starting a survey?
To save time and effort in development
Which stage involves developing the first draft of a questionnaire based on expert opinion or qualitative results?
Stage 3: Developing first draft
What is included in the aim and objectives definition stage of using a questionnaire?
Determination of overall purpose and key variables
What is one important consideration before starting a survey according to the text?
Acknowledgment of previous surveys
What is the purpose of cognitive interviewing in survey research?
To understand how potential respondents interpret questions
Which type of validity assesses whether a questionnaire covers the constructs fully and measures what it intends to measure?
Face validity
What does inter-rater reliability ensure in survey research?
Consistent results by different people administering the instrument
How is test-re-test reliability assessed?
By administering the questionnaire to the same population on two occasions
Which type of bias in surveys is associated with deficiencies in the survey instrument?
Measurement bias
What is a method to help maximize response rates in surveys?
Use multiple contacts and reminders
Why is it important to understand the characteristics of non-responders in a survey?
To quantify bias in the survey results
What is the purpose of including additional questions in a pilot study of a survey questionnaire?
To understand how potential respondents interpret questions
Which type of validity determines whether people understand the way a survey instrument has been constructed?
Content validity
What does internal reliability assess in a survey instrument?
Consistency among items covering similar constructs
Study Notes
Developing and Using Questionnaires
Advantages of Questionnaires
- Easily replicable
- Relatively quick to administer
- Relatively cheap
- Can cover a wide geographic area and large numbers
- Researcher has control over the focus of the questions and the answers
- Anonymity may encourage openness in respondents
- Can be analyzed quantitatively
Disadvantages of Questionnaires
- Very dependent on researcher’s perspectives
- Assumes the respondents understand what the questions mean
- May not be comparable between sub-groups or over time
- Non-responders may differ in their characteristics
- Need to consider relevant characteristics of responders and non-responders
Assessment of Questionnaire Validity and Reliability
Validity
- Face validity: does the instrument cover the constructs fully?
- Content validity: do people understand the instrument and is the content appropriate?
- Criterion-referenced validity: does the instrument measure what it's supposed to measure?
Reliability
- Inter-rater reliability: do users of the instrument administer it in the same way?
- Test-re-test reliability: does the instrument get the same results in the same population?
- Internal reliability: do items in the instrument covering similar constructs give similar results?
Bias in Surveys
Types of Bias
- Sampling bias: inappropriate sampling method
- Exclusion bias: incomplete sampling frame
- Measurement bias: instrument deficiencies
- Non-response bias: people don’t respond
Maximizing Response Rates
- Use multiple distribution methods
- Use multiple contacts and reminders
- Ensure high-quality covering letter and attractive appearance of the questionnaire
- Provide freepost envelopes and incentives
- Add endorsements from funding bodies, local NHS, or professional bodies
Dealing with Non-Responders
- Understand the characteristics of non-responders to quantify bias
- Compare characteristics of responders and non-responders
Learn about the advantages and disadvantages of using questionnaires, types of questions, methods of distributing questionnaires, assessing validity and reliability, minimizing bias, and gathering data for service development and needs assessment.
Make Your Own Quizzes and Flashcards
Convert your notes into interactive study material.
Get started for free
