Survey Design and Administration Quiz
59 Questions
1 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What type of fixed design often looks at many more variables than an experiment or quasi-experiment?

  • Single case design
  • Experimental design
  • Quasi-experimental design
  • Non-experimental fixed design (correct)
  • Which type of non-experimental fixed design might examine the relationship between physician age and type of care received?

  • Longitudinal design
  • Comparative design
  • Relational design (correct)
  • Cross-sectional survey
  • What type of design gives a picture of something at one point in time and looks at many variables at once?

  • Cross-sectional survey (correct)
  • Experimental design
  • Longitudinal design
  • Comparative design
  • Which type of scaling is the most common for responses?

    <p>Likert</p> Signup and view all the answers

    What is the purpose of pilot testing in research?

    <p>To assess how well a questionnaire works prior to administration</p> Signup and view all the answers

    What is the main difference between a highly structured survey and a flexible survey?

    <p>Highly structured surveys have fixed designs with close-ended questions, while flexible surveys allow for rewording and reordering of questions</p> Signup and view all the answers

    What is the purpose of the multitrait-multimethod matrix approach in research?

    <p>To collect data on multiple related concepts using relational approaches and multiple methods</p> Signup and view all the answers

    What is the main concern when a measurement is valid but not reliable?

    <p>The answers are related to the target but not consistent</p> Signup and view all the answers

    What does a floor effect and a ceiling effect indicate in research?

    <p>The measure is not sensitive enough to detect lower or upper limits of the variable</p> Signup and view all the answers

    What is the purpose of conducting interviews in research?

    <p>To gather in-depth information from individuals or groups</p> Signup and view all the answers

    What is the primary reason for using a multitrait-multimethod matrix approach in research?

    <p>To assess the convergent, discriminant, and predictive validity of measurement instruments</p> Signup and view all the answers

    Which type of survey method is good for non-threatening situations and fast data collection?

    <p>In-person interviews</p> Signup and view all the answers

    What is the primary concern regarding the value of surveys according to researchers?

    <p>Social desirability bias</p> Signup and view all the answers

    What does generalizability reflect in a study?

    <p>The extent to which study findings can be applied to the general population</p> Signup and view all the answers

    What is a crucial factor in determining whether to use a sample or census approach?

    <p>Feasibility and availability of a list</p> Signup and view all the answers

    What is important to ensure when determining the sample size for a study?

    <p>Representativeness within reason</p> Signup and view all the answers

    What is power analysis crucial for in research studies?

    <p>Determining sample sizes and ensuring studies have enough power to detect differences or relationships</p> Signup and view all the answers

    What does power analysis help to avoid in research studies?

    <p>Type 2 errors (failure to detect an effect that exists)</p> Signup and view all the answers

    What is a sampling plan primarily focused on?

    <p>Careful consideration of the population, sampling approach, sample size, and type of sample</p> Signup and view all the answers

    What is the primary purpose of a sampling frame?

    <p>To be representative of the population of interest</p> Signup and view all the answers

    What is the primary consideration in determining whether to use paper and pencil/online surveys?

    <p>Careful consideration of instrument design, sample, and response rates</p> Signup and view all the answers

    What is a crucial factor in determining the appropriate sampling approach?

    <p>Careful consideration of the population and feasibility</p> Signup and view all the answers

    What is a key consideration in determining the sample size for a study?

    <p>Ensuring studies have enough power to detect differences or relationships</p> Signup and view all the answers

    What does reliability measure in social science research?

    <p>Consistency of an item, scale, or instrument when administered at different times, locations, or to different populations</p> Signup and view all the answers

    What does a reliability estimate ranging from 0 to 1 indicate?

    <p>The proportion of variability in the measure attributable to the true score</p> Signup and view all the answers

    What is participative leadership characterized by?

    <p>Seeking input from employees on company decisions</p> Signup and view all the answers

    What does construct validity concern in social science research?

    <p>The logic of items comprising measures of social concepts</p> Signup and view all the answers

    What does criterion-related validity examine?

    <p>Whether a measure relates to other constructs as expected</p> Signup and view all the answers

    What statistical technique is used to uncover the underlying structure and dimensionality of constructs?

    <p>Factor analysis</p> Signup and view all the answers

    How can the dimensionality of a construct be assessed?

    <p>Using factor analysis</p> Signup and view all the answers

    What is Cronbach’s alpha used to establish?

    <p>Reliability</p> Signup and view all the answers

    How can reliability be estimated in experimental and quasi designs?

    <p>Through split-half reliability and test-retest reliability</p> Signup and view all the answers

    What is involved in establishing construct validity?

    <p>Assessing face and content validity, as well as a relational approach</p> Signup and view all the answers

    What was used to develop a self-report measure of clinicians’ orientation toward integrative medicine?

    <p>Interviews, free pile sorting, and item-scale correlations</p> Signup and view all the answers

    What is challenging and requires assessing face and content validity, as well as a relational approach?

    <p>Establishing construct validity</p> Signup and view all the answers

    Which method can be used to estimate the reliability of survey measures?

    <p>Cronbach's alpha</p> Signup and view all the answers

    What is the recommended data collection period with reminders for surveys?

    <p>At least 2 months</p> Signup and view all the answers

    What is the most important aspect of good survey measures?

    <p>Reliability</p> Signup and view all the answers

    What should good questionnaire measures ensure in relation to respondents' knowledge or experience?

    <p>Relevance</p> Signup and view all the answers

    What is essential for ensuring the quality of survey measures?

    <p>Good psychometrics</p> Signup and view all the answers

    What is important for behavior-focused questions in surveys?

    <p>Measuring what people say they do</p> Signup and view all the answers

    What should the length of a survey be tailored to?

    <p>The audience</p> Signup and view all the answers

    What should good response options in surveys be?

    <p>Accurate, exhaustive, mutually exclusive, and on the same dimension</p> Signup and view all the answers

    What should be avoided in survey questions to ensure clarity?

    <p>Double-barreled or leading questions</p> Signup and view all the answers

    What is important for the ability to generalize findings from surveys?

    <p>Sample selection and response rates</p> Signup and view all the answers

    What should be considered in survey follow-up procedures?

    <p>Sending multiple mailings and tracking all correspondence carefully</p> Signup and view all the answers

    What should good questionnaire measures ensure in relation to language?

    <p>Using simple, unambiguous language</p> Signup and view all the answers

    What is the primary purpose of power calculation in research studies?

    <p>To determine the appropriate sample size for a study</p> Signup and view all the answers

    In probability sampling, what does it allow for?

    <p>Generalization from the sample to the population</p> Signup and view all the answers

    What is the primary purpose of cluster sampling?

    <p>Used when a complete list of the population is not available</p> Signup and view all the answers

    What is a key consideration for enhancing survey response rates?

    <p>Increasing generalizability</p> Signup and view all the answers

    What is a primary role of confidentiality in survey development?

    <p>Addressing concerns about data usage</p> Signup and view all the answers

    What should cover letters for surveys include?

    <p>Specific details about the study, purpose, risks, benefits, privacy, and participant responsibilities</p> Signup and view all the answers

    What can incentives be used for in survey research?

    <p>Increase survey response rates and participant engagement</p> Signup and view all the answers

    What is important to consider when designing research studies?

    <p>The potential benefits and drawbacks of different survey methods and sampling techniques</p> Signup and view all the answers

    What is crucial for generalizability in research?

    <p>Considerations of the sampling frame, sample representation, and respondent representation</p> Signup and view all the answers

    What plays essential roles in survey development?

    <p>Survey design and layout, pretesting, and confidentiality or anonymity</p> Signup and view all the answers

    What is a characteristic of non-probability sampling methods?

    <p>Convenience, dimensional, purposive, and snowball sampling</p> Signup and view all the answers

    What are types of probability samples?

    <p>Simple random, systematic, stratified, and cluster sampling</p> Signup and view all the answers

    Study Notes

    Survey Follow-up Procedures and Questionnaire Measures

    • The follow-up procedures for surveys involve sending multiple mailings and tracking all correspondence carefully.
    • Web-based surveys have different issues including shorter timelines, email address accuracy, and differences in attention to email vs. mail survey invitations.
    • It is recommended to avoid conducting surveys during Christmas and summer holiday times, and data collection with reminders typically takes at least 2 months.
    • The ability to generalize findings from surveys depends on how the sample is chosen and the response rates, including any non-response bias.
    • Good questionnaire measures should be clear, easy to recall, and relevant to the respondents' knowledge or experience, ensuring validity and variability.
    • The length of the survey should be tailored to the audience, using simple, unambiguous language and avoiding double-barreled or leading questions.
    • Specific reference frames, sensitivity, and explicitness about personal feelings should be considered, while avoiding prestige bias and asking for personal details in a sensitive way.
    • Behavior-focused questions are important for measuring what people say they do, and good response options should be accurate, exhaustive, mutually exclusive, and on the same dimension.
    • New and existing measures have their advantages and disadvantages, such as the ability to compare data with existing measures but potential limitations in meeting specific needs.
    • The two most important aspects of good measures are reliability and construct validity, which involve measuring consistency and ensuring that what is measured aligns with the intended construct.
    • Reliability reflects the consistency of measurement across different situations and times, and it is estimated through various methods such as Cronbach's alpha and split halves reliability.
    • Good psychometrics, including reliability and validity, are essential for ensuring the quality of survey measures.

    Research Methods and Survey Design

    • Power calculation is crucial in determining the appropriate sample size for a study, with 80% power being a rule of thumb for detecting relationships.
    • Probability sampling allows for generalization from the sample to the population, while non-probability sampling does not.
    • Types of probability samples include simple random, systematic, stratified, and cluster sampling, each with specific applications.
    • Non-probability sampling methods include convenience, dimensional, purposive, and snowball sampling.
    • Cluster sampling is used when a complete list of the population is not available, and random sampling would be too costly.
    • Generalizability in research requires considerations of the sampling frame, sample representation, and respondent representation.
    • Enhancing survey response rates is critical for increasing generalizability and can be achieved through various survey design and administration strategies.
    • Survey design and layout, pretesting, and confidentiality or anonymity play essential roles in survey development.
    • Confidentiality in surveys may raise concerns about data usage, while anonymity can encourage honest responses.
    • Cover letters for surveys should include specific details about the study, purpose, risks, benefits, privacy, and participant responsibilities.
    • Incentives can be used to increase survey response rates and participant engagement.
    • It is important to consider the potential benefits and drawbacks of different survey methods and sampling techniques when designing research studies.

    Studying That Suits You

    Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

    Quiz Team

    Related Documents

    HLST 4200 Exam Review PDF

    Description

    Test your knowledge of survey follow-up procedures, questionnaire measures, research methods, and survey design with this comprehensive quiz. Challenge yourself with questions on survey response rates, sampling methods, survey layout, reliability, and validity. Assess your understanding of survey design and administration strategies, and enhance your expertise in conducting high-quality surveys.

    More Like This

    Survey Follow-Up Procedures Quiz
    10 questions
    Survey Follow-Up Procedures Quiz
    12 questions
    Survey Follow-Up Procedures Quiz
    24 questions
    Survey Follow-Up Procedures Quiz
    10 questions
    Use Quizgecko on...
    Browser
    Browser