Survey Design and Administration Quiz

Study Flashcards Play Quiz

Questions and Answers

What type of fixed design often looks at many more variables than an experiment or quasi-experiment?

Non-experimental fixed design

Which type of non-experimental fixed design might examine the relationship between physician age and type of care received?

Relational design

What type of design gives a picture of something at one point in time and looks at many variables at once?

Cross-sectional survey

Which type of scaling is the most common for responses?

Likert Signup and view all the answers

What is the purpose of pilot testing in research?

To assess how well a questionnaire works prior to administration Signup and view all the answers

What is the main difference between a highly structured survey and a flexible survey?

Highly structured surveys have fixed designs with close-ended questions, while flexible surveys allow for rewording and reordering of questions Signup and view all the answers

What is the purpose of the multitrait-multimethod matrix approach in research?

To collect data on multiple related concepts using relational approaches and multiple methods Signup and view all the answers

What is the main concern when a measurement is valid but not reliable?

The answers are related to the target but not consistent Signup and view all the answers

What does a floor effect and a ceiling effect indicate in research?

The measure is not sensitive enough to detect lower or upper limits of the variable Signup and view all the answers

What is the purpose of conducting interviews in research?

To gather in-depth information from individuals or groups Signup and view all the answers

What is the primary reason for using a multitrait-multimethod matrix approach in research?

To assess the convergent, discriminant, and predictive validity of measurement instruments Signup and view all the answers

Which type of survey method is good for non-threatening situations and fast data collection?

In-person interviews Signup and view all the answers

What is the primary concern regarding the value of surveys according to researchers?

Social desirability bias Signup and view all the answers

What does generalizability reflect in a study?

The extent to which study findings can be applied to the general population Signup and view all the answers

What is a crucial factor in determining whether to use a sample or census approach?

Feasibility and availability of a list Signup and view all the answers

What is important to ensure when determining the sample size for a study?

Representativeness within reason Signup and view all the answers

What is power analysis crucial for in research studies?

Determining sample sizes and ensuring studies have enough power to detect differences or relationships Signup and view all the answers

What does power analysis help to avoid in research studies?

Type 2 errors (failure to detect an effect that exists) Signup and view all the answers

What is a sampling plan primarily focused on?

Careful consideration of the population, sampling approach, sample size, and type of sample Signup and view all the answers

What is the primary purpose of a sampling frame?

To be representative of the population of interest Signup and view all the answers

What is the primary consideration in determining whether to use paper and pencil/online surveys?

Careful consideration of instrument design, sample, and response rates Signup and view all the answers

What is a crucial factor in determining the appropriate sampling approach?

Careful consideration of the population and feasibility Signup and view all the answers

What is a key consideration in determining the sample size for a study?

Ensuring studies have enough power to detect differences or relationships Signup and view all the answers

What does reliability measure in social science research?

Consistency of an item, scale, or instrument when administered at different times, locations, or to different populations Signup and view all the answers

What does a reliability estimate ranging from 0 to 1 indicate?

The proportion of variability in the measure attributable to the true score Signup and view all the answers

What is participative leadership characterized by?

Seeking input from employees on company decisions Signup and view all the answers

What does construct validity concern in social science research?

The logic of items comprising measures of social concepts Signup and view all the answers

What does criterion-related validity examine?

Whether a measure relates to other constructs as expected Signup and view all the answers

What statistical technique is used to uncover the underlying structure and dimensionality of constructs?

Factor analysis Signup and view all the answers

How can the dimensionality of a construct be assessed?

Using factor analysis Signup and view all the answers

What is Cronbach’s alpha used to establish?

Reliability Signup and view all the answers

How can reliability be estimated in experimental and quasi designs?

Through split-half reliability and test-retest reliability Signup and view all the answers

What is involved in establishing construct validity?

Assessing face and content validity, as well as a relational approach Signup and view all the answers

What was used to develop a self-report measure of clinicians’ orientation toward integrative medicine?

Interviews, free pile sorting, and item-scale correlations Signup and view all the answers

What is challenging and requires assessing face and content validity, as well as a relational approach?

Establishing construct validity Signup and view all the answers

Which method can be used to estimate the reliability of survey measures?

Cronbach's alpha Signup and view all the answers

What is the recommended data collection period with reminders for surveys?

At least 2 months Signup and view all the answers

What is the most important aspect of good survey measures?

Reliability Signup and view all the answers

What should good questionnaire measures ensure in relation to respondents' knowledge or experience?

Relevance Signup and view all the answers

What is essential for ensuring the quality of survey measures?

Good psychometrics Signup and view all the answers

What is important for behavior-focused questions in surveys?

Measuring what people say they do Signup and view all the answers

What should the length of a survey be tailored to?

The audience Signup and view all the answers

What should good response options in surveys be?

Accurate, exhaustive, mutually exclusive, and on the same dimension Signup and view all the answers

What should be avoided in survey questions to ensure clarity?

Double-barreled or leading questions Signup and view all the answers

What is important for the ability to generalize findings from surveys?

Sample selection and response rates Signup and view all the answers

What should be considered in survey follow-up procedures?

Sending multiple mailings and tracking all correspondence carefully Signup and view all the answers

What should good questionnaire measures ensure in relation to language?

Using simple, unambiguous language Signup and view all the answers

What is the primary purpose of power calculation in research studies?

To determine the appropriate sample size for a study Signup and view all the answers

In probability sampling, what does it allow for?

Generalization from the sample to the population Signup and view all the answers

What is the primary purpose of cluster sampling?

Used when a complete list of the population is not available Signup and view all the answers

What is a key consideration for enhancing survey response rates?

Increasing generalizability Signup and view all the answers

What is a primary role of confidentiality in survey development?

Addressing concerns about data usage Signup and view all the answers

What should cover letters for surveys include?

Specific details about the study, purpose, risks, benefits, privacy, and participant responsibilities Signup and view all the answers

What can incentives be used for in survey research?

Increase survey response rates and participant engagement Signup and view all the answers

What is important to consider when designing research studies?

The potential benefits and drawbacks of different survey methods and sampling techniques Signup and view all the answers

What is crucial for generalizability in research?

Considerations of the sampling frame, sample representation, and respondent representation Signup and view all the answers

What plays essential roles in survey development?

Survey design and layout, pretesting, and confidentiality or anonymity Signup and view all the answers

What is a characteristic of non-probability sampling methods?

Convenience, dimensional, purposive, and snowball sampling Signup and view all the answers

What are types of probability samples?

Simple random, systematic, stratified, and cluster sampling Signup and view all the answers

Study Notes

Survey Follow-up Procedures and Questionnaire Measures

The follow-up procedures for surveys involve sending multiple mailings and tracking all correspondence carefully.
Web-based surveys have different issues including shorter timelines, email address accuracy, and differences in attention to email vs. mail survey invitations.
It is recommended to avoid conducting surveys during Christmas and summer holiday times, and data collection with reminders typically takes at least 2 months.
The ability to generalize findings from surveys depends on how the sample is chosen and the response rates, including any non-response bias.
Good questionnaire measures should be clear, easy to recall, and relevant to the respondents' knowledge or experience, ensuring validity and variability.
The length of the survey should be tailored to the audience, using simple, unambiguous language and avoiding double-barreled or leading questions.
Specific reference frames, sensitivity, and explicitness about personal feelings should be considered, while avoiding prestige bias and asking for personal details in a sensitive way.
Behavior-focused questions are important for measuring what people say they do, and good response options should be accurate, exhaustive, mutually exclusive, and on the same dimension.
New and existing measures have their advantages and disadvantages, such as the ability to compare data with existing measures but potential limitations in meeting specific needs.
The two most important aspects of good measures are reliability and construct validity, which involve measuring consistency and ensuring that what is measured aligns with the intended construct.
Reliability reflects the consistency of measurement across different situations and times, and it is estimated through various methods such as Cronbach's alpha and split halves reliability.
Good psychometrics, including reliability and validity, are essential for ensuring the quality of survey measures.

Research Methods and Survey Design

Power calculation is crucial in determining the appropriate sample size for a study, with 80% power being a rule of thumb for detecting relationships.
Probability sampling allows for generalization from the sample to the population, while non-probability sampling does not.
Types of probability samples include simple random, systematic, stratified, and cluster sampling, each with specific applications.
Non-probability sampling methods include convenience, dimensional, purposive, and snowball sampling.
Cluster sampling is used when a complete list of the population is not available, and random sampling would be too costly.
Generalizability in research requires considerations of the sampling frame, sample representation, and respondent representation.
Enhancing survey response rates is critical for increasing generalizability and can be achieved through various survey design and administration strategies.
Survey design and layout, pretesting, and confidentiality or anonymity play essential roles in survey development.
Confidentiality in surveys may raise concerns about data usage, while anonymity can encourage honest responses.
Cover letters for surveys should include specific details about the study, purpose, risks, benefits, privacy, and participant responsibilities.
Incentives can be used to increase survey response rates and participant engagement.
It is important to consider the potential benefits and drawbacks of different survey methods and sampling techniques when designing research studies.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Survey Design and Administration Quiz

Questions and Answers

What type of fixed design often looks at many more variables than an experiment or quasi-experiment?

Which type of non-experimental fixed design might examine the relationship between physician age and type of care received?

What type of design gives a picture of something at one point in time and looks at many variables at once?

Which type of scaling is the most common for responses?

What is the purpose of pilot testing in research?

What is the main difference between a highly structured survey and a flexible survey?

What is the purpose of the multitrait-multimethod matrix approach in research?

What is the main concern when a measurement is valid but not reliable?

What does a floor effect and a ceiling effect indicate in research?

What is the purpose of conducting interviews in research?

What is the primary reason for using a multitrait-multimethod matrix approach in research?

Which type of survey method is good for non-threatening situations and fast data collection?

What is the primary concern regarding the value of surveys according to researchers?

What does generalizability reflect in a study?

What is a crucial factor in determining whether to use a sample or census approach?

What is important to ensure when determining the sample size for a study?

What is power analysis crucial for in research studies?

What does power analysis help to avoid in research studies?

What is a sampling plan primarily focused on?

What is the primary purpose of a sampling frame?

What is the primary consideration in determining whether to use paper and pencil/online surveys?

What is a crucial factor in determining the appropriate sampling approach?

What is a key consideration in determining the sample size for a study?

What does reliability measure in social science research?

What does a reliability estimate ranging from 0 to 1 indicate?

What is participative leadership characterized by?

What does construct validity concern in social science research?

What does criterion-related validity examine?

What statistical technique is used to uncover the underlying structure and dimensionality of constructs?

How can the dimensionality of a construct be assessed?

What is Cronbach’s alpha used to establish?

How can reliability be estimated in experimental and quasi designs?

What is involved in establishing construct validity?

What was used to develop a self-report measure of clinicians’ orientation toward integrative medicine?

What is challenging and requires assessing face and content validity, as well as a relational approach?

Which method can be used to estimate the reliability of survey measures?

What is the recommended data collection period with reminders for surveys?

What is the most important aspect of good survey measures?

What should good questionnaire measures ensure in relation to respondents' knowledge or experience?

What is essential for ensuring the quality of survey measures?

What is important for behavior-focused questions in surveys?

What should the length of a survey be tailored to?

What should good response options in surveys be?

What should be avoided in survey questions to ensure clarity?

What is important for the ability to generalize findings from surveys?

What should be considered in survey follow-up procedures?

What should good questionnaire measures ensure in relation to language?

What is the primary purpose of power calculation in research studies?

In probability sampling, what does it allow for?

What is the primary purpose of cluster sampling?

What is a key consideration for enhancing survey response rates?

What is a primary role of confidentiality in survey development?

What should cover letters for surveys include?

What can incentives be used for in survey research?

What is important to consider when designing research studies?

What is crucial for generalizability in research?

What plays essential roles in survey development?

What is a characteristic of non-probability sampling methods?

What are types of probability samples?

Study Notes

Studying That Suits You

More Quizzes Like This

Survey Follow-Up Procedures Quiz

Survey Follow-Up Procedures Quiz

Survey Follow-Up Procedures Quiz

Survey Follow-Up Procedures Quiz