Qualitative & Quantitative Research Methods Survey Research PDF

Qualitative & Quantitative Research Method 1 Survey research | Week 1 Laurent Sovet (Ph.D.) Assistant professor in differential psychology Université Paris Cité, Boulogne-Billancourt 13...

Qualitative & Quantitative Research Method 1 Survey research | Week 1 Laurent Sovet (Ph.D.) Assistant professor in differential psychology Université Paris Cité, Boulogne-Billancourt 13 [email protected] 1. Introduction What is the survey?  Presser (1984, p. 95) “Any data collection operation that gathers information from human respondents by means of a standardized questionnaire in which the interest is in aggregates rather than particular individuals.”  Kelley, Clark, Brown, & Sitzia (2003, p. 261) “Surveys are designed to provide a ‘snapshot of how things are at a specific time’. There is no attempt to control conditions or manipulate variables; surveys do not allocate participants into groups or vary the treatment they receive. Surveys are well suited to descriptive studies, but can also be used to explore aspects of a situation, or to seek explanation and provide data for testing hypotheses”  Variety of methods 14 1. Introduction The uses of survey  Global interests for gathering information  Social and behavioral science  Governmental and international agencies  Polling organizations  Various disciplines  Economics  Psychology  Sociology  Marketing … 15 1. Introduction The uses of survey in social and behavioral science (Saris & Gallhofer, 2014) 16 1. Introduction Types of survey research (Kelley, Clark, Brown, & Sitzia, 2003) Different designs: Panel, longitudinal, cross-sectional or trend studies  Descriptive research  Gather information about a phenomenon  Use to describe prevalence and association among a specific population  Analytical studies  Go beyond simple description (e.g., regression model)  Evaluation research  Impact of a planned change 17 1. Introduction Using or not using … ? (Kelley, Clark, Brown, & Sitzia, 2003) Disadvantages Advantages Information rapidly become Gather empirical data obsolete Bias may limit the Generalizable to a population generalizability Data collection can be time- Produce a large amount of consuming and/or expensive data in a short time Lack details Give a general picture Low participation rate Sampling error correction 18 1. Introduction Data access and secondary analyses  Several research institutes and polling organizations offer data access  Restricted access  Subscription  Some examples  World Values Survey (WVS): www.worldvaluessurvey.org  European Social Survey (ESS): www.europeansocialsurvey.org  Afrobarometer: www.afrobarometer.org  International survey of children’s well-being (ISCWeB): www.isciweb.org 19 1. Introduction Specific access to data collected in France  Quetelet PROGEDO Diffusion: http://quetelet.progedo.fr/ 20 1. Introduction A search engine for databases in social and behavioral science  The GESIS – Leibniz Institute for the Social Sciences : https://www.gesis.org/ 21 1. Introduction What are the most critical steps in survey research? 22 1. Introduction What are the most critical steps in survey research? 1. Research question / Hypothesis 2. Ethics and legal aspects 3. Target population 4. Operationalization of each variable 5. Research design 6. Strategies for data collection 7. Data collection 8. Data management 9. Data analysis 10. Interpretation 11. Reporting and results sharing 23 1. Introduction What are the most critical steps in survey research? (Kelley, Clark, Brown, & Sitzia, 2003) Research question Ethics and legal issues Questionnaire design Sample Data collection Data analysis Reporting 24 2. Research question Some guidelines  A single, clear, and explicit research question  Based on a rigorous literature review  Based on observational/empirical data  Bringing new insights  Pitfalls to avoid  Defining the method before the research question  Collecting data and then thinking about your research question  Posing research question that cannot be answered  Asking questions that have already been answered satisfactorily 25 3. Ethics and legal issues Why do we matter? What are you talking about? 26 3. Ethics and legal issues Three main concerns  Research and method concerns  Mostly related to the rationale of the study and the relevance of its method  Most restricted procedure: Pre-registering study  Ethics concerns  Mostly related to participants and their informed consent  Most restricted procedure: Ethics committee approval (e.g. IRB)  Legal concerns  Related to the informed consent and the data acquisition, storage, and access  Most restricted procedure: Database registration (e.g. GDPR) 27 3. Ethics and legal issues What are the required elements for a consent form? 28 3. Ethics and legal issues What are the required elements for a consent form?  Assurance that participation is voluntary  Purpose of the research  Description of the procedures  Potential risks  Confidentiality (if applicable)  Anonymity (if applicable)  Potential benefits  Financial reimbursement, costs, and commercialization (if applicable)  Withdrawal from research without any consequences  Alternatives to participation (if applicable)  Your contact information  Legal information about data acquisition, storage, access, and use (if applicable)  Access to the study results  IRB number (if applicable) Source: Article L1122-1 of the French Public Health Code 29 3. Ethics and legal issues Restrictions and permissions in France  Sensitive data  Political orientation  Religious beliefs  Union membership  Sexual orientation  Health state  Skin color / ethnicity  Permissions can be granted under specific circumstances  Strict anonymity, informed consent, purpose of the study, … 30 3. Ethics and legal issues General Data Protection Regulation (GDPR)  A regulation in EU law on data protection  Individuals must give their consent to the processing of their personal data  What is the purpose of the data collection  Which organization is collecting the data  How long the data will be stored  Access to information  Contact information  Security of the personal data 31 3. Ethics and legal issues Consent form to participate in a research study  Two key inseparable components  Letter of information  Consent form (based on the content of the letter of information)  Consent traceability as a critical aspect in France  Does the GDPR apply?  Can I formally identify the participants?  Based on the amount of information I collect, can I identify the participants?  Applying GDPR with a research purpose  Do you want consider your thesis as a scientific study or as an academic assignment? 32 3. Ethics and legal issues Consent based on an incomplete presentation of the objectives  Examples  Experimental designs  Research based on sensitive topics (e.g., racism)  Sources  Article L1122-1 of the French Public Health  Article 49 of the French Code of Ethics for Psychologists  Procedures 1. Collect an incomplete consent before the study 2. Collect the full consent after the study 3. Erase answers from participants who did give their full consents 33 3. Ethics and legal issues Informed consents with minors  How can we proceed? 34 3. Ethics and legal issues Informed consents with minors  Active parental or legal guardian consent  Different methods: in-person, students taking forms home, mailing  Parents sign and return a form if they consent for their child to participate  Passive parental or legal guardian consent (i.e., not legal in France)  Different methods: in-person, students taking forms home, mailing  Parents sign and return a form if they refuse to allow their child to participate  Other considerations and issues  No consent form?  Children voice? 35 3. Ethics and legal issues Informed consents with minors: Comparison of methods (Totura, Kutash, Labouliere, & Karver, 2017) 36 3. Ethics and legal issues Research within an institutional setting  What is an institutional research?  Research taking place in an institutional setting  Examples: universities, prisons, schools  Informed consent  Permission from an appropriate institutional guardian/responsible  Informed consent from participants or their legal guardian  Institutionalized participants: Relevance of the study? 37