Research Design in Survey Studies

Research Methodology

• Research methodology outlines the framework and techniques chosen for a research study, explaining the research type.
• It details the path researchers take to accomplish the overall and specific objectives of the study.

Qualitative Research (Pure)

• Chapter 3: Includes sections for proposed method (research design), research environment, research participants, research instrument, and data gathering procedure (pre-data, actual, and post-data). Also includes sections for rigor in research, data analysis, and ethical considerations.
• Data Gathering Procedure: Broken down into pre-data gathering, actual data gathering (interview proper), and post-data gathering phases.

Quantitative Research (Survey)

• Chapter 3: Includes sections for proposed method (research design), research environment, description of respondents, research instrument, data gathering procedure (pre-data, actual, and post-data), data analysis, and ethical considerations.
• Data Gathering Procedure: Includes pre-data gathering, actual data gathering (survey proper), and post-data gathering phases.

Quantitative Research (Experimental)

• Chapter 3: Includes sections for proposed method (research design), research environment, research procedure (preparations, actual experimentation, data gathering), data analysis, and ethical considerations.
• Research Procedure: Includes distinct sub-sections for preparations, actual experimentation, and data gathering

Research Design

• A framework of research methods and techniques.
• Explains the type of research and the path researchers will take to reach research objectives.

Research Environment

• 1st Paragraph: Describes the primary research environment, highlighting the significance. (e.g. school building).
• 2nd Paragraph: Explains the virtual environment of online surveys or interviews, or experimental testing sites/facilities.

Research Participants/Respondents

• 1st paragraph: a. Describes the respondents. b. Explains why specific respondents were chosen.
• 2nd paragraph: a. Specifies the population, sampling technique, and sample size. b. Explains the appropriateness of the sampling technique. c. Explains how the sampling technique assists in data collection.

Research Instrument (Quantitative - Survey)

• Specifies the research tool. Explaining the tool's significance, whether it's researcher-made or standardized. Clarifying tool validation (if researcher-made).
• If standardized, provides details on the tool (name, authors, original purpose, measurement). Explains how the tool is useful for the research goal.
• If researcher-made, details to be supplied include: topics included, intended measurement, explanation of creation process, reliability/validity testing and method, and involvement of experts (including Cronbach's Alpha value)

Data Gathering

• Explains the full data collection process including pre-, actual, and post-data stages. Covers both qualitative and quantitative research.

Pre-Data Gathering

• Qualitative/Quantitative - Survey: Outline the process of preparing for data collection including Ethics Board approval. Include drafting of transmittal letters, participant preparation, materials preparation (if applicable).
• Experimental: Describe how the transmittal letter, procedure familiarity, materials preparation, and (if applicable) parent consent will be addressed.

Actual Data Gathering

• Survey Research: Explains how the survey forms (online or onsite) are sent and how respondents are identified. Includes explanation on checking for complete responses data gathering.
• Qualitative research: Explains the interview dynamics, duration, question types, and when to conclude the interview.
• Experimental: Detailed explanation of how the experiment is conducted, the characteristics of the process, specific details, and timeframes

Post-Data Gathering (Qualitative/Quantitative - Survey)

• Survey Research: Explains what happens after data collection is complete. Covers data organization techniques, examples (figures, tables).
• Qualitative Research: Explains how the researcher handles data after all interviews are complete, including methods such as converting video to audio data and creating transcript.
• Experimental: Explains the action following experimentation, the testing approach, and the result quantification methods.

Data Analysis

• Qualitative Research: Details the thematic coding methods researchers will use.
• Quantitative Research: Explains the statistical methods (descriptive or inferential), the types of data expected (e.g. nominal or interval), and where to collect the data (e.g. sensory evaluations, tests). Includes the specific formulas used for analyses.

Rigor in Research

• Quantitative Research: Details validity (face, construct, criterion-related) and reliability (test-retest, parallel form, inter-rater).

Sample

• To ensure research credibility and trustworthiness, there will be analyses for consistency between research methods, accuracy, and results explanations. Review transcripts for similarities amongst study participants, emphasizing the importance of thoroughness, detailed explanations to make research easily followed, and to allow the transferability of methods.

Research Ethics

• Describes ethical researcher conduct regarding honest representation, proper scientific standards, and data gathering prior to research procedures. Explains how the process considers human subjects (informed consent, voluntary participation). Includes, confidentiality, anonymity and privacy policies and incentives or compensations are included as relevant.

Types of Quantitative Research

• Explains various quantitative research types and examples, including experimental and non-experimental designs.

Qualitative vs. Quantitative

• Provides a comparison table of Qualitative and Quantitative research methodologies

Types of Non-Experimental Design

• Outlines different types of non-experimental research (survey, retrospective, cross-sectional, longitudinal, descriptive, comparative, correlational, evaluative).

Types of Experimental Design

• Distinguishes different experimental designs: true experimental and quasi-experimental and details their specific characteristics.
• True Experimental: Designs that utilize comparison or control groups, where participants are randomly allocated, and where the researcher manipulates independent variables.
• Quasi-Experimental: Types of designs that may lack a control group or where randomization of participant allocation is not possible.

Types of Experimental Variables

• Explains the different types of variables in an experiment (independent, dependent, and control variables) with practical examples.

Survey Studies

• Highlights the self-reporting approach used to collect data from participants. Gives specific examples

Retrospective

• Explains that the method focuses on determining past independent variables based on present dependent variables.

Cross-Sectional

• Details how data is collected as a single point in time, focusing on various stages or phases of experience.

Longitudinal

• Explains research that collects data from the same participants at different points in time.

Descriptive

• Explains how the aim is to describe the current status of a discovered variable or phenomenon.

Comparative

• Details this method as comparing different groups in relation to specific variables.

Correlational

• Outlines the statistical relationship between two or more variables.

Evaluative

• Details the method that uses evaluation for worth, and value judgments to understand different outcomes whether through process or outcome.

Ethical Considerations for Qualitative/Quantitative Survey Research.

• Explains participant protections and data privacy. Outlines ethical guidelines that must be observed in the entirety of the research.

Research Ethics

• Explains ethical researcher conduct regarding honest representation, proper scientific standards, and data gathering prior to research procedures. Explains how the process considers human subjects (informed consent, voluntary participation). Includes, confidentiality, anonymity and privacy policies and incentives or compensations are included as relevant.