Podcast
Questions and Answers
What is the primary goal of descriptive-comparative studies?
What is the primary goal of descriptive-comparative studies?
- To evaluate the effectiveness of policies
- To randomly assign participants to classifications
- To establish significant differences between groups (correct)
- To control extraneous factors affecting subjects
In descriptive comparative studies, which variable do researchers not control?
In descriptive comparative studies, which variable do researchers not control?
- Extraneous factor
- Criterion measure
- Independent variable (correct)
- Dependent variable
What does formative evaluation primarily assess?
What does formative evaluation primarily assess?
- Public opinion on a program
- Quality of implementation and processes (correct)
- Cost-efficiency of a program
- Outcomes of a program after implementation
Which of the following best describes summative assessment?
Which of the following best describes summative assessment?
Which aspect of evaluation provides judgments and values to measured data?
Which aspect of evaluation provides judgments and values to measured data?
What type of evaluation is conducted to determine the necessity of a program?
What type of evaluation is conducted to determine the necessity of a program?
Which of the following is NOT a component of formative evaluation?
Which of the following is NOT a component of formative evaluation?
Which factor is crucial to the understanding of comparative research?
Which factor is crucial to the understanding of comparative research?
What is the purpose of program monitoring in educational research?
What is the purpose of program monitoring in educational research?
In impact evaluation, what is the primary goal?
In impact evaluation, what is the primary goal?
What type of evaluation compares relative costs to outcomes?
What type of evaluation compares relative costs to outcomes?
Which of the following is a characteristic of experimental research design?
Which of the following is a characteristic of experimental research design?
What is a key aspect that differentiates true experiments from other types of research?
What is a key aspect that differentiates true experiments from other types of research?
Which type of analysis would you use to explore the influence of gender and mental ability on test results?
Which type of analysis would you use to explore the influence of gender and mental ability on test results?
An aspect of program monitoring involves evaluating performance before a program is completed. What does this aim to achieve?
An aspect of program monitoring involves evaluating performance before a program is completed. What does this aim to achieve?
What distinguishes longitudinal studies from other experimental designs?
What distinguishes longitudinal studies from other experimental designs?
What is cliometrics primarily concerned with?
What is cliometrics primarily concerned with?
Which source has become a historical reference for understanding changing electoral behavior since 1948?
Which source has become a historical reference for understanding changing electoral behavior since 1948?
What is the first step in the major process of historical research?
What is the first step in the major process of historical research?
What type of sources are rich in historical data for researchers?
What type of sources are rich in historical data for researchers?
What must historians do when they find discrepancies in historical data?
What must historians do when they find discrepancies in historical data?
What is one of the main disadvantages of using the Solomon Four Group Design?
What is one of the main disadvantages of using the Solomon Four Group Design?
Which group receives both a pretest and posttest in the Solomon Four Group Design?
Which group receives both a pretest and posttest in the Solomon Four Group Design?
What factor might cause a subject's responses to be influenced by their condition at the time of testing?
What factor might cause a subject's responses to be influenced by their condition at the time of testing?
Which phenomenon involves subjects changing answers in the posttest due to familiarity with the pretest?
Which phenomenon involves subjects changing answers in the posttest due to familiarity with the pretest?
What effect does a major event, like a super typhoon, have on an experimental study?
What effect does a major event, like a super typhoon, have on an experimental study?
What is 'mortality' in the context of an experimental plan?
What is 'mortality' in the context of an experimental plan?
Which group in the Solomon Four Group Design has only posttest measures?
Which group in the Solomon Four Group Design has only posttest measures?
Which of the following affects the experimental outcome due to external circumstances beyond the study's control?
Which of the following affects the experimental outcome due to external circumstances beyond the study's control?
What is a potential consequence of losing subjects from comparison groups during an experiment?
What is a potential consequence of losing subjects from comparison groups during an experiment?
What factor can interact with an experimental variable to produce erroneous measurements?
What factor can interact with an experimental variable to produce erroneous measurements?
Which scenario exemplifies the concept of differential selection?
Which scenario exemplifies the concept of differential selection?
What can statistical regression in experimental research indicate?
What can statistical regression in experimental research indicate?
How might the John Henry effect influence the results of an experiment?
How might the John Henry effect influence the results of an experiment?
What is a major limitation of using historical research design?
What is a major limitation of using historical research design?
What can changes in measuring instruments lead to during an experiment?
What can changes in measuring instruments lead to during an experiment?
Which of the following is an example of an extraneous factor affecting an experiment?
Which of the following is an example of an extraneous factor affecting an experiment?
Flashcards are hidden until you start studying
Study Notes
Descriptive Research Design
- Descriptive-comparative studies aim to identify significant differences between two or more groups based on a specific measurement.
- No attempts are made to control extraneous factors.
- Example: Comparing the managerial effectiveness of three groups of managers.
- This type of research usually involves group comparisons.
- Groups represent the independent variable.
- Example: Gender, pre-school attendance, or children with a working mother versus children without a working mother.
- The independent variable is not under the researchers' control. This means researchers cannot randomly assign participants to specific groups (e.g., gender, socioeconomic class).
Assessment/Evaluation Studies
- These studies determine the effectiveness or efficiency of practices or policies applied to a group of respondents.
- Assessment involves measurement of key indicators without judgment.
- Evaluation adds judgment and valuation to the measurements.
- Evaluation research gathers feedback from various sources to aid in decision-making or policy formulation.
Formative Evaluation
- Determines the quality of implementation, efficiency, and effectiveness of a project or program.
- Evaluates organizational processes such as procedures, policies, guidelines, and human resource development.
- Types of Formative Evaluation:
- Needs Assessment: Evaluates the need for a program or project. For example, identifying the need for a remedial math class.
- Process Evaluation: Evaluates the implementation process of a program. For example, examining the implementation of a Student Information System in a school.
- Implementation Evaluation: Evaluates the efficiency or effectiveness of a project or program. For example, assessing the effectiveness of a scholarship program.
- Program Monitoring: Evaluates the performance and implementation of an unfinished program. This helps improve implementation and achieve optimal results.
Summative Assessment
- Examines the outcomes, products, or effects of a program after implementation.
- Types of Summative Assessment:
- Secondary Data Analysis: Analyzes existing data. For example, examining the influence of gender and mental ability on National Achievement Test results.
- Impact Evaluation: Evaluates the overall effect of a program.
- Cost-Effectiveness Evaluation: Determines if a program has caused useful effects based on target outcomes.
- Cost-Benefit Analysis: Compares the relative costs to the outcomes or results of different courses of action.
Experimental Research Design
-
Also known as longitudinal or repeated-measures studies.
-
Uses the scientific method to establish cause-and-effect relationships between variables.
-
A true experiment attempts to control all variables except one.
- Independent variable is manipulated to determine its effect on the dependent variable.
- Subjects are randomly assigned to experimental treatments rather than being identified within naturally occurring groups.
-
Control group is used to eliminate potential confounding factors, such as the Hawthorne effect, maturation, and attrition.
-
Solomon Four Group Design is used to further control for these potential confounding factors. It involves four groups:
- Experimental Group 1: Pretest, treatment, posttest
- Control Group 1: Pretest, no treatment, posttest
- Experimental Group 2: Treatment, posttest
- Control Group 2: No treatment, posttest
Factors Affecting the Experimental Plan
- History: Specific events occurring during the experiment may affect the results.
- Maturation: Biological or physiological changes in subjects may influence the outcomes.
- Testing: Subjects may become more aware of the test content due to taking a pretest.
- Mortality: Subjects may drop out of the study, potentially affecting group comparisons.
- Interaction Effects: Interactions between the experimental variable and extraneous factors (setting, time, conditions) may lead to errors in measurement and interpretation.
- Measuring Instruments: Changes in instruments, observers, or scoring methods can influence measurements.
- Statistical Regression: Extreme scores tend to move towards the mean with repeated measurements.
- Differential Selection: Different individuals or groups may have different levels of prior knowledge or ability, affecting the final measurement.
- John Henry Effect: The control group may feel disadvantaged and work harder to outperform the experimental group.
Historical Research Design
- Purpose: Collect, verify, and synthesize evidence from the past to establish facts that support or refute a hypothesis.
- Sources: Secondary sources and primary documentary evidence (logs, diaries, official records, reports, archives, non-textual information like maps, pictures, audio/visual recordings) are used.
- Authenticity and validity: Sources must be both authentic and valid.
- Quantitative history: Also called cliometrics, involves using quantitative data to analyze historical events.
Major Processes of Historical Research
- Data Collection: Gathering data from the past through relics, fossils, documents, or interviews.
- Analysis of Data: Bringing together collected data to understand past events.
- Report of Findings: Presenting findings, explaining discrepancies, and identifying potential causes for those discrepancies.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.