Podcast
Questions and Answers
Which of the following is an example of a product that can be rated in education?
Which of the following is an example of a product that can be rated in education?
Product ratings can only be conducted during a specific observation period.
Product ratings can only be conducted during a specific observation period.
False
What is a primary advantage of using product ratings over behavior ratings?
What is a primary advantage of using product ratings over behavior ratings?
They can be done at any time.
An example of a researcher-completed instrument is the _____ which includes a set of questions for subjects.
An example of a researcher-completed instrument is the _____ which includes a set of questions for subjects.
Signup and view all the answers
Match the following researcher-completed instruments with their descriptions:
Match the following researcher-completed instruments with their descriptions:
Signup and view all the answers
What is a disadvantage of interviews compared to questionnaires?
What is a disadvantage of interviews compared to questionnaires?
Signup and view all the answers
Interviews are strictly data-collection exercises without any interpersonal interaction.
Interviews are strictly data-collection exercises without any interpersonal interaction.
Signup and view all the answers
Name one type of multi-sensory channel used in interviews.
Name one type of multi-sensory channel used in interviews.
Signup and view all the answers
What is the primary purpose of the Likert scale?
What is the primary purpose of the Likert scale?
Signup and view all the answers
The semantic differential scale uses numerical ratings to assess attitudes.
The semantic differential scale uses numerical ratings to assess attitudes.
Signup and view all the answers
Name one example of a personality inventory.
Name one example of a personality inventory.
Signup and view all the answers
The semantic differential scale presents subjects with a continuum of several pairs of __________.
The semantic differential scale presents subjects with a continuum of several pairs of __________.
Signup and view all the answers
Match each type of scale with its correct description:
Match each type of scale with its correct description:
Signup and view all the answers
Which of the following best describes achievement tests?
Which of the following best describes achievement tests?
Signup and view all the answers
Pictorial attitude scales are designed for adults and use complex graphics.
Pictorial attitude scales are designed for adults and use complex graphics.
Signup and view all the answers
What is a common characteristic of personality inventories?
What is a common characteristic of personality inventories?
Signup and view all the answers
What term refers to the kinds of information researchers obtain on their subjects?
What term refers to the kinds of information researchers obtain on their subjects?
Signup and view all the answers
An instrument is a device used to analyze data after it has been collected.
An instrument is a device used to analyze data after it has been collected.
Signup and view all the answers
Name one type of demographic information that researchers might collect.
Name one type of demographic information that researchers might collect.
Signup and view all the answers
The questions regarding the location, time, frequency, and administrator of data collection are critical in the process of __________.
The questions regarding the location, time, frequency, and administrator of data collection are critical in the process of __________.
Signup and view all the answers
Match the following terms with their definitions:
Match the following terms with their definitions:
Signup and view all the answers
Which of the following is NOT a question related to data collection?
Which of the following is NOT a question related to data collection?
Signup and view all the answers
The frequency of data collection refers to how often data is gathered.
The frequency of data collection refers to how often data is gathered.
Signup and view all the answers
What is one important factor a researcher must decide during the planning phase of an investigation?
What is one important factor a researcher must decide during the planning phase of an investigation?
Signup and view all the answers
What is the primary purpose of a tally sheet in research?
What is the primary purpose of a tally sheet in research?
Signup and view all the answers
A performance checklist requires subjective judgments from the observer regarding performance quality.
A performance checklist requires subjective judgments from the observer regarding performance quality.
Signup and view all the answers
What are the two types of researcher-completed instruments discussed?
What are the two types of researcher-completed instruments discussed?
Signup and view all the answers
A tally sheet is used to record the frequency of __________ behaviors or activities.
A tally sheet is used to record the frequency of __________ behaviors or activities.
Signup and view all the answers
Match the following types of instruments with their primary functions:
Match the following types of instruments with their primary functions:
Signup and view all the answers
Which of the following is a disadvantage of observational research?
Which of the following is a disadvantage of observational research?
Signup and view all the answers
A performance checklist includes subjective opinions about how well a student completed a task.
A performance checklist includes subjective opinions about how well a student completed a task.
Signup and view all the answers
Name one example of an activity that a performance checklist might assess.
Name one example of an activity that a performance checklist might assess.
Signup and view all the answers
What is the primary purpose of aptitude tests?
What is the primary purpose of aptitude tests?
Signup and view all the answers
Aptitude tests can only be used for individual assessment and not for groups.
Aptitude tests can only be used for individual assessment and not for groups.
Signup and view all the answers
What is one major advantage of administering group aptitude tests?
What is one major advantage of administering group aptitude tests?
Signup and view all the answers
Aptitude tests attempt to predict an individual’s capacity to acquire improved performance with additional ______.
Aptitude tests attempt to predict an individual’s capacity to acquire improved performance with additional ______.
Signup and view all the answers
What is a disadvantage of group aptitude tests?
What is a disadvantage of group aptitude tests?
Signup and view all the answers
A mathematics achievement test can never measure aptitude for additional mathematics.
A mathematics achievement test can never measure aptitude for additional mathematics.
Signup and view all the answers
In what types of areas have aptitude tests been designed to predict improved performance?
In what types of areas have aptitude tests been designed to predict improved performance?
Signup and view all the answers
What can render even the most highly regarded instruments useless?
What can render even the most highly regarded instruments useless?
Signup and view all the answers
Subject-completed instruments include interview schedules.
Subject-completed instruments include interview schedules.
Signup and view all the answers
Name two types of subject-completed instruments.
Name two types of subject-completed instruments.
Signup and view all the answers
The researcher's decisions about location and time affect the kind of _______ to be used.
The researcher's decisions about location and time affect the kind of _______ to be used.
Signup and view all the answers
Match the following types of instruments with their correct category:
Match the following types of instruments with their correct category:
Signup and view all the answers
Which of the following is NOT a type of subject-completed instrument?
Which of the following is NOT a type of subject-completed instrument?
Signup and view all the answers
Researcher-completed instruments include performance tests.
Researcher-completed instruments include performance tests.
Signup and view all the answers
What must all instruments allow researchers to do?
What must all instruments allow researchers to do?
Signup and view all the answers
Study Notes
Instrumentation
- Instrumentation encompasses the selection and design of tools, along with procedures and conditions for their use, in data collection.
- Data collection tools are referred to as instruments.
- Researchers must consider crucial factors during the planning phase, such as the type(s) of data to collect.
What are Data?
- Data encompass the information collected about research subjects.
- Demographic details (age, gender, ethnicity, religion) are one form of data.
- Scores from pre-made or researcher-made tests are another category.
- Responses to researcher-posed questions, either verbally (oral interview) or in writing (surveys), are also considered data.
- Various student work samples, such as essays, grade point averages, performance records (from coaches), and anecdotal records (from teachers), are all considered data sources for research.
Instrumentation Questions
- Location: Where is the data collection taking place? (e.g., classroom, schoolyard, street).
- Timing: When will the data be collected? (e.g., morning, afternoon, evening, weekend).
- Frequency: How often will data be collected? (e.g., one time, twice, more than twice).
- Collector: Who is responsible for collecting the data? (e.g., the researcher, a trained individual).
Importance of Instrumentation Questions
- Answering these questions properly can positively influence collected data.
- Incorrect administration or inappropriate contexts might yield useless data.
- Factors like subject fatigue, unwelcoming environments, or administering instruments via unliked individuals negatively impact the data's reliability.
- Researchers must thoughtfully consider these aspects before collecting data.
Classifying Data Collection Instruments
- Instruments can be categorized based on whether they're completed by the researcher or the subject.
- Researcher-completed instruments include rating scales, interview schedules, observation forms, tally sheets, performance checklists, anecdotal records, flowcharts, and time-and-motion logs.
- Subject-completed instruments include questionnaires, self-checklists, attitude scales, personality inventories, achievement tests, aptitude tests, projective devices, and sociometric devices.
Rating Scales
- A rating scale represents a measured judgment of something, such as behavior or product.
- Observations and ratings are distinct concepts. A rating offers a judgment, while an observation documents the presence or absence of a behavior.
- Researchers might perform both tasks for subjects or specific occurrences.
Product Rating Scales
- Researchers can use rating scales to assess products.
- Examples in education include book reports, diagrams, drawings, notebooks, essays, and various creative work.
- Unlike behavioral ratings, product ratings can be done at any time.
Interview Schedules
- These are question-and-answer instruments conducted orally (in person or via phone).
- Answers are recorded by the researcher or a trained assistant.
- There are significant differences in how interviews and questionnaires are administered.
- Interviews provide greater flexibility to address misunderstandings and questions concerning the purpose of the interview.
- Poor response rate and subjective interpretation are inherent disadvantages.
Observation Forms
- Observation isn't merely looking; it's systematically recording various elements, including people, events, behaviors, routines, settings, artifacts, and so on.
- Observation can be structured (e.g., observation schedules) or less structured (e.g., participant observations).
- Observation forms help researchers document the frequency of behaviors or activities.
- Observation forms should be tested initially to identify potential errors or ambiguities.
Performance Checklists
- These instruments consist of a list of behaviors or actions.
- Researchers use them to determine whether an individual exhibits a specific behavior during a particular task.
- A tick mark indicates the presence of the behavior; if the behavior isn't present, no mark is needed.
- Researchers frequently use checklists to evaluate various actions and behaviors.
Anecdotal Records
- These documents serve as a means to record observations in narrative form.
- Anecdotal records provide accounts of actions without a fixed format.
- Observers retain the autonomy to record relevant behaviors, not needing to focus on the same behavior throughout the study.
- Observers are better advised to focus on factual specifics and avoid evaluative, interpretive, or broadly generalized commentary.
Flowcharts
- Flowcharts visualize the interactions or discussions within a particular group.
- They're helpful for analyzing class discussions, charting the quantity and focus of verbal participation, and tracking student interactions.
- A flowchart visually displays student interaction, direction, and volume, using a grid display and arrows to connect participants.
Time and Motion Logs
- These tools are used to meticulously observe and document behaviors or activities over a specific period.
- They're helpful in situations requiring detailed observation, especially when discovering the roots of individual or group issues/problems.
- Observer records every aspect of activities, at predetermined intervals, with breaks between observation periods.
Questionnaires
- Questionnaires are frequently used as a tool for gathering information through a set of questions.
- They are cost-effective, efficient, and enable the collection of data from large groups of people.
- Questionnaire design varies significantly, from structured (e.g., multiple choice) to open-ended (e.g., short-answer).
- The structure of the questionnaire should align with the intended sample size (the larger the size, the more structured it should be).
Self-Checklists
- Self-checklists are lists of characteristics or behaviors that individuals use to identify or note whether they possess them or engage in them.
- Participants review the self-checklist and mark items they find appropriate to their behaviors and activities.
- Self-checklists assist researchers in self-assessment and performance evaluation of students.
Attitude Scales
- The core tenet of attitude scales is the assumption that individuals' attitudes can be identified by their responses to a series of statements.
- Researchers use attitude scales, frequently in the form of statements (agree or disagree), to assess attitudes toward specific things.
- The responses' structure is analyzed to infer individuals' attitudes.
- Attitude scales often employ rating scales, in which subjects select a position on a continuum between opposite adjectives.
- Pictorial attitude scales use drawn faces to represent various levels of agreement/disagreement.
Personality Inventories
- These instruments aim to gauge personality traits or individual feelings.
- Specific statements or questions require subjects to indicate similarities to their traits/feelings.
- These instruments yield numerical scores believed to reflect personality characteristics.
- Examples include the Minnesota Multiphasic Personality Inventory, the IPAT Anxiety Scale, the Piers-Harris Children's Self-Concept Scale, and the Kuder Preference Record.
Achievement Tests
- Achievement tests assess knowledge or skills in a specific subject or field.
- Often used in schools for evaluating learning, academic placement, and determining levels of acquisition or mastery.
- These tests can also help determine student strengths and weaknesses.
- General achievement typically involves broader subject areas like language, math, and social studies.
- Specific tests are on particular domains (e.g., English, history).
Aptitude Tests
- Aptitude tests aim to estimate a person's potential for future learning or performance in a specific domain.
- To clarify, these tests assess existing skills or knowledge related to the specific area.
- Frequently, different criteria and content differentiate aptitude from achievement tests.
- Aptitude tests have a variety of formats, including group and individual applications.
Performance Tests
- Performance tests essentially assess how an individual executes a particular activity or task.
- Objective assessments are favored, though subjective judgments may be necessary in complex tasks.
- Performance tests are often considered the most objective type among the various assessments due to their direct evaluation of performance on the relevant task.
- Performance tests can involve observation of actions, while recording responses/activities.
Projective Devices
- Projective tools present ambiguous stimuli, allowing participants to project their underlying feelings, desires, interests, needs, and conflicts.
- Participants are free to portray their understanding of the stimulus without restrictions other than the task itself.
Sociometric Devices
- These instruments enable the assessment of interpersonal relationships and perceptions within a group, typically through ratings or play scenario applications.
- Sociograms, visualized diagrams, depict individuals and their connections.
- Participants in group play scenarios are asked to assign relevant roles on a paper based on their perceptions of the different individuals.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Related Documents
Description
Test your knowledge on various educational research instruments and their applications in evaluating products and behaviors. This quiz covers topics such as product ratings, scales, and the advantages and disadvantages of different data collection methods. Perfect for students and educators in the field of educational research.