Teacher's Test Construction Process

Play an AI-generated podcast conversation about this lesson

Why might a researcher choose to use a shorter measure instead of a longer and more comprehensive one?

Testing time is severely limited (correct)

The shorter measure is free to use

The shorter measure is proprietary

The shorter measure is more reliable and valid

What is typically the case when an existing measure was created primarily for use in scientific research?

It is described in detail in a published research article and is free to use (correct)

It is only briefly described by later researchers

It is proprietary and must be purchased

It is included in the Directory of Unpublished Experimental Measures

Where can you find details about proprietary measures and how to obtain them?

In the text provided

In your university library

In the Mental Measurements Yearbook (correct)

In the Directory of Unpublished Experimental Measures

What is the purpose of the American Psychological Association's Directory of Unpublished Experimental Measures and PsycTESTS?

To catalog measures that have been used in previous research Signup and view all the answers

What is the main difference between using an existing measure and creating your own measure?

Creating your own measure allows you to test new concepts Signup and view all the answers

Which of the following is NOT a reason a researcher might choose to use a shorter measure instead of a longer one?

The researcher wants to test new concepts Signup and view all the answers

What is a characteristic of multidimensional scales with correlated dimensions?

Each subscale is unidimensional. Signup and view all the answers

In scales with higher-order factors, what do the subscales assess?

Different psychological attributes linked by a broader attribute Signup and view all the answers

What distinguishes scales with uncorrelated dimensions from scales with higher-order factors?

The lack of a broader psychological attribute linking the subscales Signup and view all the answers

What does the NASA-TLX measure using its 6 subscales?

Different aspects of workload Signup and view all the answers

Which type of scale should not compute a total score across subscales?

Scales with uncorrelated dimensions Signup and view all the answers

In multidimensional scales, what does it mean when dimensions are uncorrelated?

Each dimension is independent and not related to the others. Signup and view all the answers

What might agreeable participants do when being measured?

Respond in ways they believe they are expected to Signup and view all the answers

How can participant reactivity affect the reliability and validity of scores?

By making scores inconsistent and unreliable Signup and view all the answers

What are demand characteristics in research studies?

Subtle hints about the study's real purpose Signup and view all the answers

How might a participant react if they perceive subtle cues indicating how the researcher expects them to behave?

They might respond as they believe is expected of them Signup and view all the answers

What impact can a researcher's own expectations have on participants' behaviors?

Bias participants' behaviors in unintended ways Signup and view all the answers

How might agreeable participants with low self-esteem respond when asked about their self-worth?

They will answer based on what they believe is socially appropriate Signup and view all the answers

What was the primary factor in determining the total number of items and item types for the test?

The time allocated for students to complete the test and students' general test-taking abilities Signup and view all the answers

How did the teacher determine the percentage of class time for each learning objective?

By dividing the minutes spent teaching each objective by the total minutes for the unit and multiplying by 100 Signup and view all the answers

What was the purpose of determining the percentage of time spent in class on each objective?

To identify how many items on the test should address any particular objective and enhance test content validity evidence Signup and view all the answers

How did the teacher determine the number of items needed to measure each objective?

By multiplying the percentage of time on topic by the total number of items on the test Signup and view all the answers

What did the teacher do in instances where the calculated number of items for an objective was not a whole number?

Rounded to the nearest whole number when appropriate Signup and view all the answers

Why did the teacher not include any test items for Objective 4?

Not enough instructional time was spent teaching that content to justify assessing it on the unit test Signup and view all the answers

What is the primary purpose of measuring 'workload' as described in the text?

To develop questions that reflect different dimensions of workload Signup and view all the answers

Which of the following is an example of a 'bad' survey question?

The interface was visually pleasing and easy to use. Signup and view all the answers

Which of the following is an example of a 'good' survey question, as described in the text?

The interface was easy to use. Signup and view all the answers