Psych 312_Standardization of Scoring.pdf

UNIFORMITY in SCORING  HOW TO CONSTRUCT OPEN-ENDED ITEMS to ensure standardized and objective scoring: Suggested Rules for Item Construction: a. The direct question form is preferred over the statement form. b. The question should be designed in such a way that there is only one pos...

UNIFORMITY in SCORING  HOW TO CONSTRUCT OPEN-ENDED ITEMS to ensure standardized and objective scoring: Suggested Rules for Item Construction: a. The direct question form is preferred over the statement form. b. The question should be designed in such a way that there is only one possible correct answer..g. Who became President of the Philippines? c. The question should be worded so that the answer is short and definite – preferably a single word, number, or symbol. This will facilitate objective scoring. d. Extraneous hints should be avoided, as these may enable examinees to identify the correct answer. e.g. Who has the initials “JR”, and is the national her James Reid?! Doctor James Reid?! The late doctor James Reid?!  HOW TO SCORE OPEN-ENDED ITEMS to ensure standardized and objective scoring: The PRIMARY strategy to ensure standardized and objective scoring for open-ended types of items is this: Develop rules for judgment that all scorers will follow HOW would you SCORE the answers to these? 1.What is a tricycle? 2.In what way a banana and a mango alike? 3.Why do we wash our clothes?  v Construct guides that show possible acceptable responses and corresponding credits, such as those in the test manuals of the WISC, WAIS, and Stanford-Binet. In what way are a banana and a mango alike? Rule: Answer must express the main feature or main essence of similarity POINT/S ANSWER 2 points both are fruits; both can be eaten 1 point both are yellow; both grow on trees; both have seeds No points other answers such as: both are long, both are nutritious; both are God’s creations; I love them both  What is a tricycle? Rule: A good synonym will be given full points. A complete description with mention of the function or use will be given full credit. POINT/ ANSWER S 2 points a mode of transportation; a ride with three wheels 1 point it has three wheels No other answers such as: I own one; it is fun to points ride in; bigger than a bike; its shiny Following the previous examples, what rule would you come up with for the question “Why do we wash our clothes?” v Provide guides that display specimens representing various levels of quality (e.g. handwriting, drawing) may be used as references for scoring. Example: Example: sample item form the Copying subtest of the Snijders-Oomen Nonverbal Intelligence Test (SON) The anatomy of a structured item  TIME-LIMIT WORK-LIMIT Examinees are given the same amount of Examinees are given the same number of time. items. The score would depend on the number The score would depend on the time of items completed. needed to complete all the items. e.g. in 10 minutes, how many items can Given 100 items, how long will it take for you finish? you to finish? Examinee A: 15 items Examinee X: 12.5 minutes Examinee B: 10 items Examinee Y: 30 minutes Examinee C: 45 items Examinee Z: 24 minutes  To make a test objective & standardized, several elements should be paid attention to: vadministration procedures vconditions of the examinee vimmediate and accurate recording of observations vscoring by the same rules vScoring rules for open-ended items (test constructor) If you have 2 choices, then … Your chance of getting a lucky guess is ½; and your chance of being unlucky is ½ If you are presented with 3 choices, then… Your chance of a lucky guess is 1 out of 3 Your chance of getting an unlucky guess is 2 out of 3. Using the principles of probability, we can say that if you are presented with 3 choices, then for every 2 unlucky guesses, there is 1 lucky guess. UNIFORMITY in SCORING