Biases-or-Scoring-Errors.pdf

Prof Ed 6 Assessment of Learning I BIASES AND SCORING ERRORS Lesson 4  Biases or Scoring Errors In the context of Assessment of Learning 1, biases or scoring errors can affect the fairness and accuracy of student evaluations. Here are some comm...

Prof Ed 6 Assessment of Learning I BIASES AND SCORING ERRORS Lesson 4  Biases or Scoring Errors In the context of Assessment of Learning 1, biases or scoring errors can affect the fairness and accuracy of student evaluations. Here are some common types: 1.Halo Effect Occurs when a teacher’s overall positive or negative impression of a student influences their assessment in unrelated areas. Example: A student who is always punctual and well-behaved may receive higher scores in group work even though they contributed little to the actual task Assessment of Learning 1  Biases or Scoring Errors 2. Leniency or Severity Bias Driven by a personal preference for being seen as compassionate or avoiding conflicts, an assessor gives higher marks than deserved. Example: A teacher inflates the grades of students who are struggling in the subject so they don't feel discouraged, even though their work doesn’t meet the required standards. Assessment of Learning 1  Biases or Scoring Errors 3. Contrast Effect This bias occurs when a student’s performance is evaluated in comparison to others rather than on its own merit. Example: A student's essay is graded lower than it deserves because it follows an outstanding essay from another student, making the second essay seem less impressive in comparison. Assessment of Learning 1  Biases or Scoring Errors 4. Generosity Error Assessors are overly lenient, consistently giving higher marks than what is deserved. Example: A teacher gives most students in the class full marks on a project because they want to encourage them, even though some of the work is incomplete or lacks quality Assessment of Learning 1  Biases or Scoring Errors 5. Rater Drift Over time, an assessor's standards or interpretations of the rubric may shift, leading to inconsistency. Example: A teacher grades strictly at the beginning of an exam session but becomes more lenient as they get tired, leading to higher marks for students assessed later. Assessment of Learning 1  Biases or Scoring Errors 6. Severity Error Occurs when an assessor is overly harsh in scoring, even on strong performances. Example: A student writes a well-researched paper, but the teacher gives a low score because they focus on minor grammar mistakes rather than the quality of the argument. Assessment of Learning 1  Biases or Scoring Errors 7. Contamination Effect When irrelevant factors unrelated to the assessment influence the score. Example: A student who regularly disrupts class receives a lower grade on their presentation because the teacher is influenced by their negative behavior, even though the presentation was strong. Assessment of Learning 1  Biases or Scoring Errors 8. Similar-to-Me Effect Assessors give higher scores to students they perceive as similar to themselves. Example: A teacher gives extra credit to a student who shares the same hobbies, such as playing the guitar, even though this is not related to the subject matter being assessed. Assessment of Learning 1  It occurs when the teacher is unintentionally redefining criteria and standards over time or across a series of scoring. Assessment of Learning 1 The teacher has tendency to avoid both extremes of the scales of the grades, neither very high grades nor very low grades. Most of the grades are in the middle scale Assessment of Learning 1