Human Machine Systems Assignment
7 Questions
0 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to Lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

Which inspector has greater sensitivity (i.e., is better able to detect a flaw in the weld)?

  • Inspector Clouseau
  • Inspector Morse (correct)
  • Inspector Morse has a neutral criterion, and Inspector Clouseau has a liberal criterion. Draw and label a vertical line representing the criterion in each graph. For which inspector is (\beta < 1)?

    Inspector Clouseau has (\beta < 1)

    If Inspector Clouseau had a miss rate of .20 and a correct rejection rate of .80, what would his d' value be? (Hint: may use attached d' table, Wickens)

    d' = 1.28

    Construct an ROC curve for each observer (plot both curves on the same axes). Label the axes.

    <p>The x-axis of the ROC curve represents the false alarm rate, and the y-axis represents the hit rate. The ROC curve for each observer is a plot of the hit rate as a function of the false alarm rate, for different criteria.</p> Signup and view all the answers

    Were both observers affected by the payoffs the same amount, or was one observer more affected by the payoffs? Explain.

    <p>Inspector Clouseau was more affected by the payoffs. (C)</p> Signup and view all the answers

    The performance of a third inspector, Inspector Smith, was also monitored under different payoff conditions. His standardized ROC curve, plotted on normal probability paper, had a shallow slope (less than 45 degrees). How would you choose to quantify this inspector's sensitivity, and why?

    <p>A shallow slope on the standardized ROC curve suggests that the inspector is less sensitive to the signal. It is better to quantify this inspector's sensitivity by using the area under the ROC curve (AUC), instead of d', because the AUC is more robust to changes in the criterion.</p> Signup and view all the answers

    If Inspector Morse was paid $10 for every hit, but charged $1 for every false alarm, compute the optimal (\beta ) value for this inspector. (a) Assume P(N)/P(S)=1 (1 pt).

    <p>The optimal (\beta ) is 10, as the payoff for a hit is 10 times higher than the cost of a false alarm. (b) Assume that P(N) = 0.8 (1 pt) HINT: Given only P(N) it is possible to determine P(S) and P(N)/P(S)</p> Signup and view all the answers

    Flashcards

    Sensitivity

    The ability to detect a true signal amid noise.

    Inspector Clouseau

    An inspector with a liberal criterion for detecting weld flaws.

    Inspector Morse

    An inspector with a neutral criterion for detecting weld flaws.

    Criterion

    The standard that determines whether a signal is detected.

    Signup and view all the flashcards

    d' (d prime)

    A measure of sensitivity in signal detection theory.

    Signup and view all the flashcards

    Miss Rate

    The proportion of false negatives when a signal is present.

    Signup and view all the flashcards

    Correct Rejection Rate

    The proportion of accurate identifications of noise.

    Signup and view all the flashcards

    ROC Curve

    A graphical representation of a detector's performance.

    Signup and view all the flashcards

    Hit Rate

    The frequency of correctly detecting a signal when it is present.

    Signup and view all the flashcards

    False Alarm Rate

    The frequency of incorrectly detecting a signal when it is not present.

    Signup and view all the flashcards

    Payoff Conditions

    The reward structure affecting how inspectors make detections.

    Signup and view all the flashcards

    Session One Rates

    Hit rates: Clouseau .80, Morse .99; FA Rates: Clouseau .44, Morse .63.

    Signup and view all the flashcards

    Session Two Rates

    Hit rates: Clouseau .65, Morse .85; FA Rates: Clouseau .27, Morse .15.

    Signup and view all the flashcards

    Session Three Rates

    Hit rates: Clouseau .45, Morse .50; FA Rates: Clouseau .10, Morse .02.

    Signup and view all the flashcards

    Quantifying Sensitivity

    Determining how effectively an inspector identifies signals based on performance.

    Signup and view all the flashcards

    Optimal b value

    The best balance point for false alarms versus hits in a detection task.

    Signup and view all the flashcards

    P(N)/P(S)

    The ratio of the probabilities of noise to the probability of a signal.

    Signup and view all the flashcards

    Performance Monitoring

    The observation and analysis of how inspectors detect flaws.

    Signup and view all the flashcards

    False Alarm

    An incorrect report of a signal when it is actually noise.

    Signup and view all the flashcards

    Wickens Table

    A reference table for calculating d' values in detection theory.

    Signup and view all the flashcards

    Session Effects

    Changes in inspector behavior based on reward systems across sessions.

    Signup and view all the flashcards

    Inspector Smith

    A third inspector whose performance indicates overall sensitivity.

    Signup and view all the flashcards

    Standardized ROC Curve

    A normalization of the ROC curve for better sensitivity assessment.

    Signup and view all the flashcards

    Shallow Slope

    Indicates poor detection capability in an ROC curve.

    Signup and view all the flashcards

    Positive Rate

    The ratio of hits to total positive cases detected.

    Signup and view all the flashcards

    Negative Rate

    The proportion of times a non-signal is correctly identified.

    Signup and view all the flashcards

    Dynamic Adjustment

    Changing detection strategy based on payoff conditions.

    Signup and view all the flashcards

    Detection Theory

    A field that studies how decisions are made under uncertainty.

    Signup and view all the flashcards

    Cognitive Bias

    A systematic pattern of deviation from norm or rationality in judgment.

    Signup and view all the flashcards

    Signal Detection

    The process of identifying the presence of a signal amid distractions.

    Signup and view all the flashcards

    Study Notes

    Human Machine Systems Assignment

    • Inspectors Clouseau and Morse monitor weld quality.
    • Clouseau's neural activity distributions are shown for noise and signal+noise.
    • Morse's neural activity distributions are also shown.
    • Sensitivity: Clouseau is better at detecting flaws than Morse.
    • Criteria:
      • Morse has a neutral criterion.
      • Clouseau has a liberal criterion.
    • β < 1: This occurs for Morse, with β representing the criterion in their respective ROC graphs.
    • Clouseau's d' value: If miss rate = 0.20 and correct rejection rate = 0.80, Clouseau’s d' value can be determined using the formula or a table.
    • Payoff Conditions:
      • Inspectors' performance was evaluated in three sessions with different reward structures.
      • Session 1: $1 for each correct detection.
      • Session 2: $1 for each correct detection, but a $1 penalty for false alarms.
      • Session 3: Nothing for correct detection, but $1 penalty for false alarms.
    • ROC Curves:
      • Create ROC curves plotting sensitivity (hit rate) against false alarm rate for each session.
      • All curves should be plotted on the same axes.
    • Observer Effect of Payoffs: How much the two observers' performance was affected by the different reward structures.
    • Quantifying Inspector Smith's Sensitivity: Given that Inspector Smith's ROC curve on normal probability paper has a slope of less than 45 degrees, sensitivity is quantified by measuring the area under the ROC curve; a shallow slope signals less sensitivity.
    • Optimal β Value for Morse: Calculation of the optimal beta value (β) if paid $10 for every hit, and charged $1 for each false alarm.

    Studying That Suits You

    Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

    Quiz Team

    Related Documents

    ISEN 814 Assignment 2 PDF

    Description

    This assignment focuses on the analysis of weld quality monitoring by inspectors Clouseau and Morse. It includes discussions on their neural activity distributions, sensitivity in flaw detection, and various payoff conditions that affected their performance. Dive into the nuances of signal detection theory and the evaluation of ROC graphs.

    More Like This

    Signal Detection Theory Quiz
    5 questions
    Fuzzy Signal Detection Theory
    12 questions
    Signal Detection Theory Overview
    14 questions

    Signal Detection Theory Overview

    EffortlessGyrolite7402 avatar
    EffortlessGyrolite7402
    Use Quizgecko on...
    Browser
    Browser