Software Development Evaluation
32 Questions
2 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is one of the goals of evaluation in the design life cycle?

  • To evaluate the level of system functionality (correct)
  • To design the system quickly
  • To only test the implementation of the system
  • To ignore user feedback

    • What is the primary focus of Cognitive Walkthrough analysis?

  • To analyze user behavior
  • To identify problems using psychological principles (correct)
  • To compare different design layouts
  • To evaluate design based on user feedback

    • Where can evaluation occur?

  • Only in a field
  • Only with users
  • In a laboratory, field, and/or in collaboration with users (correct)
  • Only in a laboratory

    • What is one of the things that evaluation identifies?

    <p>Specific problems with the system</p> Signup and view all the answers

    Who typically performs a Cognitive Walkthrough?

    <p>An expert in cognitive psychology</p> Signup and view all the answers

    What is the purpose of forms in Cognitive Walkthrough analysis?

    <p>To guide the analysis</p> Signup and view all the answers

    When should evaluation be considered?

    <p>At all stages of the design life cycle</p> Signup and view all the answers

    What type of evaluation is proposed by Polson et al.?

    <p>Cognitive Walkthrough</p> Signup and view all the answers

    What aspect of user interaction is considered in Cognitive Walkthrough?

    <p>Impact of interaction on the user</p> Signup and view all the answers

    What is one of the things that evaluation evaluates?

    <p>The effect of the interface on user satisfaction</p> Signup and view all the answers

    What cognitive processes are considered in Cognitive Walkthrough?

    <p>Cognitive processes required for task completion</p> Signup and view all the answers

    What is the ultimate goal of Cognitive Walkthrough analysis?

    <p>To ensure the design leads the user to make correct goals</p> Signup and view all the answers

    Who proposed the Heuristic Evaluation method?

    <p>Nielsen and Molich</p> Signup and view all the answers

    What is the purpose of Heuristic Evaluation?

    <p>To identify usability issues</p> Signup and view all the answers

    What is one of the heuristics mentioned in the text?

    <p>System behavior is predictable</p> Signup and view all the answers

    What is the goal of debugging in Heuristic Evaluation?

    <p>To fix errors</p> Signup and view all the answers

    What is Review-based evaluation used for?

    <p>To support or refute parts of a design</p> Signup and view all the answers

    What is important to ensure when using Review-based evaluation?

    <p>That the results are transferable to new designs</p> Signup and view all the answers

    What is a key advantage of laboratory studies in evaluating user participation?

    <p>Specialist equipment is available</p> Signup and view all the answers

    What is a limitation of field studies in evaluating user participation?

    <p>Distractions and noise</p> Signup and view all the answers

    What is required for evaluating implementations?

    <p>An artefact, such as a simulation or prototype</p> Signup and view all the answers

    What is a key characteristic of experimental evaluation?

    <p>Evaluator chooses the hypothesis to be tested</p> Signup and view all the answers

    What is an advantage of model-based evaluation?

    <p>Not mentioned in the text</p> Signup and view all the answers

    What is a limitation of laboratory studies in evaluating user participation?

    <p>Lack of context</p> Signup and view all the answers

    What is the purpose of a hypothesis in an experiment?

    <p>To frame a prediction of the outcome</p> Signup and view all the answers

    What is an independent variable in an experiment?

    <p>A characteristic changed to produce different conditions</p> Signup and view all the answers

    What is a dependent variable in an experiment?

    <p>A characteristic measured in the experiment</p> Signup and view all the answers

    What is the main advantage of a within-groups design?

    <p>It is less costly and less likely to suffer from user variation</p> Signup and view all the answers

    What is a null hypothesis?

    <p>A statement of no difference between conditions</p> Signup and view all the answers

    What is an example of an independent variable in an experiment?

    <p>Interface style</p> Signup and view all the answers

    What is the purpose of a null hypothesis?

    <p>To state no difference between conditions</p> Signup and view all the answers

    What is an example of a dependent variable in an experiment?

    <p>Error rate</p> Signup and view all the answers

    Study Notes

    Evaluation

    • Evaluates the usability and functionality of a system
    • Occurs in laboratory, field, and/or in collaboration with users
    • Evaluates both design and implementation

    Goals of Evaluation

    • Evaluates level of system functionality
    • Evaluates effect of interface on user
    • Identifies specific problems

    Evaluating Designs

    • Cognitive Walkthrough: evaluates design on how well it supports user in learning tasks
    • Heuristic Evaluation: evaluates design based on usability criteria (heuristics)
    • Review-based evaluation: uses written reviews to support or refute parts of design

    Cognitive Walkthrough

    • Evaluates design on how well it supports user in learning tasks
    • Performed by expert in cognitive psychology
    • Expert 'walks through' design to identify possible problems using psychological principles
    • Forms used to guide analysis
    • For each task, walkthrough considers:
      • What impact will interaction have on user?
      • What cognitive processes are required?
      • What learning problems may occur?

    Heuristic Evaluation

    • Proposed by Nielsen and Molich
    • Evaluates design based on usability criteria (heuristics)
    • Examples of heuristics:
      • System behavior is predictable
      • System behavior is consistent
      • Feedback is provided
    • Heuristic evaluation 'debugs' design

    Review-based Evaluation

    • Results from written review used to support or refute parts of design
    • Care needed to ensure results are transferable to new design

    Evaluating through User Participation

    • Laboratory studies:
      • Advantages: specialist equipment available, uninterrupted environment
      • Disadvantages: lack of context, difficult to observe several users cooperating
    • Field Studies:
      • Advantages: natural environment, context retained
      • Disadvantages: distractions, noise

    Evaluating Implementations

    • Requires an artefact: simulation, prototype, or full implementation
    • Experimental evaluation:
      • Controlled evaluation of interactive behavior
      • Evaluator chooses hypothesis to be tested
      • A number of experimental conditions are considered, which differ only in the value of some controlled variable
      • Changes in behavioral measure are attributed to different conditions

    Experimental Factors

    • Subjects:
      • Who: representative, sufficient sample
    • Variables:
      • What to modify and measure
    • Hypothesis:
      • What you'd like to show
    • Experimental design:
      • How you are going to do it

    Variables

    • Independent variable (IV):
      • Characteristic changed to produce different conditions
      • E.g. interface style, number of menu items
    • Dependent variable (DV):
      • Characteristics measured in the experiment
      • E.g. time taken, number of errors

    Hypothesis (Thesis or Theory)

    • Prediction of outcome
    • Framed in terms of IV and DV
    • E.g. "error rate will increase as font size decreases"
    • Null hypothesis:
      • States no difference between conditions
      • E.g. "no change with font size"

    Studying That Suits You

    Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

    Quiz Team

    Description

    Assessing the usability and functionality of a system, evaluating design and implementation, and testing in laboratory, field, and collaborative settings.

    More Like This

    Use Quizgecko on...
    Browser
    Open
    Browser
    Browser