Podcast Beta
Questions and Answers
What is a primary advantage of the Think Aloud method?
Which of the following is a significant disadvantage of interviews as a data collection method?
In what way are cooperative evaluations an improvement over traditional think aloud protocols?
What is a characteristic weakness of questionnaires in data collection?
Signup and view all the answers
What is an essential consideration when designing a questionnaire?
Signup and view all the answers
What is a primary disadvantage of using laboratory studies for evaluation?
Signup and view all the answers
Which evaluation method involves experts assessing if usability criteria are violated?
Signup and view all the answers
What is a key advantage of field studies in evaluating system usability?
Signup and view all the answers
In the context of user participation, if both advantages and disadvantages are present, which environment may be least appropriate for testing?
Signup and view all the answers
What advantage does the laboratory study offer for system evaluations?
Signup and view all the answers
Which cognitive evaluation method focuses on supporting users in learning tasks?
Signup and view all the answers
What should be carefully considered when applying results from model-based evaluations?
Signup and view all the answers
What is the purpose of formative evaluation in the design process?
Signup and view all the answers
What is the primary purpose of an experimental evaluation?
Signup and view all the answers
Which of the following correctly differentiates between independent and dependent variables?
Signup and view all the answers
In hypothesis formulation, what does the null hypothesis represent?
Signup and view all the answers
What defines a within groups experimental design?
Signup and view all the answers
What is a characteristic of discrete data in statistical analysis?
Signup and view all the answers
Which experimental factor pertains to the participants involved in a study?
Signup and view all the answers
What is a primary consideration when selecting a statistical technique for data analysis?
Signup and view all the answers
Why is it important to save original data before performing statistical analysis?
Signup and view all the answers
Study Notes
Evaluation
- Test usability and functionality of a system
- Can be conducted in the lab, field, and/or in collaboration with users
- Evaluates design and implementation
- Should be considered at all stages of the design lifecycle
- Formative v.s. Summative evaluation
Goals of evaluation
- Assess the extent of system functionality
- Assess the effect of the interface on the user
- Identify specific problems
Evaluating Designs
- Cognitive Walkthrough
- Heuristic Evaluation
- Model-based Evaluation
Cognitive Walkthrough
- Proposed by Polson et al.
- Evaluates design on how well (or easy) it supports users in learning tasks
- Usually performed by an expert in cognitive psychology
- Can be performed by an expert 'walking through' a design to identify potential problems using psychological principles
- Forms can be used to guide analysis
- Example: Command line interface v.s. WIMP
Heuristic Evaluation
- Proposed by Nielsen and Molich
- Usability criteria (heuristics) are identified
- Design examined by experts to see if these criteria are violated
- Example heuristics: System behaviour is predictable, system behavior is consistent, and feedback is provided.
- Heuristic evaluation 'debugs' design.
Model-based evaluation
- Results from the literature used to support or refute parts of a design
- Care is needed to ensure results are transferable to a new design
- Cognitive models used to filter design options
- GOMS (goals, operators, methods, and selection) prediction of user performance
- Design rationale can also provide useful evaluation information
Evaluating through user participation
Laboratory studies
- Advantages:
- Specialist equipment available
- Uninterrupted environment
- Disadvantages:
- Lack of content
- Difficult to observe several users cooperating
- Appropriate:
- If a system's location is dangerous or impractical for constrained single-user systems to allow controlled manipulation of use.
Field Studies
- Advantages:
- Natural environment
- Context retained (though observation may alter it)
- Disadvantages:
- Distractions
- Noise
- Appropriate:
- Where content is crucial and difficult to implement in a lab.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Related Documents
Description
Explore various evaluation techniques used to assess system usability and functionality. This quiz covers methods such as cognitive walkthroughs and heuristic evaluations, emphasizing their importance throughout the design lifecycle. Understand how to identify specific problems and improve user interface design.