24 Questions
What is the origin of the term 'benchmark'?
It originated in surveying, referring to marks made in stone structures
What type of data is collected during a benchmark task?
Both qualitative and quantitative data
What is the purpose of a benchmark task in UX evaluation?
To compare user performance across different design versions
Why might designers defer a design decision to UX testing?
They cannot decide on a design feature and want user input
What is a benchmark task used to address?
Designer questions about interaction designs
What is the purpose of UX targets in relation to benchmark tasks?
To compare user performance data to design goals
What is the characteristic of a benchmark task?
It is a standardized task used to compare performance
What is the benefit of using benchmark tasks in UX evaluation?
It allows designers to compare performance among different users and design versions
What is the primary goal of selecting benchmark tasks in UX design?
To evaluate new features and edge cases
Why should benchmark tasks be presented in a particular order?
To get users accustomed to the design and feeling comfortable in their role as evaluators
What is the purpose of introducing more features and complexity in benchmark tasks?
To build user confidence and engagement
What is an example of an intervening circumstance in a benchmark task?
Changing the user's mind and wanting to do something different
What is the purpose of including navigation in benchmark tasks?
To simulate real-world scenarios
What is the benefit of starting with short and easy tasks in benchmarking?
To get users accustomed to the design and feeling comfortable in their role as evaluators
What is the purpose of using benchmark tasks in UX design?
To evaluate the usability and effectiveness of the system
Why are business-critical and mission-critical tasks included in benchmarking?
To evaluate the consequences of getting these tasks wrong
What is the primary purpose of making benchmark tasks unambiguous?
To minimize differences in user performance due to different interpretations of the task
What is a potential issue with the phrase '1 month from today' in a benchmark task?
It is ambiguous and can be interpreted in different ways
Why should benchmark tasks be specific?
So that participants do not get sidetracked on irrelevant details during testing
What is the benefit of using clear and precise instructions in benchmark tasks?
It ensures consistent results and reduces ambiguity
What is the primary goal of creating benchmark tasks for a UX measure?
To measure the initial performance of a system
What is the role of 'Dr. Ehrich' in the example benchmark task?
Meeting participant
What is the name of the UX measure mentioned in the content?
Initial performance
What is the purpose of the '133 McBryde Hall' detail in the example benchmark task?
To specify the location of the meeting
Study Notes
Origin of Benchmark
- The term "benchmark" originates from surveying, referring to chiseled horizontal marks on stone structures that serve as a reference point for leveling rods.
Benchmark Tasks in UX
- A benchmark task is a representative task that users perform in evaluation to measure UX performance and behavior.
- It provides qualitative data (observations of critical incidents and user experience problems) and quantitative data (user performance data to compare with UX targets).
- Benchmark tasks are standardized to compare performance among different users and across different design versions.
Addressing Designer Questions
- Benchmark tasks help address designer questions and UX targets.
- They are used to evaluate new features, edge cases, and business-critical and mission-critical tasks.
Selecting and Designing Benchmark Tasks
- Start with short and easy tasks and increase difficulty progressively.
- Consider the presentation order of benchmark tasks to build user confidence and engagement.
- Introduce more features, complexity, and difficulty in later tasks.
- Repeat benchmark tasks with different task paths to see how users navigate in multiple ways.
- Introduce intervening circumstances in advanced benchmark tasks to test creativity.
Constructing Benchmark Task Content
- Remove ambiguities with clear, precise, specific, and repeatable instructions.
- Ensure unambiguous benchmark tasks for consistent results.
- Make instructions clear and not confusing to avoid differences in user performance due to different interpretations.
- Avoid sidetracking users on irrelevant details during testing.
Learn about the origins of the term 'benchmark' and its meaning in surveying. Discover how it was used to ensure accurate repositioning of leveling rods.
Make Your Own Quizzes and Flashcards
Convert your notes into interactive study material.
Get started for free
