Module 4.1 Advanced HCI_ HCI Evaluation.pdf

IT 114 HCI EVALUATION  EVALUATION is integral to the design process. It involves collecting and analyzing data about users’ or potential users’ experiences when interacting with a design artifact such as a screen sketch, prototype, app, computer system, or compon...

IT 114 HCI EVALUATION  EVALUATION is integral to the design process. It involves collecting and analyzing data about users’ or potential users’ experiences when interacting with a design artifact such as a screen sketch, prototype, app, computer system, or component of a computer system. A central goal of evaluation is to improve the artifact’s design Evaluation focuses on both the usability of the system (that is, how easy it is to learn and to use) and on the users’ experiences when interacting with it (for example, how satisfying, enjoyable, or motivating the interaction is). THE WHY, WHAT, WHERE, AND WHEN OF EVALUATION  WHY EVALUATE? User experience involves all aspects of the user’s interaction with the product. Nowadays users expect much more than just a usable system—they also look for a pleasing and engaging experience from more products. Simplicity and elegance are valued so that the product is a joy to own and use. well-designed products sell well  WHAT TO EVALUATE What to evaluate ranges from low-tech prototypes to complete systems, from a particular screen function to the whole workflow, and from aesthetic design to safety features  WHERE TO EVALUATE Where evaluation takes place depends on what is being evaluated. Some characteristics, such as web accessibility, are generally evaluated in a lab because it provides the control necessary to investigate systematically whether all of the requirements are met. This is also true for design choices, such as choosing the size and layout of keys for a small handheld device for playing games. User experience aspects, such as whether children enjoy playing with a new toy and for how long before they get bored, can be evaluated more effectively in natural settings, which are often referred to as in-the-wild studies.  WHEN TO EVALUATE The stage in the product lifecycle when evaluation takes place depends on the type of product and the development process being followed. For example, the product being developed could be a new concept, or it could be an upgrade to an existing product. It could also be a product in a rapidly changing market that needs to be evaluated to see how well the design meets current and predicted market needs. If the product is new, then considerable time is usually invested in market research and discovering user requirements  WHEN TO EVALUATE When evaluations are conducted during design to check that a product continues to meet users’ needs, they are known as formative evaluations. Evaluations that are carried out to assess the success of a finished product are known as summative evaluations. TYPES OF EVALUATION  THREE BROAD CATEGORIES Controlled settings directly involving users (examples are usability labs and research labs): Users’ activities are controlled to test hypotheses and measure or observe certain behaviors. The main methods are usability testing and experiments Natural settings involving users (examples are online communities and products that are used in public places): There is little or no control of users’ activities to determine how the product would be used in the real world. The main method used is field studies (for example in-the-wild studies). Any settings not directly involving users: Consultants and researchers critique, predict, and model aspects of the interface to identify the most obvious usability problems. The range of methods includes inspections, heuristics, walk-throughs, models, and analytics.  CONTROLLED SETTINGS INVOLVING USERS Experiments and user tests are designed to control what users do, when they do it, and for how long. They are designed to reduce outside influences and distractions that might affect the results, such as people talking in the background. The approach has been extensively and successfully used to evaluate software applications running on laptops and other devices where participants can be seated in front of them to perform a set of tasks. Usability Testing  NATURAL SETTINGS INVOLVING USERS The goal of field studies is to evaluate products with users in their natural settings. Field studies are used primarily to Help identify opportunities for new technology Establish the requirements for a new design Facilitate the introduction of technology or inform deployment of existing technology in new contexts  ANY SETTINGS NOT INVOLVING USERS Evaluations that take place without involving users are conducted in settings where the researcher has to imagine or model how an interface is likely to be used. Inspection methods are commonly employed to predict user behavior and to identify usability problems based on knowledge of usability, users’ behavior, the contexts in which the system will be used, and the kinds of activities that users undertake  SELECTING AND COMBINING METHODS The three broad categories identified previously provide a general framework to guide the selection of evaluation methods. Often, combinations of methods are used across the categories to obtain a richer understanding. For example, sometimes usability testing conducted in labs is combined with observations in natural settings to identify the range of usability problems and find out how users typically use a product. THANK YOU