Evaluation Methods Quiz

Evaluation Methods: Inspections, Analytics, and Models

• This chapter introduces evaluation methods that do not require direct interaction with users.

• Inspection methods involve a researcher analyzing aspects of an interface and identifying potential usability problems.

• Heuristic evaluation is a method where researchers evaluate whether user-interface elements conform to tried-and-tested principles, guided by a set of usability principles known as heuristics.

• Heuristics closely resemble high-level design principles and help identify usability problems.

• Heuristic evaluation can be done at any stage of a design project and can complement user testing.

• Heuristic sets for evaluating websites have been developed based on Nielsen's original 10 heuristics.

• Heuristic evaluations can be broken down into three main stages: a briefing session, evaluation period, and report writing.

• Analytics involves user interaction logging to understand user behavior and identify potential usability problems.

• A/B testing is an experimental method that involves comparing two versions of a product to determine which one performs better.

• Predictive modeling involves analyzing the physical and mental operations needed to perform tasks and operationalizing them as quantitative measures.

• Fitts' law is a commonly used predictive model.

• The number of researchers needed for a heuristic evaluation depends on the product and its intended users, but employing several researchers can be resource-intensive.Heuristics and Guidelines for Evaluating Website Usability and Accessibility

• Heuristics focus on usability criteria and user experience, including interface complexity and color usage.

• Being aware of heuristics can lead to a stronger focus on design and user needs.

• Applying heuristics can be difficult, especially for those not accustomed to heuristic evaluations.

• Researchers typically have specific user tasks in mind when evaluating a functioning product.

• Evaluating early designs with mock-ups or specifications requires adapting the evaluation approach.

• Researchers may work together, recording problems identified and thinking aloud during evaluation.

• Debriefing sessions with designers prioritize problems and suggest solutions.

• Heuristic evaluation should not be viewed as a replacement for user testing.

• Heuristic evaluation can miss severe problems and report false alarms.

• Heuristic evaluation can be improved by checking researcher expertise, using multiple researchers, and providing support for using heuristics.

• Web Content Accessibility Guidelines (WCAG) are standards for ensuring web page accessibility.

• WCAG guidelines can be used as heuristics to evaluate web accessibility, with key concepts summarized as POUR (Perceivable, Operable, Understandable, and Robust).Inspections: Heuristic Evaluation and Walk-Throughs

• The text discusses different sets of guidelines and heuristics for evaluating the usability of a system, including Nielsen's usability heuristics, Shneiderman's eight golden rules, and web accessibility guidelines.

• Heuristic evaluation is a method that involves experts evaluating a system against a set of guidelines or heuristics.

• Shneiderman's eight golden rules focus on consistency, universal usability, informative feedback, closure, error prevention, easy reversal of actions, user control, and reducing short-term memory load.

• Cognitive walk-throughs involve simulating how users go about problem-solving at each step in a human-computer interaction.

• Cognitive walk-throughs focus on evaluating designs for ease of learning and are often integrated with other evaluation and design processes.

• The main steps involved in cognitive walk-throughs include identifying typical users and tasks, analyzing the action sequences, compiling a record of critical information, and revising the design to fix problems.

• Walk-throughs focus more closely on identifying specific user problems at a detailed level than heuristic evaluation.

• Semiotic engineering is the study of how signs and symbols are constituted, interpreted, and produced, and it contributes to improving the communication of principles, features, and values of UX design.

• SigniFYIng Message is an inspection procedure that evaluates the quality of semiotic engineering in UX design and assesses the quality of the messages and the strategies of communication that a piece of UX design offers to the users.

• A cognitive walk-through would typically take longer than a heuristic evaluation because it is a more detailed process.

• A cognitive walk-through would typically not be used to evaluate a whole website unless it was a small one.

• Rick Spencer developed a variation of a cognitive walk-through that addressed problems with the original form, including lengthy answers and defensive designers.Evaluation Methods: Walk-Throughs, Analytics, and A/B Testing

• Cognitive walk-throughs involve users working through a task scenario and discussing usability issues associated with dialog elements involved in the scenario steps.

• Cognitive walk-throughs have been adapted to be less detailed and time-consuming, resulting in a more coarse-grained analysis.

• Pluralistic walk-throughs involve users, developers, and usability researchers stepping through a task scenario and discussing usability issues.

• Pluralistic walk-throughs involve each person assuming the role of a typical user and writing down the sequence of actions they would take.

• Pluralistic walk-throughs are beneficial for detailed analysis and participatory design practices, but have limitations with time constraints and exploring a limited number of scenarios.

• Analytics involves recording users' actions automatically, including key presses, mouse movements, time spent on a webpage, and task flow through software modules.

• Web analytics is a form of interaction logging specifically created to analyze users' activity on websites.

• Web analytics can provide a big-picture overview of user interaction on a website and is especially valued by businesses and market research organizations.

• Learning analytics play a strong role in evaluating learners' activities in MOOCs and OERs.

• On-site analytics are used by website owners to measure visitor behavior, while off-site analytics measure a website's visibility and potential to acquire an audience on the Internet.

• Google Analytics is the most widely used on-site web analytics and statistics service, and it can provide information about who accessed the site, how long they stayed, which pages they visited, and more.

• Other analytics tools, such as Moz Analytics, TruSocialMetrics, Clicky, KISSmetrics, Crazy Egg, and ClickTale, provide additional layers of information, good access control options, and raw and real-time data collection.

Evaluation Methods: Inspections, Analytics, and Models

• This chapter introduces evaluation methods that do not require direct interaction with users.

• Inspection methods involve a researcher analyzing aspects of an interface and identifying potential usability problems.

• Heuristic evaluation is a method where researchers evaluate whether user-interface elements conform to tried-and-tested principles, guided by a set of usability principles known as heuristics.

• Heuristics closely resemble high-level design principles and help identify usability problems.

• Heuristic evaluation can be done at any stage of a design project and can complement user testing.

• Heuristic sets for evaluating websites have been developed based on Nielsen's original 10 heuristics.

• Heuristic evaluations can be broken down into three main stages: a briefing session, evaluation period, and report writing.

• Analytics involves user interaction logging to understand user behavior and identify potential usability problems.

• A/B testing is an experimental method that involves comparing two versions of a product to determine which one performs better.

• Predictive modeling involves analyzing the physical and mental operations needed to perform tasks and operationalizing them as quantitative measures.

• Fitts' law is a commonly used predictive model.

• The number of researchers needed for a heuristic evaluation depends on the product and its intended users, but employing several researchers can be resource-intensive.Heuristics and Guidelines for Evaluating Website Usability and Accessibility

• Heuristics focus on usability criteria and user experience, including interface complexity and color usage.

• Being aware of heuristics can lead to a stronger focus on design and user needs.

• Applying heuristics can be difficult, especially for those not accustomed to heuristic evaluations.

• Researchers typically have specific user tasks in mind when evaluating a functioning product.

• Evaluating early designs with mock-ups or specifications requires adapting the evaluation approach.

• Researchers may work together, recording problems identified and thinking aloud during evaluation.

• Debriefing sessions with designers prioritize problems and suggest solutions.

• Heuristic evaluation should not be viewed as a replacement for user testing.

• Heuristic evaluation can miss severe problems and report false alarms.

• Heuristic evaluation can be improved by checking researcher expertise, using multiple researchers, and providing support for using heuristics.

• Web Content Accessibility Guidelines (WCAG) are standards for ensuring web page accessibility.

• WCAG guidelines can be used as heuristics to evaluate web accessibility, with key concepts summarized as POUR (Perceivable, Operable, Understandable, and Robust).Inspections: Heuristic Evaluation and Walk-Throughs

• The text discusses different sets of guidelines and heuristics for evaluating the usability of a system, including Nielsen's usability heuristics, Shneiderman's eight golden rules, and web accessibility guidelines.

• Heuristic evaluation is a method that involves experts evaluating a system against a set of guidelines or heuristics.

• Shneiderman's eight golden rules focus on consistency, universal usability, informative feedback, closure, error prevention, easy reversal of actions, user control, and reducing short-term memory load.

• Cognitive walk-throughs involve simulating how users go about problem-solving at each step in a human-computer interaction.

• Cognitive walk-throughs focus on evaluating designs for ease of learning and are often integrated with other evaluation and design processes.

• The main steps involved in cognitive walk-throughs include identifying typical users and tasks, analyzing the action sequences, compiling a record of critical information, and revising the design to fix problems.

• Walk-throughs focus more closely on identifying specific user problems at a detailed level than heuristic evaluation.

• Semiotic engineering is the study of how signs and symbols are constituted, interpreted, and produced, and it contributes to improving the communication of principles, features, and values of UX design.

• SigniFYIng Message is an inspection procedure that evaluates the quality of semiotic engineering in UX design and assesses the quality of the messages and the strategies of communication that a piece of UX design offers to the users.

• A cognitive walk-through would typically take longer than a heuristic evaluation because it is a more detailed process.

• A cognitive walk-through would typically not be used to evaluate a whole website unless it was a small one.

• Rick Spencer developed a variation of a cognitive walk-through that addressed problems with the original form, including lengthy answers and defensive designers.Evaluation Methods: Walk-Throughs, Analytics, and A/B Testing

• Cognitive walk-throughs involve users working through a task scenario and discussing usability issues associated with dialog elements involved in the scenario steps.

• Cognitive walk-throughs have been adapted to be less detailed and time-consuming, resulting in a more coarse-grained analysis.

• Pluralistic walk-throughs involve users, developers, and usability researchers stepping through a task scenario and discussing usability issues.

• Pluralistic walk-throughs involve each person assuming the role of a typical user and writing down the sequence of actions they would take.

• Pluralistic walk-throughs are beneficial for detailed analysis and participatory design practices, but have limitations with time constraints and exploring a limited number of scenarios.

• Analytics involves recording users' actions automatically, including key presses, mouse movements, time spent on a webpage, and task flow through software modules.

• Web analytics is a form of interaction logging specifically created to analyze users' activity on websites.

• Web analytics can provide a big-picture overview of user interaction on a website and is especially valued by businesses and market research organizations.

• Learning analytics play a strong role in evaluating learners' activities in MOOCs and OERs.

• On-site analytics are used by website owners to measure visitor behavior, while off-site analytics measure a website's visibility and potential to acquire an audience on the Internet.

• Google Analytics is the most widely used on-site web analytics and statistics service, and it can provide information about who accessed the site, how long they stayed, which pages they visited, and more.

• Other analytics tools, such as Moz Analytics, TruSocialMetrics, Clicky, KISSmetrics, Crazy Egg, and ClickTale, provide additional layers of information, good access control options, and raw and real-time data collection.

Evaluation Methods: Inspections, Analytics, and Models

• This chapter introduces evaluation methods that do not require direct interaction with users.

• Inspection methods involve a researcher analyzing aspects of an interface and identifying potential usability problems.

• Heuristic evaluation is a method where researchers evaluate whether user-interface elements conform to tried-and-tested principles, guided by a set of usability principles known as heuristics.

• Heuristics closely resemble high-level design principles and help identify usability problems.

• Heuristic evaluation can be done at any stage of a design project and can complement user testing.

• Heuristic sets for evaluating websites have been developed based on Nielsen's original 10 heuristics.

• Heuristic evaluations can be broken down into three main stages: a briefing session, evaluation period, and report writing.

• Analytics involves user interaction logging to understand user behavior and identify potential usability problems.

• A/B testing is an experimental method that involves comparing two versions of a product to determine which one performs better.

• Predictive modeling involves analyzing the physical and mental operations needed to perform tasks and operationalizing them as quantitative measures.

• Fitts' law is a commonly used predictive model.

• The number of researchers needed for a heuristic evaluation depends on the product and its intended users, but employing several researchers can be resource-intensive.Heuristics and Guidelines for Evaluating Website Usability and Accessibility

• Heuristics focus on usability criteria and user experience, including interface complexity and color usage.

• Being aware of heuristics can lead to a stronger focus on design and user needs.

• Applying heuristics can be difficult, especially for those not accustomed to heuristic evaluations.

• Researchers typically have specific user tasks in mind when evaluating a functioning product.

• Evaluating early designs with mock-ups or specifications requires adapting the evaluation approach.

• Researchers may work together, recording problems identified and thinking aloud during evaluation.

• Debriefing sessions with designers prioritize problems and suggest solutions.

• Heuristic evaluation should not be viewed as a replacement for user testing.

• Heuristic evaluation can miss severe problems and report false alarms.

• Heuristic evaluation can be improved by checking researcher expertise, using multiple researchers, and providing support for using heuristics.

• Web Content Accessibility Guidelines (WCAG) are standards for ensuring web page accessibility.

• WCAG guidelines can be used as heuristics to evaluate web accessibility, with key concepts summarized as POUR (Perceivable, Operable, Understandable, and Robust).Inspections: Heuristic Evaluation and Walk-Throughs

• The text discusses different sets of guidelines and heuristics for evaluating the usability of a system, including Nielsen's usability heuristics, Shneiderman's eight golden rules, and web accessibility guidelines.

• Heuristic evaluation is a method that involves experts evaluating a system against a set of guidelines or heuristics.

• Shneiderman's eight golden rules focus on consistency, universal usability, informative feedback, closure, error prevention, easy reversal of actions, user control, and reducing short-term memory load.

• Cognitive walk-throughs involve simulating how users go about problem-solving at each step in a human-computer interaction.

• Cognitive walk-throughs focus on evaluating designs for ease of learning and are often integrated with other evaluation and design processes.

• The main steps involved in cognitive walk-throughs include identifying typical users and tasks, analyzing the action sequences, compiling a record of critical information, and revising the design to fix problems.

• Walk-throughs focus more closely on identifying specific user problems at a detailed level than heuristic evaluation.

• Semiotic engineering is the study of how signs and symbols are constituted, interpreted, and produced, and it contributes to improving the communication of principles, features, and values of UX design.

• SigniFYIng Message is an inspection procedure that evaluates the quality of semiotic engineering in UX design and assesses the quality of the messages and the strategies of communication that a piece of UX design offers to the users.

• A cognitive walk-through would typically take longer than a heuristic evaluation because it is a more detailed process.

• A cognitive walk-through would typically not be used to evaluate a whole website unless it was a small one.

• Rick Spencer developed a variation of a cognitive walk-through that addressed problems with the original form, including lengthy answers and defensive designers.Evaluation Methods: Walk-Throughs, Analytics, and A/B Testing

• Cognitive walk-throughs involve users working through a task scenario and discussing usability issues associated with dialog elements involved in the scenario steps.

• Cognitive walk-throughs have been adapted to be less detailed and time-consuming, resulting in a more coarse-grained analysis.

• Pluralistic walk-throughs involve users, developers, and usability researchers stepping through a task scenario and discussing usability issues.

• Pluralistic walk-throughs involve each person assuming the role of a typical user and writing down the sequence of actions they would take.

• Pluralistic walk-throughs are beneficial for detailed analysis and participatory design practices, but have limitations with time constraints and exploring a limited number of scenarios.

• Analytics involves recording users' actions automatically, including key presses, mouse movements, time spent on a webpage, and task flow through software modules.

• Web analytics is a form of interaction logging specifically created to analyze users' activity on websites.

• Web analytics can provide a big-picture overview of user interaction on a website and is especially valued by businesses and market research organizations.

• Learning analytics play a strong role in evaluating learners' activities in MOOCs and OERs.

• On-site analytics are used by website owners to measure visitor behavior, while off-site analytics measure a website's visibility and potential to acquire an audience on the Internet.

• Google Analytics is the most widely used on-site web analytics and statistics service, and it can provide information about who accessed the site, how long they stayed, which pages they visited, and more.

• Other analytics tools, such as Moz Analytics, TruSocialMetrics, Clicky, KISSmetrics, Crazy Egg, and ClickTale, provide additional layers of information, good access control options, and raw and real-time data collection.

Evaluation Methods: Inspections, Analytics, and Models

• This chapter introduces evaluation methods that do not require direct interaction with users.

• Inspection methods involve a researcher analyzing aspects of an interface and identifying potential usability problems.

• Heuristic evaluation is a method where researchers evaluate whether user-interface elements conform to tried-and-tested principles, guided by a set of usability principles known as heuristics.

• Heuristics closely resemble high-level design principles and help identify usability problems.

• Heuristic evaluation can be done at any stage of a design project and can complement user testing.

• Heuristic sets for evaluating websites have been developed based on Nielsen's original 10 heuristics.

• Heuristic evaluations can be broken down into three main stages: a briefing session, evaluation period, and report writing.

• Analytics involves user interaction logging to understand user behavior and identify potential usability problems.

• A/B testing is an experimental method that involves comparing two versions of a product to determine which one performs better.

• Predictive modeling involves analyzing the physical and mental operations needed to perform tasks and operationalizing them as quantitative measures.

• Fitts' law is a commonly used predictive model.

• The number of researchers needed for a heuristic evaluation depends on the product and its intended users, but employing several researchers can be resource-intensive.Heuristics and Guidelines for Evaluating Website Usability and Accessibility

• Heuristics focus on usability criteria and user experience, including interface complexity and color usage.

• Being aware of heuristics can lead to a stronger focus on design and user needs.

• Applying heuristics can be difficult, especially for those not accustomed to heuristic evaluations.

• Researchers typically have specific user tasks in mind when evaluating a functioning product.

• Evaluating early designs with mock-ups or specifications requires adapting the evaluation approach.

• Researchers may work together, recording problems identified and thinking aloud during evaluation.

• Debriefing sessions with designers prioritize problems and suggest solutions.

• Heuristic evaluation should not be viewed as a replacement for user testing.

• Heuristic evaluation can miss severe problems and report false alarms.

• Heuristic evaluation can be improved by checking researcher expertise, using multiple researchers, and providing support for using heuristics.

• Web Content Accessibility Guidelines (WCAG) are standards for ensuring web page accessibility.

• WCAG guidelines can be used as heuristics to evaluate web accessibility, with key concepts summarized as POUR (Perceivable, Operable, Understandable, and Robust).Inspections: Heuristic Evaluation and Walk-Throughs

• The text discusses different sets of guidelines and heuristics for evaluating the usability of a system, including Nielsen's usability heuristics, Shneiderman's eight golden rules, and web accessibility guidelines.

• Heuristic evaluation is a method that involves experts evaluating a system against a set of guidelines or heuristics.

• Shneiderman's eight golden rules focus on consistency, universal usability, informative feedback, closure, error prevention, easy reversal of actions, user control, and reducing short-term memory load.

• Cognitive walk-throughs involve simulating how users go about problem-solving at each step in a human-computer interaction.

• Cognitive walk-throughs focus on evaluating designs for ease of learning and are often integrated with other evaluation and design processes.

• The main steps involved in cognitive walk-throughs include identifying typical users and tasks, analyzing the action sequences, compiling a record of critical information, and revising the design to fix problems.

• Walk-throughs focus more closely on identifying specific user problems at a detailed level than heuristic evaluation.

• Semiotic engineering is the study of how signs and symbols are constituted, interpreted, and produced, and it contributes to improving the communication of principles, features, and values of UX design.

• SigniFYIng Message is an inspection procedure that evaluates the quality of semiotic engineering in UX design and assesses the quality of the messages and the strategies of communication that a piece of UX design offers to the users.

• A cognitive walk-through would typically take longer than a heuristic evaluation because it is a more detailed process.

• A cognitive walk-through would typically not be used to evaluate a whole website unless it was a small one.

• Rick Spencer developed a variation of a cognitive walk-through that addressed problems with the original form, including lengthy answers and defensive designers.Evaluation Methods: Walk-Throughs, Analytics, and A/B Testing

• Cognitive walk-throughs involve users working through a task scenario and discussing usability issues associated with dialog elements involved in the scenario steps.

• Cognitive walk-throughs have been adapted to be less detailed and time-consuming, resulting in a more coarse-grained analysis.

• Pluralistic walk-throughs involve users, developers, and usability researchers stepping through a task scenario and discussing usability issues.

• Pluralistic walk-throughs involve each person assuming the role of a typical user and writing down the sequence of actions they would take.

• Pluralistic walk-throughs are beneficial for detailed analysis and participatory design practices, but have limitations with time constraints and exploring a limited number of scenarios.

• Analytics involves recording users' actions automatically, including key presses, mouse movements, time spent on a webpage, and task flow through software modules.

• Web analytics is a form of interaction logging specifically created to analyze users' activity on websites.

• Web analytics can provide a big-picture overview of user interaction on a website and is especially valued by businesses and market research organizations.

• Learning analytics play a strong role in evaluating learners' activities in MOOCs and OERs.

• On-site analytics are used by website owners to measure visitor behavior, while off-site analytics measure a website's visibility and potential to acquire an audience on the Internet.

• Google Analytics is the most widely used on-site web analytics and statistics service, and it can provide information about who accessed the site, how long they stayed, which pages they visited, and more.

• Other analytics tools, such as Moz Analytics, TruSocialMetrics, Clicky, KISSmetrics, Crazy Egg, and ClickTale, provide additional layers of information, good access control options, and raw and real-time data collection.

Evaluation Methods: Inspections, Analytics, and Models

• This chapter introduces evaluation methods that do not require direct interaction with users.

• Inspection methods involve a researcher analyzing aspects of an interface and identifying potential usability problems.

• Heuristic evaluation is a method where researchers evaluate whether user-interface elements conform to tried-and-tested principles, guided by a set of usability principles known as heuristics.

• Heuristics closely resemble high-level design principles and help identify usability problems.

• Heuristic evaluation can be done at any stage of a design project and can complement user testing.

• Heuristic sets for evaluating websites have been developed based on Nielsen's original 10 heuristics.

• Heuristic evaluations can be broken down into three main stages: a briefing session, evaluation period, and report writing.

• Analytics involves user interaction logging to understand user behavior and identify potential usability problems.

• A/B testing is an experimental method that involves comparing two versions of a product to determine which one performs better.

• Predictive modeling involves analyzing the physical and mental operations needed to perform tasks and operationalizing them as quantitative measures.

• Fitts' law is a commonly used predictive model.

• The number of researchers needed for a heuristic evaluation depends on the product and its intended users, but employing several researchers can be resource-intensive.Heuristics and Guidelines for Evaluating Website Usability and Accessibility

• Heuristics focus on usability criteria and user experience, including interface complexity and color usage.

• Being aware of heuristics can lead to a stronger focus on design and user needs.

• Applying heuristics can be difficult, especially for those not accustomed to heuristic evaluations.

• Researchers typically have specific user tasks in mind when evaluating a functioning product.

• Evaluating early designs with mock-ups or specifications requires adapting the evaluation approach.

• Researchers may work together, recording problems identified and thinking aloud during evaluation.

• Debriefing sessions with designers prioritize problems and suggest solutions.

• Heuristic evaluation should not be viewed as a replacement for user testing.

• Heuristic evaluation can miss severe problems and report false alarms.

• Heuristic evaluation can be improved by checking researcher expertise, using multiple researchers, and providing support for using heuristics.

• Web Content Accessibility Guidelines (WCAG) are standards for ensuring web page accessibility.

• WCAG guidelines can be used as heuristics to evaluate web accessibility, with key concepts summarized as POUR (Perceivable, Operable, Understandable, and Robust).Inspections: Heuristic Evaluation and Walk-Throughs

• The text discusses different sets of guidelines and heuristics for evaluating the usability of a system, including Nielsen's usability heuristics, Shneiderman's eight golden rules, and web accessibility guidelines.

• Heuristic evaluation is a method that involves experts evaluating a system against a set of guidelines or heuristics.

• Shneiderman's eight golden rules focus on consistency, universal usability, informative feedback, closure, error prevention, easy reversal of actions, user control, and reducing short-term memory load.

• Cognitive walk-throughs involve simulating how users go about problem-solving at each step in a human-computer interaction.

• Cognitive walk-throughs focus on evaluating designs for ease of learning and are often integrated with other evaluation and design processes.

• The main steps involved in cognitive walk-throughs include identifying typical users and tasks, analyzing the action sequences, compiling a record of critical information, and revising the design to fix problems.

• Walk-throughs focus more closely on identifying specific user problems at a detailed level than heuristic evaluation.

• Semiotic engineering is the study of how signs and symbols are constituted, interpreted, and produced, and it contributes to improving the communication of principles, features, and values of UX design.

• SigniFYIng Message is an inspection procedure that evaluates the quality of semiotic engineering in UX design and assesses the quality of the messages and the strategies of communication that a piece of UX design offers to the users.

• A cognitive walk-through would typically take longer than a heuristic evaluation because it is a more detailed process.

• A cognitive walk-through would typically not be used to evaluate a whole website unless it was a small one.

• Rick Spencer developed a variation of a cognitive walk-through that addressed problems with the original form, including lengthy answers and defensive designers.Evaluation Methods: Walk-Throughs, Analytics, and A/B Testing

• Cognitive walk-throughs involve users working through a task scenario and discussing usability issues associated with dialog elements involved in the scenario steps.

• Cognitive walk-throughs have been adapted to be less detailed and time-consuming, resulting in a more coarse-grained analysis.

• Pluralistic walk-throughs involve users, developers, and usability researchers stepping through a task scenario and discussing usability issues.

• Pluralistic walk-throughs involve each person assuming the role of a typical user and writing down the sequence of actions they would take.

• Pluralistic walk-throughs are beneficial for detailed analysis and participatory design practices, but have limitations with time constraints and exploring a limited number of scenarios.

• Analytics involves recording users' actions automatically, including key presses, mouse movements, time spent on a webpage, and task flow through software modules.

• Web analytics is a form of interaction logging specifically created to analyze users' activity on websites.

• Web analytics can provide a big-picture overview of user interaction on a website and is especially valued by businesses and market research organizations.

• Learning analytics play a strong role in evaluating learners' activities in MOOCs and OERs.

• On-site analytics are used by website owners to measure visitor behavior, while off-site analytics measure a website's visibility and potential to acquire an audience on the Internet.

• Google Analytics is the most widely used on-site web analytics and statistics service, and it can provide information about who accessed the site, how long they stayed, which pages they visited, and more.

• Other analytics tools, such as Moz Analytics, TruSocialMetrics, Clicky, KISSmetrics, Crazy Egg, and ClickTale, provide additional layers of information, good access control options, and raw and real-time data collection.