Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics (Interactive Technologies)
Thomas Tullis, William Albert
Format: PDF / Kindle (mobi) / ePub
Effectively measuring the usability of any product requires choosing the right metric, applying it, and effectively using the information it reveals. Measuring the User Experience provides the first single source of practical information to enable usability professionals and product developers to do just that. Authors Tullis and Albert organize dozens of metrics into six categories: performance, issues-based, self-reported, web navigation, derived, and behavioral/physiological. They explore each metric, considering best methods for collecting, analyzing, and presenting the data. They provide step-by-step guidance for measuring the usability of any type of product using any type of technology.
• Presents criteria for selecting the most appropriate metric for every case
• Takes a product and technology neutral approach
• Presents in-depth case studies to show how organizations have successfully used the metrics and the information they revealed
Professional practices, may become necessary. Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information or methods described herein. In using such information or methods they should be mindful of their own safety and the safety of others, including parties for whom they have a professional responsibility. To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors, assume any liability for any.
Approaches to levels of success: • • Based on the user’s experience in completing a task. Some users might struggle or require assistance, while others complete their tasks without any difficulty. Based on the users accomplishing the task in different ways. Some users might accomplish the task in an optimal way, while others might accomplish it in ways that are less than optimal. Levels of success based on the degree to which users complete a task typically have between three and six levels.
Above or below a threshold. For example, for some tasks, an error rate above 20% is unacceptable, whereas for others, an error rate above 5% is unacceptable. The most straightforward analysis is to first establish an acceptable threshold for each task or each participant. Next, calculate whether that specific task’s error rate or user error count was above or below the threshold. Sometimes you want to take into account that not all errors are created equal. Some errors are much more serious than.
Value format, with one name and value per line. 6.4.5 U sefulness, Satisfaction, and Ease-of-Use Questionnaire Arnie Lund (2001) proposed the Usefulness, Satisfaction, and Ease of Use (USE) questionnaire, shown in Figure 6.11, which consists of 30 rating scales divided into four categories: Usefulness, Satisfaction, Ease of Use, and Ease of Learning. Each is a positive statement (e.g., “I would recommend it to a friend”), to which the user rates level of agreement on a seven-point Likert.
Prior to running the study. Figure 7.4 is an example screen that the participant would see during the setup process. Similar to any eye-tracking study, different images or visual stimuli are shown to the participants, along with the option to add different survey questions. This technology has the potential to be very useful for UX researchers in that eye movement data can now be collected from a large number of participants, over a short amount of time, without respect to geography. For example,.