1. Asking Users and Experts Li Zhang (Jacey) Yuewei Zhou (Joanna)

2. Asking Experts Why Experts? Users are not easily accessible Too expensive Takes too long Then Ask experts to provide feedback.

3. Experts Inspection How ? Experts inspect the human-computer interface and predict problems users would have when interacting with it. Advantages Relatively inexpensive Easy to learn Effective Can be used at any stage of a design project

4. Inspection Techniques Heuristic evaluations  Heuristic evaluations Walkthroughs  Walkthroughs

5. Heuristic Evaluation  Informal usability inspection technique  Experts review guided by a set of heuristics ( usability principles )

6. Core Heuristic Visibility of system status Match between system and the real world User control and freedom Consistency and standards Help users recognize, and recover from errors Error prevention Recognition rather than recall Flexibility and efficiency of use Aesthetic and minimalist design Help and documentation

7. Problems? What if products are brand new? What if products are specific? Core Heuristic are too general! Go Specific!

8. Example: Commercial Websites High-quality content Often updated Minimal download time Easy of use Relevant to user’s needs Unique to the online medium Netcentric corporate culture HOMERUN ! (Nielsen, 1999)

9. Conclusion Which heuristics are the best, and How many are needed are debatable and depend on product.

10. How to do Heuristic Evaluation Stage 1:Briefing Session Stage 1: Briefing Session Experts are told what to do. Stage 2:Evaluation Period Stage 2: Evaluation Period Two passes: 1 st : gain overall feeling of the system. 2 nd : focus on specific interface elements. Stage 3:Debriefing Session Stage 3: Debriefing Session Experts come together, discuss their findings suggest solutions.

11. Dilemma About 33% reported problems are real usability problems. Sometimes heuristic evaluation misses severe problems. Heuristic evaluation misses about 21% of user’s problems. 43% are not problems at all.

12. Solutions Use complementary user testing techniques along with heuristic evaluation. Get really good or experienced evaluators Have several evaluators to avoid one person’s bias or poor performance.

13. Efficiency Five evaluators can identify around 75% of the total usability problems

14. MedlinePlus example Medical information website Provides health information for patients, doctors and researches.

15. Heuristics and Evaluation Internal Consistency Simple Dialog Shortcuts Minimizing Memory Load Preventing Errors Feedback Internal locus of control 7 heuristics were used 3 expert evaluators did independent evaluation

16. Improvement Suggestions  Layout: Uncomplicated Vertical Design; well suited for printing; conservative using of graphics  Internal Consistency: Formatting of pages and logo is consistent across the website.  Arrangement of health topics: Problems should be arranged alphabetically as well as in categories.  Depth of navigation menu: increase the fan-out in navigation menu in the left margin.

17. General Web Design Slow internet connections, limited processing power Access  Access User’s understanding and impressions Information Design  Information Design Navigate large website, lost in cyberspace Navigation  Navigation

18. Guidelines for Web Design Avoid complex URLs Avoid long download times Access  Access content comprehension and aesthetics Information Design  Information Design Avoid orphan pages Avoid excessive white space resulting in long page Provide navigation support Avoid narrow, deep or hierarchical menus Avoid non-standard link colors Provide consistent look and feel for navigation  Navigation

19. Heuristics For more….  For online communities Sociability Usability  For other devices handheld, computerized toy More…

20. Walkthroughs  Cognitive Walkthroughs  Pluralistic Walkthroughs

21. Cognitive Walkthroughs Simulating user’s problem-solving process at each step in the human- computer dialog Checking to see if the user’s goals and memory for actions can be assumed to lead to the next correct action They focus on evaluating designs for ease of learning

22. Cognitive Walkthroughs—Steps 1.Identify characteristics of typical users; Develop sample tasks; Produce the interface’s prototype, or a description of it; Generate a clear sequence of the actions needed for the users to complete the task 2.A designer and one or more experts begin the analysis 3.Evaluators walk through the sequences for each task, and try to answer the following questions: 4. Record critical information, including: Assumptions about what would cause problems and why Notes about side issues and design changes A summary of the results 5. Revise the design according to the results.

23. Finding a book at Amazon.com  Task: find a at  Typical user: students who use web regularly  Step 1: selecting the correct category of goods on the homepage  Step 2: complete the request form  Questions: Will user know what to do? Will users see how to do? Will User understand from feedback whether the action is correct or not?

24. Cognitive walkthroughs vs Heuristic Evaluation It provides much more detailed information It takes longer than heuristic evaluation for the same part, because it examines each step of a task. It’s useful to examine small part of a system; whereas heuristic evaluation is useful for examining a whole system.

25. Pluralistic Walkthroughs Users, developers and usability experts work together to step through a scenario, discussing usability issues associated with dialog elements involved in the scenario steps.

26. Pluralistic Walkthroughs--Steps 1.Develop scenarios in the form of a series (usually 1 or 2) of hard-copy screens 2.representing a single path through the interface. 3.A panelist ask evaluators to write down the sequence of actions they take to move from one screen to another. 4.Discuss the actions from that round of review. (Users-> Experts-> Designers) 5.Move on to next round of screens. The process continues until all the scenarios have been evaluated.

27. Benefits and Constraints of Pluralistic Walkthroughs Strong focus on user’s task Involving a multidisciplinary team Performance data is produced and many designers like the apparent clarity of quantitative data. Limited screens each time, so it takes relatively long time to complete.

28. Thanks!