1. The Information School of the University of Washington Information System Design Info-440 Autumn 2002 Session #16

2. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 2 Agenda Quiz Usability –Finish review of assignment –Finish concepts Break Feedback on assignment #3

3. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 3 Admin Announcements –Will schedule some kind of Visio lab It will be very collaborative We’ll teach each other Student technology fee –Writing grant for ten tablet computers –You can help!

4. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 4 Upcoming This week –Read Nielsen, Chapter 5 –Heuristic evaluations Assignment #4 –December 4

5. The Information School of the University of Washington Assignment #4 (continued)

6. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 6 Four parts Part I: –Heuristic evaluation Part II: –Task analysis Part III: –Task performance estimate Part IV: –Usability evaluation

7. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 7 Part I: Heuristic Evaluation Using Nielsen guidelines, carry out a heuristic evaluation of the movie site, M. Read chapter 5 of Nielsen Suggestions –Inspect 10-15 pages –Organize your thinking in terms of tasks

8. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 8 Part II: Task Analysis Suppose you are sitting on your couch and you decide "I want to go to a movie with my friend Joe". Develop a detailed task analysis for solving this goal. The goal is satisfied when you are sitting with Joe in the theatre. See class notes, Oct 21

9. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 9 Part III & Part IV Covered last time Did everyone get the notes?

10. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 10 Reminder: User goal 1.First select a location for watching films –_______________________________ 2.Find when the movie is playing at your location between 6-9pm on Thursday The movies are –M1: James Bond, Die another day –M2: Harry Potter

11. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 11 Reminder: Everyone generates 8 records… User IDTrial Movie MethodTime Dgh-me1m1news40 Dgh-me2m2news67 Dgh-me1m2tele40 Dgh-me2m1tele67 Dgh-P11m1Yahoo40 Dgh-P12m2Yahoo67 Dgh-P21m2Yahoo30 Dgh-P22m1Yahoo87 (Please include trial information.) **NOTE

12. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 12 Reminder: Procedural details Part III –Use 333-FILM for telephone look-up Part IV –Reset browser Remove cookie for movie site (if applicable) –Go to jump page http://courses.washington.edu/i440a/movie.html –Have participant read task Tell participant the movie & what site to use –End state: User tells you the time the movie is playing Measure time (first click until answer is known) –‘Return’ to jump page

13. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 13 Report format Executive summary –A maximum of two hundred words on what you did and what you learned The objective –Propose an objective for this assignment Heuristic evaluation –Present the heuristic evaluation Task analysis –Present the task analysis

14. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 14 Report format (cont) The participants –Describe briefly who the participants were The task –Describe the goal that you gave the participants and how you timed them Findings –Include the graph here, a discussion of it, and your conjectures about task completion times Issues and recommendations –List a maximum of three issues that you discovered and your recommendation for solving the issues

15. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 15 Report format (cont) Discussion of methods –Discuss what it was like to observe the users. Did anything surprise you? Did they change your understanding of the goal and tasks? How did the usability evaluation compare to the heuristic evaluation? References –If required Appendix A –Include a table showing the raw data

16. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 16 Report audience Product team consisting of people from various disciplines Aim for –Conciseness –Clarity –Simplicity

17. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 17 Usability process 1.Decide on objectives 2.Decide on participant profile & develop a scenario 3.Analyze system & make predictions 4.Decide on participant goals 5.Prompt participants to complete goals 6.Carefully observe 4-6 participants Identify critical incidents Measure performance (time, errors, etc.) 7.Debrief participants 8.Prioritize issues Team discussion Develop presentations, reports, etc.

18. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 18 Many, many details Human subject ethics Participants Creating good tasks Being a good moderator Etc.

19. The Information School of the University of Washington Assignment #3 Feedback

20. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 20 Overview Assignment #3 –A difficult problem (‘real’ in many respects) –Limited practice with techniques –Limited time You did a very good job –Some of the work was outstanding!

21. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 21

22. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 22 Part I: Scenario Personalization: “A solution for” …. –Organizing multiple information sources/activities in one place Addresses these needs –Remote, mobile access –Repeated use of multiple information sources to solve problems –Customize ‘filters’ of information sources –Selection and organization of info sources –Layout to prioritize important things –Color preferences

23. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 23 Part IIa: Possible solution document

24. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 24 Part IIb: Metaphors My Yahoo –‘My’ -- similar to My Documents, My Computer, etc. Companion, Bill payer Message center, Portfolio Pages, front page Sign out Tabs, tools, tours Window metaphor from a desktop computer, X button for removing a module Newspaper –Headlines –Columns –Front page

25. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 25 Part IIb: Discussion of conceptual model Looked for more than single feature that is supported Looked for comments on selection and organization of information and giving certain kinds of information priority Features that lack personalization –(e-mail: dave@yahoo.com)dave@yahoo.com

26. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 26 Part IIb: Mental models Inspecting the components/pages for the types of customization made Noting what they say they use/like, and what they actually use Collect data from different perspectives Ask users to draw a picture and talk about the entities Surveys across time (longitudinally) Developmental model (develop a learning model and see how long it takes people to reach each of the steps) Compare novice and experienced users

27. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 27 Part III-a For (a), looking for any reasonable top-down flow through content For example 

28. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 28 Part III-b For (b), looking for –Error-checking decision –Email

29. The Information School of the University of Washington

30. Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 30 Next time Heuristic evaluations –What are they? –What are their strengths & weaknesses? –How do them? Question: –What would you like to cover Dec 2-4?

31. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 31

32. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 32 Human subject ethics Guidelines –Acknowledge that that system is being tested, not the participant (remind repeatedly) –Tell the participant that she is free to leave at any time –Reveal who is watching & what is being recorded –Do not report results such that a participant is identified –Avoid telling the participant that he is making mistakes or doing things wrong –Acknowledge participants efforts but in a neutral fashion Bottom line: Treat people with great respect

33. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 33 Participants Participant profile –Computer/net experience –Experience with system –Interests Example –You want to study an online teen magazine –Consider 15 year old girls who use IM Anyone else The most important decision to make

34. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 34 Creating good tasks Clear beginning and end states Easily stated Cover target areas of the system Consider –Find the 5-day weather forecast for Toronto –Here’s $75.00 -- use eBay to buy something

35. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 35 Being a good moderator Spend almost all your time listening and observing carefully ‘Encourage’ participants in a neutral fashion When people are quite say –“Can you keep talking”

36. The Information School of the University of Washington Copyright David Hendry (INFO-440 session 16 - 11/25/2002) 36 Think aloud