1. University of Washington HCDE 518 User Research 2 HCDE 518 Autumn 2011 With credit to Jake Wobbrock, Dave Hendry, Andy Ko, Jennifer Turns, & Mark Zachry

2. University of Washington HCDE 518 Agenda  Announcements, Hand in assignments  Mid-quarter Eval  Sketching Critiques  Lecture – Interviews  Design Activity  Break – 10 mins  Lecture – Questionnaires  Design Activity  Lecture – Observation (direct & indirect)  Design Activity  Break – 10 mins  Two Case Studies  Next Class  Group Project Work Time

3. University of Washington HCDE 518 Mid-Quarter Evaluation  Jim Borgford-Parnell  Center for Engineering Learning & Teaching (CELT)  ~20 minutes

4. University of Washington HCDE 518 Announcements, Questions  R3 due now  A2 due now  R2 grades posted  A2 returned today  P0 comments uploaded (check with your teammate who uploaded)  Questions?

5. University of Washington HCDE 518 Assignment 1  Very interesting descriptions of what you love and hate  Many insightful design principles  Scores:  4.0 – Excellent  3.5 – Complete, but some problems --->  3.0 – Something missing  Common problems:  Not explaining why an interaction was successful or not  Not defining your design principles  Principles were more about process than products  Not applying design principles to your loved/hated things

6. University of Washington HCDE 518 A1 – Some of Your Design Principles  Tactile  Accessible  Beautiful  Autonomy  Sustainable  Finesse  Safe  Efficient  Consistency  Performant  Makes me happy  Big picture view  Permanence  Error mitigation  Expected experience  Avoid errors  Sticky settings  Feedback  Not overdesigned  Understandable  Versatile  Flexible/Customizable  Simple  Harmony  Humanity  Sentimentality

7. University of Washington HCDE 518 A1 – Things you love and hate Love :)Hate :( iPhoneTravel books iPhoneAlarm clock Soap dispenserEducation workshop Kindle FireTimed traffic lights Macbook Air Wireless remote control Rice cookerGimp InstagramComcast email DominionPower cords Bluetooth headsetMicrowave DirecTV remoteMicrowave French PressKitchen cabinent Android phoneiPhone Love :)Hate :( Headlamp Garage door opener Electric dispensing potSony remote Honda accord GPSStove top IBM trackpointTouchpad Droid smartphoneAndroid OS GoogleLaptop audio software Rabbit ToyToenail clippers iPadFiOS remote control Macbook ProOffice Chair Solar powered chargerSamsung Focus Lenovo thinkpadSafeway self-checkout Baby monitorAutomatic clock Smart carChia head Nord Electro keyboardWindows Vista Logitech mouseAdobe Illustrator Water Bottle Amazon’s search inside ESPN Score CenterAlarm clock

8. University of Washington HCDE 518 P0 – Your Design Questions  Orange/Chore Bored  How can we make chores in the household less stressful and more engaging for a couple?  Green/Market Maven  How do we connect consumers to their local farmers markets?  Brown  How can a social networking service offer comfortable levels of privacy for its users?  Purple  TBD

9. University of Washington HCDE 518 P0 – Your Design Questions  Yellow/Mamalode  How can an iPad magazine reader facilitate local networking and support among mothers?  Red  How can we help stakeholders (clients, therapists, clinical administrators, and the research team) get the best possible outcome when a client reports suicidal ideation or intent?  Blue  How can an entertainment/communication system increase a sense of connectedness?

10. University of Washington HCDE 518 Sketching Critiques – 20 minutes  Break into groups of 3 people  Take turns showing and explaining your 3 sketches with each other  Critics should offer advice and feedback about the idea  Strengths, Weaknesses, Originality, Feasibility  Sketcher: take notes about what feedback was offered  Critic: be critical, but constructive and courteous!  Each critic should sign and date the page after the sketches

11. University of Washington HCDE 518 LECTURE – USER RESEARCH, PT. 2

12. University of Washington HCDE 518 User Research – Data Gathering  Triangulation  Recording techniques  Interviews  Questionnaires  Observations  Direct vs. Indirect

13. University of Washington HCDE 518 Triangulation  All user research techniques have their own limitations  Use multiple techniques to fully understand a design scenario  Choose techniques that account for the weaknesses of each other  Choose techniques to cover both a breadth and depth of the user experience Key Concept

14. University of Washington HCDE 518 Triangulation  What are some complementary techniques you might use to account for the weaknesses of each other?  What are some techniques that cover both breadth and depth when combined?

15. University of Washington HCDE 518 Data Recording Approaches 1.Notes 2.Notes + still camera 3.Notes + Audio 4.Notes + Audio + still camera 5.Video What are the advantages and disadvantages to each of these?

16. University of Washington HCDE 518 Interviews Purpose: Collect detailed information about tasks, activities, technologies. Understand the why behind activities, rather than the what. Suitable for relatively small number of people (5 – 30) - Shoot for ~12 to reach data saturation, though not always feasible

17. University of Washington HCDE 518 Interviews  Unstructured Broad questions concerning some general area  Structured Narrow questions concerning specific area  Semi-structured Balance between broad/narrow questions  Focus groups Group discussion around a topic

18. University of Washington HCDE 518 Creating an Interview Guide  Who do you need to interview and why?  Demographic questions  Open questions  Closed questions  Activities  Sketching  Demonstrations  Reliability and validity  Be careful about leading questions

19. University of Washington HCDE 518 Running an Interview 0. Recruitment 1.Introduction 2.Warm up session 3.Main session 4.Cool-off period 5.Closing session

20. University of Washington HCDE 518 Example – Huang & Truong  https://courses.washington.edu/hcde518/rea dings/MobilePhoneInterviewProtocol.pdf https://courses.washington.edu/hcde518/rea dings/MobilePhoneInterviewProtocol.pdf

21. University of Washington HCDE 518 Design Activity: Devising an Interview Plan – 10 minutes Scenario: You’ve been asked to gather information on the design of a patient education system for hospital/doctor's office waiting rooms You've decided to conduct some interviews and to collect data with questionnaires. Propose a plan answering these questions:  What is the goal of the interview?  Who do you need to interview? How many?  What kinds of questions/activities?  List a few specific questions

22. University of Washington HCDE 518 BREAK – 10 MINUTES

23. University of Washington HCDE 518 Questionnaires/Surveys  Purpose: Deepen understanding by collecting information from a broad range of people  Suitable for large number of people  20 – 1,000+

24. University of Washington HCDE 518 Questionnaires  Be clear on the goal  Keep it short  Open and closed questions  Rating scales (e.g. Likert)  Be sure to pilot your questionnaire and expect to iterate 3-4 times  Online or on paper?

25. University of Washington HCDE 518 Example – Huang & Truong  https://courses.washington.edu/hcde518/rea dings/MobilePhoneSurvey.pdf https://courses.washington.edu/hcde518/rea dings/MobilePhoneSurvey.pdf

26. University of Washington HCDE 518 Design Activity: Devising Questions for Questionnaires – 10 minutes Scenario: You are designing a new video sharing system and would like to determine how people share videos online and what features they find useful and not useful  Propose three questions (at least 1 open and 1 closed)  Discuss ideas for distribution & recruitment techniques, paper vs. online, etc.

27. University of Washington HCDE 518 Observations in the Field  Helps you understand people’s context, task, activities, goals  What people do is different than what people say they do  People are notoriously poor and describing their work

28. University of Washington HCDE 518 What to Pay Attention To Key features  Space  Actors  Activities  Objects / workarounds  Acts  Events / triggers  Time  Goals  Feelings Questions  How is the physical space adapted to the job?  What are the key constraints on the job?  Where are strategic decisions made?  Where are tactical decisions made?

29. University of Washington HCDE 518 Examples  What might you observe about each case?  Is observation appropriate?  A nurse as she treats patients in a hospital  A teacher while he is teaching a classroom full of kindergartners  A team of emergency medical technicians working on a case  A writer working on a book

30. University of Washington HCDE 518 Laboratory Studies  Useful for studying and recording the details of how people perform:  Goals  Tasks  Action sequences  Disadvantages: Not the user’s natural environment, missing context  Better for doing tests of prototypes where detail is important

31. University of Washington HCDE 518 Lab Studies

32. University of Washington HCDE 518 Indirect Observations  Diary studies  Experience Sampling studies  Interaction logs

33. University of Washington HCDE 518 Diary Studies  Have users carry a diary with them to answer specific questions about activities throughout the day when certain activities occur

34. University of Washington HCDE 518 Example  PAL diary study  Fits in one’s pocket  Record when PAL is desirable

35. University of Washington HCDE 518 Experience Sampling Studies  Have users carry around a device that has them answer questions at given intervals  Cell phone, PDA, SMS  Good for getting in-the-moment assessments  Example: page user once every 3 hours and ask them to fill out a short survey on their current activity and rate sleepiness level on a scale from 1 to 7

36. University of Washington HCDE 518 Example – Track Your Happiness  Go to TrackYourHappiness. org and sign up

37. University of Washington HCDE 518 Diary Study vs. Experience Sampling  Both can collect similar types of information  Diary is less intrusive  ES can be more reliable at getting regular data  User is less likely to forget  Another alternative – context-based sampling  MyExperience Toolkit - http://myexperience.sourceforge.net/

38. University of Washington HCDE 518 Interaction Logs / Usage Logs  Use software to automatically log interactions with a system  e.g., number of clicks, time spent on task, etc.  e.g., pages visited within a site: Google Analytics  Can also be used on other platforms using interesting sensors to sense context of use  Example: Logging steps with a pedometer

39. University of Washington HCDE 518 Example  Using Bluetooth tags to track people’s distance from their cell phones  Intent: Inform design of “always on” ubiquitous computing applications

40. University of Washington HCDE 518 Design Exercise: Improving Picture Messaging – 5 minutes Suppose you wanted to improve the picture messaging feature on a mobile phone Describe TWO different kinds of indirect observational approaches that might be useful

41. University of Washington HCDE 518 Summary: Consider study needs and purposes, pros/cons of methods Triangulate! Interviews Focus groups Questionnaires Direct observation in the field Direct observation in the lab Indirect observation What types of recording techniques?

42. University of Washington HCDE 518 Discussion: Your projects  What methods are you considering for your project?  How do they cover both breadth and depth?  How do they complement one another?

43. University of Washington HCDE 518 BREAK – 10 MINUTES

44. University of Washington HCDE 518 Case Studies  Huang & Truong  Questionnaire and Interviews  Focus on understanding how and why people dispose of their old mobile phones  Identify design opportunities  Tee, Brush, & Inkpen  Interviews, family trees  Understand ways that families currently communicate  Identify design opportunities

45. University of Washington HCDE 518 Questions  What were your overall thoughts?  What did you like about the approach?  What would you have changed about the approach?  Why do you think they chose the approach they did?

46. University of Washington HCDE 518 My Own Examples  Interviews/Observations with parents & pediatricians to inform design of tracking developmental progress in young children  Contextual Inquiry, survey, and interviews for understanding how technology can support healthy sleep behaviors  Cultural probe plus interviews/draw the experience for understanding people’s views on privacy surrounding sensing technologies

47. University of Washington HCDE 518 Next Class  Wednesday, October 26th  Personas, Scenarios, & Storyboards  Upcoming Work  Reflection 4  Sketching, Week 5  Theme: Sports, Fitness, & Recreation  Keep working on P1!

48. University of Washington HCDE 518 GROUP PROJECT MEET TIME