Darlene Fichter Data Coordinator, University of Saskatchewan Libraries February 20, 2002 Usability Testing on a Shoestring

Outline  What is usability?  Why does it matter?  Simple techniques and tests  Demonstration of task based testing? Overview

Usability Usability is the combination of fitness for purpose, ease of use, and ease of learning that makes a product effective. »Dorothy Kushner Overview

Why Usability Matters Bad design  Examples?  Do you ever use them again?  Do you feel loyal? Overview

Good Design  Invisible  Usability has been called the “science of the obvious” Overview

Books, Articles and Research  Don’t need to invent the wheel  Read, learn, look it up!  Many great sites: – Overview

Techniques & Tests Admissions Prospective Students Enroll Registration Testing  Cognitive Walkthroughs  Heuristic Evaluation  Preference Testing  Task Based Testing  Field Studies

Task Based Testing  Users are given specific tasks  Verbalize their thoughts  Only AFTER they have failed, can you provide direction  Observe, record, and debrief Testing

Lab Setting  Special labs with one way glass  Eye tracking equipment Testing

Guerilla Testing  Idea popularized by Jakob Nielsen  Showed that simple “low tech” testing of five users could yield excellent results 5 users will typically uncover 80% of the site-level usability problems Testing

Preparation 1.What do you want to know? 2.Who? Segment the audience. 3.Design your sample. 4.Develop your tasks. 5.Recruit testers. 6.Do a beta test. Testing

During the Test Observers:  Time each task  Record (notes, video, software) actions, expressions, comments and tester behaviors  Do NOT help the user Testing

Typical measures  Time - how many seconds?  Errors - incorrect answers? –User can’t complete the task –User is slowed down –User is annoyed or irritated slightly  Satisfaction Testing

Demonstration  Carleton Carleton  U of A U of A Testing

Task 1 You are planning to enrolling as Graduate Student in Sociology. You want to know the: –Deadline for application –Application process –Tuition fee

Task 2 You jus bought a wireless modem for your computer and wonder if it will work anywhere on the new campus?

Participant Task Number 12345MedianMean Summary of Results Testing

Debriefing  Brief survey measuring user satisfaction  Site structure - can they draw a map  User satisfaction (subjective) Other measures: What the user can recall about the site or if they can manoeuvre easily on the screen space. Testing

When to Test  Before redesign  Paper mockups  Wire frames  Beta testing  Live site  “Peer” site Testing Wire frame

Why Test  You can’t believe what users say  Self referential design  ROI - save everyone time and money.  Avoid web team “battles”  Convince your manager  Do it for the users. Testing

Questions  Darlene Fichter Data Library Coordinator, University of Saskatchewan  Resources library.usask.ca/~fichter/usability/ Questions