Usability Tests and Reports Brian Gastle Western Carolina University

What is a Usability Test Examines How Effective a Document or Device Is: –Finding Information –Performing Tasks –Answering Questions –Solving Problems

How is it performed/conducted? Experiments with “real” users –Study users as they use the document or device Observed by development team or testing agency –Should be viewed by a variety of “specialists”

Goals of the Test Safety Economic –Reduce clarification inquiries –Highlight “best” parts of product in marketing –Future product development –Customer Satisfaction

Stages of the Test Preparation of the Test Administration of the Test Interpreting and Reporting Test Info

Preparation of the Test Define important needs of users –Goals of the document or device Define purpose of the test based upon needs Define Test Team Write Test Plan (proposal – resources) Prepare materials –Activities, questions, etc. Select Participants Establish Testing Environment Pilot Test

Administering Test Develop Clear Checklist and/or Schedule for each test Conduct each test the same way –Including interaction with participant Watch leading questions / statements Debrief / Interview after test

Reporting Data Tabulate and graph numerical data Group data into appropriate categories for revision of document Follow Formal Report Format and Layout.

Some Sample Online Tests –Common Industry Format for Usability Test Reports –A gov. document outlining standard formats for UT’s –If you do all this you’ll be in good shape ;-) y_test/ y_test/ –A very clear UT comparing usability of two web sites –A complete report from inception to administration to recommendations