1. Usability Tests and Reports Brian Gastle Western Carolina University

2. What is a Usability Test Examines How Effective a Document or Device Is: –Finding Information –Performing Tasks –Answering Questions –Solving Problems

3. How is it performed/conducted? Experiments with “real” users –Study users as they use the document or device Observed by development team or testing agency –Should be viewed by a variety of “specialists”

4. Goals of the Test Safety Economic –Reduce clarification inquiries –Highlight “best” parts of product in marketing –Future product development –Customer Satisfaction

5. Stages of the Test Preparation of the Test Administration of the Test Interpreting and Reporting Test Info

6. Preparation of the Test Define important needs of users –Goals of the document or device Define purpose of the test based upon needs Define Test Team Write Test Plan (proposal – resources) Prepare materials –Activities, questions, etc. Select Participants Establish Testing Environment Pilot Test

7. Administering Test Develop Clear Checklist and/or Schedule for each test Conduct each test the same way –Including interaction with participant Watch leading questions / statements Debrief / Interview after test

8. Reporting Data Tabulate and graph numerical data Group data into appropriate categories for revision of document Follow Formal Report Format and Layout.

9. Some Sample Online Tests http://zing.ncsl.nist.gov/iusr/documents/cifv1.1b.htm –Common Industry Format for Usability Test Reports –A gov. document outlining standard formats for UT’s –If you do all this you’ll be in good shape ;-) http://www.macromedia.com/software/flash/productinfo/usability/usabilit y_test/http://www.macromedia.com/software/flash/productinfo/usability/usabilit y_test/ –A very clear UT comparing usability of two web sites http://www.gooddocuments.com/samples/usabilitytest.htm –A complete report from inception to administration to recommendations