1 Usability Test Plans CSSE 376 Software Quality Assurance Rose-Hulman Institute of Technology April 20, 2007

2 Outline  Purpose of Test Plans  Suggested Format

3 Purpose of Test Plans  Blueprint for test  Communication with development team  Describes needed resources  Milestone for testing

4 Suggested Format 1.Purpose 2.Problem Statement 3.User profile 4.Method 5.Task list 6.Environment/ equipment 7.Test monitor role 8.Evaluation measures 9.Report contents

5 Problem Statement  High-level reason for performing test  Describe what you expect to achieve from testing  don't be vague  make sure that objective can be measured  Example:  Is help easier to access via a shortcut key or the mouse?

6 User Profile  Describe end users of product  Cover all important attributes  Cover important ranges

7 Example User Profile AttributeRangeDistribution Computer experience none to 10 years 10% none 25% 1 year 65% 1+ years Age years 50% % % over 50 Gendermale/female 85% male

8 Cartoon of the Day

9 Method Describe major steps of testing 1.Participant greeting 2.Orientation 3.Performance test 4.Participant debriefing

10 Task List  Tasks to be performed by participants  Describe Successful Completion Criteria (SCC)  Include Maximum Time to Complete (MTC)

11 Task List Example TaskDescriptionDetail 1 Select region of data SCC: Correct values selected MTC: 2.0 sec 2 Choose chart type SCC: Correct type selected MTC: 2.0 sec 3 Assign labels SCC: Correct labels assigned MTC: 10.0 sec

12 Environment/Equipment  Describe environment that you are attempting to simulate  desk arrangement  availability of other materials  lighting, noise level  Equipment needed to perform testing

13 Test Monitor Role  Explain how test monitor will interact with participants  Describe tasks that the monitor will perform

14 Evaluation Measures  Data that will be collected  performance  time to complete tasks  number of errors by type  preference  usefulness of product  ease of learning/use

15 Report Contents  What you will report at the conclusion of testing  major sections of report  schedule for dissemination  Does not include analysis