1. HCI – Lesson 7
USABILITY Homework
Prof. Garzotto

2. SUBJECT OF THE EVALUATION

3. WHAT TO DO
Activity 1: USABILITY EVALUATION USING MILE+ (TECHNICAL INSPECTION only) Activity 2: EMPIRICAL TESTING (min 5 USERS) Activity 3: REPORTING evaluation results Activity 4: Greenberg&Buxton paper

4. ACTIVITY 1 Inspection: Define 3-5 relevant scenarios (the site is big)
Execute the inspection using MILE+ method
TECHNICAL INSPECTION ONLY
PLEASE REFER TO THE MILE Report FOR THE LIST OF HEURISTICS
USE A 0-5 SCALE TO SCORE HEURISTICS
0= this heuristic is not relevant
1= this heuristic is violated …
5= th
Define a severity rate scale (weight) for the importance of each heuristic in your inspection (e.g., 0-1)

5. ACTIVITY 2 User testing: Design the test (see slides)
Conceive the test for ONE user profile
Consider profile and the tasks in the scenarios defined for inspection
Define clearly which measures you want to take and how
Execute the test involving at least 5 users

6. ACTIVITY 3:Reporting
Describe the work done; key information to be included:
Inspection:
few lines about MILE+
Steps followed (at a glance)
heuristics used and their weight
Scores of each relevant heuristics (with examples of screenshots and comments why a violation occurred)
PROVIDE AGGREGATED DATA, e.g., MEAN VALUE FOR EURISTICS (with score different from zero) BY DIMENSIONS (e.g., a mean for all values of CONTENT HEURISTICS, NAVIGATION HEURISTICS, ect.)
PROVIDE VISUAL REPRESENTATIONS OF RESULTS (diagrams, summary tables...)
Discuss results and requirements for redesign

7. ACTIVITY 3:Reporting (cont.)
User testing
Design of the study (metrics used, data collection method, tasks assigned, how you recruited users, where the test has been carried on...)
Results - please provide both analytical and aggregated data (e.g. mean values for the various measures, visual representation of results, ...)
Discussion of results
Recommendations …
(optional Annexes- photos, or any further information you may find usefull)

8. ACTIVITY 3:Reporting (cont.)
AT THE BEGINNING:
Cover (1 page)
Table of contents WITH PAGE NUM (1 page)
Executive Summary (1/2 page)
Overview of the Application (max 1 page)
AT THE END: FINAL CONSIDERATIONS
Final comparisons of the results the 2 evaluations
your opinion and judgement about the methods and the work done (what do you think about Mile? About UT? What did you learn from this HM?...)

9. ACTIVITY 3: Reporting - Remember
SEE NOTES
This report is the input for a redesign activity
You are not asked to propose re-design solutions (but should discuss the requirements for re-design)
Your report is for the general manager of the institution (the hypothetical “client” who pays for this work) AND the design manager
They both want to have a clear idea of problems and their severity, with proper examples
The design manager may need further examples and details (if you want to consider this aspect, include details or examples in an annex

10. ACTIVITY 3: Reporting - Lengh
Maximum length of the report (without annexes), font Times New Roman 11) including images, diagrams, graphs, tables
Max 20 pages for MILE+ inspection
Max 8 pages for user testing
Max 2 pages for final considerations

11. Activity 4 Read Greenberg&Buxton paper
Present the key points of the paper (as done for the previous assignments)
For practical reasons, please include this short presentation in the usability report

12. Delivery deadline of HM1:
Nov 24 (postponed)
Post on the Beep platform
IMPORTANT: file name MUST BE
COGNOME-NOME-MAT-HCI-USABILITY HM

13. Learning resources Slides on MILE+ heuristics Articles (see Resources)
User testing
MILE+ heuristics
Articles (see Resources)
ID book chapters: 12, 14, 15, 7 and 8