1. William H. Bowers – whb108@psu.edu Usability Evaluation Torres 14

2. William H. Bowers – whb108@psu.edu Topics Evaluation Goals Evaluation Goals Types of Evaluations Types of Evaluations Evaluation Factors Evaluation Factors Preparing for an Evaluation Preparing for an Evaluation

3. William H. Bowers – whb108@psu.edu Topics Conducting an Evaluation Conducting an Evaluation Data Evaluation Data Evaluation Developer Participation Developer Participation Desk Checking Desk Checking

4. William H. Bowers – whb108@psu.edu Evaluation Goals Predicting user satisfaction Predicting user satisfaction Understanding appearance and behavior Understanding appearance and behavior Problem determination and resolution Problem determination and resolution Criteria validation Criteria validation

5. William H. Bowers – whb108@psu.edu Types of Evaluations Ad hoc review Ad hoc review Heuristic review Heuristic review Walk-through Walk-through Conventional usability test Conventional usability test Comparative usability evaluation Comparative usability evaluation Field tests Field tests

6. William H. Bowers – whb108@psu.edu Evaluation Factors Predetermined, objective criteria Predetermined, objective criteria Structured and objective methods Structured and objective methods User involvement User involvement Techniques to determine right and wrong Techniques to determine right and wrong

7. William H. Bowers – whb108@psu.edu Preparing for an Evaluation Plan Plan Design Design Pre-evaluation briefing Pre-evaluation briefing Pre-evaluation questionnaire Pre-evaluation questionnaire Scenarios and tasks Scenarios and tasks Post-scenario questionnaires Post-scenario questionnaires

8. William H. Bowers – whb108@psu.edu Preparing for an Evaluation Data to collect Data to collect Source of subjects Source of subjects Test platform Test platform Test conductors Test conductors

9. William H. Bowers – whb108@psu.edu Conducting an Evaluation Set-up Set-up Pilot test Pilot test Pretest questionnaire Pretest questionnaire Executing scenarios Executing scenarios

10. William H. Bowers – whb108@psu.edu Conducting an Evaluation Evaluation notes Evaluation notes Comparisons Comparisons Post-scenario questionnaire Post-scenario questionnaire Follow-up Follow-up

11. William H. Bowers – whb108@psu.edu Data Evaluation Graphs and trend lines Graphs and trend lines Descriptive statistics Descriptive statistics Causal analysis Causal analysis Reporting results Reporting results

12. William H. Bowers – whb108@psu.edu Developer Participation Lets the programmer see the end user Lets the programmer see the end user Determine next steps Determine next steps

13. William H. Bowers – whb108@psu.edu Desk Checking Is there sufficient capability? Is there sufficient capability? Are the UI features sufficient to accomplish the tasks? Are the UI features sufficient to accomplish the tasks? Is response time fast enough? Is response time fast enough? Is installation easy? Is installation easy? Is it reliable? Is it reliable?

14. William H. Bowers – whb108@psu.edu Questions & Discussion