Chapter 23 Deciding how to collect data

UIDE Chapter 23 Introduction: Preparing to Collect Evaluation Data Timing and Logging Actions –Automatic Logging of Keystrokes and Mouse Clicks –Specialist Logging Software for Usability EvaluationsSpecialist Logging Software for Usability Evaluations –Choosing a Logging Product

UIDE Chapter 23 Think-Aloud and Offering Help –Using Cognitive Walkthrough Questions “Is there anything there that tells you what to do next?” “Is there a choice on the screen that lines up with what you want to do? If so, which one?” “Now that you’ve tried it, has it done what you wanted it to do?”

UIDE Chapter 23 Taking Notes When Observing Users

UIDE Chapter 23 Conducting Post-Session Discussions –Retrospective protocol –Post-session interview / debrief

UIDE Chapter 23 Think-Aloud (Concurrent) Protocol vs. Retrospective protocol –Recording time? Concurrent may get in the way –Retrospective allows examination of what the user was thinking or trying to do. –Concurrent is immediate, less loss of events –Concurrent may unduly interfere with the users ability to concentrate

UIDE Chapter 23 Questionnaires –Advantages Can’t forget to ask a question All participants see the same questions Ability to collect quantitative data –Disadvantages Difficult to design Must predict topics the users will need Closed questions don’t give reasons why the users answered the way that they have.

UIDE Chapter 23 Questionnaires –SUMI, the Software Usability Measurement Inventory Learnability – knowledge of the world Helpfulness – visibility Control – affordance Efficiency Affect (emotional response)

UIDE Chapter 23 Using Technologies to Help with Recording –Video and Audio Recording –Eye-Tracking Equipment

UIDE Chapter 23 Using Technologies to Help with Recording –Practitioner’s Choice of Technology What to Do If a Participant Does Not Agree to Be Recorded

UIDE Chapter 23 Using Technologies to Help with Recording – the benefits of human interaction –Shows participants that you are paying close attention –Gives the observer more opportunity to directly interact and control progress of the test