COMP5047 Pervasive Computing: 2012 Extended Cognitive Walkthrough Judy Kay CHAI: Computer human adapted interaction research group School of Information Technologies

COMP5047 Pervasive Computing: Overview Predictive method Cognitive Walkthrough Benefits Disadvantages (About 446,000 results from Googl)‏

COMP5047 Pervasive Computing: Postconditions for this week (incl studio)‏ Describe the uses of Cognitive Walkthrough Describe the processes for conducting Cognitive Walkthrough analyses Describe advantages and limitations Ability to perform a Cognitive Walkthrough study Justify the use of Cognitive Walkthrough in the overall testing of a pervasive computing application

COMP5047 Pervasive Computing: Focus on learnability Appropriate for novice or casual users cf Think-Aloud? Does not focus on speed cf Think-Aloud? Sequence is not known prior to inspection Assesses user success and recovery from errors Conducted by experts cf Think-Aloud?

COMP5047 Pervasive Computing: Model of Exploratory Learning User has task –0. will user understand this sub-task is needed Explores system for useful elements –1. will correct action be obvious? eg button visible –2. will user understand instructions? eg user understands the label on the button Selects one to try User interprets system response –3. will user know if progress has been made?

COMP5047 Pervasive Computing: User has task –0. will user understand this sub-task is needed (given their mental model)‏ Explores system for useful elements –1. will correct action be obvious? –(given their mental model)‏ –2. will user understand instructions? – (given their mental model)‏ Selects one to try User interprets system response –3. will user know if progress has been made? –(given their mental model)‏

COMP5047 Pervasive Computing: Example Design a cash-operated machine for quick, easy purchase of train tickets by passengers Determine fare to pay –indicate destination –indicate one-way or return Dispense ticket –pay money –get ticket and change Adapted from Newman and Lamming, Interactive System Design, 1995 )‏

COMP5047 Pervasive Computing: The interface

COMP5047 Pervasive Computing: The task buy a one-way ticket to Town Hall

COMP5047 Pervasive Computing: Task? –Buy one-way ticket to Town Hall 1. Is correct action obvious? –Two possibilities: Destination One way / return –Will user know both must be set?

COMP5047 Pervasive Computing: How to Help the User? Indicate extra information needed Indicate steps 1 and 2 can be done in either order Reorganise layout so that Steps 1 and 2 display fare

COMP5047 Pervasive Computing: Will user understand instructions? 3. Will user interpret machine action correctly?

COMP5047 Pervasive Computing: Will user understand instructions? –Yes – due to labels and instructions 3. Will user interpret machine action correctly? –Yes (buttons light up, new state appears)‏

COMP5047 Pervasive Computing: Correct action obvious? 2. Will user understand instructions? 3. Will user interpret machine action correctly?

COMP5047 Pervasive Computing: Correct action obvious? –Yes 2. Will user understand instructions? –Yes 3. Will user interpret machine action correctly? –Yes

COMP5047 Pervasive Computing: Paying 1. Correct action obvious? 2. Will user understand instructions? 3. Will user interpret machine action correctly?

COMP5047 Pervasive Computing: Paying 1. Correct action obvious? –Yes 2. Will user understand instructions? –Yes 3. Will user interpret machine action correctly? –Unclear (no feedback on money accepted so far)‏

COMP5047 Pervasive Computing:

COMP5047 Pervasive Computing: Buying a Ticket: Insufficient Money? 1. Correct action obvious?

COMP5047 Pervasive Computing: Summary of Flaws (so far)‏ Confusion about need for steps 1 and 2 No feedback on amount deposited No means to get money back So far …...

COMP5047 Pervasive Computing: Goals and Tasks In this example: Goal: buy a ticket Sub-goals: (determine fare) and pay User tasks: concrete cases used in CW

COMP5047 Pervasive Computing: Extended cognitive walkthrough Adding user's mental model What does user believe? How do you find this out?

COMP5047 Pervasive Computing: Summary of uses Relatively inexpensive Desk check –No users –Better with expert evaluators Generally applicable Novice, casual, intermittent users Focus on learnability Relevance for Pervasive?

COMP5047 Pervasive Computing: Summary Really useful technique, even for designer Better if done by Outsider Expert Part of early usability evaluation because Low cost No users needed