2.7 Cognitive Walkthrough What is wanted Analysis Design Evaluation

Cognitive Walkthrough Exploratory learning Users tend to love learning by exploration Similar to software code walkthrough user Software (EOU) Software (usefulness)

Inputs of Cognitive Walkthrough Design specification or prototype User descriptions Task descriptions Action sequence

Questions Asked by Evaluator 問題：正確動作的控制項是否明顯？ 問題：正確動作的控制項與其目標之間的關係是否明顯？ 問題：使用者是否能夠評估系統回應的正確性？ 任務問題：使用者要完成的目標是什麼？

Cognitive Walkthrough Example Train ticket vending machine from [Newman & Lamming 1995] 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills 4. Press to receive ticket and change LIFT for ticket and change 取票與零錢區

Cognitive Walkthrough Example Scenario A novice user wants to buy a one-way ticket to New Brunswick. She has a $5 bill in her pocket + some change. Task-definition question Q0: “What is the user trying to achieve?” Answer: “Buy a one-way ticket to New Brunswick.”

Cognitive Walkthrough Example 1. Will the correct action be evident to the user? 問題：使用者要做出正確動作會不會很困難？(X) 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills 4. Press to receive ticket and change LIFT for ticket and change 7

Cognitive Walkthrough Example 1. Will the correct action be evident to the user? (subgoals provided to user) 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip Yes 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 8

Cognitive Walkthrough Example 2. Will the user connect the correct action’s description/label with his/her intent? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 9

Cognitive Walkthrough Example 2. Will the user connect the correct action’s description/label with his/her intent? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip Yes 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 10

Cognitive Walkthrough Example 3. Will the user properly interpret the system’s response? (know if chose right/wrong?) 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 11

Cognitive Walkthrough Example 3. Will the user properly interpret the system’s response? (know if chose right/wrong?) 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip Yes (if button lights up…) 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 12

Cognitive Walkthrough Example 1. Will the correct action be evident to the user? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 13

Cognitive Walkthrough Example 1. Will the correct action be evident to the user? Yes 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 14

Cognitive Walkthrough Example 2. Will the user connect the correct action’s description/label with his/her intent? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 15

Cognitive Walkthrough Example 2. Will the user connect the correct action’s description/label with his/her intent? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip Yes 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 16

Cognitive Walkthrough Example 3. Will the user properly interpret the system’s response? (know if chose right/wrong?) 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 17

Cognitive Walkthrough Example 3. Will the user properly interpret the system’s response? (know if chose right/wrong?) 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip Yes … One-way $6.35 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 18

Cognitive Walkthrough Example 1. Will the correct action be evident to the user? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip One-way $6.35 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 19

Cognitive Walkthrough Example 1. Will the correct action be evident to the user? Yes 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip One-way $6.35 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 20

Cognitive Walkthrough Example 2. Will the user connect the correct action’s description/label with his/her intent? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip One-way $6.35 3. Deposit money coins bills LIFT for ticket and change 4. Press to receive ticket and change 21

Cognitive Walkthrough Example 2. Will the user connect the correct action’s description/label with his/her intent? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip One-way $6.35 3. Deposit money Yes coins bills LIFT for ticket and change 4. Press to receive ticket and change 22

Cognitive Walkthrough Example 3. Will the user properly interpret the system’s response? (know if chose right/wrong?) 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip One-way $6.35 3. Deposit money coins bills $5 LIFT for ticket and change 4. Press to receive ticket and change 23

Cognitive Walkthrough Example 3. Will the user properly interpret the system’s response? (know if chose right/wrong?) 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills 4. Press to receive ticket and change LIFT for ticket and change $6.35 Recv’d: $5.00 No, need feedback!  Add received amount display 24

Cognitive Walkthrough Example Not enough $… 1. Will the correct action be evident? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills 4. Press to receive ticket and change LIFT for ticket and change $6.35 Recv’d: $5.00 25

Cognitive Walkthrough Example Probably not! Not enough $… 1. Will the correct action be evident? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip 3. Deposit money coins bills 4. Press to receive ticket and change LIFT for ticket and change $6.35 Recv’d: $5.00 ? ? ? 26

Cognitive Walkthrough Example Probably not!  Add a new UI element to make it clear! Not enough $… 1. Will the correct action be evident? 1. Choose destination or enter fare Newark Rahway Metropark Metuchen Edison New Brunswick 2. Indicate journey type One-way Round-trip One-way $6.35 Recv’d: $5.00 3. Deposit money coins bills Cancel & return money LIFT for ticket and change 4. Press to receive ticket and change 27

Sample Cover Form for Cognitive Walkthrough Cognitive walkthrough data collection sheet Evaluator Date Amanda 2013/9/9 User Familiar with VCRs Not acquainted with this design Task Time-record a program [18:00-19:15] on channel 4 on 2013/11/9 Design specification (or prototype) See next slide Action sequence (action descriptions)

Initial Design of VCR Remote Control

Action Description Actor(#) Description of Action or Response UA 1 Press the ‘timed record’ button SD 1 Display moves to timer mode. Flashing cursor appears after ‘start:’ UA 2 Press digits 1 8 0 0 SD 2 Digits are displayed as typed. Flashing cursor moves to next position. UA 3 Press the ‘timed record’ button. SD 3 Flashing cursor moves to ‘end:’ UA 4 Press digits 1 9 1 5 SD 4

Sample Form for Cognitive Walkthrough UA 1 Press the ‘timed record’ button Questions Evaluation result Severity Q0 使用者目標 The user tries to record TV show … -- Q1 控制項明顯? Yes (the button can be seen clearly) Q2 控制項連結意義? Uneasy (as there’re also other icons that might mislead a user) Medium Q3 回應容易解讀? (The display change is apparent)

Cognitive Walkthrough for the Web (CWW) Based on CoLiDes Contextual rich goal descriptions Interaction (navigation) Task/Goal Webpages Human

CoLiDeS (Comprehension-based Linked Model of Deliberate Search)

CoLiDeS (Comprehension-based Linked Model of Deliberate Search)

Four Problem Types Detected Weak scent link Unfamiliar problem Competing headings Competing links 0’55”

Sample Category Page From Sony Australia The Definitive Internet TV Experience Breathtaking. A must have Full HD TV Home Entertainment Powered with the Internet Matchless quality and a world of possibilities Monolithic Design and Immersive 3D Technology Full HD 3D Equipped with Network Capability The Ultimate TV and Web Surfing Experience Network Capability with High Picture Quality Vibrant images, seamless network capacity Superior Image Technology & Energy Efficiency All-round Entertainment and Enjoyment

Summarizing Cognitive Walkthrough Usability evaluation with expertise Usability specialist Design team members NOT End Users Subjectivity issue Cost issue Use the Delphi method Address the subjectivity issue Achieve consensus Anonymity

Any Question?