Cognitive Walkthrough

Slides:



Advertisements
Similar presentations
DT Coursework By D. Henwood.
Advertisements

Cognitive Walkthrough Example Dr. Philip Craiger Human - Computer Interaction.
Cognitive Walkthrough More evaluation without users.
Data analysis and interpretation. Agenda Part 2 comments – Average score: 87 Part 3: due in 2 weeks Data analysis.
Discount Evaluation Evaluating with experts. Agenda Online collaboration tools Heuristic Evaluation Perform HE on each other’s prototypes Cognitive Walkthrough.
Useability.
Discount Evaluation Evaluating with experts. Agenda Part 4 preview Heuristic Evaluation Perform HE on each other’s prototypes Cognitive Walkthrough Perform.
Heuristic Evaluation Evaluating with experts. Discount Evaluation Techniques  Basis: Observing users can be time- consuming and expensive Try to predict.
Evaluating with experts
Intro to Evaluation See how (un)usable your software really is…
Feedback from Usability Evaluation to User Interface Design: Are Usability Reports Any Good? Christian M. Nielsen 1 Michael Overgaard 2 Michael B. Pedersen.
Discount Evaluation Evaluating with experts. Agenda Project was due today – You will demo your prototype next class Heuristic Evaluation Cognitive Walkthrough.
John Kelleher (IT Sligo) Cognitive Walkthrough. 1 Background Authors – Lewis & Polson (1991) Based on theory L&P CE+ Theory of Exploratory Learning Assesses.
Analytical Evaluations 2. Field Studies
Cognitive walkthrough: description and example Based on Task-Centered Design by Clayon Lewis & John Rieman, CU Boulder.
Predictive Evaluation
Chapter 11: An Evaluation Framework Group 4: Tony Masi, Sam Esswein, Brian Rood, & Chris Troisi.
Discount Evaluation Evaluating with experts. Discount Evaluation Techniques Basis: – Observing users can be time-consuming and expensive – Try to predict.
Intro to Evaluation See how (un)usable your software really is…
Evaluation Techniques Material from Authors of Human Computer Interaction Alan Dix, et al.
Cognitive Walkthrough Judy Kay CHAI: Computer human adapted interaction research group School of Information Technologies.
Extended Cognitive Walkthrough Judy Kay CHAI: Computer human adapted interaction research group School of Information Technologies.
Usability Testing Chapter 6. Reliability Can you repeat the test?
Usability Assessment Methods beyond Testing Chapter 7 Evaluating without users.
Usability 1 Usability evaluation Without users - analytical techniques With users - survey and observational techniques.
User Interface Evaluation Cognitive Walkthrough Lecture #16.
Cognitive Walkthrough More evaluating with experts.
COMP5047 Pervasive Computing: 2012 Extended Cognitive Walkthrough Judy Kay CHAI: Computer human adapted interaction research group School of Information.
Introduction to Evaluation without Users. Where are you at with readings? Should have read –TCUID, Chapter 4 For Next Week –Two Papers on Heuristics from.
Chapter 23 Deciding how to collect data. UIDE Chapter 23 Introduction: Preparing to Collect Evaluation Data Timing and Logging Actions –Automatic Logging.
1 Cognitive Walkthrough C. Wharton, J. Rieman, C. Lewis and P. Polson, The Cognitive Walkthrough Method: A Practitioner’s Guide, in J. Nielsen and R. Mack.
Intro to Evaluation See how (un)usable your software really is…
Introduction to Evaluation “Informal” approaches.
Fall 2002CS/PSY Predictive Evaluation (Evaluation Without Users) Gathering data about usability of a design by a specified group of users for a particular.
Steps in Planning a Usability Test Determine Who We Want To Test Determine What We Want to Test Determine Our Test Metrics Write or Choose our Scenario.
Usability Engineering Dr. Dania Bilal IS 587 Fall 2007.
Asking Users and Experts Li Zhang (Jacey) Yuewei Zhou (Joanna)
Who uses it? What is it? Why should I care?
User Interface Evaluation
Interviews & focus groups
The Reverse Engineering Process
Designing and Developing Games
AP CSP: Data Assumptions & Good and Bad Data Visualizations
Human Computer Interaction Lecture 15 Usability Evaluation
Imran Hussain University of Management and Technology (UMT)
ROUTERS AND REDUNDANCY
CS3205: HCI in SW Development Evaluation (Return to…)
Who uses it? What is it? Why should I care?
Evaluation of Research Methods
Wrapping up prototyping
Who uses it? What is it? Why should I care?
Evaluation without Users, Part 2
Check Your Assumptions
Interviews & focus groups
Cognitive Walkthrough
Cognitive Walkthrough
Who uses it? What is it? Why should I care?
Beach Monitoring App Team Phoenix 2/2/17
Chapter 23 Deciding how to collect data
Cognitive Walkthrough
Gathering Requirements
Evaluation.
Interviews & focus groups
HCI Evaluation Techniques
Evaluation Techniques
Fostering Critical and Creative Thinking
Interviews & focus groups
Who uses it? What is it? Why should I care?
COMP444 Human Computer Interaction Prototyping
Evaluation: Inspections, Analytics, and Models
Presentation transcript:

Cognitive Walkthrough More evaluation without users

Project part 3 Please read the comments on your evaluation plans Find participants Friends, neighbors, co-workers Perform the evaluations Clearly inform your users what you are doing and why. If you are audio or video recording, I prefer you use a consent form. Pilot at least once – know how long its going to take.

Part 3 write up State exactly what you did (task list, how many, questionnaires etc.) Summarize data collected Summarize usability conclusions based on your data Discuss implications for the prototype based on those conclusions

Cognitive Walkthrough Assess learnability and usability through simulation of way users explore and become familiar with interactive system A usability “thought experiment” Like code walkthrough (s/w engineering) From Polson, Lewis, et al at UC Boulder

Cognitive Walkthrough Qualitative Predictive With experts to examine learnability and novice behavior

CW: Process Construct carefully designed tasks from system spec or screen mock-up Walk through (cognitive & operational) activities required to go from one screen to another Review actions needed for task, attempt to predict how users would behave and what problems they’ll encounter

CW: Requirements Description of users and their backgrounds Description of task user is to perform Complete list of the actions required to complete task Prototype or description of system

CW: Assumptions User has rough plan User explores system, looking for actions to contribute to performance of action User selects action seems best for desired goal User interprets response and assesses whether progress has been made toward completing task

CW: Methodology Step through action sequence Response A, B, .. Action 2 Response A ... For each one, ask four questions and try to construct a believability story

CW: Questions Will users be trying to produce whatever effect action has? Will users be able to notice that the correct action is available? (is it visible) Once found, will they know it’s the right one for desired effect? (is it correct) Will users understand feedback after action?

CW: Answering the Questions 1. Will user be trying to produce effect? Typical supporting evidence It is part of their original task They have experience using the system The system tells them to do it No evidence? Construct a failure scenario Explain, back up opinion

CW: Next Question 2.Will user notice action is available? Typical supporting evidence Experience Visible device, such as a button Perceivable representation of an action such as a menu item

CW: Next Question 3.Will user know it’s the right one for the effect? Typical supporting evidence Experience Interface provides a visual item (such as prompt) to connect action to result effect All other actions look wrong

CW: Next Question 4.Will user understand the feedback? Typical supporting evidence Experience Recognize a connection between a system response and what user was trying to do

Let’s practice: My Internet Radio

User characteristics Technology savy users Familiar with computers Understand Internet radio concept Just joined and downloaded this radio

Task: find a new station to presets Click genre Scroll list and choose genre Assuming station is on first page, add station to presets -- right-click on station, choose add to presets from popup menu. Click OK on Presets

Task: Click – Pick a genre Will users be trying to produce whatever effect action has? Will users be able to notice that the correct action is available? Once found, will they know it’s the right one for desired effect? Will users understand feedback after action?

Action: Add to Preset Will users be trying to produce whatever effect action has? Will users be able to notice that the correct action is available? Once found, will they know it’s the right one for desired effect? Will users understand feedback after action?

Action: Click OK Will users be trying to produce whatever effect action has? Will users be able to notice that the correct action is available? Once found, will they know it’s the right one for desired effect? Will users understand feedback after action?

CW Summary Advantages Disadvantages Explores important characteristic of learnability Novice perspective Detailed, careful examination Working prototype not necessary Disadvantages Can be time consuming May find problems that aren’t really problems Narrow focus, may not evaluate entire interface

Your turn Banner checking classes What are our tasks? What are the actions?

CW: Questions Will users be trying to produce whatever effect action has? Will users be able to notice that the correct action is available? (is it visible) Once found, will they know it’s the right one for desired effect? (is it correct) Will users understand feedback after action?

Homework: last one Cognitive Walkthrough of each other’s prototypes Gather materials for your prototype: User characteristics tasks (1 or 2) and action lists Storyboard or running prototype Perform CW for another group

Homework Tuxbo evaluate EZFinder EZFinder evaluate GWH2 GWH2 evaluate Tuxbo To turn in on your group page: List of tasks and actions for your prototype Date and people who evaluated your prototype