Brugergrænseflader til apparater BRGA Presentation 3: Cognitive Psychology & usable methods.

Slides:



Advertisements
Similar presentations
Chapter 15: Analytical evaluation
Advertisements

User Modeling CIS 376 Bruce R. Maxim UM-Dearborn.
User Interfaces 4 BTECH: IT WIKI PAGE:
Copyright 1999 all rights reserved The HCI Design Process n User Interfaces are not just built by sitting down and drawing up designs for them n Just like.
Cognitive Walkthrough More evaluation without users.
CPSC 481 Foundations and Principles of Human Computer Interaction
Department of Computer Science
Saul Greenberg CPSC 481 Foundations and Principles of Human Computer Interaction James Tam.
1 User Centered Design and Evaluation. 2 Overview Why involve users at all? What is a user-centered approach? Evaluation strategies Examples from “Snap-Together.
Saul Greenberg CPSC 481 Foundations and Principles of Human Computer Interaction James Tam.
Graphical User Interfaces Design and usability Saul Greenberg Professor University of Calgary Slide deck by Saul Greenberg. Permission is granted to use.
This Interaction Annoys Me Documenting a problem with an interaction.
Assignment 1 Pick an interaction you find annoying. Document the steps. Describe the annoyance and how it can be fixed.
Usability Inspection n Usability inspection is a generic name for a set of methods based on having evaluators inspect or examine usability-related issues.
PowerPoint Presentation for Dennis, Wixom & Tegarden Systems Analysis and Design Copyright 2001 © John Wiley & Sons, Inc. All rights reserved. Slide 1.
User interface design Designing effective interfaces for software systems Objectives To suggest some general design principles for user interface design.
SIMS 213: User Interface Design & Development Marti Hearst Thurs, Jan 22, 2004.
James Tam CPSC 481 Foundations and Principles of Human Computer Interaction James Tam.
Predictive Evaluation Predicting performance. Predictive Models Translate empirical evidence into theories and models that can influence design. Performance.
HCI revision lecture. Main points Understanding Applying knowledge Knowing key points Knowing relationship between things If you’ve done the group project.
What is a prototype? A prototype is a small scale model of your larger product. Can be a physical object, or a simple software program. Many physical.
Analytical Evaluations 2. Field Studies
User Interface Design Chapter 11. Objectives  Understand several fundamental user interface (UI) design principles.  Understand the process of UI design.
Usability Methods: Cognitive Walkthrough & Heuristic Evaluation Dr. Dania Bilal IS 588 Spring 2008 Dr. D. Bilal.
Evaluating User Interfaces Walkthrough Analysis Joseph A. Konstan
©2011 1www.id-book.com Analytical evaluation Chapter 15.
1. Human – the end-user of a program – the others in the organization Computer – the machine the program runs on – often split between clients & servers.
Brugergrænseflader til apparater BRGA Presentation 3: Cognitive Psychology & usable methods.
Chapter 5 Models and theories 1. Cognitive modeling If we can build a model of how a user works, then we can predict how s/he will interact with the interface.
Predictive Evaluation
Discount Evaluation Evaluating with experts. Discount Evaluation Techniques Basis: – Observing users can be time-consuming and expensive – Try to predict.
User interface design. Recap OOD is an approach to design so that design components have their own private state and operations Objects should have constructor.
CSC 480 Software Engineering Lecture 19 Nov 11, 2002.
Overview Prototyping and construction Conceptual design
Design, prototyping and construction CSSE371 Steve Chenoweth and Chandan Rupakheti (Chapter 11- Interaction Design Text)
Object-Oriented Software Engineering Practical Software Development using UML and Java Chapter 7: Focusing on Users and Their Tasks.
GOMS CS 160 Discussion Chris Long 3/5/97. What is GOMS? l A family of user interface modeling techniques l Goals, Operators, Methods, and Selection rules.
Brugergrænseflader til apparater BRGA Presentation 3: Cognitive Psychology & usable methods.
SEG3120 User Interfaces Design and Implementation
User Interface Structure Design Chapter 11. Key Definitions The user interface defines how the system will interact with external entities The system.
GOMs and Action Analysis and more. 1.GOMS 2.Action Analysis.
INTRO TO USABILITY Lecture 12. What is Usability?  Usability addresses the relationship between tools and their users. In order for a tool to be effective,
Requirements Validation CSCI 5801: Software Engineering.
Chapter 15: Analytical evaluation. Inspections Heuristic evaluation Walkthroughs.
Chapter 15: Analytical evaluation Q1, 2. Inspections Heuristic evaluation Walkthroughs Start Q3 Reviewers tend to use guidelines, heuristics and checklists.
Usability 1 Usability evaluation Without users - analytical techniques With users - survey and observational techniques.
Usability Engineering Dr. Dania Bilal IS 582 Spring 2006.
Task Analysis CSCI 4800/6800 Feb 27, Goals of task analysis Elicit descriptions of what people do Represent those descriptions Predict difficulties,
Input Design Lecture 11 1 BTEC HNC Systems Support Castle College 2007/8.
User Interface Evaluation Cognitive Walkthrough Lecture #16.
Prototyping. REVIEW : Why a prototype? Helps with: –Screen layouts and information display –Work flow, task design –Technical issues –Difficult, controversial,
Brugergrænseflader til apparater BRGA Presentation 3: Cognitive Psychology & usable methods.
EVALUATION PROfessional network of Master’s degrees in Informatics as a Second Competence – PROMIS ( TEMPUS FR-TEMPUS-JPCR)
Brugergrænseflader til apparater BRGA Presentation 7: Users.
Overview and Revision for INFO3315. The exam
Usability Engineering Dr. Dania Bilal IS 592 Spring 2005.
1 Cognitive Modeling GOMS, Keystroke Model Getting some details right!
Cognitive Walkthrough More evaluating with experts.
Chapter 15: Analytical evaluation. Aims: Describe inspection methods. Show how heuristic evaluation can be adapted to evaluate different products. Explain.
Introduction to Evaluation without Users. Where are you at with readings? Should have read –TCUID, Chapter 4 For Next Week –Two Papers on Heuristics from.
Object-Oriented Software Engineering Practical Software Development using UML and Java Chapter 7: Focusing on Users and Their Tasks.
Introduction to Evaluation “Informal” approaches.
Fall 2002CS/PSY Predictive Evaluation (Evaluation Without Users) Gathering data about usability of a design by a specified group of users for a particular.
Usability Engineering Dr. Dania Bilal IS 587 Fall 2007.
CIS 376 Bruce R. Maxim UM-Dearborn
Evaluation without Users, Part 2
Systems Analysis and Design in a Changing World, 6th Edition
Evaluation.
Cognitive Walkthrough
Presentation transcript:

Brugergrænseflader til apparater BRGA Presentation 3: Cognitive Psychology & usable methods

Ingeniørhøjskolen i Århus Slide 2 af 32 Outline Recap from last time –The History of HCI – and why it is important –“The Psychology of HCI” Delving further into Cognitive HCI Methods we may employ Performing a CW

Ingeniørhøjskolen i Århus Slide 3 af 32 The History of HCI And why it is important – recap from last time –Why is it important to know the History? –Suggestions? Do NOT repeat the mistakes of others –Example: WAP – 1994 all over again? Rather: –Learn from those who went before you –Use their guidelines and methods (& theories) –And be able to understand what they are referring to!

Ingeniørhøjskolen i Århus Slide 4 af 32 The Psychology of HCI It is not easy to control all aspects of your product development –You may be dependent on others to provide the technical settings within which you must work Hardware: processing power available, battery, display quality Software: low level programming (hard to make Windows systems in assembler or C), few available widgets (J2ME) or even no GUI at all! –What you ARE able to do, is optimizing the resources you DO have, for the task ahead –This includes anticipating what the user might want Guessing (or is this a clever strategy?) Qualified assumptions based on heuristics (Aha History again!) Involving users in the design, and testing it (more of this later!)

Ingeniørhøjskolen i Århus Slide 5 af 32 The Psychology of HCI Two main theoretic frameworks –Cognitive Sciences –Social Computing Both with user involvement! –But with different backgrounds –We will not spend too much time on discussing this –Only note, that the Cognitive School is more “hard science” and “lab oriented” than is Social Computing

Ingeniørhøjskolen i Århus Slide 6 af 32 Cognitive HCI First generation: cognitive sciences (RECAP) –Cognitive psychology: the study of how people perceive, learn, and remember (USA 1950’s) –Cognition: the act or process of knowing (DK: erkendelse/viden) –“The Psychology of HCI” until late 1980’s – Cognitive HCI –the human mind as a series of information processors – almost like a computer, ready to measure against the computer, practical! 3 parts – Input system, output system, information processor system The body (eyes, muscles etc) is only hardware –Input/output – stimulus/response – ultimatly: the PUM –hard science and practical concerns – engineering HCI Task analysis, Approximation, Calculation, models: KLA, GOMS –Lab testing and “measuring” usability (Fittz law – Joystick/Mouse) –WE CAN MAKE MODELS OF EVERYTHING AND CALCULATE USABILITY! GREAT!

Ingeniørhøjskolen i Århus Slide 7 af 32 Cognitive sciences

Ingeniørhøjskolen i Århus Slide 8 af 32 Cognitive characteristics The human “central information processing” –Here Cognition takes place Components of cognition –Short-term(working) vs Long-term memory Most GUI’S (& SUI’s) are memory intensive Need to support the user get through the task (focus problems) User can only comprehend 7+2 elements in short term memory –Associative thinking Using Icons to connect –The Importance of meaning (humans remember things with …) DOS, SOAP, CORBA harder than “File System” – use Metaphors –Many other factors, which we will not delve into here Read more in Shneiderman (Designing the User Interface) Normans “The Design of Everyday things” Nielsen's “Usability Engineering”

Ingeniørhøjskolen i Århus Slide 9 af 32 Methods Cognition Psychology makes assumptions on user behavior – and believes in it –We can isolate users in the LAB and make testing that is hard science (quantitative empirical data) Method: Think out loud (Tognazzini – User testing on the cheap) –We can “predict” usability – task performance time (eg calculating number of necessary key strokes or mouse clicks - KLA) – by knowing things about the user –We can try to “predict” usability problems, by simulating the user – done by designer & analyst Here the Cognitive Walkthrough is a qualitative method)

Ingeniørhøjskolen i Århus Slide 10 af 32 Evaluation without users Quantitative Methods –GOMS/keystroke analysis (low level) –Back-of-the-envelope action analysis (well …) Qualitative Methods –Expert evaluation (high level) –Cognitive walkthrough (high level) –Heuristic evaluation (high level) –Think out loud (medium to high level)

Ingeniørhøjskolen i Århus Slide 11 af 32 With or without users Users are the gold standard –They cannot be simulated perfectly Users are expensive and inconsistent –Usability studies require several users –Some users provide great information, others little –Nearly always qualitative studies Too expensive to make quantitative Best choice do both –Start out without – later with

Ingeniørhøjskolen i Århus Slide 12 af 32 GOMS Analysis Goals –Change a word in a text document Operators –Click mouse, look at a menubar, remember a name Methods –Move mouse to point at word, then double-click Selection Rules (to decide which course of action to take) Use Cut menu, Delete key, etc.

Ingeniørhøjskolen i Århus Slide 13 af 32 GOMS/Keystroke Analysis Formal action analysis –Accurately predict task completion time for skilled users Break task into tiny steps –Keystroke, mouse movement, refocus gaze –Retrieve item from long-term memory Look up average step times –Tables from large experiments

Ingeniørhøjskolen i Århus Slide 14 af 32 GOMS/Keystroke Analysis Primary utility: repetitive tasks –e.g., telephone operators, SMS users (T9) –Benefit: can be very accurate (within 20%) –May identify bottlenecks Difficulties –Challenging to decompose accurately –Long/laborious process –Not useful with non-expert users

Ingeniørhøjskolen i Århus Slide 15 af 32 GOMS Timing K = 0.2 sec –Tap a key on the keyboard P = 1.1 sec –Point to a position on a display H = 0.4 sec –Homing, moving from keyboard to mouse or back M = 1.35 sec –Mentally preparing R = ??? –Responding

Ingeniørhøjskolen i Århus Slide 16 af 32 Back-of-the-Envelope Action Analysis Coarse-grain –List basic actions (e.g., ‘select menu item’) –Each action can be 2-3 seconds (or less) –What must be learned/remembered? –What can be done easily? –Documentation/training? Goal is to find major problems

Ingeniørhøjskolen i Århus Slide 17 af 32 Action Analysis example Windows File Open Dialog –Especially the NT & pre-2000 –Takes additional seconds each time it is used –Does not remember sort order –Cannot be resized

Ingeniørhøjskolen i Århus Slide 18 af 32 Semi-quantitative action analysis Windows File Open dialog F: 1.25 sec O: 1.25 Move to folder: 1.25 D-click folder: 0.25 Sum = 4.0 sec 4 sec x 5x/day x 1 million users = 5,555 hrs/yr $416, ($75/hr)

Ingeniørhøjskolen i Århus Slide 19 af 32 Windows File Open (Continued) To details button: 1.25 sec0.5 sec To column separator: 1.25 sec1.0 sec To 2nd col separator: To Mod col head: Sum = 5.0 sec3.5 sec 3.5 x 5x/day x 1 million users = 4,861 hrs/yr $364, ($75/hr)

Ingeniørhøjskolen i Århus Slide 20 af 32 Is it worth a redesign? This is the one that shows up in MS Powerpoint in Windows 2000™

Ingeniørhøjskolen i Århus Slide 21 af 32 Expert evaluation Usability specialists are very valuable –Double-specialists are even better An inexpensive way to get a lot of feedback Be sure the expert is qualified in your area Confusing Dialog? Do you really want to Cancel your short sell order on the leveraged options? YesForget It “This should be ‘Cancel’… that’s what the guidelines say”

Ingeniørhøjskolen i Århus Slide 22 af 32 Walkthrough Analysis Economical interface evaluation –Low-fidelity prototype –Development team Users optional Effective, if –Goal is improvement, not defense –Some team members skilled –Proper motivation

Ingeniørhøjskolen i Århus Slide 23 af 32 Cognitive Walkthrough Goals –to critique the designers assumptions about the design Imagine user’s experience Evaluate choice-points in the interface Detect e.g. confusing labels or options Detect likely user navigation errors Start with a complete scenario –Never try to “wing it” on a walkthrough

Ingeniørhøjskolen i Århus Slide 24 af 32 Tell a Believable Story How does the user accomplish the task Action-by-action –Tasks should be important –Tasks should be realistic Based on user knowledge and system interface

Ingeniørhøjskolen i Århus Slide 25 af 32 Best Approach Work as a group –Don’t partition the task Be highly skeptical –Remember, the goal is to improve the UI Every gap is an interface problem

Ingeniørhøjskolen i Århus Slide 26 af 32 Who Should Do the Walkthrough Designers, as an early check Team of designers & users –Remember: goal is to find problems –Avoid making it a show Skilled UI people may be valuable team members

Ingeniørhøjskolen i Århus Slide 27 af 32 How Far Along Basic requirements –Description or prototype of interface –Know who users are (and their experience) –Task description –List of actions to complete the task (scenario) Viable once the scenario and interface sketch are completed But can be done anytime …

Ingeniørhøjskolen i Århus Slide 28 af 32 Outline of CW Preparation –Define assumed user background –Choose sample task –Specifiy correct action sequence(s) for task –Determine interface states along the sequence(s) Analysis –For each correct action Construct a success story that explains why a user would choose that action OR Use a failure story to indicate why a user would not choose that action –Record problems, reasons & assumptions –Consider and record design alternatives Follow-up –Modify the interface design to eliminate problems -> redesign!

Ingeniørhøjskolen i Århus Slide 29 af 32 How to Proceed For each action in the sequence –Tell the story of why the user will do it –Ask critical questions Will the user be trying to achieve the right effect? Will the user notice that the correct action is available? Will the user select a different control instead? Will the user associate the correct action with the desired effect? Will the user understand the feedback – and that progress has been made?

Ingeniørhøjskolen i Århus Slide 30 af 32 The Questions Will the user be trying to achieve the right effect? Will the user notice that the correct action is available? Will the user select a different control instead? Will the user associate the correct action with the desired effect? Will the user understand the feedback – and that progress has been made?

Ingeniørhøjskolen i Århus Slide 31 af 32 Walkthroughs are not Perfect They won’t find every problem A useful tool in conjunction with others Conclusions from Lewis & Wharton (taken from overview of different related studies) –CW finds about 40% (or more) og the problems later revealed by user testing –CW takes substantially less effort than user testing –Considering problems found per unit effort, CW may not be much more cost effective than user testing –Heuristic Evaluation finds more problems than the CW and takes less effort –CW can be tedious and too much concerned with low-level details –CW does not provide a high-level perspective on the interface –CW’s performed by groups of analysts work better than those done by individuals After the exercises – you may form your own opinion

Ingeniørhøjskolen i Århus Slide 32 af 32 Exercise: Cognitive Walkthrough Analysis In non-project groups of 3-5 Scenario developed jointly –Coffee Vending machine (group 1 starts) Perform walkthrough –identify problems –estimate error probabilities (25% intervals) Remember who your users are! AND WRITE EVERYTHING DOWN –We will be meeting in 1 hour again