Evaluation Types GOMS and KLM CS352. Quiz Announcements Notice upcoming due dates (web page). Where we are in PRICPE: –Predispositions: Did this in Project.

Slides:



Advertisements
Similar presentations
Chapter 15: Analytical evaluation
Advertisements

Foundations and Strategies Attention Investment CS352.
Chapter 12 cognitive models.
User Modeling CIS 376 Bruce R. Maxim UM-Dearborn.
KLEM: A Method for Predicting User Interaction Time and System Energy Consumption during Application Design CHRISTIAN DZIUBA ILYAS DASKAYA Ubiquitious.
Human Capabilities: Mental Models CS352. Announcements Notice upcoming due dates (web page). Where we are in PRICPE: –Predispositions: Did this in Project.
Evaluation (cont.): Heuristic Evaluation Cognitive Walkthrough CS352.
Evaluation Types GOMS and KLM
1 User-Centered Design and Development Instructor: Franz J. Kurfess Computer Science Dept. Cal Poly San Luis Obispo FJK 2009.
Instructor: Vincent Duffy, Ph.D. Associate Professor of IE Lecture 8 – Human-Computer Interaction Thurs. Feb. 8, 2007 IE 486 Work Analysis & Design II.
ICS 463, Intro to Human Computer Interaction Design: 6 (Practice). Guidelines and Metrics Chapters
KLM and GOMS Professor: Tapan Parikh TA: Eun Kyoung Choe
Predictive Evaluation Predicting performance. Predictive Models Translate empirical evidence into theories and models that can influence design. Performance.
Analytical Evaluations 2. Field Studies
Spreadsheet. Objectives Create a new blank workbook. Create a new blank workbook. Identify user interface elements that you can use to accomplish basic.
©2011 1www.id-book.com Analytical evaluation Chapter 15.
Lesson 1 – Microsoft Excel The goal of this lesson is for students to successfully explore and describe the Excel window and to create a new worksheet.
Chapter 5 Models and theories 1. Cognitive modeling If we can build a model of how a user works, then we can predict how s/he will interact with the interface.
Word Processing Understanding Microsoft Word 10. Benefits of a Word Processor Word Processing Is the use of a computer and software to produce written.
GOMS Keystroke analysis When (fine-grained) speed matters.
Keystroke-Level Model IST 331 Gaurav Dubey Based on ‘The ABCs of Users’, Ritter et al 2011.
Gary MarsdenSlide 1University of Cape Town Human-Computer Interaction - 6 User Models Gary Marsden ( ) July 2002.
COMP5047 Pervasive Computing: 2012 GOMS and keystroke predictive methods Judy Kay CHAI: Computer human adapted interaction research group School of Information.
Cell Alignment By default, text is left aligned and values are right aligned. You can also adjust vertical alignment.
Productivity Programs Common Features and Commands.
Word 2010 Vocabulary List 1. Click and Type - A feature that allows you to double-click a blank area of a document to position the cursor in that location,
Testing & modeling users. The aims Describe how to do user testing. Discuss the differences between user testing, usability testing and research experiments.
Evaluation of User Interface Design 4. Predictive Evaluation continued Different kinds of predictive evaluation: 1.Inspection methods 2.Usage simulations.
Evaluation (cont.): Empirical Studies CS352. Announcements Notice upcoming due dates (web page). Where we are in PRICPE: –Predispositions: Did this in.
Chapter 15: Analytical evaluation. Inspections Heuristic evaluation Walkthroughs.
Task Analysis CSCI 4800/6800 Feb 27, Goals of task analysis Elicit descriptions of what people do Represent those descriptions Predict difficulties,
Concepts and Prototypes CS352. Announcements Notice upcoming due dates (web page). Where we are in PRICPE: –Predispositions: Did this in Project Proposal.
ITM 734 Introduction to Human Factors in Information Systems
Editing Basics Lesson 8. Skills Matrix SKILL #MATRIX SKILL 2.2.1Cut, copy, and paste text 2.2.2Find and replace text 4.1.1Insert building blocks in documents.
Evaluation Using Modeling. Testing Methods Same as Formative Surveys/questionnaires Interviews Observation Documentation Automatic data recording/tracking.
Evaluation (cont.): Heuristic Evaluation Cognitive Walkthrough CS352.
1 Cognitive Modeling GOMS, Keystroke Model Getting some details right!
Edit text and revise your documents Make changes to your document Documents get changed. You may make changes as you type, or after you finish the document.
Cognitive Models Lecture # March, 2008Human Computer Intercation Spring 2008, Lecture #10 2 Agenda Cognitive models –KLM –GOMS –Fitt’s Law –Applications.
Chapter 15: Analytical evaluation. Aims: Describe inspection methods. Show how heuristic evaluation can be adapted to evaluate different products. Explain.
Prof. James A. Landay University of Washington Winter 2009 (1) Action Analysis (2) Automated Evaluation January 13, 2009.
A Survey on User Modeling in HCI PRESENTED BY: MOHAMMAD SAJIB AL SERAJ SUPERVISED BY: PROF. ROBERT PASTEL.
Word processing is the software package that enables you to create,edit, print and save documents for future retrieval reference. creating a document.
Human Computer Interaction Lecture 23 Cognitive Models
Chapter 5 – Cognitive Engineering
Human Computer Interaction
Task Analysis CSCI 4800/6800 Feb 27, 2003.
CIS 376 Bruce R. Maxim UM-Dearborn
Concepts and Prototypes
UI Design.
Analytical Evaluation with GOMS and KLM
Evaluation (cont.): Cognitive Walkthrough and Heuristic Evaluation
Evaluation - Analytical Cognitive Walkthrough and Heuristic Evaluation
Evaluation (cont.): Empirical Studies
Models and Theories.
Human Capabilities: Mental Models
Evaluation Types CS352.
15. Human-Computer Interaction
Model based design Cognitive (user) models
Cognitive models linguistic physical and device architectural
Model based design NGOMSL and CPM- GOMS
Model based design keystroke level model
Chapter 12 cognitive models.
Human Computer Interaction Lecture 24 Cognitive Models
Evaluation (cont.): Empirical Studies
Chapter 12 cognitive models.
Evaluation - Analytical Cognitive Walkthrough and Heuristic Evaluation
Evaluation - Analytical Cognitive Walkthrough and Heuristic Evaluation
Evaluation (cont.): Empirical Studies: The Thinkaloud
Presentation transcript:

Evaluation Types GOMS and KLM CS352

Quiz

Announcements Notice upcoming due dates (web page). Where we are in PRICPE: –Predispositions: Did this in Project Proposal. –RI: Research was studying users. Hopefully led to Insights. –CP: Concept and initial (very low-fi) Prototypes due Design Gallery #1. –Evaluate throughout, repeat iteratively!! 3

Evaluation Analytical – based on your head Empirical – based on data –Formative inFORMs design what is (still) needed? –Summative did it work?

Analytical methods You follow established guidelines/procedures/models to decide (in your head) how good your design is. Examples: –GOMS/KLM – for skilled users, no errors. evaluating efficiency of regular use. –Heuristic Evaluation –Cognitive Walkthrough – for first-time users. evaluating ease of learning.

GOMS (and KLM) GOMS: a family of models. Predict user performance. Useful for predicting actual time a skilled user will take in UI. Useful for comparing different UIs.

GOMS Constructs Goal, Operators, Methods, Selection rules Goal: “what”. Method: “how” steps (learned). Operators: Cognitive processes + physical actions to DO it. Selection rules: rules saying which method to select.

GOMS example: Delete a word Goal: delete a word in a sentence. Method #1: use the menu –Recall that the word has to be highlighted. –Recall that the command is “cut”. –Recall that “cut” is in the Edit Menu. –Accomplish goal of selecting and executing “cut”. –Return: goal accomplished.

GOMS example (cont.) Method #2: use the delete key –Recall where to position cursor in relation to word to be deleted. –Recall which key is delete key. –Press “delete” key to delete each letter. –Return: goal accomplished. Operators used in these methods –Click mouse, Drag cursor over text, Select menu, Move cursor, Press KB key, Think,...

GOMS example (cont.) Selection rules: –Use mouse/menu method (#1) if there’s a lot of text to delete. –Else use “delete” key (method #2).

KLM (a low-level variant of GOMS) Keystroke Level Model. Simple, but accurate. Widely used. Scope: –skilled users –doing a task error-free. –using a specific method in a UI. CogTool has this built-in.

KLM Operators User Operators: –K (keystroke), P (point), H (homing), D (drawing), M (mental: think). –Times for each are provided to you based on extensive research/empirical data. System Operator: –R (respond).

KLM/GOMS example 1: Open a file 27 ways to open a file in Windows! Methods as states + transitions. (High op granularity combines low-level ops.)

KLM/GOMS example 1 (cont.) Used to: –Understand cost of each. –(break down participants actual costs). –“Rx”:recent lists. –“WS/WX”:search. And to...

KLM/GOMS example 1 (cont.) Use the breakdowns to compare costs to new UI alternative (new feature “FP”) actualcalc’d

CogTool Example CogTool examples. –Calculating the cost of the task in this UI. –Comparing the cost if do the task with different widgets. –Where are these cost differences coming from? under the hood to ACT/R

What’s coming up next: Heuristic Evaluation Cognitive Walkthroughs Empirical Studies