Comprehension-Based Approach to HCI for Designing Interaction in Information Space Muneo Kitajima Human-Computer Interaction Group Institute for Human Science and Biomedical Engineering National Institute of Advanced Industrial Science and Technology Japan

Outline Traditional HCI vs. Information-Centric HCI Views Cognitive Modeling Cognitive Models for Information-Centric HCI Performing by Exploration: LICAI Model Web Navigation: CoLiDeS Model Model-Based Suggestions for Designing Usable Interaction in Information Space

Traditional HCI Hide the Legend of the Chart Created by Excel Familiar Task Domain Legend X-axis Line-Graph … Familiar Interface Style Menu Tool Direct Manipulation Familiar Controls Button Menu Item Active Objects Window Controls Check Box Menu & Dialogue Box Select CHART Menu Item Select CHART OPTIONS Pulldown-Menu Item Select LEGEND Tab Clear SHOW LEGEND Check Box Direct Manipulation Select Legend Press DELETE Tool Press LEGEND Button

Modeling for Traditional HCI Intention Translate Computer Interpret Physical World Task Interacting with Computers Norman’s Action Cycle Evaluation Stage Execution Stage GOMS Model (Card, Moran & Newell, 1983) Routine Task Goals, Operators, Methods, and Selection Rules Proved to be Useful Task Analysis Method Action Sequences Determined by Task and Interface Knowledge in the Head Structure of Task: Hierarchical Goal Structure Weak Interaction with Environment

Interacting with Information Task: Satisfy Information Needs Interaction Style Directly Interacting with Information via Information Appliances/Internet Appliances NOT Interacting with Applications on a Computer via Menu, Tools, etc. Difference from Traditional HCI Lots of New Information Interpretation Varies Depending on User’s Goal and Background Knowledge Physical Action Sequences Not Consistent GOMS-like Modeling NOT Appropriate I’d like to know more about Hodgkin’s disease at WebMD, a Medical Site

Comprehension is the Key Traditional HCI Translation of Intention to Physical Action, Requires Procedural Knowledge Interpretation of the Consequence of Action in the Light of Intention, NOT Knowledge Intensive Information-Centric HCI Comprehension of Information Provided by the Interface, Requires Lots of Factual and Semantic Knowledge Selecting Hyperlink Most Similar to the Current Goal, NOT Based on Predetermined Rules Action is Trivial

Designing for Information-Centric HCI Key to Success USER: Adequate Comprehension of Information DESIGN: Provision of Appropriate Information to EVERY User Information for Navigation Information about Contents Design Challenges Cope with Variability of Users Information Needs Cope with Diversity of Users Background Knowledge Importance of Model-Based Usability Evaluation

Comprehension-Based Models for Information-Centric HCI Comprehension Process Modeled by Kintsch’s Construction-Integration Theory of Text Comprehension Comprehension-Based Model of Performing by Exploration LICAI, LInked model Comprehension-based Action planning and Instruction taking Kitajima and Polson, 1997, Human-Computer Interaction Non-Routine Task Integration of Factual and Semantic Knowledge When Selecting Action Little Information Change Comprehension-Based Model of Web Navigation CoLiDeS, Comprehension-based Linked model of Deliberate Search Kitajima, Blackmon, and Polson, 2000, British HCI Conference Large Information Change – Interacting with Information

Performing by Exploration Task Know the Subtasks Communicate the Destination Know Fair Insert Coin Retrieve the Change Take the Ticket Novel Labels Familiar Controls Buttons, Slot, … Buy a Train Ticket in UK

Comprehension-Based Model Performing by Exploration LICAI LInked model of Comprehension-based Action planning and Instruction taking (Kitajima and Polson, 1997) Three Processes Goal Formation Process Comprehends the task for the purpose of transforming it into workable subtasks Goal Selection Process Comprehends the interface to sequence the subtasks properly Action Selection Process Selects an object-action pair to execute, consisting of the following sub-processes; Object Selection Process Selection is Done Through Comprehension of the Display in the Light of the Goal, Using Massive Amount of Knowledge Retrieved from Long-Term Memory, NOT Applying Predetermined Rules

Web Navigation Task: Satisfy Information Needs Ex) Browse Books on Cognitive Science at Amazon.Com Compare Digital Cameras at Points.Com Obtain Diagnosis for Type Two Diabetes at WebMD.Com … Novel Pages – More Dynamic Familiar Controls Hyperlinks, Buttons, …

Comprehension-Based Model Web Navigation CoLiDeS Comprehension-based Linked model of Deliberate Search (Kitajima, Blackmon and Polson, 2000) Four Processes, Attention Process Added to the LICAI Model Goal Formation Process Goal Selection Process Attention Process Parse the page and focus-on one sub-region Action Selection Process Comprehend the selected sub-region and select link

Example Goal: the user is planning to make a travel to Japan and wants to know about details of family tours.

Attend-to This Subregion Example Goal: the user is planning to make a travel to Japan and wants to know about details of family tours. Parse the Page Attend-to This Subregion Comprehend and Attend-to Subregion

Example Attend Here Parse the Attended-to Region Comprehend and Goal: the user is planning to make a travel to Japan and wants to know about details of family tours. Parse the Attended-to Region Comprehend and Attend-to Subregion Attend Here

Example Select This Link Goal: [text] Parse the Attended-to Region Goal: the user is planning to make a travel to Japan and wants to know about details of family tours. Goal: [text] Select This Link Parse the Attended-to Region Comprehend and Attend-to Subregion Comprehend and Select Link

Designing Usable Interface for Information Space Goal Formation Stage Comprehend the task in order to transform it into workable subtasks Goal Selection Stage Comprehend the interface to sequence the subtasks properly Action Selection Stage Comprehend the interface to attend to the right place Comprehend the interface to select the right object Comprehend the interface to select the right action

Designing Usable Interface for Information Space Goal Formation Stage Is the task representation appropriate for activating critical knowledge? Goal Selection Stage Is the interface representation appropriate for activating the right subgoal? Action Selection Stage Is the interface representation appropriate for activating critical knowledge for parsing the interface? Is the interface representation of the object appropriate for activating knowledge necessary to relate it with the current subgoal? Is the representation of the interface object appropriate for activating eligible action for the current subgoal?

Conclusions Interaction with Computers vs. Interaction with Information Space Comprehension is the Key Cognitive Skill Users Have to Comprehend the Information on the Screen Appropriately to Accomplish the Goal Designs Have to Provide Appropriate Information Design Challenges Diversity in user goals Variability in user’s background knowledge Comprehension-Based Models, LICAI and CoLiDeS Design Suggestions Based on the Cognitive Models Usability Evaluation Tool, Cognitive Walkthrough for the Web http://staff.aist.go.jp/kitajima.muneo/