1. Comprehension-Based Approach to HCI for Designing Interaction in Information Space
Muneo Kitajima
Human-Computer Interaction Group
Institute for Human Science and Biomedical Engineering
National Institute of Advanced Industrial Science and Technology
Japan

2. Outline Traditional HCI vs. Information-Centric HCI
Views
Cognitive Modeling
Cognitive Models for Information-Centric HCI
Performing by Exploration: LICAI Model
Web Navigation: CoLiDeS Model
Model-Based Suggestions for Designing Usable Interaction in Information Space

3. Traditional HCI Hide the Legend of the Chart Created by Excel
Familiar Task Domain
Legend
X-axis
Line-Graph …
Familiar Interface Style
Menu
Tool
Direct Manipulation
Familiar Controls
Button
Menu Item
Active Objects
Window Controls
Check Box
Menu & Dialogue Box
Select CHART Menu Item
Select CHART OPTIONS Pulldown-Menu Item
Select LEGEND Tab
Clear SHOW LEGEND Check Box
Direct Manipulation
Select Legend
Press DELETE
Tool
Press LEGEND Button

4. Modeling for Traditional HCI
Intention
Translate
Computer
Interpret
Physical World
Task
Interacting with Computers
Norman’s Action Cycle
Evaluation Stage
Execution Stage
GOMS Model
(Card, Moran & Newell, 1983)
Routine Task
Goals, Operators, Methods, and Selection Rules
Proved to be Useful Task Analysis Method
Action Sequences Determined by Task and Interface
Knowledge in the Head
Structure of Task: Hierarchical Goal Structure
Weak Interaction with Environment

5. Interacting with Information
Task: Satisfy Information Needs
Interaction Style
Directly Interacting with Information via Information Appliances/Internet Appliances
NOT Interacting with Applications on a Computer via Menu, Tools, etc.
Difference from Traditional HCI
Lots of New Information
Interpretation Varies Depending on User’s Goal and Background Knowledge
Physical Action Sequences Not Consistent
GOMS-like Modeling NOT Appropriate
I’d like to know more about Hodgkin’s disease at WebMD, a Medical Site

6. Comprehension is the Key
Traditional HCI
Translation of Intention to Physical Action, Requires Procedural Knowledge
Interpretation of the Consequence of Action in the Light of Intention, NOT Knowledge Intensive
Information-Centric HCI
Comprehension of Information Provided by the Interface, Requires Lots of Factual and Semantic Knowledge
Selecting Hyperlink Most Similar to the Current Goal, NOT Based on Predetermined Rules
Action is Trivial

7. Designing for Information-Centric HCI
Key to Success
USER: Adequate Comprehension of Information
DESIGN: Provision of Appropriate Information to EVERY User
Information for Navigation
Information about Contents
Design Challenges
Cope with Variability of Users Information Needs
Cope with Diversity of Users Background Knowledge
Importance of Model-Based Usability Evaluation

8. Comprehension-Based Models for Information-Centric HCI
Comprehension Process Modeled by Kintsch’s Construction-Integration Theory of Text Comprehension
Comprehension-Based Model of Performing by Exploration
LICAI, LInked model Comprehension-based Action planning and Instruction taking
Kitajima and Polson, 1997, Human-Computer Interaction
Non-Routine Task
Integration of Factual and Semantic Knowledge When Selecting Action
Little Information Change
Comprehension-Based Model of Web Navigation
CoLiDeS, Comprehension-based Linked model of Deliberate Search
Kitajima, Blackmon, and Polson, 2000, British HCI Conference
Large Information Change – Interacting with Information

9. Performing by Exploration
Task
Know the Subtasks
Communicate the Destination
Know Fair
Insert Coin
Retrieve the Change
Take the Ticket
Novel Labels
Familiar Controls
Buttons, Slot, …
Buy a Train Ticket in UK

10. Comprehension-Based Model Performing by Exploration
LICAI
LInked model of Comprehension-based Action planning and Instruction taking (Kitajima and Polson, 1997)
Three Processes
Goal Formation Process
Comprehends the task for the purpose of transforming it into workable subtasks
Goal Selection Process
Comprehends the interface to sequence the subtasks properly
Action Selection Process
Selects an object-action pair to execute, consisting of the following sub-processes;
Object Selection Process
Selection is Done Through Comprehension of the Display in the Light of the Goal, Using Massive Amount of Knowledge Retrieved from Long-Term Memory, NOT Applying Predetermined Rules

11. Web Navigation Task: Satisfy Information Needs
Ex)
Browse Books on Cognitive Science at Amazon.Com
Compare Digital Cameras at Points.Com
Obtain Diagnosis for Type Two Diabetes at WebMD.Com …
Novel Pages – More Dynamic
Familiar Controls
Hyperlinks, Buttons, …

12. Comprehension-Based Model Web Navigation
CoLiDeS
Comprehension-based Linked model of Deliberate Search (Kitajima, Blackmon and Polson, 2000)
Four Processes, Attention Process Added to the LICAI Model
Goal Formation Process
Goal Selection Process
Attention Process
Parse the page and focus-on one sub-region
Action Selection Process
Comprehend the selected sub-region and select link

13. Example
Goal: the user is planning to make a travel to Japan and wants to know about details of family tours.

14. Attend-to This Subregion
Example
Goal: the user is planning to make a travel to Japan and wants to know about details of family tours.
Parse the Page
Attend-to This Subregion
Comprehend and
Attend-to Subregion

15. Example Attend Here Parse the Attended-to Region Comprehend and
Goal: the user is planning to make a travel to Japan and wants to know about details of family tours.
Parse the
Attended-to Region
Comprehend and
Attend-to Subregion
Attend
Here

16. Example Select This Link Goal: [text] Parse the Attended-to Region
Goal: the user is planning to make a travel to Japan and wants to know about details of family tours.
Goal: [text]
Select This Link
Parse the
Attended-to Region
Comprehend and
Attend-to Subregion
Comprehend and
Select Link

17. Designing Usable Interface for Information Space
Goal Formation Stage
Comprehend the task in order to transform it into workable subtasks
Goal Selection Stage
Comprehend the interface to sequence the subtasks properly
Action Selection Stage
Comprehend the interface to attend to the right place
Comprehend the interface to select the right object
Comprehend the interface to select the right action

18. Designing Usable Interface for Information Space
Goal Formation Stage
Is the task representation appropriate for activating critical knowledge?
Goal Selection Stage
Is the interface representation appropriate for activating the right subgoal?
Action Selection Stage
Is the interface representation appropriate for activating critical knowledge for parsing the interface?
Is the interface representation of the object appropriate for activating knowledge necessary to relate it with the current subgoal?
Is the representation of the interface object appropriate for activating eligible action for the current subgoal?

19. Conclusions
Interaction with Computers vs. Interaction with Information Space
Comprehension is the Key Cognitive Skill
Users Have to Comprehend the Information on the Screen Appropriately to Accomplish the Goal
Designs Have to Provide Appropriate Information
Design Challenges
Diversity in user goals
Variability in user’s background knowledge
Comprehension-Based Models, LICAI and CoLiDeS
Design Suggestions Based on the Cognitive Models
Usability Evaluation Tool, Cognitive Walkthrough for the Web