1/16 Design of Intelligent Human Interface - Brief Summary of Research Activities - Yasufumi Takama Tokyo Institute of Technology （ Currently: Tokyo Metropolitan Institute of Technology) PREST, Japan Science and Technology Corporation

2/16 Characteristics of VSA Multi-modal Interface Face-to-face interaction & speech dialog Connected with WWW browser Suitable for users with little knowledge of computers Applicable to facility guidance systems Dialog management system (DMS) with learning module Acquisition of cooperative answering strategy VSA 1

3/16 DMS with Learning Module Cooperative answer depends on both user ’ s knowledge & system ’ s location E.g. “ Where is the library? ” Tell the way from system ’ s location to the library Use the landmark that user seems to know 2 types of knowledge acquisition Overlay-type user-model to estimate the knowledge state of the present user Reinforcement learning to acquire location- specific appropriate rules VSA 2

4/16 Reading documents Making diagrams Retrieving new documents Viewpoint-based support by Fisheye Matching Viewpoint extraction Viewpoint information feature generation Users’ Activity Document Ordering while Reading is an Effective Way of Dealing with Vast Collection of Documents FISH VIEW 1

5/16 From medical news Extracted Concepts as Viewpoints IDHeading InformationWords (stemmed) 3f98b3value of healthdiseas,sickne,health,etc component of living bodyprotei,immuno,choles,dna 30f6dainternal organseye,heart,lung,knee,etc. 3f969ediseasesyndro,aids,cancer,cold,etc cmedical suppliesdrug,medici,laxati,acid,etc. 30f6f7medical instrumentsbandag,cathet,glasse,etc. From cinema reviews Categories of action, SF, monster, etc. FISH VIEW 2

6/16 Clustering-based visualization applied to WWW-IR Categorization (static, i.e. user independent) Naive clustering (one-shot, i.e. no inheritance) K-means, STC, etc. Query Network: Plastic Clustering for Visualization Plastic clustering (gradual formation through a series of IR) Query Network 1

7/16 Analogy to Immune Network Antibodies generated for antigens Activated antibody can be sensitive to next invasion Various antibodies in plastic structure Clusters generated for retrieved documents Effective cluster can be reused for subsequent retrieval Various clusters in plastic structure Activation value calculation based on differential equation of mathematical biology Query Network 2