Towards a Theoretical Framework for the Integration of Dialogue Models into Human-Agent Interaction John R. Lee Assistive Intelligence Inc. Andrew B. Williams.

Slides:



Advertisements
Similar presentations
Technical and design issues in implementation Dr. Mohamed Ally Director and Professor Centre for Distance Education Athabasca University Canada New Zealand.
Advertisements

The 20th International Conference on Software Engineering and Knowledge Engineering (SEKE2008) Department of Electrical and Computer Engineering
ARCHITECTURES FOR ARTIFICIAL INTELLIGENCE SYSTEMS
Workpackage 2: Norms
1 Intention of slide set Inform WSMOLX of what is planned for Choreography & Orhestration in DIP CONTENTS Terminology Clarification / what will be described.
Probabilistic Adaptive Real-Time Learning And Natural Conversational Engine Seventh Framework Programme FP7-ICT
Argumentation-based negotiation Rahwan, Ramchurn, Jennings, McBurney, Parsons and Sonenberg, 2004 Presented by Jean-Paul Calbimonte.
Professional Communications
INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING NLP-AI IIIT-Hyderabad CIIL, Mysore ICON DECEMBER, 2003.
OASIS Reference Model for Service Oriented Architecture 1.0
© Tefko Saracevic, Rutgers University1 Interaction in information retrieval There is MUCH more to searching than knowing computers, networks & commands,
Knowledge Acquisitioning. Definition The transfer and transformation of potential problem solving expertise from some knowledge source to a program.
Multiagent Systems and Societies of Agents
1 Learning from Behavior Performances vs Abstract Behavior Descriptions Tolga Konik University of Michigan.
Requirements Analysis Concepts & Principles
HAS. Patterns The use of patterns is essentially the reuse of well established good ideas. A pattern is a named well understood good solution to a common.
© 2006 Pearson Addison-Wesley. All rights reserved2-1 Chapter 2 Principles of Programming & Software Engineering.
1 IUT de Montreuil Université Paris 8 Emotion in Interaction: Embodied Conversational Agents Catherine Pelachaud.
Semantic Web Technologies Lecture # 2 Faculty of Computer Science, IBA.
Knowledge Mediation in the WWW based on Labelled DAGs with Attached Constraints Jutta Eusterbrock WebTechnology GmbH.
Effective Communication
Communication Degree Program Outcomes
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Model View Controller (MVC) Rick Mercer with a wide variety of others 1.
Recognition of meeting actions using information obtained from different modalities Natasa Jovanovic TKI University of Twente.
SLB /04/07 Thinking and Communicating “The Spiritual Life is Thinking!” (R.B. Thieme, Jr.)
Lecture 9: Chapter 9 Architectural Design
1 PLAN RECOGNITION & USER INTERFACES Sony Jacob March 4 th, 2005.
Argumentation and Trust: Issues and New Challenges Jamal Bentahar Concordia University (Montreal, Canada) University of Namur, Belgium, June 26, 2007.
CONSTRUCTIVISM & CONTINUOUS COMPREHENSIVE EVALUATION
K. J. O’Hara AMRS: Behavior Recognition and Opponent Modeling Oct Behavior Recognition and Opponent Modeling in Autonomous Multi-Robot Systems.
EEL 5937 Agent communication EEL 5937 Multi Agent Systems Lecture 10, Feb. 6, 2003 Lotzi Bölöni.
© DATAMAT S.p.A. – Giuseppe Avellino, Stefano Beco, Barbara Cantalupo, Andrea Cavallini A Semantic Workflow Authoring Tool for Programming Grids.
Towards multimodal meaning representation Harry Bunt & Laurent Romary LREC Workshop on standards for language resources Las Palmas, May 2002.
ARTIFICIAL INTELLIGENCE [INTELLIGENT AGENTS PARADIGM] Professor Janis Grundspenkis Riga Technical University Faculty of Computer Science and Information.
Ocean Observatories Initiative Data Management (DM) Subsystem Overview Michael Meisinger September 29, 2009.
An Ontological Framework for Web Service Processes By Claus Pahl and Ronan Barrett.
Issues in Multiparty Dialogues Ronak Patel. Current Trend  Only two-party case (a person and a Dialog system  Multi party (more than two persons Ex.
A Context Model based on Ontological Languages: a Proposal for Information Visualization School of Informatics Castilla-La Mancha University Ramón Hervás.
Service Service metadata what Service is who responsible for service constraints service creation service maintenance service deployment rules rules processing.
1 1. Representing and Parameterizing Agent Behaviors Jan Allbeck and Norm Badler 연세대학교 컴퓨터과학과 로봇 공학 특강 학기 유 지 오.
ES component and structure Dr. Ahmed Elfaig The production system or rule-based system has three main component and subcomponents shown in Figure 1. 1.Knowledge.
Information state and dialogue management in the TRINDI Dialogue Move Engine Toolkit, Larsson and Traum 2000 D&QA Reading Group, Feb 20 th 2007 Genevieve.
A Quantitative Trust Model for Negotiating Agents A Quantitative Trust Model for Negotiating Agents Jamal Bentahar, John Jules Ch. Meyer Concordia University.
International Workshop Jan 21– 24, 2012 Jacksonville, Fl USA Model-based Systems Engineering (MBSE) Initiative Slides by Henson Graves Presented by Matthew.
1 Chapter 8 Building the Analysis Model (1) Analysis Concepts and Principles.
EEL 5937 Agent communication EEL 5937 Multi Agent Systems Lotzi Bölöni.
A Mediated Approach towards Web Service Choreography Michael Stollberg, Dumitru Roman, Juan Miguel Gomez DERI – Digital Enterprise Research Institute
A Resource Discovery Service for the Library of Texas Requirements, Architecture, and Interoperability Testing William E. Moen, Ph.D. Principal Investigator.
AAAI Fall Symposium on Mixed-Initiative Problem-Solving Assistants 1 Mixed-Initiative Dialogue Systems for Collaborative Problem-Solving George Ferguson.
“Intelligent User Interfaces” by Hefley and Murray.
MERL 1 COLLAGEN: Applying Collaborative Discourse Theory to Human-Computer Interaction Charles Rich Candace L. Sidner Neal Lesh Mitsubishi Electric Research.
EEL 5937 Content languages EEL 5937 Multi Agent Systems Lecture 10, Feb. 6, 2003 Lotzi Bölöni.
Understanding Naturally Conveyed Explanations of Device Behavior Michael Oltmans and Randall Davis MIT Artificial Intelligence Lab.
A Speech Interface to Virtual Environment Authors Scott McGlashan and Tomas Axling Swedish Institute of Computer Science.
Software Architecture for Multimodal Interactive Systems : Voice-enabled Graphical Notebook.
 Copyright 2005 Digital Enterprise Research Institute. All rights reserved. SOA-RM Overview and relation with SEE Adrian Mocan
Agent-Based Dialogue Management Discourse & Dialogue CMSC November 10, 2006.
Principles of Communication
Mechanisms for Requirements Driven Component Selection and Design Automation 최경석.
Service-Oriented Computing: Semantics, Processes, Agents
OPM/S: Semantic Engineering of Web Services
Thrust IC: Action Selection in Joint-Human-Robot Teams
Agent Based Learning Systems
Service-Oriented Computing: Semantics, Processes, Agents
Professional Communications
Service-Oriented Computing: Semantics, Processes, Agents
Social Abstractions for Information agents
UML Design for an Automated Registration System
Presentation transcript:

Towards a Theoretical Framework for the Integration of Dialogue Models into Human-Agent Interaction John R. Lee Assistive Intelligence Inc. Andrew B. Williams Spelman College

Motivation How should an intelligent agent incorporate communication? How does communication and behavior integrate within an agent model? How can ideas from many different dialogue models and conversation examples by incorporated? How can one validate the correctness of an agent conversational model?

Motivation Negotiation Persuasion Formal Argumentation Informal Argumentation Integrated Model Cooperative Planning Belief Grounding

Dialogue Agent Paradigm Embedded dialogue manager –Perception processing Embedded behavior model DIALOGUE CAPABLE AGENT ActionsPercepts Dialogue Manager Behavioral Model Conversation Internal API or Language

Goal A unified conversational architecture for intelligent agents and assistants –Representation of communication –Incorporation of communication within behavior –Incorporating a variety of models and ideas into a single integrated model –Validation of the conversational model –Independent of dialogue interpreter or agent

Focus CommunicationBehavior Agent Implementation Bring behavior to communication as much as possible

Focus CommunicationBehavior Agent Implementation Separate dialogue interpreter from agent –Parallel development of each –Interchangeable components

Human Interpreter

The Practical Communication Language (PCL) Hypothesis There exists a language between that of a human conversational participant and that of an intelligent agent. This language is capable of abstracting away the complexity of human language while yet maintaining the practical information of the conversation. Adding toThe Practical Dialogue Hypothesis and The Domain-independence Hypothesis stated in Allen 2000.

Current Utterance-Based Languages Application Programmer Interfaces (API) –Task Management Interface Specialized Languages –Artificial Discourse Language –Universal Communication Language (Interlingua) –Parameterized Action Representation Discourse and Speech Act Tags Agent Communication Languages –Foundation for Intelligent Physical Agents (FIPA-ACL) –Knowledge Query Manipulation Language (KQML)

Searching for the language… True PCL is ideal and volatile Ever expanding definition of ‘practical’ PCL should be abstracted * of 1.Region and dialect aspects of language. 2.Informal, Colloquial, Slang and Idiomatic expressions. 3.Modality (Spoken, Written, Gestural, GUI) *Translated or Incorporated not discarded.

Approach Task Communication Language (TCL) –Messages to/from Dialogue Interpreter Task Model Task Communication Model Interaction Model TCL Message –Set of integrated models

TCL Messages Header –Generator: Generated utterance or gesture –Addressee: Intended Receivers of message –Receiver: Participants who saw or heard –Uncertainty in all above fields –Interpretation Stack Information obtained at al levels of translation –Used by feedback mechanism for improving interpreters –Content Meaning-Action Concept

Conversational Paradigms HumanAgent Human Observation Manager / Assistant Teacher / Student Coach / Player Peer / Peer Agent Agent Communication Semantic Web

Conversational Paradigms Single AgentMultiple Agent Single Human Current Trend Simulation and Training Consumer Products Multiple Human Mediator Discussion Leader Team Coordinator Referee Semantic Web Marketplaces Teamwork

Conversational Paradigms Not just endpoint to endpoint Multiple segmentations –A conversation between people listening in on another conversation

Meaning-Action Concept Meaning of utterance or gesture Possible association with action. “propose( action: )” “propose( goal: )” “reject( goal: )” “counter-propose( action: )” “query( justification( action: ) )”

Meaning-Action Concepts (MAC) Defined in ontological format –Allows for rollback to known concepts –Manageable growth of concept space Proposal( ) Counter-Proposal( ) Commit( ) Commit( confidence:30 )

Task Communication Expression First-order logic expression of MAC. –Conjunction: Multiple Meanings –Disjunction: Ambiguity –Expressiveness and complexity

Focus CommunicationBehavior

Task Model Task Concepts: Objectives Recipes Actions Resources Situations States Constraints Beliefs Intentions Metrics Priorities

Task Model Task Operations: Adoption Selection Deferment Abandonment Release Identification Evaluation Modification

Task Model CommunicationBehavior Task Model

Task-Communication Model Integrate the task concepts and operators –Communication with a dialgue interpreter –Task manipulation of an intelligent agent Modeling can be language independent –CFSM, CPetriNet, Inference-Based, BDI...

Task-Communication Model Nested task operators Lower layers: –Persuasion, inquiry, deliberation, formal argumentation, informal argumentation, clarification, explanation… Higher layers: –Negotiation, cooperative planning, learning through orders, command and control…

Task-Communication Model CommunicationBehavior Task Model Task-Communication Model

Trivial Example: Communicative acts –TCL Messages Behavioral acts –Agent integration [IN]: Propose( Action A ) Evaluate( Action A ) [OUT]: Reject( Action A ) [OUT]: Accept( Action A )

Integration Model Generated automatically through tracing the Task-Communication Model Represents incoming and outgoing message sequences and possibilities

Task-Communication Model [IN]: Propose( Action A ) Evaluate( Action A ) [OUT]: Reject( Action A ) [OUT]: Accept( Action A )

Interaction Model Extraction of Input-Output Sequences [IN]: Propose( Action A )[OUT]: Accept( Action A ) [OUT]: Reject( Action A ) [OUT]: Refine( Action A ) [OUT]: Clarify( Goal G ) [OUT]: Counter( Action A )

Interaction Model CommunicationBehavior Task Model Interaction Model Task-Communication Model

Interaction Model Validated with known TCL sequences –If sequence is covered, path validated –If sequence is missing, update model Assists in integration of models Prove various properties –Turn Taking –Liveness –Sanity checks

Mixed-Initiative Control No longer in hands of dialogue interpreter –Also managed by ‘task communication model’ Task-communication model must –Initiate dialogue sequences –Manage turn-taking context tracking autonomy

Stratagus Open source real-time strategy engine –Multiple data sets for varying games Dynamically changing environment Real time resource management

Discussion