Agent-Based Dialogue Management Discourse & Dialogue CMSC 35900-1 November 10, 2006.

Slides:



Advertisements
Similar presentations
Pat Langley Computational Learning Laboratory Center for the Study of Language and Information Stanford University, Stanford, California USA
Advertisements

Pat Langley Computational Learning Laboratory Center for the Study of Language and Information Stanford University, Stanford, California USA
Pat Langley School of Computing and Informatics Arizona State University Tempe, Arizona A Cognitive Architecture for Integrated.
Pat Langley Institute for the Study of Learning and Expertise Palo Alto, California A Cognitive Architecture for Complex Learning.
ARCHITECTURES FOR ARTIFICIAL INTELLIGENCE SYSTEMS
The Logic of Intelligence Pei Wang Department of Computer and Information Sciences Temple University.
Negotiative dialogue some definitions and ideas. Negotiation vs. acceptance Clark’s ladder: –1. A attends to B’s utterance –2. A percieves B’s utterance.
© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Building Fault Tolerant Voice User Interfaces SpeechTEK 2007 Tuesday, August 21 Track B “Getting.
Supporting Business Decisions Expert Systems. Expert system definition Possible working definition of an expert system: –“A computer system with a knowledge.
FLO Enhancement Program (FEP)
COLLAGEN: When Agents Collaborate with People Charles Rich and Candace L. Sidner Presented by Daniel Schulman.
Dialogue in Intelligent Tutoring Systems Dialogs on Dialogs Reading Group CMU, November 2002.
CPSC 322, Lecture 19Slide 1 Propositional Logic Intro, Syntax Computer Science cpsc322, Lecture 19 (Textbook Chpt ) February, 23, 2009.
I1-[OntoSpace] Ontologies for Spatial Communication John Bateman, Kerstin Fischer, Reinhard Moratz Scott Farrar, Thora Tenbrink.
Dialogue types GSLT course on dialogue systems spring 2002 Staffan Larsson.
U1, Speech in the interface:2. Dialogue Management1 Module u1: Speech in the Interface 2: Dialogue Management Jacques Terken HG room 2:40 tel. (247) 5254.
V.S. Subrahmanian University of Maryland 1 IMPACT: Future Directions (years 3 and 4)
CPSC 322 Introduction to Artificial Intelligence September 20, 2004.
Artificial Intelligence
A Glimpse on Some Dialogue Systems Arthur Chan. Introduction Questions to ponder:  What is a dialogue?  What is a dialogue system?  What are the issues.
Spoken Dialogue Technology How can Jerry Springer contribute to Computer Science Research Projects?
1RADAR – Scheduling Task © 2003 Carnegie Mellon University RADAR – Scheduling Task May 20, 2003 Manuela Veloso, Stephen Smith, Jaime Carbonell, Brett Browning,
Information, action and negotiation in dialogue systems Staffan Larsson Kings College, Jan 2001.
4-1 Chapter 4: PRACTICAL REASONING An Introduction to MultiAgent Systems
Ideas for Explainable AI
Collaboration Works, Inc. IEP Facilitation: Preventing and Effectively Engaging Conflict in Meetings October 5, 2007 Karen Hannan Collaboration Works,
Chapter 6: Objections to the Physical Symbol System Hypothesis.
Introduction (Chapter 1) CPSC 386 Artificial Intelligence Ellen Walker Hiram College.
Enhancing Student Mathematical Thinking through Conversation LISET GONZALEZ ACOSTA MANDY BREITENSTEIN.
Interactive Dialogue Systems Professor Diane Litman Computer Science Department & Learning Research and Development Center University of Pittsburgh Pittsburgh,
Knowledge representation
Author: James Allen, Nathanael Chambers, etc. By: Rex, Linger, Xiaoyi Nov. 23, 2009.
Theories of Discourse and Dialogue. Discourse Any set of connected sentences This set of sentences gives context to the discourse Some language phenomena.
© 2007 Tom Beckman Features:  Are autonomous software entities that act as a user’s assistant to perform discrete tasks, simplifying or completely automating.
1 PLAN RECOGNITION & USER INTERFACES Sony Jacob March 4 th, 2005.
Learning Science and Mathematics Concepts, Models, Representations and Talk Colleen Megowan.
Topics in Artificial Intelligence: Discourse and Dialogue CS 359 Gina-Anne Levow September 25, 2001.
1 USC INFORMATION SCIENCES INSTITUTE CALO, 8/8/03 Acquiring advice (that may use complex expressions) and action specifications Acquiring planning advice,
Dept. of Computer Science University of Rochester Rochester, NY By: James F. Allen, Donna K. Byron, Myroslava Dzikovska George Ferguson, Lucian Galescu,
Chapter 8 Object Design Reuse and Patterns. Object Design Object design is the process of adding details to the requirements analysis and making implementation.
Issues in Multiparty Dialogues Ronak Patel. Current Trend  Only two-party case (a person and a Dialog system  Multi party (more than two persons Ex.
Towards a Theoretical Framework for the Integration of Dialogue Models into Human-Agent Interaction John R. Lee Assistive Intelligence Inc. Andrew B. Williams.
Politeness & Speaking Style Discourse & Dialogue CS 359 November 15, 2001.
ENTERFACE 08 Project 1 “MultiParty Communication with a Tour Guide ECA” Mid-term presentation August 19th, 2008.
DenK and iCat Two Projects on Cooperative Electronic Assistants (CEA’s) Robbert-Jan Beun, Rogier van Eijk & Huub Prüst Department of Information and Computing.
1 Natural Language Processing Lecture Notes 14 Chapter 19.
Cognitive Processes Chapter 8. Studying CognitionLanguage UseVisual CognitionProblem Solving and ReasoningJudgment and Decision MakingRecapping Main Points.
Information state and dialogue management in the TRINDI Dialogue Move Engine Toolkit, Larsson and Traum 2000 D&QA Reading Group, Feb 20 th 2007 Genevieve.
Modeling Speech Acts and Joint Intentions in Modal Markov Logic Henry Kautz University of Washington.
Software Maintenance Speaker: Jerry Gao Ph.D. San Jose State University URL: Sept., 2001.
Distributed Models for Decision Support Jose Cuena & Sascha Ossowski Pesented by: Gal Moshitch & Rica Gonen.
Rational Agency CSMC Introduction to Artificial Intelligence January 8, 2007.
Rational Agency CSMC Introduction to Artificial Intelligence January 8, 2004.
A preliminary classification of dialogue genres Staffan Larsson Internkonferens 2003.
AAAI Fall Symposium on Mixed-Initiative Problem-Solving Assistants 1 Mixed-Initiative Dialogue Systems for Collaborative Problem-Solving George Ferguson.
ENTERFACE 08 Project #1 “ MultiParty Communication with a Tour Guide ECA” Final presentation August 29th, 2008.
RULES Patty Nordstrom Hien Nguyen. "Cognitive Skills are Realized by Production Rules"
Goteborg University Dialogue Systems Lab Comments on ”A Framework for Dialogue Act Specification” 4th Workshop on Multimodal Semantic Representation January.
Artificial Intelligence: Research and Collaborative Possibilities a presentation by: Dr. Ernest L. McDuffie, Assistant Professor Department of Computer.
Abdul Rahim Ahmad MITM 613 Intelligent System Chapter 10: Tools.
Artificial Intelligence
MERL 1 COLLAGEN: Applying Collaborative Discourse Theory to Human-Computer Interaction Charles Rich Candace L. Sidner Neal Lesh Mitsubishi Electric Research.
Intention & Cooperation Discourse and Dialogue CS 359 October 18, 2001.
Grounding and Repair Joe Tepperman CS 599 – Dialogue Modeling Fall 2005.
Andrew Garland, Neal Lesh, and Charles Rich Mitsubishi Electric Research Laboratories Responding to and Recovering from Mistakes during Collaboration.
COMMUNICATION OF MEANING
Integrating Learning of Dialog Strategies and Semantic Parsing
SECOND LANGUAGE LISTENING Comprehension: Process and Pedagogy
Communicative Resources
Mike Anderson, Darsana P. Josyula, Don Perlis
Presentation transcript:

Agent-Based Dialogue Management Discourse & Dialogue CMSC November 10, 2006

Possible Projects Alternatives: –Implementation with short write-up –Analysis with longer write-up (max 15p) Topics: Use toolkit to implement components of SLS Implement/Extend a pronoun resolution algorithm Identify phenomena not covered by theory & extend –E.g. Dialogue type functions in RST –Zero-anaphora in pronoun resolution Analysis: –Compare reference behavior in chats/IM to other –Turn-taking in CallHome vs Switchboard

Roadmap Agent-based Dialogue Management –Dialogue by Theorem Proving –Dialogue by Planning –Dialogue by Conversational Agency –Event-Driven Dialogue –Dialogue by Rational Interaction Advantages and Disadvantages

Agent-Based Dialogue Contrasts with State- and Frame- Based –Structurally constrained –Simplified, activity based semantics Agent-based dialogue management –Employs AI planning or reasoning processes –More full linguistic interpretation –More complex model of interaction, belief –Wide variety of models, reasoning

Dialogue by Theorem Proving Exemplar: Circuit Fix-it-Shop (Smith) –Interaction between student and expert (S) –Debugging a fault in a circuit Dynamically develops solution –Based on state and user knowledge Theorem prover determines task completion –Dialogue used to acquire missing axioms

Theorem Proving in Dialogue Example: system needs to know if there is a wire b/t connectors 84 and 99 –goal(c,learn,..(prop(84,99),exist,X),true))) –“missing” axiom about wire present yes/no –Use language to ask user, and ask to add –Answers, then asks for help Adds new subgoal to teach user Integrates problem-solving, theorem proving, and dialogue

Dialogue by Planning Integrate utterances with plan actions –Interpret intention behind utt, how achieve goal –Utterance=speech act, same structure as plan op –Example: ConvincebyInform –Constraints: Agent(Spkr),Agent(Hear),Prop(prop),Bel(Spkr,prop) –Preconditions: At(Spkr,Loc(hear)) –Effects: Bel(Hear,prop) Buying ticket, requires agent using CBI to tell price

Dialogue by Planning Issues: –Intention inference error-prone, cascading –Planning AI & NP-complete in general case Strategies: –Differentiate domain plans and discourse plans Train routing vs clarification subdialogues –Later approaches revise

Conversational Agency Multi-agent planning system –Exemplar: TRAINS (Allen et al) Collaborative, incremental: –System: Low-level route planning, track info –User: High-level goals, can relax constraints if needed –Mixed-initiative planning: Plan generation under constraints; criticism & revision –System as full-fledged agent in conversation Utts are speech acts, interp user, maintain models

Discourse Obligations Prior work: “co-operativeness” –Interpret utt to determine speaker goals –System adopts goals as own Trains: –Distinguish intentions and obligations of conv –Obligations represent what agent should do E.g. if promise(A), generate obligation to achieve A –If S1 requests A, S2 should accept or reject –If utt not understood or wrong, should repair/correct, etc

Discourse Actor Algorithm Act on any obligations before doing own goals If user doesn’t take lead, system will take initiative While conversation not finished If system has obligations then address obligations else if system has turn then if system has intended conv. Acts then call NL generator else if some material is ungrounded then do grounding else if some proposal not accepted then consider proposals else if high-level goals unsatisfied then address goals else release turn to try to end conv else if no one has turn then take turn else if long pause then take turn

Event-driven Dialogue Extension of frame-based approaches –Doesn’t model or recognize user intention –Models system state, intentions –Uses more complex representation of context to perform semantic interp of user utt Modular approach: dialogue, task, belief –Based on current belief/task state, select dialogue options: e.g. confirmations, requests

Contextual Interpretation Interpretation of utt generates contextual functions E.g. new_for_system(X): confirm(X) or spec(X,Y) repeated_by_user(X): cancel “confirm(X)” Inferred_by_system(X): goal confirm(X) Modified_by_user(X): goal repair confirm(X) Negated_by_user(X): repair(X) Combine goals with initiating actions Include meta-strategy of increasing system control when need repair

Rational Interaction