Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.

Slides:

Advertisements

Similar presentations

Key architectural details RavenClaw: Dialog Management Using Hierarchical Task Decomposition and an Expectation Agenda Dan BohusAlex Rudnicky School of.

Advertisements

Non-Native Users in the Let s Go!! Spoken Dialogue System: Dealing with Linguistic Mismatch Antoine Raux & Maxine Eskenazi Language Technologies Institute.

Developing Spoken Dialogue Systems in the Communicator / RavenClaw Framework Sphinx Lunch Talk Carnegie Mellon University, October 2004 Presented by:Dan.

Good Morning! How many times have you tried to get ahold of someone and failed?How many times have you tried to get ahold of someone and failed? Need to.

Manuela Veloso, Anthony Stentz, Alexander Rudnicky Brett Browning, M. Bernardine Dias Faculty Thomas Harris, Brenna Argall, Gil Jones Satanjeev Banerjee.

1 Team Talk – A Report. 2 Introduction Project done as part of , Spring ’03. Design and implementation of a spoken dialog system. Thrust of project:

H E L S I N K I U N I V E R S I T Y O F T E C H N O L O G Y G O p r o j e c t : S e r v i c e A r c h i t e c t u r e f o r t h e N o m a d i c I n t e.

Error Handling in the RavenClaw Dialog Management Framework Dan Bohus, Alexander I. Rudnicky Computer Science Department, Carnegie Mellon University (

Building a SOA roadmap for your enterprise Presented by Sanjeev Batta Architect, Cayzen Technologies.

Workflow Automation 1.1 feature overview

MCTS GUIDE TO MICROSOFT WINDOWS 7 Chapter 10 Performance Tuning.

(Spoken) Dialogue and Information Retrieval Antoine Raux Dialogs on Dialogs Group 10/24/2003.

Heterogeneous Multi-Robot Dialogues for Search Tasks Thomas K Harris, Satanjeev (Bano) Banerjee Alexander Rudnicky AAAI Spring Symposium 2005: Dialogical.

Building Enterprise Applications Using Visual Studio ®.NET Enterprise Architect.

LECTURE 7 SEP 27, 2010 Building computational pipelines.

RavenClaw Yet another (please read “An improved”) dialog management architecture for task-oriented spoken dialog systems Presented by: Dan Bohus

Copyright © 2004, GemStone Systems Inc. All Rights Reserved. A Capstone with GemStone David Whitlock October 25, 2004.

Multiple-Agent Dialogue Thomas K Harris, Satanjeev (Bano) Banerjee Alex Rudnicky Boeing Kick-off Meeting June 8, 2004.

Spoken Dialog Management for an Astronaut’s Procedure Assistant Presented by: Dan Bohus Collaborators: Gregory Aist, RIALIST Group.

Revising Riverbot Outline and Specifications Christian Skalka.

MITRE Dialog Management Workshop – a review Dan Bohus Dialogs on Dialogs reading group CMU, November 2003.

Communication and the Team. Communication Issues A common problem with most development projects are communication issues These can be present in a number.

RavenClaw An improved dialog management architecture for task-oriented spoken dialog systems Presented by: Dan Bohus Work by: Dan Bohus,

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle SQL Developer What’s New in Version 4.1 Jeff Smith

Goteborg University Dialogue Systems Lab GoDiS and TrindiKit MITRE workshop 27/10-03 Staffan Larsson Göteborg University Sweden.

Sports Scores Speech Recognition System Major League Baseball Score System.

The Basic Tools Presented by: Robert E., & Jonathan Chase.

The Modular Structure of Complex Systems D.L. Parnas, P.C. Clement, and D.M. Weiss Published in IEEE Transactions on Software Engineering, March 1985 Presented.

SOA & BPM Business Architecture, SOA & BPM Learn about SOA and Business Process Management (BPM) Learn how to build process diagrams.

31 st October, 2012 CSE-435 Tashwin Kaur Khurana.

Separating VUI from business logic Caller Experience-centered design approach Alex Kurganov, CTO Parus Interactive

©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 18 Slide 1 Software Reuse.

1 Design and Integration: Part 1 Nuggets about Design vs Project Management.

Advances in Technology and CRIS Nikos Houssos National Documentation Centre / National Hellenic Research Foundation, Greece euroCRIS Task Group Leader.

What’s new in agenTel 6.2 December 2009 The Voxtron Factory.

MCTS Guide to Microsoft Windows 7

COMP 523 DIANE POZEFSKY 20 August AGENDA Introductions Logistics Software Engineering Overview Selecting a project Working with a client.

Artificial Intelligence: Prospects for the 21 st Century Henry Kautz Department of Computer Science University of Rochester.

Chapter 7. BEAT: the Behavior Expression Animation Toolkit

By Touseef Tahir Software Testing Basics. Today's Agenda Software Quality assurance Software Testing Software Test cases Software Test Plans Software.

Lecture # 6 Forms, Widgets and Event Handling. Today Questions: From notes/reading/life? Share Personal Web Page (if not too personal) 1.Introduce: How.

Faculty: Manuela Veloso, Anthony Stentz, Alex Rudnicky Brett Browning, M. Bernardine Dias Students: Thomas Harris, Brenna Argall, Gil Jones Satanjeev Banerjee.

Adaptive Spoken Dialogue Systems & Computational Linguistics Diane J. Litman Dept. of Computer Science & Learning Research and Development Center University.

Technical Workshops | Esri International User Conference San Diego, California Creating Geoprocessing Services Kevin Hibma, Scott Murray July 25, 2012.

1 Geospatial and Business Intelligence Jean-Sébastien Turcotte Executive VP San Francisco - April 2007 Streamlining web mapping applications.

Sports Scores Speech Recognition System Major League Baseball Score System.

L9 - April 5, 2006copyright Thomas Pole , all rights reserved 1 Lecture 9: Reuse Driven Processes and Text Ch. 7: Programming with Models.

Data Structures for Programmers Vamshi Ambati

Tutoring & Help System CSE-435 Nicolas Frantzen CSE-435 Nicolas Frantzen.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

1 Design and Integration: Part 2. 2 Plus Delta Feedback Reading and lecture repeat Ambiguous questions on quizzes Attendance quizzes Boring white lecture.

STAKEHOLDER MEETING Selecting Interventions to Improve Utilization of the IUD City, Country Date Insert MOH logoInsert Project logoInsert USAID logo (Note:

DIALOG SYSTEMS FOR AUTOMOTIVE ENVIRONMENTS Presenter: Joseph Picone Inst. for Signal and Info. Processing Dept. Electrical and Computer Eng. Mississippi.

Software Maintenance Speaker: Jerry Gao Ph.D. San Jose State University URL: Sept., 2001.

Architecture View Models A model is a complete, simplified description of a system from a particular perspective or viewpoint. There is no single view.

1 Galatea: Open-Source Software for Developing Anthropomorphic Spoken Dialog Agents S. Kawamoto, et al. October 27, 2004.

Instructional Leadership Planning with Indicators of Quality Instruction.

Chapter 3 JSP Overview. The Problem with Servlets processing the request and generating the response are both handled by a single servlet class Java programming.

Comprehension Language: Creating and Using Sensory Images: K-1 Modeled I can almost (see, feel, taste, hear) it in my mind…because the illustrator shows.

Presented by Syed Baber Development Lead Mazik Global.

1 Automating Network Diagnostics to Help End-Users Dave Thaler

Deductive Techniques for synthesis from Inductive Specifications Dagstuhl Seminar Oct 2015 Sumit Gulwani.

Jython Environment For Students (JES) Final Presentation Team 3 David Raines Claire Bailey Jason Ergle Josh Sklare July 16,

Making Accessibility a Distributed Responsibility Presenters: Brent Bakken, Chelsea Seeley, Clare Rose, Holly Woodruff, and Corey Fauble 09 May 2016.

Applied Software Project Management SOFTWARE TESTING Applied Software Project Management 1.

Microsoft Cloud Adoption Framework Workshop

Sphinx Lunch Talk Carnegie Mellon University, October 2004

XML Based Interoperability Components

IDE and Visualisation of Abstract Syntax Trees for Coco/R

Joys and Pains of building a Dialog System

Presentation transcript:

Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Overall Architecture Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Recognition SPHINX Synthesis FESTIVAL

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Overall Architecture (internals) Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA HUB FESTIVAL SERVER Recognition SPHINX Synthesis FESTIVAL Galaxy

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Overall Architecture Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Recognition SPHINX Synthesis FESTIVAL

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Overall Architecture Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Text I/O TTYServer Recognition SPHINX Synthesis FESTIVAL

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Developed Resources Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Text I/O TTYServer Grammar Templates RavenClaw Dialog Task Specification Back-end (perl)

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Development Time Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Text I/O TTYServer Grammar Templates RavenClaw Dialog Task Specification Back-end (perl) Total: 21:15h

Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture  Captures all domain-specific dialog (task) logic with a hierarchical description  The authoring effort is focused entirely here Dialog Task (Specification) Domain-independent Dialog Engine  Manages dialog by executing the dialog task specification  Provides domain-independent conversational strategies

Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome Expectation Agenda general_feeling chart have_fever diagnostic

Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome Expectation Agenda general_feeling chart have_fever diagnostic

Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Welcome Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome Expectation Agenda general_feeling chart have_fever diagnostic

Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Hi, this is Madeleine, the automated… Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome Expectation Agenda general_feeling chart have_fever diagnostic

Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Hi, this is Madeleine, the automated… Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome LoadSymptoms R:HeadacheR: Expectation Agenda general_feeling chart have_fever diagnostic headache

Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Hi, this is Madeleine, the automated… Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome R:HeadacheR: Expectation Agenda general_feeling chart have_fever diagnostic headache

Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Hi, this is Madeleine, the automated… Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome R:HeadacheR: GeneralFeel Expectation Agenda general_feeling chart have_fever diagnostic headache

Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Hi, this is Madeleine, the automated… Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome R:HeadacheR: GeneralFeel How are you feeling today? general_feeling chart have_fever diagnostic HowAreYou Expectation Agenda general_feeling: [good], [bad], [soso] GeneralFeel I:GladI:Sorry Not so good, I think I have a fever [soso](not so good) [fever](I think I have a fever) headache GeneralFeel

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Illustrated Features  Dynamic generation of dialog task structure  Symptoms loaded from backend, appropriate structures to “talk about them” created on-the-fly  New symptoms – no DM changes  Dynamic dialog control policy  The order in which symptoms are addressed is controlled by the backend  Conversational skills

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Illustrated Features  Dynamic generation of dialog task structure  Symptoms loaded from backend, appropriate structures to “talk about them” created on-the-fly  New symptoms – no DM changes  Dynamic dialog control policy  The order in which symptoms are addressed is controlled by the backend  Conversational skills

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Dynamic Dialog Control … Dialog Stack Madeleine Hi, this is Madeleine, the automated… How are you today? Not so good, I think I have a headache Sorry to hear you’re not feeling so good, Tell me more about your symptoms… Do you have abdominal pain? Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome R:HeadacheR: Diagnose Expectation Agenda general_feeling chart have_fever diagnostic headache Backend Decision Tree

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Illustrated Features  Dynamic generation of dialog task structure  Symptoms loaded from backend, appropriate structures to “talk about them” created on-the-fly  New symptoms – no DM changes  Dynamic dialog control policy  The order in which symptoms are addressed is controlled by the backend  Conversational skills

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Conversational Skills  Corresponding agencies added automatically to the dialog task tree  Help  What Can I Say?  Repeat  Suspend / Resume  Start Over  Timeout handling (not illustrated)  Still need all the language generation prompts and grammar, but some of those are develop-once, too

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Conclusion  Highlights  Set task posed no challenges to the framework Easy to implement  Dynamic dialog structure and control  Automatic use of domain-independent conversational skills  Lowlights?  Toolkit perspective: how easy would it be for someone else to build it?  Asynchronous behaviors? (timing)  Couple of bugs / fixes (or is that a highlight?)  …

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Demo Run

Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Grounding Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome R:HeadacheR: general_feeling chart have_fever diagnostic headache Grounding Engine State Indicators Strategies

Madeleine: a RavenClaw exercise in the medical diagnosis domain… Other RavenClaw systems  LARRI – Language Assistant for Retrieval of Repair Information  RoomLine – Conference room reservation within SCS  Let’s Go! (BusLine) – Bus schedule information in Pittsburgh  TeamTalk – Command and control for a team of robots  Eureka – Dialog interface to a clustered web search engine (Vivisimo)