Presentation is loading. Please wait.

Presentation is loading. Please wait.

Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.

Published by Modified over 9 years ago

Similar presentations

Presentation on theme: "Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003."— Presentation transcript:

1 Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003

2 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Overall Architecture Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Recognition SPHINX Synthesis FESTIVAL

3 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Overall Architecture (internals) Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA HUB FESTIVAL SERVER Recognition SPHINX Synthesis FESTIVAL Galaxy

4 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Overall Architecture Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Recognition SPHINX Synthesis FESTIVAL

5 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Overall Architecture Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Text I/O TTYServer Recognition SPHINX Synthesis FESTIVAL

6 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Developed Resources Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Text I/O TTYServer Grammar Templates RavenClaw Dialog Task Specification Back-end (perl)

7 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Development Time Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Text I/O TTYServer Grammar Templates RavenClaw Dialog Task Specification Back-end (perl) Total: 21:15h

8 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture  Captures all domain-specific dialog (task) logic with a hierarchical description  The authoring effort is focused entirely here Dialog Task (Specification) Domain-independent Dialog Engine  Manages dialog by executing the dialog task specification  Provides domain-independent conversational strategies

9 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome Expectation Agenda general_feeling chart have_fever diagnostic

10 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome Expectation Agenda general_feeling chart have_fever diagnostic

11 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Welcome Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome Expectation Agenda general_feeling chart have_fever diagnostic

12 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Hi, this is Madeleine, the automated… Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome Expectation Agenda general_feeling chart have_fever diagnostic

13 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Hi, this is Madeleine, the automated… Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome LoadSymptoms R:HeadacheR: Expectation Agenda general_feeling chart have_fever diagnostic headache

14 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Hi, this is Madeleine, the automated… Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome R:HeadacheR: Expectation Agenda general_feeling chart have_fever diagnostic headache

15 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Hi, this is Madeleine, the automated… Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome R:HeadacheR: GeneralFeel Expectation Agenda general_feeling chart have_fever diagnostic headache

16 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Architecture Dialog Stack Madeleine Hi, this is Madeleine, the automated… Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome R:HeadacheR: GeneralFeel How are you feeling today? general_feeling chart have_fever diagnostic HowAreYou Expectation Agenda general_feeling: [good], [bad], [soso] GeneralFeel I:GladI:Sorry Not so good, I think I have a fever [soso](not so good) [fever](I think I have a fever) headache GeneralFeel

17 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Illustrated Features  Dynamic generation of dialog task structure  Symptoms loaded from backend, appropriate structures to “talk about them” created on-the-fly  New symptoms – no DM changes  Dynamic dialog control policy  The order in which symptoms are addressed is controlled by the backend  Conversational skills

18 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Illustrated Features  Dynamic generation of dialog task structure  Symptoms loaded from backend, appropriate structures to “talk about them” created on-the-fly  New symptoms – no DM changes  Dynamic dialog control policy  The order in which symptoms are addressed is controlled by the backend  Conversational skills

19 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Dynamic Dialog Control … Dialog Stack Madeleine Hi, this is Madeleine, the automated… How are you today? Not so good, I think I have a headache Sorry to hear you’re not feeling so good, Tell me more about your symptoms… Do you have abdominal pain? Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome R:HeadacheR: Diagnose Expectation Agenda general_feeling chart have_fever diagnostic headache Backend Decision Tree

20 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Illustrated Features  Dynamic generation of dialog task structure  Symptoms loaded from backend, appropriate structures to “talk about them” created on-the-fly  New symptoms – no DM changes  Dynamic dialog control policy  The order in which symptoms are addressed is controlled by the backend  Conversational skills

21 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Conversational Skills  Corresponding agencies added automatically to the dialog task tree  Help  What Can I Say?  Repeat  Suspend / Resume  Start Over  Timeout handling (not illustrated)  Still need all the language generation prompts and grammar, but some of those are develop-once, too

22 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Conclusion  Highlights  Set task posed no challenges to the framework Easy to implement  Dynamic dialog structure and control  Automatic use of domain-independent conversational skills  Lowlights?  Toolkit perspective: how easy would it be for someone else to build it?  Asynchronous behaviors? (timing)  Couple of bugs / fixes (or is that a highlight?)  …

23 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Demo Run

24 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… RavenClaw Grounding Madeleine E:LoadSymptomsGeneralFeel R:HowAreYou?I:GladI:Sorry Diagnose FeverTravel R:AskFeverE:MeasureTempI:InformFever I:Welcome R:HeadacheR: general_feeling chart have_fever diagnostic headache Grounding Engine State Indicators Strategies

25 10-127-2003Madeleine: a RavenClaw exercise in the medical diagnosis domain… Other RavenClaw systems  LARRI – Language Assistant for Retrieval of Repair Information  RoomLine – Conference room reservation within SCS  Let’s Go! (BusLine) – Bus schedule information in Pittsburgh  TeamTalk – Command and control for a team of robots  Eureka – Dialog interface to a clustered web search engine (Vivisimo)

Download ppt "Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003."

Similar presentations

Key architectural details RavenClaw: Dialog Management Using Hierarchical Task Decomposition and an Expectation Agenda Dan BohusAlex Rudnicky School of.

Key architectural details RavenClaw: Dialog Management Using Hierarchical Task Decomposition and an Expectation Agenda Dan BohusAlex Rudnicky School of.
Non-Native Users in the Let s Go!! Spoken Dialogue System: Dealing with Linguistic Mismatch Antoine Raux & Maxine Eskenazi Language Technologies Institute.

Non-Native Users in the Let s Go!! Spoken Dialogue System: Dealing with Linguistic Mismatch Antoine Raux & Maxine Eskenazi Language Technologies Institute.
Developing Spoken Dialogue Systems in the Communicator / RavenClaw Framework Sphinx Lunch Talk Carnegie Mellon University, October 2004 Presented by:Dan.

Developing Spoken Dialogue Systems in the Communicator / RavenClaw Framework Sphinx Lunch Talk Carnegie Mellon University, October 2004 Presented by:Dan.
Good Morning! How many times have you tried to get ahold of someone and failed?How many times have you tried to get ahold of someone and failed? Need to.

Good Morning! How many times have you tried to get ahold of someone and failed?How many times have you tried to get ahold of someone and failed? Need to.
Manuela Veloso, Anthony Stentz, Alexander Rudnicky Brett Browning, M. Bernardine Dias Faculty Thomas Harris, Brenna Argall, Gil Jones Satanjeev Banerjee.

Manuela Veloso, Anthony Stentz, Alexander Rudnicky Brett Browning, M. Bernardine Dias Faculty Thomas Harris, Brenna Argall, Gil Jones Satanjeev Banerjee.
1 Team Talk – A Report. 2 Introduction Project done as part of 11-754, Spring ’03. Design and implementation of a spoken dialog system. Thrust of project:

1 Team Talk – A Report. 2 Introduction Project done as part of , Spring ’03. Design and implementation of a spoken dialog system. Thrust of project:
H E L S I N K I U N I V E R S I T Y O F T E C H N O L O G Y G O p r o j e c t : S e r v i c e A r c h i t e c t u r e f o r t h e N o m a d i c I n t e.

H E L S I N K I U N I V E R S I T Y O F T E C H N O L O G Y G O p r o j e c t : S e r v i c e A r c h i t e c t u r e f o r t h e N o m a d i c I n t e.
Error Handling in the RavenClaw Dialog Management Framework Dan Bohus, Alexander I. Rudnicky Computer Science Department, Carnegie Mellon University (

Error Handling in the RavenClaw Dialog Management Framework Dan Bohus, Alexander I. Rudnicky Computer Science Department, Carnegie Mellon University (
Building a SOA roadmap for your enterprise Presented by Sanjeev Batta Architect, Cayzen Technologies.

Building a SOA roadmap for your enterprise Presented by Sanjeev Batta Architect, Cayzen Technologies.
Workflow Automation 1.1 feature overview

Workflow Automation 1.1 feature overview
MCTS GUIDE TO MICROSOFT WINDOWS 7 Chapter 10 Performance Tuning.

MCTS GUIDE TO MICROSOFT WINDOWS 7 Chapter 10 Performance Tuning.
(Spoken) Dialogue and Information Retrieval Antoine Raux Dialogs on Dialogs Group 10/24/2003.

(Spoken) Dialogue and Information Retrieval Antoine Raux Dialogs on Dialogs Group 10/24/2003.
Heterogeneous Multi-Robot Dialogues for Search Tasks Thomas K Harris, Satanjeev (Bano) Banerjee Alexander Rudnicky AAAI Spring Symposium 2005: Dialogical.

Heterogeneous Multi-Robot Dialogues for Search Tasks Thomas K Harris, Satanjeev (Bano) Banerjee Alexander Rudnicky AAAI Spring Symposium 2005: Dialogical.
Building Enterprise Applications Using Visual Studio ®.NET Enterprise Architect.

Building Enterprise Applications Using Visual Studio ®.NET Enterprise Architect.
LECTURE 7 SEP 27, 2010 Building computational pipelines.

LECTURE 7 SEP 27, 2010 Building computational pipelines.
RavenClaw Yet another (please read “An improved”) dialog management architecture for task-oriented spoken dialog systems Presented by: Dan Bohus

RavenClaw Yet another (please read “An improved”) dialog management architecture for task-oriented spoken dialog systems Presented by: Dan Bohus
Copyright © 2004, GemStone Systems Inc. All Rights Reserved. A Capstone with GemStone David Whitlock October 25, 2004.

Copyright © 2004, GemStone Systems Inc. All Rights Reserved. A Capstone with GemStone David Whitlock October 25, 2004.
Multiple-Agent Dialogue Thomas K Harris, Satanjeev (Bano) Banerjee Alex Rudnicky Boeing Kick-off Meeting June 8, 2004.

Multiple-Agent Dialogue Thomas K Harris, Satanjeev (Bano) Banerjee Alex Rudnicky Boeing Kick-off Meeting June 8, 2004.
Spoken Dialog Management for an Astronaut’s Procedure Assistant Presented by: Dan Bohus Collaborators: Gregory Aist, RIALIST Group.

Spoken Dialog Management for an Astronaut’s Procedure Assistant Presented by: Dan Bohus Collaborators: Gregory Aist, RIALIST Group.
Revising Riverbot Outline and Specifications Christian Skalka.

Revising Riverbot Outline and Specifications Christian Skalka.

Similar presentations

Ads by Google