WP1 UGOT demos 2nd year review Saarbrucken Mar 2006

GoDiS features System makes sure that the system and the user have heard and understood each other (“grounding”) User can give information in any order (“accommodation”) User can take own initiatives, and the system can handle multiple simultaneous topics / tasks (“multiple tasks”) System generates clarification questions of there is some problem (”clarification”) and more...

Multimodality in GoDiS Two kinds of multimodality Parallel multimodality –All modalities convey all the information, without support from other modalities Integrated multimodality –Information is distributed over several modalities; Modalities are combined to convey information

Parallel multimodality in GoDiS AgendaTalk application –Demo in demo session Two separate interfaces to the same application –Speech interface –GUI interface Only speech input and output handled by GoDiS dialogue manager

Agenda GUI (BORG) Nuance ASR + TTS module Agenda database IS MIVs RIVs rules updateselect device resource GoDiS core agent domain agenda

Integrated multimodality in GoDiS Multimodal Menu-based Dialogue (MMD) –Dialogue plans are based on existing menu system –Menus can be navigated by speech, GUI or combination of both Original GUI menu interface can be used as usual User can control player using speech only, if necessary Modalities can be freely mixed and changed at any point –No need to learn menu structure or even commands Both speech and GUI input/output handled by GoDiS dialogue manager Demo (film): DJ-GoDiS

Graphical I/O module Nuance ASR + TTS module Music player agent Music database agent IS updateselect device player GoDiS core agent device database domain player DJ-GoDiS (current version)

GF DJ-GoDiS with GF multimodal grammar Graphical I/O module Nuance ASR + TTS module Music player agent Music database agent IS updateselect device player GoDiS core agent device database domain player