1 Spontaneous-Speech Dialogue System In Limited Domains (98 - 01) Development of an oral human-machine interface, by way of dialogue, for a semantically.

Slides:

Advertisements

Similar presentations

How to be a good teacher? What makes a good teacher?

Advertisements

CHART or PICTURE INTEGRATING SEMANTIC WEB TO IMPROVE ONLINE Marta Gatius Meritxell González TALP Research Center (UPC) They are friendly and easy to use.

INTEGRATION OF VOICE SERVICES IN INTERNET APPLICATIONS By Eduardo Carrillo (lecturer), J. J Samper, J.J. Martínez-Durá Universidad Autónoma de Bucaramanga.

Outline Part I Speaking 1. Strategies 2. Sample Dialogue Volunteer for the dialogue… This is when you call! Part II Listening Comprehension 1. Strategies.

© GyrusLogic, Inc AI and Natural Language VUI design Peter Trompetter, VP Global Development GyrusLogic, Inc. Tuesday, August 21 at 1:30 PM - C202.

INCORPORATING MULTIPLE-HMM ACOUSTIC MODELING IN A MODULAR LARGE VOCABULARY SPEECH RECOGNITION SYSTEM IN TELEPHONE ENVIRONMENT A. Gallardo-Antolín, J. Ferreiros,

Part 4: Evaluation Days 25, 27, 29, 31 Chapter 20: Why evaluate? Chapter 21: Deciding on what to evaluate: the strategy Chapter 22: Planning who, what,

What can humans do when faced with ASR errors? Dan Bohus Dialogs on Dialogs Group, October 2003.

CONTROLLING A HIFI WITH A CONTINUOUS SPEECH UNDERSTANDING SYSTEM ICSLP’ 98 CONTROLLING A HIFI WITH A CONTINUOUS SPEECH UNDERSTANDING SYSTEM J. Ferreiros,

Conversational Agent 1.Two layers: Dialogue manager and Conversational agent. 2.Rule-Based Translator (ELIZA and PARRY) 3. Layer one: Dialogue Manager.

I.1 ii.2 iii.3 iv.4 1+1=. i.1 ii.2 iii.3 iv.4 1+1=

Natural Language Query Interface Mostafa Karkache & Bryce Wenninger.

I.1 ii.2 iii.3 iv.4 1+1=. i.1 ii.2 iii.3 iv.4 1+1=

A Guide to Reflective Practice for Core French Teachers : Module 3 The Action-Oriented Approach.

Auditory User Interfaces

U1, Speech in the interface: 1. Introduction1 Module u1: Speech in the Interface 1: Introduction Jacques Terken HG room 2:40 tel. (247) 5254

© 2001 CUHK Recognition Software Building Block Overview 1. Task specification — What is the function of the system ? 2. Recognizer Design — Vocabulary.

Module 1, Unit 2, Transparency #1 Assisting Students with Disabilities: A Training Program for Paraeducators Module 1, Unit 2: Communication & Teamwork.

DQA meeting: : Learning more effective dialogue strategies using limited dialogue move features Matthew Frampton & Oliver Lemon, Coling/ACL-2006.

Interactive Dialogue Systems Professor Diane Litman Computer Science Department & Learning Research and Development Center University of Pittsburgh Pittsburgh,

TOEIC Test: Listening Comprehension

Welcome to the NALA Presentation to CACPS about Curriculum-Based Certification Helpful hints to make this web cast presentation effective and easy to follow:

Interaction Design Session 12 LBSC 790 / INFM 718B Building the Human-Computer Interface.

Experiments on Building Language Resources for Multi-Modal Dialogue Systems Goals identification of a methodology for adapting linguistic resources for.

Teaching language means teaching the components of language Content (also called semantics) refers to the ideas or concepts being communicated. Form refers.

Theban Stanley Human and Systems Engineering Center for Advanced Vehicular Systems Enhancements to the DARPA Communicator Architecture.

Multiagent System as an intelligent assistant tool in Sakai Diego del Blanco Orobitg Fernando Olivares Fernández UPA Universidad Politécnica de Valencia.

SPEECH CONTENT Spanish Expressive Voices: Corpus for Emotion Research in Spanish R. Barra-Chicote 1, J. M. Montero 1, J. Macias-Guarasa 2, S. Lufti 1,

Crowdsourcing for Spoken Dialogue System Evaluation Ling 575 Spoken Dialog April 30, 2015.

Slide 1 Welcome California Mathematics and Science Partnership (CaMSP) Year 2, Follow Up 3 January 22, 2011.

Learning Automata based Approach to Model Dialogue Strategy in Spoken Dialogue System: A Performance Evaluation G.Kumaravelan Pondicherry University, Karaikal.

DIALOG SYSTEMS FOR AUTOMOTIVE ENVIRONMENTS Presenter: Joseph Picone Inst. for Signal and Info. Processing Dept. Electrical and Computer Eng. Mississippi.

CLEF 2007 Workshop Budapest, September 19, 2007  ELDA 1 Overview of QAST Question Answering on Speech Transcriptions - J. Turmo, P. Comas (1),

Noche de Ciencias (Science Night) Media Training Anna Vue, Cindy Cha Solsken PR October 4, 2012.

1 Boostrapping language models for dialogue systems Karl Weilhammer, Matthew N Stuttle, Steve Young Presenter: Hsuan-Sheng Chiu.

16.0 Spoken Dialogues References: , Chapter 17 of Huang 2. “Conversational Interfaces: Advances and Challenges”, Proceedings of the IEEE,

1 Natural Language Processing Lecture Notes 14 Chapter 19.

Introduction to Dialogue Systems. User Input System Output ?

Natural Language Processing Menu Based Natural Language Interfaces -Kyle Neumeier.

McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 12 Implementing Business/IT Solutions.

Chapter 12: Fostering the Development of Language Skills.

DIALOG SYSTEMS FOR AUTOMOTIVE ENVIRONMENTS Presenter: Joseph Picone Inst. for Signal and Info. Processing Dept. Electrical and Computer Eng. Mississippi.

Information state and dialogue management in the TRINDI Dialogue Move Engine Toolkit, Larsson and Traum 2000 D&QA Reading Group, Feb 20 th 2007 Genevieve.

International Teacher Exchange Week 2014 Oulu University of Applied Sciences School of Engineering, March.

Theban Stanley, Julie Baca, Matt Elliott and Joseph Picone Human and Systems Engineering Center for Advanced Vehicular Systems Mississippi State University.

The Direct Method 1. Background It became popular since the Grammar Translation Method was not very effective in preparing students to use the target.

Modeling the ODP Computational Viewpoint with UML 2.0: The Templeman Library Example José Raúl Romero, Antonio Vallecillo Universidad de Málaga, Spain.

Lti Shaping Spoken Input in User-Initiative Systems Stefanie Tomko and Roni Rosenfeld Language Technologies Institute School of Computer Science Carnegie.

The Audio-Lingual Method

A Patent Document Retrieval System Addressing Both Semantic and Syntactic Properties Liang Chen*,Naoyuki Tokuda+, Hisahiro Adachi+ *University of Northern.

Artificial Intelligence: Research and Collaborative Possibilities a presentation by: Dr. Ernest L. McDuffie, Assistant Professor Department of Computer.

User Responses to Prosodic Variation in Fragmentary Grounding Utterances in Dialog Gabriel Skantze, David House & Jens Edlund.

Integrating Multiple Knowledge Sources For Improved Speech Understanding Sherif Abdou, Michael Scordilis Department of Electrical and Computer Engineering,

Speech Processing 1 Introduction Waldemar Skoberla phone: fax: WWW:

Writing Your Speech.

Slide 1 Welcome California Mathematics and Science Partnership (CaMSP) Year 2, Follow Up 3 January 22, 2011.

A Simple English-to-Punjabi Translation System By : Shailendra Singh.

Objectives of session By the end of today’s session you should be able to: Define and explain pragmatics and prosody Draw links between teaching strategies.

Predicting and Adapting to Poor Speech Recognition in a Spoken Dialogue System Diane J. Litman AT&T Labs -- Research

Unit 1 Building up Business Relations Part I Background Information  Q1:What information should you get about the person or the company that you would.

Detection Of Anger In Telephone Speech Using Support Vector Machine and Gaussian Mixture Model Prepared By : Siti Marahaini Binti Mahamood.

Course Projects Speech Recognition Spring 1386

Issues in Spoken Dialogue Systems

Chapter 12 Implementing Business/IT Solutions.

Partnerships and networks

Resolving Incorrect Accommodations During Testing

How to Manage a Test Session

Interactive Medium-Fi Prototype

Resolving Incorrect Accommodations During Testing

Presentation transcript:

1 Spontaneous-Speech Dialogue System In Limited Domains ( ) Development of an oral human-machine interface, by way of dialogue, for a semantically limited task: Queries into a database with information on Spanish trains Supported by CICYT(Comisión Interministerial de Ciencia y Tecnologia) of Spanish Government Project Overview (I)

2 Partners list EHU (Universidad del Pais Vasco) UJI (Universidad Jaume I, Castellón) UPC-I (Universidad Politécnica de Cataluña) UPC-T (Universidad Politécnica de Cataluña) UPV (Universidad Politécnica de Valencia) UZ (Universidad de Zaragoza) Project: Spontaneous-Speech Dialogue System In Limited Domains (I)

3 Project tasks (I) The acquisition of a corpus so as to study the dialogue in the task. A study on spontaneous speech and its modelling. The development of robust speech signal modelling techniques, to cope with variations due to speaker, background and channel effects. Project: Spontaneous-Speech Dialogue System In Limited Domains (II)

4 Project tasks (II) The study and development of the dialogue system in the semantically restricted environment of the task The speech recognition module The understanding module The system that will generate an oral answer Project: Spontaneous-Speech Dialogue System In Limited Domains (III)

5 Project tasks (III) The development of a prototype of the dialogue system for railway information in Spanish over the telephone network. Project: Spontaneous-Speech Dialogue System In Limited Domains (IV)

6 Why the railway information task was chosen? -Delimited task. Easy to understand -Vocabulary stable. There are no foreign word (As in flights information or entertainment) -Rich conversations. Several turn-taking Project: Spontaneous-Speech Dialogue System In Limited Domains (V)

7 Why the railway information task was chosen? -Delimited task. Easy to understand -Vocabulary stable. There are no foreign word (As in flights information or entertainment) -Rich conversations. Several turn-taking Project: Spontaneous-Speech Dialogue System In Limited Domains (VI)

8  200 conversations from the RENFE call information centre.  Calls from Barcelona. In Spanish.  Selection of different ways of asking for information  Language too complex Adquisition of the person-to-person corpus (I)

9  Redefinition the task. Eliminating complexes  Design of the Dialog Controller.  Design of the Answer Generator  Preparing the man-machine corpus Adquisition of the person-to-person corpus (II)

10  People uses different when they talk to a machine  The wizard of Oz strategy allows the obtaining examples before the systed is developed Adquisition of the man-machine corpus

11 aTTemps (accès telefonic al Temps) aTTemps is an automatic system to access meteorological information by phone. Supported by Catalunya Government Universitat Politècnica de Catalunya Universitat de Barcelona Project Overview (II)

12 Provides personalized real-time data on a set of meteorological conditions on each place of the Catalan geography In Catalan language Phone: (in Spain). Project: aTTemps (accès telefonic al Temps)

13 The Dialogue Manager Module in aTTemps (I) Main goals Provide the right information in minimum time Guiding the user in order to avoid situations where she will be lost

14 The Dialogue Manager Module in aTTemps (II) Strategy Dialogue Flow. Barge-in Confirmation policy Implicit as a general rule Explicit in critical situations Amount of Data per Turn Considering the complexity Helping features. Helping messages Language generation Using templates

15 System: Welcome to the ATTEMPS meteorological warning and information system. You can always say help, correction, repetition or exit. From which Catalan place do you want information, or do you want to establish a warning? User: I am interested in Barcelona, please. System: From Badalona, which information do you need? User: I want to correct, not from Badalona. System: From which Catalan place do you want information User: I want to know the weather right now in Barcelona. System: From Barcelona, which information do you need? User: I need the temperature, please. System: In the last measure at 14:30h, the temperature was 20 degrees. Do you need any other information User: No, thanks. System: Thanks for calling aTTemps : An example of conversation