A Dialogue System for Robots using VoiceXML Louise Funke & Marc Bauer 2007/12/11 EDA171/DATN06 Language Processing and Computational Linguistics Pierre.

Slides:



Advertisements
Similar presentations
INTEGRATION OF VOICE SERVICES IN INTERNET APPLICATIONS By Eduardo Carrillo (lecturer), J. J Samper, J.J. Martínez-Durá Universidad Autónoma de Bucaramanga.
Advertisements

With Folder HelpDesk for Outlook, support centres and other helpdesks can work efficiently with support cases inside Microsoft Outlook. The support tickets.
Sebastiaan Eldritch-Böersen, IT Support Specialist ~ Assistive Technologies and Yvonne Ward, Support Officer.
Manuela Veloso, Anthony Stentz, Alexander Rudnicky Brett Browning, M. Bernardine Dias Faculty Thomas Harris, Brenna Argall, Gil Jones Satanjeev Banerjee.
Introduction to Intellicaller for Channel Partners/Clients Confidential. © Zeal Web Technologies. Please destroy if you are not the intended.
H E L S I N K I U N I V E R S I T Y O F T E C H N O L O G Y G O p r o j e c t : S e r v i c e A r c h i t e c t u r e f o r t h e N o m a d i c I n t e.
Multi Instruments Data Acquisition Software Evolution
MET CS 405/605 Human Computer Interface Design. Week 5 – Design  Interaction Style ~  Command Line  Menu Selection  Form Fill  Direct Manipulation.
1 Chapter 12 Working With Access 2000 on the Internet.
The State of the Art in VoiceXML Chetan Sharma, MS Graduate Student School of CSIS, Pace University.
Pace VoiceXML Absentee System Paul Visokey, Ping Gallivan, Yani Mulyani, Lisa Jordan, Elaine Li, George Mathew, Qisheng Hong Presenter Name : Paul Visokey.
How Clients and Servers Work Together. Objectives Learn about the interaction of clients and servers Explore the features and functions of Web servers.
Russell Taylor Lecturer in Computing & Business Studies.
AVERSTAR GROUP September 6, 2001NASA Software IV&V Facility1 SIAT C++ CSIP Presentation.
VoiceXML Builder Arturo Ramirez ACS 494 Master’s Graduate Project May 04, 2001.
INTRODUCTION TO WEB DATABASE PROGRAMMING
NETWORK CENTRIC COMPUTING (With included EMBEDDED SYSTEMS)
Server- Side technologies Client-side vs. Server-side scripts PHP basic ASP.NET basic ColdFusion.
Smart Forms  Overview of Smart Form Process Flow  Print the Form  Fill in the Form  Scan and Upload the Form  Adsystech’s Smart Form Technology.
11.10 Human Computer Interface www. ICT-Teacher.com.
Web Programming: Client/Server Applications Server sends the web pages to the client. –built into Visual Studio for development purposes Client displays.
Creating Speaking Web Pages: The Text-to-Speech Integrated Development Environment (TTS-IDE) David C. Gibbs Department of Mathematics and Computing University.
Chapter 4 – Slide 1 Effective Communication for Colleges, 10 th ed., by Brantley & Miller, 2005© Technology and Electronic Communication.
Learningcomputer.com SQL Server 2008 Configuration Manager.
HTML. Principle of Programming  Interface with PC 2 English Japanese Chinese Machine Code Compiler / Interpreter C++ Perl Assembler Machine Code.
Client Side Programming with JavaScript Why use client side programming? Web sides built on CGI programs can rapidly become overly complicated to maintain,
CHAPTER TEN AUTHORING.
Outline Grammar-based speech recognition Statistical language model-based recognition Speech Synthesis Dialog Management Natural Language Processing ©
Active Server Pages  In this chapter, you will learn:  How browsers and servers interacted on the Internet when the Internet first became popular 
1 Welcome to CSC 301 Web Programming Charles Frank.
Vex Robotics Programming Options. To start you off and give you a safe "home base" to return to while you explore, a few key programs are already included.
Collaborative Annotation of the AMI Meeting Corpus Jean Carletta University of Edinburgh.
240-Current Research Easily Extensible Systems, Octave, Input Formats, SOA.
E.g.: MS-DOS interface. DIR C: /W /A:D will list all the directories in the root directory of drive C in wide list format. Disadvantage is that commands.
Moby Web Services Iván Párraga García MSc on Bioinformatics for Health Sciences May 2006.
RUBRIC IP1 Ruben Botero Web Design III. The different approaches to accessing data in a database through client-side scripting languages. – On the client.
DAWN: Dynamic Aural Web Navigation Gopal Gupta, S. Sunder Raman, Mike Nichols, H. Reddy, N. Annamalai Department of Computer Science University of Texas.
Chapter 29 World Wide Web & Browsing World Wide Web (WWW) is a distributed hypermedia (hypertext & graphics) on-line repository of information that users.
CSIT 220 (Blum)1 Remote Procedure Calls Based on Chapter 38 in Computer Networks and Internets, Comer.
© Paradigm Publishing, Inc. 4-1 Chapter 4 System Software Chapter 4 System Software.
Tbox is a monitoring solution for all your computer systems Unifies and simplifies management of system surveillance Notifies you in the event of.
Introduction Selenium IDE is a Firefox extension that allows you to record, edit, and debug tests for HTML Easy record and playback Intelligent field selection.
Student Pages
Different Types of HCI CLI Menu Driven GUI NLI
1 Galatea: Open-Source Software for Developing Anthropomorphic Spoken Dialog Agents S. Kawamoto, et al. October 27, 2004.
Language Implementation Methods David Woolbright.
VoiceXML Version 2.0 Jon Pitcherella. What is it? A W3C standard for specifying interactive voice dialogues. Uses a “voice” browser to interpret documents,
JavaScript 101 Introduction to Programming. Topics What is programming? The common elements found in most programming languages Introduction to JavaScript.
Programming Logic and Design Fourth Edition, Comprehensive Chapter 14 Event-Driven Programming with Graphical User Interfaces.
Creating interfaces XML & XSL review VoiceXML: grammar Homework: postings, presentation, study guide.
Technical lssues for the Knowledge Engineering Competition Stefan Edelkamp Jeremy Frank.
4000 Imaje 4020 – Software Imaje 4020 – Content ■ Content of Chapter Software: 1. Flash Up 2. Netcenter 3. FTP 4. Active X 5. XCL commands 6. Exercise.
1 Chapter 1 INTRODUCTION TO WEB. 2 Objectives In this chapter, you will: Become familiar with the architecture of the World Wide Web Learn about communication.
Data Virtualization Demoette… ODBC Clients
Computer Programming.
11.10 Human Computer Interface
3.01 Apply Controls Associated With Visual Studio Form
Section 17.1 Section 17.2 Add an audio file using HTML
3.01 Apply Controls Associated With Visual Studio Form
Database Driven Websites
Assembler, Compiler, Interpreter
Tech Drop In: Google Drive
Working with Files.
Assembler, Compiler, Interpreter
Teaching slides Chapter 6.
What is Perl? PERL--Practical Extraction and Report Language
Bharat Prakash | Solutions Consultant
Chapter 9 System Control
Human-computer interaction
VoiceXML An investigation Author: Mya Anderson
Presentation transcript:

A Dialogue System for Robots using VoiceXML Louise Funke & Marc Bauer 2007/12/11 EDA171/DATN06 Language Processing and Computational Linguistics Pierre Nugues

Structure SME robot Dialogue systems Example dialogue VoiceXML Our program Demo Pro & Contra VoiceXML Future

SME robot EU project to develop a robot for small & medium enterprises Task: a dialogue system to program it!

Dialogue systems a computer system intended for machine- human interaction may contain text, speech, graphics, gestures, etc. our task:  program to fill in a form of known limits with voice  Input saved in a file for further processing

Dialogue systems (picture)

Example dialogue Robot: Welcome to the SME robot voice operating system. Please choose one of the following options. Wood sign process, (...) Human: (I’d like) wood sign process (please). Robot: You have chosen the wood sign process. Do you want to continue? Human: Yes. Robot: Step one, configuration of wood sign variables. What kind of shape do you want? Sharp corners, soft corners or cut corners. Human: Soft corners (please). Robot: You have chosen soft corners. Is that correct? Human: Yes. (...)

VoiceXML “is the W3C's standard XML format for specifying interactive voice dialogues between a human and a computer.” Developed in Tellme Studio Server sided interpretation & execution (speech recognition software already existing in the system) Client connects via Skype or telephone

Our program (part of code) (...) Step one, configuration of wood sign variables. What kind of shape do you want? Sharp corners, soft corners or cut corners. <![CDATA[ [ [(sharp corners) (sharp)] { } [(soft corners) (soft)] { } [(cut corners) (cut)] { } ] ]]>

Our program (part of code - 2) You have chosen Is that correct?

Demo Time for a little demonstration... 

Pro & Contra VoiceXML Pro:  Easy to program  Listens to key words  Extendable with JavaScript, Perl, etc. Contra:  Noise!!! (leading to misinterpretation)  Code not flexible - new task == new code

Future Full integration to the robot Complex exception catching (noise, dialects) Mixed initiative More tasks, more options, more navigation.. Global commands Etc.