DAWN: Dynamic Aural Web Navigation Gopal Gupta, S. Sunder Raman, Mike Nichols, H. Reddy, N. Annamalai Department of Computer Science University of Texas.

Slides:

Advertisements

Similar presentations

The Web Warrior Guide to Web Design Technologies

Advertisements

Stat-JR: eBooks Richard Parker. Quick overview To recap… Stat-JR uses templates to perform specific functions on datasets, e.g.: – 1LevelMod fits 1-level.

XISL language XISL= eXtensible Interaction Sheet Language or XISL=eXtensible Interaction Scenario Language.

Copyright 2004 Monash University IMS5401 Web-based Systems Development Topic 2: Elements of the Web (g) Interactivity.

The State of the Art in VoiceXML Chetan Sharma, MS Graduate Student School of CSIS, Pace University.

Semantic Search Jiawei Rong Authors Semantic Search, in Proc. Of WWW Author R. Guhua (IBM) Rob McCool (Stanford University) Eric Miller.

Visual Web Information Extraction With Lixto Robert Baumgartner Sergio Flesca Georg Gottlob.

1 A Balanced Introduction to Computer Science, 2/E David Reed, Creighton University ©2008 Pearson Prentice Hall ISBN Chapter 7 Event-Driven.

Voice XML Absentee System Presenters: Shawn Ramdass, Saji Abraham, Billy Santamorena.

CGI and Perl MSc Publishing on the WWW. What is CGI ? (1) User Buying and selling Playing games Customised web pages Developer Means to run external programs.

WWW and Internet The Internet Creation of the Web Languages for document description Active web pages.

Outline IS400: Development of Business Applications on the Internet Fall 2004 Instructor: Dr. Boris Jukic Table, Forms, Metatags and Frames.

Creating Web Page Forms

AN EXTENSIBLE TRANSCODER FOR HTML TO VOICEXML CONVERSION by Narayanan Annamala Gopal Gupta B. Prabhakaran DEPARTMENT OF COMPUTER SCIENCE THE UNIVERSITY.

Part or all of this lesson was adapted from the University of Washington’s “Web Design & Development I” Course materials.

Dawn Pedersen Art Institute. Introduction All your hard design work will suffer in anonymity if people can't find your site. The most common way people.

Chapter 9 Collecting Data with Forms. A form on a web page consists of form objects such as text boxes or radio buttons into which users type information.

1 Introduction to Web Development. Web Basics The Web consists of computers on the Internet connected to each other in a specific way Used in all levels.

VoiceXML Builder Arturo Ramirez ACS 494 Master’s Graduate Project May 04, 2001.

INTRODUCTION TO WEB DATABASE PROGRAMMING

INTRODUCTION TO DHTML. TOPICS TO BE DISCUSSED……….  Introduction Introduction  UsesUses  ComponentsComponents  Difference between HTML and DHTMLDifference.

_______________________________________________________________________________________________________________ E-Commerce: Fundamentals and Applications1.

AN EXTENSIBLE TRANSCODER FOR HTML TO VOICEXML CONVERSION by Narayanan Annamalai B.E. Master’s Thesis Advisors: Dr. Gopal Gupta and Dr. B Prabhakaran THE.

JavaScript: Control Structures September 27, 2005 Slides modified from Internet & World Wide Web: How to Program (3rd) edition. By Deitel, Deitel,

Chapter 6: Forms JavaScript - Introductory. Previewing the Product Registration Form.

XHTML Introductory1 Forms Chapter 7. XHTML Introductory2 Objectives In this chapter, you will: Study elements Learn about input fields Use the element.

ITCS 6010 SALT. Speech Application Language Tags (SALT) Speech interface markup language Extension of HTML and other markup languages Adds speech and.

Creating Speaking Web Pages: The Text-to-Speech Integrated Development Environment (TTS-IDE) David C. Gibbs Department of Mathematics and Computing University.

Listener Controlled Navigation of VoiceXML Documents Gopal Gupta N. Annamalai, H. Reddy Dept. of Computer Science UT Dallas.

Integrating VoiceXML with SIP services

Design and Construction of Accessible Web Sites Michael Burks Chairman Internet Society SIG For Internet Accessibility for People with Disabilities June.

1 HTML John Sum Institute of Technology Management National Chung Hsing University.

Java CGI Lecture notes by Theodoros Anagnostopoulos.

Fundamentals of Web Design Copyright ©2004  Department of Computer & Information Science Introducing XHTML: Module A: Web Design Basics.

XML A web enabled data description language 4/22/2001 By Mark Lawson & Edward Ryan L’Herault.

Chapter 8 Collecting Data with Forms. Chapter 8 Lessons Introduction 1.Plan and create a form 2.Edit and format a form 3.Work with form objects 4.Test.

A Dialogue System for Robots using VoiceXML Louise Funke & Marc Bauer 2007/12/11 EDA171/DATN06 Language Processing and Computational Linguistics Pierre.

Voice User Interface

1 Welcome to CSC 301 Web Programming Charles Frank.

1 © Netskills Quality Internet Training, University of Newcastle HTML Forms © Netskills, Quality Internet Training, University of Newcastle Netskills is.

AN EXTENSIBLE TRANSCODER FOR HTML TO VOICEXML CONVERSION by Narayanan Annamalai B.E. Master’s Thesis Advisors: Dr. Gopal Gupta and Dr. B Prabhakaran THE.

Listener Controlled Navigation of VoiceXML Documents Gopal Gupta N. Annamalai, H. Reddy Dept. of Computer Science UT Dallas.

Web Technologies Lecture 3 Web forms. HTML5 forms A component of a webpage that has form controls – Text fields – Buttons – Checkboxes – Range controls.

1 CSC160 Chapter 7: Events and Event Handlers. 2 Outline Event and event handlers onClick event handler onMouseOver event handler onMouseOut event handler.

CS562 Advanced Java and Internet Application Introduction to the Computer Warehouse Web Application. Java Server Pages (JSP) Technology. By Team Alpha.

HTML Overview Part 5 – JavaScript 1. Scripts 2  Scripts are used to add dynamic content to a web page.  Scripts consist of a list of commands that execute.

Listener-Control Navigation of VoiceXML. Nuance Speech Analysis 92% of customer service is through phone. 84% of industrialists believe speech better.

Introduction to HTML. _______________________________________________________________________________________________________________ 2 Outline Key issues.

VoiceXML Version 2.0 Jon Pitcherella. What is it? A W3C standard for specifying interactive voice dialogues. Uses a “voice” browser to interpret documents,

Creating User Interfaces Ideas & Trends Homework: Post constructive comments. Work on project.

Chapter 11 Adding Media and Interactivity. Chapter 11 Lessons Introduction 1.Add and modify Flash objects 2.Add rollover images 3.Add behaviors 4.Add.

The Database and Info. Systems Lab. University of Illinois at Urbana-Champaign Understanding Web Query Interfaces: Best-Efforts Parsing with Hidden Syntax.

JavaScript 101 Introduction to Programming. Topics What is programming? The common elements found in most programming languages Introduction to JavaScript.

Creating User Interfaces XML, MathML, ChomeVox. XML eXtended Markup Language Tags and text Tags are singletons and paired. Tags have types and, generally,

1 CSC160 Chapter 1: Introduction to JavaScript Chapter 2: Placing JavaScript in an HTML File.

W3C Multimodal Interaction Activities Deborah A. Dahl August 9, 2006.

VoiceXML. Nuance Speech Analysis 92% of customer service is through phone. 84% of industrialists believe speech better than web.

1 Survey of Profiles from Other Domains XMSF Profile SG 13 January 2004 Curt Blais and NPS MV3250 (Introduction to XML, 1st Quarter 2005) Katherine L.

Presented By Sharmin Sirajudeen S7 CS Reg No :

1 Chapter 1 INTRODUCTION TO WEB. 2 Objectives In this chapter, you will: Become familiar with the architecture of the World Wide Web Learn about communication.

Introduction to Visual Basic. NET,. NET Framework and Visual Studio

Software Design and Architecture

Datamining : Refers to extracting or mining knowledge from large amounts of data Applications : Market Analysis Fraud Detection Customer Retention Production.

Chapter 7 - JavaScript: Introduction to Scripting

JavaScript: Introduction to Scripting

An Introduction to JavaScript

Chapter 7 - JavaScript: Introduction to Scripting

Chapter 7 - JavaScript: Introduction to Scripting

Chapter 7 - JavaScript: Introduction to Scripting

VoiceXML An investigation Author: Mya Anderson

Presentation transcript:

DAWN: Dynamic Aural Web Navigation Gopal Gupta, S. Sunder Raman, Mike Nichols, H. Reddy, N. Annamalai Department of Computer Science University of Texas at Dallas

Introduction The Web is intrinsically Visual. We need computers to access the Web. People with visual disabilities cannot fully iiiinteract with the Web.

What is the Aural Web?  Based on the traditional Web.  Voice/Audio for Input/Output.  Listeners have complete control over navigation. Aural Web

What is the Aural Web? Why do we need an Aural Web?  Make the Web accessible to all.  Do away with the need to have a computer to access iiiithe Web. Aural Web

What is the Aural Web? Why do we need an Aural Web? How can we obtain an Aural Web?  Translate HTML to VoiceXML (however, translation is not enough).  Need to enhance VoiceXML to make it dynamically iiiinavigable. Aural Web

VoiceXML W3C Standard for marking voice documents VoiceXML documents are ‘played’ on voice iiibrowsers. A VoiceXML document consists of various iiiforms. Form names are used to control iiinavigation. Inputs are restricted to a set of pre-defined iiiwords specified via a grammar.

Example VoiceXML Document <![CDATA[[ [(yes)]{ } [(no)] } ]]]> Would you like to get rich quick? Gotcha. You want to be rich! You don't want to be rich.

Translating HTML to VoiceXML A module to denotationally map HTML constructs iiito VoiceXML. It is extendable and flexible.

Translating HTML to VoiceXML Interface Sheet HTML Tags Output Text Starting of text quoted from elsewhere. Ignore Input Attributes Input Duration in Seconds for Text Box : Input Duration in Seconds for Text Area :

HTML to VoiceXML Translator A module that denotationally map HTML constructs iiito VoiceXML. It is extendable and flexible. It can handle Forms. It preserves information about iiithe submit type and target URL. The translator imposes certain reasonable iiirestrictions on the input HTML.

DAWN Architecture HTML to VoiceXML Translator. VoiceXML Enhancer. WHY…?

Limitations of VoiceXML Navigation is controlled by the author; the listener has iiivirtually no control. The author has to hardcode every possible navigation iiipath (obviously not possible). Poorly authored documents become difficult to iiibrowse. Speech recognition technology allows an arbitrary iiiuser to speak only pre-determined phrases.

Limitations of VoiceXML (cont’d) These limitations result in VoiceXML’s being useful for only simple applications. Thus, simple database lookup (e.g., American Airlines airline information system) are possible, But advanced applications that require complex interaction are not (e.g., making air reservation). What is needed is the ability for the listener to move around the VXML document at his/her will.

Solution We introduce the concept of Voice Anchors, allowing iii listeners to dynamically tag and recall any dialog. We modify the VoiceXML documents and generate iii new VoiceXML documents dynamically at run time. Support pre-defined keywords (e.g., pause).

Dynamic Voice Anchors Analogous to bookmarks or HTML anchors. An anchor is a speech label that can be associated iiiwith a specific dialog. These anchors can be then used to recall associated iiidialogs. A single anchor name can be used to tag multiple iiidialogs (cumulative anchor). Any word can be chosen for an anchor name. The iiiuser spells them out the first time only.

The Enhancer Module Enhances the VoiceXML file readying it to accept iiiDynamic Voice Anchors. Modifies the VoiceXML document to add iiiinterfaces to server side CGIs. Adds functionality for specific keywords which iiihave pre-determined semantics. e.g. skip, repeat, pause, resume, back.

The Big Picture

DEMO

Some Applications EPlan – Is a Web based integrated contingency handling system. The Aural Web increases its accessibility. MathML to VoiceXML – Allows complex Mathematical formulas to be broken down, tagged and recalled. Searching for directions on the Web. Make online airline reservations using the phone.

Current & Future Work Design of Voice Scripting Languages (Talk by Mike Nichols tomorrow in Tiberius 2 at 10:30am). Intelligent Navigation Strategy for navigating Tables. Finally, incorporate all these techniques into a Voice Browser.

Contributions An Aural Web based on the traditional Web that allows users to perform complex Web operations using the phone. Developed techniques to give a listener maximum control (via dynamic voice anchors).

?