Introduction to VXML

What is VXML? Voice Extensible Markup Language Used in telephone-based speech applications voice browsing of the web

How does VXML work? Two main components tags -- control what the program does grammars -- control what speech is recognized; what the user can say

Basic VXML tags -- defines a VXML application -- basic component of a dialog -- says something to the user -- holds information supplied by user -- defines what user can say -- what to do once user says something

VXML Hierarchy contains one or more may contain one or more and does contain one or more contains one or more but one and only one and an optional

Execution is linear unless you tell it otherwise

Example 1

Tony’s Tips #1 All files must end with the extension.vxml Use a simple editor such as Notepad or the editor provided by BeVocal. Do not use Word -- it tends to add extra hidden formatting All tags occur in pairs (e.g., and ) When using avoid punctuation and capitalization

VXML Grammars Two types of grammars Programmer specified -- you decide what can be said Built-in or pre-defined Two tags related to grammars -- what can be said -- what to do once you recognize something

Built-in Grammars OK

Example 2a

Example 2b

Recognizing phrases Single words [news sports weather exit] phrases (i want the news) Combined ((i want the) [news sports]) ((i want the) [news sports (home section)]) Saying something optional (?(i want the) [news sports] ?please)

Using slots Problem: holds entire phrase that is recognized would have to write a separate rule for each possible phrase (i.e., the vocabulary problem) Slots are a useful shortcut when recognizing phrases ((i want the) [news sports (home section)]) ((i want the) [news { } sports { } (home section) { }])

Example 2c These are the slots This goes to another field unless paying by check

More on grammars Grammars do not have to be defined directly in vxml file can be defined in a separate file with.gsl extension (see example 3)

Tony’s Tips #2 avoid capitalizing words or using punctuation when defining a grammar Use built-in grammars whenever possible Use slots when trying to recognize phrases Use a separate grammar file if certain things will be recognized repeatedly (e.g. example 3)

So far... The metaphor is VXML as a form Dialog is overdetermined (i.e., the system is in control)

What about...

Design considerations Main menu people menu Undergrad menu Grad menu

Design considerations Main menu people menu Undergrad menu Grad menu

Design considerations Main menu people menu Undergrad menu Grad menu

Example 3

Example 4 Main menu people menu Undergrad menu Grad menu ex4_psych.vxml ex4_undergr.vxmlex4_grad.vxmlex4_people.vxml grammar psychology.gsl

Tony’s Tips #3 When using external grammars the rule name must start with a capital letter and is case sensitive (e.g., Fish is different from FISH) Plan first, then write code Break the project into pieces Test each small piece individually then combine

Adding flexibility Handling speech recognition errors Handling long periods of silence Help Repeating Exiting/Hanging up gracefully

Adding flexibility Given/new information (e.g., emphasis) This implementation of VXML does not allow you to change emphasis despite having tags and

You can get this correct

Additional options Change the timeout length Say as feature Ex. system can say a series of numbers in “telephone style” Use pre-recorded sounds (i.e.,.wav files) Change the voice

Tony’s Tips #4 Start early Reuse code -- don’t reinvent the wheel Put comments in your code If you get stuck ask someone for help See Tony’s Tips 1-3

FUll flow chart Example 3/4