Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman

Project Goal Development of speech-enabled voice-only version of Electrical and Electronic Engineering Department’s Course Information Management System (CIMS) which is accessed via telephone network.

Development Environment Microsoft Speech Application SDK Beta 4 Microsoft Visual Studio.NET 2003 Enterprise Architect Microsoft SQL Server 2000 Windows 2000 Professional Edition SP 4 (Intel Pentium III 800 MHz, 256 MB RAM)

Overview SERVERCLIENT SR Engine TTS Engine SQL Server Prompts Database USER

Basic Dialog Flow User Name Password Intelligent Mode ? Course Code Course Code/Course Name and Menu YES NO Menu Another Query ? YES END START

Error Handling No Recognition: no speech detected or recognized phrase not covered by grammar Invalid Input: recognized input does not match with user’s data (UserName, Password Course ID, Menu) No Database Connection

SALT Speech Application Language Tags: extension of HTML and XML to support speech-enabled web applications Generated by Speech Application SDK Manipulated directly or via C# codebehind pages Supports client-side scripts to handle recognition or TTS events or prompts

Grammars XML codes complying to W3C’s SRGS (Speech Recognition Grammar Specification) Used by SR engine on the client side. Results returned to server using W3C’s SML (Semantic Mark-up Language)

Grammars

$.Username = $.Username ? $.Username : {}; $.Username._value = $$._value $.Cancel = $.Cancel ? $.Cancel : {}; $.Cancel._value = $$._value

QA Controls Interact with Prompts Database, TTS Engine, SR Engine Prerecorded vs. TTS prompts Prompts generated by combining recorded prompts or parts of recorded prompts 4 different timeouts for recognition timing: Initial, Babble, End Silence, Max

DATABASE A collection of interrelated data DB Models –Entity - Relationship Model –Relational Model –Network Models –etc.

CIMS A Relational DB using MS SQL Server 2000 Entities →Relations→Tables –Users –Courses –etc.

SQL String Query Language –Update, Insert, Delete etc. Operations on CIMS –Make Announcements –Give Assignments –etc.

Voice-Only CIMS Connect to CIMS Database Query the necessary tables –Ex : SELECT ID, Code FROM COURSES WHERE Enabled='1‘ Update the tables –Ex: UPDATE USERS SET LAST_ACCESS = GETDATE() WHERE USERNAME = ‘ '

Regular Expressions Text Processing and String Manipulations –Pattern Matching –String Splitting –Substring Replacement. Regex Class by C#.NET

Regex-CIMS Free Labeling –Ex: hw#3, Homework 3, Spice hw 3 … Using prerecorded prompts – homework 3 \w*\s*) (H|h)\w*(W|w)([^09]*(? \d*)).*","${preambl e}"+"homework "+"${no}")

Conlusion An IVR system, operating side-by-side with online version of CIMS developed Opportunity to gain knowledge about emerging technologies Satisfaction of developing a working system with zero initial knowledge

What to do next? Windows Server 2003 Microsoft Speech Server (MSS) (released in May 2004) Telephone card Deployment onto MSS

Thanks for listening Murat Semerci Çağdaş Kayra Akman