Spontaneous Voice Driven Interaction with Avatars: Discriminating Alerting and Referential Contexts of Sentinel Words The Problem The Solution e-WUW: Technology with increased accuracy of One (1) error per 23,635 words! Humans can not spontaneously interact with computers using their voice. Human-Machine Interaction (Press-to-talk): Optimistic Word Accuracy Rate is 99% State-of-the-Art Speech Recognition: 150-200 words per minute: Spontaneous Speech: One (1) error in less than a minute. Spontaneous Voice Only Hands-Free Computer Interaction is not possible! No Hands-Free Interface: e-WUW Recognizer Text-to-Speech Dictation System Command and Control Application Dependent Actions Hi Neytiri! “Jake!” … 1 1 2 2 3 3 PI PhD 3 Student PhD 2 PhD 1 Co-PI Research Approach Research Team + Expenses: Dr. Kepuska (PI), Dr. Carstens (Co-PI) + 3 PhD’s: $293,564 + $109,047 (Tuition) + $ 29,000 (Misc) 3 Years Total (including FIT’s MTDC): $509,808 or $169,935/year Data Collection & Analysis Data collection from movie DVD’s (Human-to-Human): to be made publically available. Wizard-of-Oz and using PowerPoint Commander (Human-Machine) Prosodic Research & Modeling Research & Develop Models from Prosodic Features for Sentinel Word Context Discrimination White Paper Documenting the Work. Integration & Develop-ment Integration of e-WUW with Windows OS Speech Centric Interface to Windows OS using Sentinel Word Recognition Time Table 5/10/2019 Dr. V. Këpuska