AudioBrowser Robert Lutz Marilyn Tremaine
01/19/052 What is AudioBrowser AudioBrowser is a system that allows blind users to hear information stored on a computer system through touching and speaking to that system. -works on both a desktop & a PDA
01/19/053 &
4 Current Solution Touch User Interface: AudioBrowser Touchpad Three Tracks
01/19/055 PDA Version Contacts MP3s Documents Internet Right track: information navigation track Left track: system settings track Physical buttons Volume Speed Spelling Voice Pitch More settings Virtual segments presenting the functions, the categories, or the information items PDA screen Figure 1. The invisible audio-tactile interface of AudioBrowser
01/19/056 PDA Architecture Figure 5. Network and Software Architecture for AudioBrowser ASR (CMU Sphinx) * Sync Service (Outlook, SyncML, etc.) teresting NY Times, Wall Street Journal, Google News, Slashdot.org, Etc. TTS Engine (FreeTTS) Test Pulse Code Modulation Formatted Audio Local DB Cache Dynamic Static Audio Output Hierarchical Layout Component System Settings Component Audio Rendering Component Auditory Display Component News Internet Calendar To Do MP3s Memos Information Components Contacts Voice Screen Event User Input Network Boundary Component or Service User Interface Data Flow Future Item Pending Feasibility Investigation Data Store * Network Services Client Device Network Services Client Device
01/19/057 Projects iPaq power-on experience and iPaq platform integration Tutorial development for desktop system Client/server audio controls (iPaq & J2SE) Desktop refresh with RSS feed integration ASR evaluation and protypying for iPaq
01/19/058 Why Participate ? This is a good cause This is a real project This project has high visibility CV value On-campus and asynchronous consultation from our team
01/19/059 Contacts Professor Marilyn Tremaine Robert Lutz Xiaoyu Chen John Visicaro