Engineering Dialog for Gadgets Thomas K Harris September 12, 2003.

Slides:

Advertisements

Similar presentations

Book Port Plus Getting Started Presented by Maria E. Delgado.

Advertisements

3.01B Multimedia Systems 3.01 Explore multimedia systems, elements and presentations.

Introducing Digital Talking-Book Machines Standard player Advanced player.

Ashmore Hall Auditorium --- Room 119 “Smart Classroom” System Overview & Operation Guide.

CHDD BOL Equipment Primer Rooms CD 326 & CD 391 Behavioral Evaluation Center Behavior Observation Laboratory.

UPnP AV WC Status Update (UPnP Summit 2003) John Ritchie – Intel Geert Knapen – Philips UPnP AV Co-chairs.

CANYON MP3 Player Presentation Compiled and created by Uviwe Nzotho.

Digital Audio 1.

Copyright TVPC 2004 TVPC: The PC for the TV Generation “Breaking the Boundaries of Digital Entertainment”

Pro Tools 7 Session Secrets Chapter 6: After the Bounce or Life Outside of Pro Tools Life Outside of Pro Tools.

Audio Video Update John Ritchie Intel Co-Chair Audio Video Committee.

Future Lifestyle Integrated with Speech Recognition 沈育德.

EXPLAIN THE CONVERSION PRINCIPLES CONVERT CASSETE TO CD By. Sarbini, S.Pd (SMK Muh 3 Yogyakarta)

Solms & Hawes Halls Classroom Multimedia Systems Overview & Operations Guide.

Classroom Support and Instructional Technical Services (CSITS) Help Desk CSITS Help Desk: (248) Emergency: (248) or 911 Key user information:

Teaching Room User Guide – Using the AV Pod, Projector and Screen If the touch panel is blank, press firmly to wake up. Start up the Pod To turn on the.

1 Audio/ Video Display System Dallas County Courts.

PICK AN AUDITORIUM MAIN AUDITORIUM SMALL AUDITORIUM (THIS PAGE DOES NOT EXIST IN THE SYSTEM AND APPEARS ONLY FOR TRAINING PURPOSES IN THIS PROGRAM)

OverviewOverview Features Methods of Programming Programming Cable Programming TV, VCR, DVD, AUDIO Devices (Code-Entry) Programming TV, VCR, DVD, AUDIO.

Book Port Plus APH Quota Dollars 1. Learn the Keys: Record Key Go to Key Bookmark Key Power key Play/Stop key Four arrow keys 2.

IRIS-16 DVR User QUICK GUIDE FCC/ CE, RoHS

Hardware Testing Imeet web conference. Hardware Requirements 2 Windows XP Professional Office XP and above CPU: Pentium 4, 2.4 GHz Memory: 512MB and above.

DIGITAL COMMUNICATIONS.  The modern world is dependent on digital communications.  Radio, television and telephone systems were essentially analog in.

5:47 1: Default Clock State PM Alarm off, time set to 5:47PM. Hour

By William Dooms Patent pending.  Start by pushing side button to video.

ELECTRONIC COMMUNICATION. Electronic Communication  Three parts : Transmitter, Receiver and Channel  Channel uses electrical energy  Graphic communication.

James A Personal Mobile Universal Speech Interface for Electronic Devices.

Phonograph Invented by Thomas Edison-1877 Recorded sound on a tinfoil sheet that rotated on a cylinder Sound played back through a large horn.

Sound Chapter Types of Sound Waveforms MIDI Sound is related to many things in computers but only Wav and MIDI exist in PCs.

1 CCTV SYSTEMS Analog CCTV systems. 2 CCTV SYSTEMS Analog CCTV systems are still prevalent and in use today, “if it isn't broke don’t fix it” is the prevailing.

Brought to you by: The GIG…Geneva Information Gateway Created by Jenny Montemorano Funded by the NYS BTOP Grant.

The two types of storage: Primary Storage Secondary Storage

3dtv.at DV/HDV Tape Drive Synchronization Stereoscopic Displays and Applications Conference 29 th – 31 th January 2007 San Jose, United States.

How to download video using a USB or analog connection.

Embedding Windows Media Player Controls First, you need to add the Developer Tab in PowerPoint. 1. Click on File and choose Options. 2. In the categories.

Learning Dialog Acts for Embodied Agents Thomas K Harris KTH: 19 May 2005.

Books in your Pocket The New Victor Stream Damian Pickering CTEBVI April 2014.

Computer Networks NYUS FCSIT Spring 2008 Igor TRAJKOVSKI, Ph.D. Associate Professor Milos STOLIC, B.Sc. Assistant

Multimedia Literacy. Topics n Definitions n Taxonomy of Multimedia Objects n Survey of Multimedia Applications n Multimedia Computer Components.

Ch Review1 Review Chapter Microcomputer Systems Hardware, Software, and the Operating System.

Creating Multimedia Interaction with Windows Media Technologies 7.

Computer Hardware Information Technology Week 5 and 6

FORD RANGER AM/FM CASSTTE PLAYER Sample Student User Manua l PowerPoint.

Vclass Presentation Component Kanchana Kanchanasut, DEC Director Dr. Akavute Sujare, DEC Consultant Mr. Chaiwarat Chaiyapotpanit, Project Manager Distance.

Multimedia Technology and Applications Chapter 2. Digital Audio

Getting Started: Remote Control

“Show me what you meant”: Mode-switching prompts in a multi-modal dialog system with distractions Thomas Harris & Hua Ai October 25, 2005.

1 THE VICTOR READER WAVE ● Plays DAISY books as well as music and books on MP3 or audio CD ● Powerful navigation features ● Go directly to any page number.

FM CONVERTER. Team Members Dan Harkins Team Leader Beau Blackwell George Henry Shawn Welch Dr. Georgios Lazarou Advisor.

By Amanda Gibson. RJ Cooper has a background in electrical engineering and developmental psychology and a strong motivation to do good, he explains, “I.

DIGITAL GRAPHICS AND ANIMATION MICROSOFT WINDOWS MOVIE MAKER.MSWMM IX.Publishing a Video/Movie.

Digital Storytelling Use of Windows Live Movie Maker to create a digital story using the “Auto” function. Create a digital story in minutes! Sept 2010Malcolm.

2N Net Audio system.

Liberally adapted by Broadcast Signal Lab from copyright material submitted by Kenwood, with permission Simulation of Universal Band Numbering Scheme.

Telecommunications and Networks Chapter 6 Principles and Learning Objectives Effective communication is essential to organizational success. –Define.

1 Multi-Track Recorder Typical Usage Scenario Demonstration.

Radio Broadcasting. RADIO IS FREE! Formats Some History First to simultaneously transmit entertainment to millions Continues to grow, with or without.

ROM AND RAM By Georgia Harris. WHAT DOES IT MEAN?  RAM: random access memory  ROM: read only memory.

MUSIC GENRE JUKEBOX. CLIENT SPECIFICATIONS Audio Player Create, delete, and modify play lists Play, pause, stop, skip, fast forward, and rewind Send Streaming.

Mapping Utterances onto Dialogue Acts with LSA and Naïve Bayes Thomas K Harris Dialogs on Dialogs: May 6, 2005.

User Guide DCT Retail Mode for SMART CAMERA Mobile Application SAMSUNG ELECTRONICS DI IMC.

Introduction Chapter 1. Uses of Computer Networks Business Applications Home Applications Mobile Users Social Issues.

Computer Control and Monitoring Today we will look at: What we mean by computer control Examples of computer control Sensors – analogue and digital Sampling.

EXPLAIN THE CONVERSION PRINCIPLES

Course Introduction & Computer Hardware Second Career Computers Fall 2009.

Recording with the Book port dt

Configuring Windows 10 for Your Studio

PUMA-5 for Law Enforcement

The New Victor Stream Damian Pickering CTEBVI April 2014

Cellular Telephone Networks

Presentation transcript:

Engineering Dialog for Gadgets Thomas K Harris September 12, 2003

???Questions??? Motivation: Is speech a useful modality for electronic devices? Hardware: How would one get speech in “other” devices? Architecture: What should the system look like? Dialog: What should/will these conversations be like?

Phone ClientPDA ClientComputer Client Speech Application Backend Current Speech Application Concept

??? Speech Application Frontend Current Electronic Devices

Protocol-based Architecture Havi adapter X10 adapter Speech Graffiti Personal Universal Controller

James Stereo (mode) tuner (radio band) AM frequency # station WXXX FM frequency # station WXXX seek forward backward auxiliaryCD (status) playstoppause repeat offsingle tracksingle discall discs disc # track # next track last track random onoff x-bass on off volume volume up volume down off Digital camera control Play mode play stop fast fwd rewind record pause step forward backward info Device mode camera VCR Media type Digital video unknown VHS none (mode) Other devices…

Speech Graffiti Dialog Artificial subset language Tree-structured functions Universal conversational primitives User-directed Great for recognition Entirely declarative (and automatic)

Minimal Keywords hello-jamesoptions where-am-i, where-was-i go-ahead, ok statusgoodbye what-is, what-is-the how-do-imore

Session Management hello-james/goodbye User: blah blah blah... System: ignoring user User: hello-james System: stereo, digital camera User: stereo System: stereo here User: goodbye System: goodbye User: blah blah blah... System: ignoring user

Query what-is path/status User: what-is-the am frequency System: the am frequency is five hundred thirty User: what-is random System: random is off User: what-is-the stereo System: the stereo is tuner

help/exploration/implicit navigation how-do-i.../options/path options User: control alarm clock radio options System: alarm, clock, radio, sleep... User: more System: x10, stereo User: stereo options System: while turning stereo on: off, am, fm, auxiliary, cd... User: control alarm clock radio options System: alarm, clock, radio, sleep... User: more System: x10, stereo User: stereo options System: while turning stereo on: off, am, fm, auxiliary, cd...

invocation/specification/implicit exploration/navigation Path User: stereo auxiliary System: while turning the stereo on and switching to auxiliary: auxiliary User: cd System: while switching to cd mode: cd User: play System: while playing a cd: play

list navigation More User: radio band am options System: bracketed list [frequency, kabc, k001, k002, k003, k004, k005][fm][off, volume][alarm, clock, sleep][x10, stereo] rendered: frequency, kabc, k001, k User: more System: k003, k004, k User: more System: fm, off, volume... User: radio band am options System: bracketed list [frequency, kabc, k001, k002, k003, k004, k005][fm][off, volume][alarm, clock, sleep][x10, stereo] rendered: frequency, kabc, k001, k User: more System: k003, k004, k User: more System: fm, off, volume...

orientation where-am-i User: what is the disc System: the disc is three User: where am i System: stereo cd disc

Research Questions Is the subset language learnable? Once learned, is it efficient? Are user mistakes infrequent enough? Are system mistake infrequent enough? Can one generalize from one device to another? Is the subset language well retained?