VAHCS Voice Activated Home Control System By: Kyle Joseph Troy Resetich Advisors: Dr. Malinowski Dr. Schertz

Presentation Outline Project Summary Functional Description Block Diagram IR Capture IR Capture IR Transmission IR Transmission Voice Direct II interface Voice Direct II interface User Interface User InterfaceConclusion

Infra-red Presentation Summary

Project Summary Control any IR activated device Control any IR activated device Via voice command Via voice command Programmable Programmable Learn IR Code Learn IR Code Learn Voice Command Learn Voice Command Learn Multiple IR Commands per Voice Command User interface

Functional Description Inputs Voice Commands Voice Commands IR Sequences To Be Captured IR Sequences To Be Captured Key Presses (User Responses to Menu) Key Presses (User Responses to Menu)Outputs User Interface Menu Via LCD Screen User Interface Menu Via LCD Screen Transmitted IR Sequences Transmitted IR Sequences Speaker Queuing User To Say Command Word Speaker Queuing User To Say Command Word

Functional Description Modes Of Operation Continuous Voice Recognition Command Recognized IR Transmit IR Transmit Keypad Initiated Learn Mode Learn Voice Command Learn Voice Command Learn IR Command(s) Learn IR Command(s) Keypad Initiated Erase Mode IR Sequences IR Sequences Voice Systems Voice Systems

Block Diagram Sub-Systems 8051 Microprocessor Sensory Voice Direct II (Voice - recognition chip ) LCD (liquid crystal display) Keyboard IR Receiver IR Transmitter Microphone Speaker

Accomplished 1: SW Accomplished 1: SW Logic of Capture is Sampling Each Sample Saved as Bit in External Memory Each Sample Saved as Bit in External Memory Time Out of 7 seconds if no IR detected 720 samples per sequence

Accomplished 2: SW Accomplished 2: SW Panasonic DVD Play Sony VCR Play Sony Receiver Aux IR to X-10 DVD Discrete Off

Accomplished 3: SW Accomplished 3: SW Sample every 100 µs 72 ms Recording time for each IR Sequence Logic Low Header Included Logic Low Header Included Each Sequence Requires 90 Bytes of Memory

Accomplished 4: SW Accomplished 4: SW Transmitting Stored IR Sequences Uses Same Logic and Timing as Capturing Every 100 µs one of the 720 samples sent to output pin

Accomplished 5: HW Accomplished 5: HW Transmission of IR requires simple modulation 1 =>intensity of IR light modulated with a triangle wave 1 =>intensity of IR light modulated with a triangle wave 0 =>no IR light 0 =>no IR light Modulator = VCO, OP-AMP, Transistor, IR-LED LED requires 76 mA (peak) LED requires 76 mA (peak)

Set Backs 1 Set Backs 1 Some IR Codes Can Not Be Stored Using This Method DVD Discrete On DVD Discrete On IR to X-10 IR to X-10

Set Backs 2 Set Backs 2 Panasonic DVD Play Sony VCR Play Sony Receiver Aux IR to X-10 DVD Discrete Off

VDII +User Interface VDII +User Interface Control a complete menu interface with voice activation Co-ordinate voice inputs with IR signals Create user-friendly interface

Problems: Slave mode: “not supported” “not supported” Stand-alone (4 modes): Stand-alone (4 modes): ESR, SCL, MCL, SWS Utilize SCL “Single Trigger Continuous Listening” Memory: 60 words different modes 60 words different modes SCL 1 trigger word + 15 words Number of I/0 pins available

Slave Mode: Originally the slave mode would allow the EMAC to control the voice templates. SCL Mode:

Number of I/O pins: 2 VDII boards working in Parallel 2 trigger-words or “systems” 2 trigger-words or “systems” 30 commands or 15 per system 30 commands or 15 per system Ports: Ports: Share 8 pin parallel inputTALK signal Share 8 pin parallel inputTALK signal Monitor Talk signal Monitor Talk signal Duration of 176ms Duration of 32 ms

Voice Direct II/EMAC interface Voice Direct II Board Input/output configuration TALK OUT1 OUT2 OUT3 OUT4 OUT5 OUT6 OUT7 OUT8 MODE1 MODE2 TRAIN TRIG-TRAIN RESET Held Externally Emac Outputs Emac Inputs

EMAC/Voice Direct II interface: EMAC Board Input/output configuration VDII CMOS TALK Sys. 1 TALK Sys. 2 OUT1 OUT2 OUT3 OUT4 OUT5 OUT6 OUT7 OUT8 RECOG(1) TRAIN(1) TRIG-TRAIN(1) RECOG(2) TRAIN(2) TRIG-TRAIN(2) P0.2 P0.3 P0.4 P0.5 P0.6 P0.7

EMAC/Voice Direct II interface: Use CMOS switches MAX4614 active HIGH Delay used to output 105 ms pulse, INX port VDII RECOG(1) TRAIN(1) TRIG-TRAIN(1) RECOG(2) TRAIN(2) TRIG-TRAIN(2) P0.2 P0.3 P0.4 P0.5 P0.6 P0.7

VDII + User interface: Initializations: Initializations: Reset both boards Reset both boards TRAIN & RECOG set HIGH TRAIN & RECOG set HIGH Options: Options: Add New System Add New System Add New Command Add New Command Delete System Delete System

Menu Flow-Chart:

Add New System:

Add New Command:

Delete System:

Listening mode entered after any command is stored Trigger word + Command word Recognized LED + Voice Output EMAC External I/0 input Corresponding IR Recalled IR output VDII Feedback:

“Voice Activation”: Receive Voice Command Word? No Transmit IR Sequence Yes Last IR Sequence? No Yes

Conclusion: Currently Completed: User interface operational User interface operational EMAC / VDII interface operational EMAC / VDII interface operational IR Capture/Transmit IR Capture/Transmit Possible Project Extensions: IR / Voice integration IR / Voice integration Memory Problems (single EMAC board) Memory Problems (single EMAC board)

QUESTIONS?