Remote Control of a Television Set via Thought Patterns Dr. William Hunt, Project Advisor Josh Rosner Drew Petry Gary Grimm George Melcer Thursday, March 11, 2010

The MindLink System Manipulates television functions via user thought patterns Provides independence to handicapped and disabled persons Estimated development cost at $80,940; per unit cost will be approximately $500

Design Objectives Minimize system costs to maximize target market Offer intuitive interface for non-technical users Manipulate simple command set for IR (Infrared) controlled devices Detect EEG (Electroencephalogram) signals in real- time to provide reliable thought pattern analysis Utilize Emotiv API (Application Programming Interface) in analysis software Interface with modified off-the-shelf remote control

Current Status EEG Headset –Selected and purchased headset –Commenced training with one engineer Host PC / EAS –Designed Pseudo code and learned about API SPB /URC –Completed Circuit Design and Board Layout

EEG Headset

Illustration

Input Propagation

Emotiv Control Panel

Cognitive Suite

Expressive Suite

EEG Headset - Problems / Issues Problem: Consistency of EEG signal from user Proposed Solutions –More training –Alter sensitivity settings –Use Expressive Suite Problem: Placement of headset Proposed Solutions –Need consistent signals to test –Seek advice from Emotiv online community

Host PC: EmoState Analysis Software

Software Process

Software Logic

EAS – Problems / Issues Problem: Invoking and communicating with Emotiv API Proposed Solutions –Should include EDK.h and link with EDK.dll –Use EE_EngineConnect for communication with headset; EE_EngineRemoteConnect used for communication with EmoComposer (debugging) Problem: Sending commands to Synergy board Proposed Solutions –Propose communication of serial connection –Invoke.NET System.IO.Ports namespace and use instance of SerialPort class

Synergy Prototyping Board & Universal Remote Control

Synergy Prototyping Board

SPB Layout

Synergy Prototyping Board Firmware

SPB – Problems / Issues Problem: MOSFETs did not interface with URC as expected Proposed Solution –Opted for bi-lateral switches instead of MOSFETs because we are open/closing a circuit, NOT pulling the signal high or low Problem: Simulation of SPB requires too much time Proposed Solution –Use “trial and error” approach with physical implementation of the board Problem: Soldering joints are weak on URC Proposed Solution –Use RTV silicone to isolate joints and prevent breaks

Acceptance Testing EPOC Headset –Train and test with Emotiv Control Panel EmoState Analysis Software –Utilize EmoComposer, printf stream, and debug symbols Synergy Prototyping Board & Universal RC –Component Testing (Switches, Microcontroller, etc.) –Board Testing (LED Blink Program) MindLink System –Iterate through defined thought patterns

Projected Schedule March 19 th –EAS Development Complete –SPB Firmware Development Complete April –16 th : System Integration Complete –30 th : Final Project Summary Complete May 6 th –Final Report Complete –Successful Project Demonstration

Budget & Cost Analysis MindLink Venture Prototype –Initial Capital Expenditure:$750 –Labor Costs:$80,000 –Per Unit Component Cost:$500 10,000 Units Production over 60 Months –Total Costs:$3,700,000 –Total Sales ($500 per unit):$5,000,000 –Net Profits:$1,300,000

Future Work Headset –Complete Emotiv Control Panel Training EmoState Analysis Software –Port pseudo code to C# –Develop and test serial port interface class –Test and debug Synergy Prototyping Board –Order PCB and generate Gerber Files –Order Additional Components –Develop Firmware –Test and debug MindLink System –Complete component integration –Test and debug

Questions / Feedback EmoState Analysis Software –How to interface C# with serial ports? Synergy Prototyping Board –Alternative Solutions?