Prototype Presentation March, 2012 BodyPointer

Team Members Miri Peretz Moshe Unger Advisors Prof. Yuval Elovici Dr. Rami Puzis Web Site http://thebodypointer.wordpress.com/

Reminder BodyPointer will give ability to people with physical impairments to control the computer. The project will be based on MindDesktop project, which use Epoc headset in order to detect signals from face movement and thought. In addition to that signals, BodyPointer will interact with the Body Sensors System, called ProComp Infiniti, which covers a full range of objective physiological signals used in biofeedback. With those two devices, the system can measure bodily and face signals and capture data in real time.

BodyPointer Devices System BodyPointer Core Signals ProComp Infinti User BodyPointer UI Epoc Helmet

Prototype The prototype is mainly related to the new functionality that is added by the body sensors. In order to prove the concept, we applied the following tasks: Connect to encoder Get signals from encoder Detect the body action preformed Detect the sensor which sent the signal Translate the body action into UI operation Execute and use basic applications in Windows OS, using a virtual keyboard

Prototype The demo demonstrates navigation and execution of Windows applications, by putting body sensors on 3 different locations: Respiration sensor – e.g. on the right hand Respiration sensor – e.g. on the stomach EMG sensor – e.g. on the left hand Those locations define 3 basic actions: Left/Right, Up/Down and Click. For example, by bending the left hand, the marker of the application will move up.

Prototype Core Demo UI ProComp Infinti User

Demo

Prototype While proving the concept with BodyPointer Demo we also focused on the following tasks: Get familiar with the devices Learn MindDesktop project Integration between Procomp Infiniti and Epoc Headset Integration between MindDesktop code and BodyPointer Demo Analyze the main problems at MindDesktop project and suggest solutions

Conclusions Each user has different range of signal’s values that detected by the sensors in each body location. Thus, it is necessary to define accurate training phase that promise reliable system. Synchronizing between more than one body action simultaneous is needed. Testing the body actions from the perspective of disabled users is essential.

Schedule Planning Application Design System architecture User Interface Training Process Development Complete Integration between Procomp Infiniti and Epoc Headset Change existing features of MindDesktop Add new features Testing Perform usability experiments on disabled users

THANK YOU for listening