A Low Cost Bidirectional Human-Computer Interface Authors: Alexey Borisenko, Lukash Monczak, Ikvir S Samra, Ovidiu Draghici, Daniel Shapiro, Voicu Groza

Overview  Objectives  Motivation  Neuroplasticity  HCI state-of-art  Approach  Results  Conclusion & Future work carg.site.uottawa.ca CARG 2010

Objectives Non-invasive bidirectional human- computer interface Low-cost (< $20) Faster training time carg.site.uottawa.ca CARG 2010

Motivation HCI devices used by hospitals to alleviate suffering of patients that have lost vision, balance, or mobility. HCI devices very expensive Neuroplasticity CARG 2010 carg.site.uottawa.ca mclasen.com

Neuroplasticity Property of the brain to reorganize itself Phantom limbs Treatment of brain damage Treatment of learning difficulties CARG 2010 carg.site.uottawa.ca brainline.org

HCI State-of-art Brainport [Danilov05] BCI 2000 [Schalk08] BCCI [Walter09] Oral Tactile Interface [Tang06] periodistadigital.com gtec.at met.usc.edu CARG 2010 carg.site.uottawa.ca

Designed Prototype (BHCI): Approach taken carg.site.uottawa.ca CARG 2010 HumanFPGATDU Pushbuttons VGASerial Data Balance Data* *Wicab has applied for provisional patents for the use of balance data for TDUs.

Tongue Display Unit (TDU) carg.site.uottawa.ca CARG 2010 A TDU actuates signals onto the tongue using an electrode array Data is received by the brain and interpreted Signals such as balance [Danilov05] and tactile information [Tang06] are observed

Advantages Low cost Simple architecture Flexible software CARG 2010 carg.site.uottawa.ca

Safety Issues and Considerations carg.site.uottawa.ca Murphy and His Law We naturally assume that any system plugged into the wall should not be connected to a person. No Human Testing, Not Yet For now we are doing testing with a digital oscilloscope and a multimeter. Wireless is the Future [Danilov05] and [Tang06], started with wired designs and left wireless as future work. CARG 2010

Computer-Human Interface carg.site.uottawa.ca Sensory Perception What humans feel CARG 2010 Current (mA) 1 secondFeeling * 1Tingling  5Maximum harmless current  10-20Muscular contraction (pain, unsafe)  Ventricular Fibrillation (can kill)  6000Defibrillation (respiratory paralysis and burns if sustained)  *

Computer-Human Interface carg.site.uottawa.ca Actuating Signals Onto the Tongue 12 th cranial nerve [Lin09]. Resistance of tongue [Faes99]. Approaches to signal actuation: Capacitive conductor (grayscale) Time multiplexing (row, column) Roof of the mouth [Tang06] Surface of tongue (BHCI, Brainport) CARG 2010

Results carg.site.uottawa.ca Low Cost and Proper Operation CARG 2010 The design does not go near the current limit and was designed with very low cost components. * *

Conclusion & Future work CARG 2010 carg.site.uottawa.ca Human testing may follow, eventually. Open collector ICs are required to fix fluctuating output voltage. An upgrade to wireless is needed to approval for human testing. Cleaning protocol Plastic sealant A low cost HCI was designed, implemented, and tested in the lab.

References [Danilov05] Y. Danilov and M. Tyler, “Brainport: an alternative input to the brain.” Journal of integrative neuroscience, vol. 4, no. 4, p. 537, [Tang06] H. Tang and D. Beebe, “An oral tactile interface for blind navigation,” Neural Systems and Rehabilitation Engineering, IEEE Transactions on, vol. 14, no. 1, pp. 116 –123, march [Lin09] H. Lin, P. Barkhaus, “Cranial Nerve XII: The Hypoglossal Nerve”, Seminars in Neurology, vol. 29, no. 1, p [Faes99] T. J. C. Faes, H. A. van der Meij, J. C. de Munck, and R. M. Heethaar, “The electric resistivity of human tissues (100 hz-10 mhz): a meta-analysis of review studies,” Physiological Measurement, vol. 20, no. 4, p. R1, [Borisenko10] A.Borisenko, L. Monczak, I. S. Samra, O. Draghici, D. Shapiro, V. Groza, “A Low Cost Bidirectional Human-Computer Interface,” Medical Measurements and Applications (MeMeA), Apr