1. A Low Cost Bidirectional Human-Computer Interface Authors: Alexey Borisenko, Lukash Monczak, Ikvir S Samra, Ovidiu Draghici, Daniel Shapiro, Voicu Groza

2. Overview  Objectives  Motivation  Neuroplasticity  HCI state-of-art  Approach  Results  Conclusion & Future work carg.site.uottawa.ca CARG 2010

3. Objectives Non-invasive bidirectional human- computer interface Low-cost (< $20) Faster training time carg.site.uottawa.ca CARG 2010

4. Motivation HCI devices used by hospitals to alleviate suffering of patients that have lost vision, balance, or mobility. HCI devices very expensive Neuroplasticity CARG 2010 carg.site.uottawa.ca mclasen.com

5. Neuroplasticity Property of the brain to reorganize itself Phantom limbs Treatment of brain damage Treatment of learning difficulties CARG 2010 carg.site.uottawa.ca brainline.org

6. HCI State-of-art Brainport [Danilov05] BCI 2000 [Schalk08] BCCI [Walter09] Oral Tactile Interface [Tang06] periodistadigital.com gtec.at met.usc.edu CARG 2010 carg.site.uottawa.ca

7. Designed Prototype (BHCI): Approach taken carg.site.uottawa.ca CARG 2010 HumanFPGATDU Pushbuttons VGASerial Data Balance Data* *Wicab has applied for provisional patents for the use of balance data for TDUs.

8. Tongue Display Unit (TDU) carg.site.uottawa.ca CARG 2010 A TDU actuates signals onto the tongue using an electrode array Data is received by the brain and interpreted Signals such as balance [Danilov05] and tactile information [Tang06] are observed

9. Advantages Low cost Simple architecture Flexible software CARG 2010 carg.site.uottawa.ca

10. Safety Issues and Considerations carg.site.uottawa.ca Murphy and His Law We naturally assume that any system plugged into the wall should not be connected to a person. No Human Testing, Not Yet For now we are doing testing with a digital oscilloscope and a multimeter. Wireless is the Future [Danilov05] and [Tang06], started with wired designs and left wireless as future work. CARG 2010

11. Computer-Human Interface carg.site.uottawa.ca Sensory Perception What humans feel CARG 2010 Current (mA) 1 secondFeeling * 1Tingling  5Maximum harmless current  10-20Muscular contraction (pain, unsafe)  100-300Ventricular Fibrillation (can kill)  6000Defibrillation (respiratory paralysis and burns if sustained)  * http://www.highvoltageconnection.com/articles/ElectricShockQuestions.htm http://www.highvoltageconnection.com/articles/ElectricShockQuestions.htm

12. Computer-Human Interface carg.site.uottawa.ca Actuating Signals Onto the Tongue 12 th cranial nerve [Lin09]. Resistance of tongue [Faes99]. Approaches to signal actuation: Capacitive conductor (grayscale) Time multiplexing (row, column) Roof of the mouth [Tang06] Surface of tongue (BHCI, Brainport) CARG 2010

13. Results carg.site.uottawa.ca Low Cost and Proper Operation CARG 2010 The design does not go near the current limit and was designed with very low cost components. * * http://www.youtube.com/user/uottawaBHCI#p/a/u/0/Sm0DINKrUHg

14. Conclusion & Future work CARG 2010 carg.site.uottawa.ca Human testing may follow, eventually. Open collector ICs are required to fix fluctuating output voltage. An upgrade to wireless is needed to approval for human testing. Cleaning protocol Plastic sealant A low cost HCI was designed, implemented, and tested in the lab.

15. References [Danilov05] Y. Danilov and M. Tyler, “Brainport: an alternative input to the brain.” Journal of integrative neuroscience, vol. 4, no. 4, p. 537, 2005. [Tang06] H. Tang and D. Beebe, “An oral tactile interface for blind navigation,” Neural Systems and Rehabilitation Engineering, IEEE Transactions on, vol. 14, no. 1, pp. 116 –123, march 2006. [Lin09] H. Lin, P. Barkhaus, “Cranial Nerve XII: The Hypoglossal Nerve”, Seminars in Neurology, vol. 29, no. 1, p.45-52. [Faes99] T. J. C. Faes, H. A. van der Meij, J. C. de Munck, and R. M. Heethaar, “The electric resistivity of human tissues (100 hz-10 mhz): a meta-analysis of review studies,” Physiological Measurement, vol. 20, no. 4, p. R1, 1999. [Borisenko10] A.Borisenko, L. Monczak, I. S. Samra, O. Draghici, D. Shapiro, V. Groza, “A Low Cost Bidirectional Human-Computer Interface,” Medical Measurements and Applications (MeMeA), Apr. 2010.