1. Saron Paz Zvika Markfeld Tomer Daniel Oleg Imanilov

2. An open source software & hardwareopen source Combining:  Arduino Arduino  Sensors  Android ADK Android ADK  Android

3.  A glove that translates a predefined vocabulary of the deaf and mute sign language into text

4.  Develop a humane, easy-to-use interface allowing hearing impaired people to communicate more freely with their physical surrounding  Allow for new interaction models between (non- disabled) people and machines  For example, we can all probably think of reasonable ways to express concepts such as "Send", "Undo", "Okay" etc. in hand gestures.  Incorporating these into everyday interactions between people and computers may help people get into more intuitive touch with technology  This, in turn, may enable elderly people and/or people coming from non-technological background to tap into today's technological world

5. Lily-Pad Arduino samples sensors attached to glove ADK board relays data from the Lily-Pad to Android Android uses a back propagation Neural Network to analyze data

6. Arduino compatible microcontroller board designed for wearables and e-textiles

7. Flex Sensors measure finger bending Wii Nunchuck = Accelerometer + Gyros Conductive tape detects fingers touching

8.  Flex Sensor changes resistance when bent  Using a voltage divider the voltage is read by Arduino ADC (10 bits)

10. 2 Buttons Joystick Accelerometer (X,Y,Z) Gyros (Roll, Pitch) I2C & Power

12.  Interconnected group of artificial neurons  Good at pattern recognitionpattern recognition

13.  Each connection has weight, which can be modified so as to model synaptic learning  Each neuron computes a threshold function of the weighted sum of its inputs  In a back propagation network weights are modified proportionally to the error

14. Artificial Neural Network GUI Relay ADK library Sensor Control Serial

22.  How to position flex sensors?  Fix tip to top and pass through sewn loops  How to distinguish between R,U,V,S,E,T,N?  Conductive tape detects fingers touching  How to distinguish between each letter?  Time based  How to record movement?  Freeze in the middle

24.  The user is required to calibrate the glove once the application starts  Calibration is needed to compensate for different wearers and even for re-wearing  All sensors are flexed to find working minima and maxima  After calibration all sensors are normalized

25.  The user is required to train the neural network to the vocabulary  Training involves recording of every gesture as well as training the neural network

27. Saron Paz is an experience designer & a hopeless idealist Zvika Markfeld is a design freshman and an aspiring inventor Tomer Daniel is a software architect by day & a maker by night Oleg Imanilov is a software engineer & a brilliant ideas generator

28.  Show & Tell Google code project  http://code.google.com/p/adk-sign-language- translator-glove/ http://code.google.com/p/adk-sign-language- translator-glove/  Sensors  Flex Sensors http://www.sparkfun.com/products/8606 http://www.sparkfun.com/products/10264  Nunchuck http://www.dealextreme.com/p/designer-s-nunchuck- controller-for-wii-24529  Arduino  Wiichuck class http://www.arduino.cc/playground/Main/WiiChuckClass  Android ADK http://developer.android.com/guide/topics/usb/adk.html