1. Department of Electrical and Computer Engineering He Zhou Hui Zheng William Mai Xiang Guo Advisor: Professor Patrick Kelly ASLLENGE Final Project Review April 4 th, 2012

2. Department of Electrical and Computer Engineering Outline  Introduction  Hardware  Integration  Recognition Algorithm  Add-on  Q/A

3. Department of Electrical and Computer Engineering Chart

4. Department of Electrical and Computer Engineering Hardware Implementation 1  Increasing the resistance of the flex sensor with bending  Inserting flex sensor into each glove  AD convertor captures analog signals while bending 4 Flex Sensor Flex Sensor Glove

5. Department of Electrical and Computer Engineering  Circuitry between flex sensor gloves and AD convertor.  Impedance buffet with relation at Impedance Buffer Hardware Implementation 2

6. Department of Electrical and Computer Engineering Hardware Implementation 3  The Arduino Mega 2560 works as an AD converter  PC captures the signal via USB or Bluetooth  Powered by 9V battery  Digital Number 6 Arduino Mega 2560

7. Department of Electrical and Computer Engineering Software Integration and Bluetooth  Choosing BlueSMiRF Silver  Sending 10 digits each time from Arduino  Synced on 9600 baud rate BlueSMiRF Silver Screen Shot of Data

8. Department of Electrical and Computer Engineering Hardware Testing  Flex sensors calibration  CircuitWriter Conductive Pen  Strain relief  insulation Conductive Pen

9. Department of Electrical and Computer Engineering Cost of Major Components 9

10. Department of Electrical and Computer Engineering Integration  Use Data gathered from both Kinect and Finger Tracker.  Convert the data in a meaningful way to input into the database

11. Department of Electrical and Computer Engineering Kinect Component  Rectangular Boxes generated around the body of the user  Whenever any of the user’s wrist move over a box, data formation begins Break and Regenerate Box ID is Saved Region is Saved

12. Department of Electrical and Computer Engineering Hand Component  Data Gathered from the Arduino  Data is saved whenever there is a box break using String with length 5

13. Department of Electrical and Computer Engineering Interface

14. Department of Electrical and Computer Engineering Levenshtein Distance  Named for Vladimir Levenshtein, who devised the algorithm in 1965.  Measuring the amount of difference between two sequences.  Has use in Spell checking, Speech recognition, DNA analysis, and Plagiarism detection

15. Department of Electrical and Computer Engineering Levenshtein Distance (cont.) Source: 1100 0110 1000 Target : 1110 0110 0010

16. Department of Electrical and Computer Engineering Background Subtraction  Use Skeleton Tracking to track the human being from the depth camera.  Comparing the data streams rendered by the depth camera and the color camera.  Subtract out any pixels that don’t belong to a player.

17. Department of Electrical and Computer Engineering Q&A 17