Department of Electrical and Computer Engineering He Zhou Hui Zheng William Mai Xiang Guo Advisor: Professor Patrick Kelly ASLLENGE Final Project Review April 4 th, 2012

Department of Electrical and Computer Engineering Outline  Introduction  Hardware  Integration  Recognition Algorithm  Add-on  Q/A

Department of Electrical and Computer Engineering Chart

Department of Electrical and Computer Engineering Hardware Implementation 1  Increasing the resistance of the flex sensor with bending  Inserting flex sensor into each glove  AD convertor captures analog signals while bending 4 Flex Sensor Flex Sensor Glove

Department of Electrical and Computer Engineering  Circuitry between flex sensor gloves and AD convertor.  Impedance buffet with relation at Impedance Buffer Hardware Implementation 2

Department of Electrical and Computer Engineering Hardware Implementation 3  The Arduino Mega 2560 works as an AD converter  PC captures the signal via USB or Bluetooth  Powered by 9V battery  Digital Number 6 Arduino Mega 2560

Department of Electrical and Computer Engineering Software Integration and Bluetooth  Choosing BlueSMiRF Silver  Sending 10 digits each time from Arduino  Synced on 9600 baud rate BlueSMiRF Silver Screen Shot of Data

Department of Electrical and Computer Engineering Hardware Testing  Flex sensors calibration  CircuitWriter Conductive Pen  Strain relief  insulation Conductive Pen

Department of Electrical and Computer Engineering Cost of Major Components 9

Department of Electrical and Computer Engineering Integration  Use Data gathered from both Kinect and Finger Tracker.  Convert the data in a meaningful way to input into the database

Department of Electrical and Computer Engineering Kinect Component  Rectangular Boxes generated around the body of the user  Whenever any of the user’s wrist move over a box, data formation begins Break and Regenerate Box ID is Saved Region is Saved

Department of Electrical and Computer Engineering Hand Component  Data Gathered from the Arduino  Data is saved whenever there is a box break using String with length 5

Department of Electrical and Computer Engineering Interface

Department of Electrical and Computer Engineering Levenshtein Distance  Named for Vladimir Levenshtein, who devised the algorithm in  Measuring the amount of difference between two sequences.  Has use in Spell checking, Speech recognition, DNA analysis, and Plagiarism detection

Department of Electrical and Computer Engineering Levenshtein Distance (cont.) Source: Target :

Department of Electrical and Computer Engineering Background Subtraction  Use Skeleton Tracking to track the human being from the depth camera.  Comparing the data streams rendered by the depth camera and the color camera.  Subtract out any pixels that don’t belong to a player.

Department of Electrical and Computer Engineering Q&A 17