1. Department of Electrical and Computer Engineering He Zhou Hui Zheng William Mai Xiang Guo Advisor: Professor Patrick Kelly ASLLENGE Comprehensive Design Review Feb 16 2012

2. Department of Electrical and Computer Engineering Outline  Introduction  Timeline/Progress  Future Work  FPR Goals  Demonstration  Q/A

3. Department of Electrical and Computer Engineering Introduction Project Objective: Gesture Recognition Unfamiliarity with ASL (lack of data) Wide Implications CHALEARN Gesture Challenge (By Kaggle)  Design changes New Record Function Hierarchical Search Pattern marching

4. Department of Electrical and Computer Engineering CHALEARN Gesture Challenge By Kaggle  “The challenge focuses on hand gestures. Applications include man-machine communication, translating sign languages for the deaf, video surveillance, and computer gaming”  “learning to recognize new categories of gestures from a single video clip of each gesture.”

5. Department of Electrical and Computer Engineering Team Roles  He Zhou(CSE): test and integrate software prototype  Hui Zheng(CSE): database development and programming  William Mai (EE): build microcontroller to detect finger and palm movements  Xiang (EE): build Arduino board, overall testing, building ASL database, and website administration 5

6. Department of Electrical and Computer Engineering Demonstration

7. Department of Electrical and Computer Engineering Kinect Environment For Integration Afterward  Two Hand tracking (able to tell left hand from right hand)  Grid Size change according to body size  More refined Grid recognition

8. Department of Electrical and Computer Engineering Planned Timeline 8

9. Department of Electrical and Computer Engineering Progress Timeline 9

10. Department of Electrical and Computer Engineering To Do  Complete Database and Database Interface  Complete Finger Tracking Module  Refine Kinect Environment  Integration

11. Department of Electrical and Computer Engineering Q&A 11