Department of Electrical and Computer Engineering He Zhou Hui Zheng William Mai Xiang Guo Advisor: Professor Patrick Kelly ASLLENGE Comprehensive Design Review Feb

Department of Electrical and Computer Engineering Outline  Introduction  Timeline/Progress  Future Work  FPR Goals  Demonstration  Q/A

Department of Electrical and Computer Engineering Introduction Project Objective: Gesture Recognition Unfamiliarity with ASL (lack of data) Wide Implications CHALEARN Gesture Challenge (By Kaggle)  Design changes New Record Function Hierarchical Search Pattern marching

Department of Electrical and Computer Engineering CHALEARN Gesture Challenge By Kaggle  “The challenge focuses on hand gestures. Applications include man-machine communication, translating sign languages for the deaf, video surveillance, and computer gaming”  “learning to recognize new categories of gestures from a single video clip of each gesture.”

Department of Electrical and Computer Engineering Team Roles  He Zhou(CSE): test and integrate software prototype  Hui Zheng(CSE): database development and programming  William Mai (EE): build microcontroller to detect finger and palm movements  Xiang (EE): build Arduino board, overall testing, building ASL database, and website administration 5

Department of Electrical and Computer Engineering Demonstration

Department of Electrical and Computer Engineering Kinect Environment For Integration Afterward  Two Hand tracking (able to tell left hand from right hand)  Grid Size change according to body size  More refined Grid recognition

Department of Electrical and Computer Engineering Planned Timeline 8

Department of Electrical and Computer Engineering Progress Timeline 9

Department of Electrical and Computer Engineering To Do  Complete Database and Database Interface  Complete Finger Tracking Module  Refine Kinect Environment  Integration

Department of Electrical and Computer Engineering Q&A 11