HAND GESTURE BASED HUMAN COMPUTER INTERACTION

Hand Gesture Based Applications –Computer Interface A 2D/3D input device (Hand Tracking) Translation of gestures to commands More natural interface for 3D design applications –Aid for disabled and deaf people Sign language analysis, translation Sign language teaching Using multimodality to enable communication between disabled people –Entertainment Applications involving hand gesture recognition, from computer games to sound and image design applications

Right Image Left Image HMM Based Hand Gesture Recognition Process The System Marker Segmentation 2D Kalman Filter 3D Reconstruction 3D Kalman Filter Vector Quantizer Gesture Spotter Application

Gesture Recognition System Setup Requirements: 2D Gesture Recognition System: 1.A simple webcam capable of acquiring RGB images 3D Gesture Recognition System: 1.Two simple webcams capable of acquiring RGB images 2.A mainboard capable of handling two webcams No special equipment required

Gesture Recognition System Setup

3D GESTURES

Capabilities Recognition of 2D and 3D gestures in real time Real time hand tracking – controlling mouse motion Capability of triggering windows input device events – controlling third party applications

Future Work Usage of IOHMM, HMM ANN hybrids A visualization module for the HMMs Combining with body and face analyzers Real time recognition of simple sign language gestures Inclusion of hand posture in recognition process

Demonstration