Overview on Gesture Recognition Spring Semester, 2010

Gesture 4 A form of non-verbal communication in which visible bodily actions communicate particular messages 4 Include movement of the hands, face, or other parts of the body

Gesture Recognition 4 Vision / Wave 4 Wearable-sensor 4 Acceleration / Gyro 4 …

Vision and Wave 4 MS –Project natal 4 Nokia –3D device control interface by using ultrasonic transducers

Wearable Sensors

Accelerometer 4 Nintendo Wii 4 Mobile phones

Accelerometers on Mobile Phones

Today’s Paper 4 Natural Throw and Tilt Interaction between Mobile Phones and Distant Displays -Dachselt, R. and Buchholz, R. presented in CHI Throw and Tilt – Seam-less Interaction across Devices Using Mobile Phone Gestures -Dachselt, R. and Buchholz, R., MEIS 2008

Goal 4 Combine the mobile phones with large displays –Most mobile phones are able to store and manage all kinds of personal information and media –All of these devices are inherently limited in terms of their screen size and amount of information they can display

Throw and Tilt 4 Use intuitive throwing gestures to transfer personal media data such as music, pictures, diary entries and map locations to a large screen 4 Use a simple, intuitive, and generic set of tilt gestures to ensure natural interaction

Tilt Interaction 4 Gesture set 4 Linear mapping

Throwing Data 4 Throw –Use a threshold of the Euclidean length of the raw force vector delivered by the sensor 4 Fetch-back

Application Scenarios 4 The zoomable music browser 4 Image / media browser 4 Geo-Referenced Data on Maps

Demo

Summary and Discussion 4 Give a brief overview on gesture recognition 4 The simple but powerful gestures can be used to control various applications –Additional application scenarios: Combining private mobile and public displays  Multi-user collaboration, proximity, and directionality of devices