1. Overview on Gesture Recognition Spring Semester, 2010

3. Gesture 4 A form of non-verbal communication in which visible bodily actions communicate particular messages 4 Include movement of the hands, face, or other parts of the body

4. Gesture Recognition 4 Vision / Wave 4 Wearable-sensor 4 Acceleration / Gyro 4 …

5. Vision and Wave 4 MS –Project natal 4 Nokia –3D device control interface by using ultrasonic transducers

6. Wearable Sensors

7. Accelerometer 4 Nintendo Wii 4 Mobile phones

8. Accelerometers on Mobile Phones

9. Today’s Paper 4 Natural Throw and Tilt Interaction between Mobile Phones and Distant Displays -Dachselt, R. and Buchholz, R. presented in CHI 2009 4 Throw and Tilt – Seam-less Interaction across Devices Using Mobile Phone Gestures -Dachselt, R. and Buchholz, R., MEIS 2008

10. Goal 4 Combine the mobile phones with large displays –Most mobile phones are able to store and manage all kinds of personal information and media –All of these devices are inherently limited in terms of their screen size and amount of information they can display

11. Throw and Tilt 4 Use intuitive throwing gestures to transfer personal media data such as music, pictures, diary entries and map locations to a large screen 4 Use a simple, intuitive, and generic set of tilt gestures to ensure natural interaction

12. Tilt Interaction 4 Gesture set 4 Linear mapping

13. Throwing Data 4 Throw –Use a threshold of the Euclidean length of the raw force vector delivered by the sensor 4 Fetch-back

14. Application Scenarios 4 The zoomable music browser 4 Image / media browser 4 Geo-Referenced Data on Maps

15. Demo

16. Summary and Discussion 4 Give a brief overview on gesture recognition 4 The simple but powerful gestures can be used to control various applications –Additional application scenarios: Combining private mobile and public displays  Multi-user collaboration, proximity, and directionality of devices