2. Student Name Server Utah School of Computing slide 1 Utah School of Computing GesturesGestures CS5540 HCI Rich Riesenfeld Fall 2010 CS5540 HCI Rich Riesenfeld Fall 2010

3. Student Name Server Utah School of Computing slide 2 Gestures Studies Following Gesture material from: Hand Centered Studies of Human Movement Project, School of Kinesiology, Simon Fraser University, February 1996 Fall 2010

4. Student Name Server Utah School of Computing slide 3 Gestures-1Gestures-1 Praying (two flat hands up together)Praying (two flat hands up together) Begging (flat hand)Begging (flat hand) Expressing anger (raising a fist)Expressing anger (raising a fist) Derogation (middle finger up)Derogation (middle finger up) Accusation (index pointing)Accusation (index pointing) Live or die decisions in the Roman amphitheater (thumb up/down)Live or die decisions in the Roman amphitheater (thumb up/down) Praying (two flat hands up together)Praying (two flat hands up together) Begging (flat hand)Begging (flat hand) Expressing anger (raising a fist)Expressing anger (raising a fist) Derogation (middle finger up)Derogation (middle finger up) Accusation (index pointing)Accusation (index pointing) Live or die decisions in the Roman amphitheater (thumb up/down)Live or die decisions in the Roman amphitheater (thumb up/down) Fall 2010

5. Student Name Server Utah School of Computing slide 4 Gestures-2Gestures-2 Hitch hiking (thumb up, hand moving sideways) Fall 2010

6. Student Name Server Utah School of Computing slide 5 Gestures-3Gestures-3 Legal and business transactions (handshake, judge hammering) Fall 2010

7. Student Name Server Utah School of Computing slide 6 Gestures-4Gestures-4 Pointing to real and abstract objects and concepts (index, hand) Fall 2010

8. Student Name Server Utah School of Computing slide 7 Gestures-5Gestures-5 Waving and Saluting Fall 2010

9. Student Name Server Utah School of Computing slide 8 Gestures-6Gestures-6 Waving and Saluting Fall 2010

10. Student Name Server Utah School of Computing slide 9 Gestures-7Gestures-7 Finger Counting Thumb often used for 1, esp abroad Fall 2010

11. Student Name Server Utah School of Computing slide 10 Gestures-8Gestures-8 Fall 2010 I beg of you … I hope so …

12. Student Name Server Utah School of Computing slide 11 Gestures-9 Fall 2010 Lets hope its true

13. Student Name Server Utah School of Computing slide 12 Gestures-10Gestures-10 Fall 2010

14. Student Name Server Utah School of Computing slide 13 Gestures-11 Fall 2010

15. Student Name Server Utah School of Computing slide 14 Gestures-12 Terminate / cut Fall 2010

16. Student Name Server Utah School of Computing slide 15 Gestures-12 Love (Am Sign Language) Fall 2010

17. Student Name Server Utah School of Computing slide 16 Gestures-13 Fall 2010 Whoa, stop, … End

18. Student Name Server Utah School of Computing slide 17 Gestures-14Gestures-14 1 10 100 Trading Floor Hand Signals Fall 2010

19. Student Name Server Utah School of Computing slide 18 Gestures-15 Fall 2010 juneseptember call put out Trading Floor Hand Signals

20. Student Name Server Utah School of Computing slide 19 Gestures-16Gestures-16 Conducting an orchestra (variety of both gestures with arms and body)Conducting an orchestra (variety of both gestures with arms and body) Traffic control of cars and airplanes (hands flat pointing or moving)Traffic control of cars and airplanes (hands flat pointing or moving) Shaping of imagined objects (hands tracing out curves and shapes)Shaping of imagined objects (hands tracing out curves and shapes) Martial arts, fighting (variety of movements of arms and body)Martial arts, fighting (variety of movements of arms and body) Conducting an orchestra (variety of both gestures with arms and body)Conducting an orchestra (variety of both gestures with arms and body) Traffic control of cars and airplanes (hands flat pointing or moving)Traffic control of cars and airplanes (hands flat pointing or moving) Shaping of imagined objects (hands tracing out curves and shapes)Shaping of imagined objects (hands tracing out curves and shapes) Martial arts, fighting (variety of movements of arms and body)Martial arts, fighting (variety of movements of arms and body) Fall 2010

21. Student Name Server Utah School of Computing slide 20 Gestures-17Gestures-17 Dance (Balinese dancing)Dance (Balinese dancing) Gesturing by singers (hand and body movements)Gesturing by singers (hand and body movements) Stock exchange operations (various hand shapes)Stock exchange operations (various hand shapes) Affective gestures (hand touching)Affective gestures (hand touching) Rejective (index up moving left & right) / appreciative (hand clapping) gesturesRejective (index up moving left & right) / appreciative (hand clapping) gestures Dance (Balinese dancing)Dance (Balinese dancing) Gesturing by singers (hand and body movements)Gesturing by singers (hand and body movements) Stock exchange operations (various hand shapes)Stock exchange operations (various hand shapes) Affective gestures (hand touching)Affective gestures (hand touching) Rejective (index up moving left & right) / appreciative (hand clapping) gesturesRejective (index up moving left & right) / appreciative (hand clapping) gestures Fall 2010

22. Student Name Server Utah School of Computing slide 21 Gestures-18Gestures-18 Game playing (hand signs to communicate with partner in card games)Game playing (hand signs to communicate with partner in card games) Game scoring (cricket, basketball, soccer, rugby, football)Game scoring (cricket, basketball, soccer, rugby, football) Dinner table actions (commanding waiter to refill wine glass)Dinner table actions (commanding waiter to refill wine glass) Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle) Game playing (hand signs to communicate with partner in card games)Game playing (hand signs to communicate with partner in card games) Game scoring (cricket, basketball, soccer, rugby, football)Game scoring (cricket, basketball, soccer, rugby, football) Dinner table actions (commanding waiter to refill wine glass)Dinner table actions (commanding waiter to refill wine glass) Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle) Fall 2010

23. Student Name Server Utah School of Computing slide 22 Gestures-6Gestures-6 Moving, touching and interacting with objectsMoving, touching and interacting with objects Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching) Italianate" gestures (two hands open shaking)Italianate" gestures (two hands open shaking) Moving, touching and interacting with objectsMoving, touching and interacting with objects Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching) Italianate" gestures (two hands open shaking)Italianate" gestures (two hands open shaking) Fall 2010

24. Student Name Server Utah School of Computing slide 23 Gestures-7Gestures-7 Mimicry and pantomime (actions and objects are depicted with hand/body movements)Mimicry and pantomime (actions and objects are depicted with hand/body movements) sign language (a complete linguistic communication system)sign language (a complete linguistic communication system) Mimicry and pantomime (actions and objects are depicted with hand/body movements)Mimicry and pantomime (actions and objects are depicted with hand/body movements) sign language (a complete linguistic communication system)sign language (a complete linguistic communication system) Mimicry and pantomime (actions and objects are depicted with hand/body movements)Mimicry and pantomime (actions and objects are depicted with hand/body movements) Fall 2010

25. Student Name Server Utah School of Computing slide 24 Gestures-8Gestures-8 Shimmering hand (maybe, maybe not)Shimmering hand (maybe, maybe not) Sign language (a complete linguistic communication system)Sign language (a complete linguistic communication system) Aircraft carrier landingsAircraft carrier landings Dog trainingDog training Gambling signals at a casinoGambling signals at a casino Shimmering hand (maybe, maybe not)Shimmering hand (maybe, maybe not) Sign language (a complete linguistic communication system)Sign language (a complete linguistic communication system) Aircraft carrier landingsAircraft carrier landings Dog trainingDog training Gambling signals at a casinoGambling signals at a casino Fall 2010

26. Student Name Server Utah School of Computing slide 25 Pictograms - 1 Fall 2010

27. Student Name Server Utah School of Computing slide 26 Pictograms - 2 Fall 2010

28. Student Name Server Utah School of Computing slide 27 Pictograms - 3 Fall 2010

29. Student Name Server Utah School of Computing slide 28 Pictograms -4 Pictgram standard MAYON OF LOND ON Fall 2010

30. Student Name Server Utah School of Computing slide 29 Pictogram standard MAYOR OF LOND ON Pictograms - 5 Fall 2010

31. Student Name Server Utah School of Computing slide 30 Special Need Group: Divers Fall 2010

32. Student Name Server Utah School of Computing slide 31 Help Which direction? Boat" Fall 2010

33. Student Name Server Utah School of Computing slide 32 Underwater Communications and Hand Signals - 1 Fall 2010

34. Student Name Server Utah School of Computing slide 33 Underwater Communications and Hand Signals - 2 Fall 2010

35. Student Name Server Utah School of Computing slide 34 Underwater Communications and Hand Signals - 3 Fall 2010

36. Student Name Server Utah School of Computing slide 35 ARFF Emergency Hand Signals - 1 Aircraft Rescue and Fire Fighting (ARFF) Communications Fall 2010

37. Student Name Server Utah School of Computing slide 36 Recommend Evacuation ARFF Emergency Hand Signals - 2 Fall 2010

38. Student Name Server Utah School of Computing slide 37 Recommend Stop ARFF Emergency Hand Signals - 3 Fall 2010

39. Student Name Server Utah School of Computing slide 38 Emergency Contained ARFF Emergency Hand Signals - 4 Fall 2010

40. Student Name Server Utah School of Computing slide 39 hear this, Fall 2010 Now,

41. Student Name Server Utah School of Computing slide 40 hear this, Now, Fall 2010

42. Student Name Server Utah School of Computing slide 41 Aircraft Carrier Deck Operations Fall 2010

43. Student Name Server Utah School of Computing slide 42 Flight Deck Organization -1 Fall 2010 Aircraft traffic flow using angle deck

44. Student Name Server Utah School of Computing slide 43 Fall 2010

45. Student Name Server Utah School of Computing slide 44 Uniform Colors-1 Fall 2010

46. Student Name Server Utah School of Computing slide 45 Fall 2010

47. Student Name Server Utah School of Computing slide 46 Uniform Colors-2 Fall 2010 Yellow Shirts:Flight Deck Officers and Plane Directors Green Shirts:Catapult and Arresting Gear people Red Shirts:Aviation ordnance crews. Checker Shirts:Squadron maintenance White Shirts: (w Red Cross): Flight deck medical corpsmen

48. Student Name Server Utah School of Computing slide 47 Uniform Colors-3 Fall 2010 Blue Shirts:Flight Deck Crew Brown Shirts:Squadron personnel Purple Shirts:Aviation fuels people White Shirts:Mail and people handlers White Shirts: (w Red Cross): Flight deck medical corpsmen

49. Student Name Server Utah School of Computing slide 48 Plane Director Uses Hand Signals to Give Directions to Pilots - 1 Fall 2010

50. Student Name Server Utah School of Computing slide 49 Plane Director Using Hand Signals - 2 Fall 2010 Cat video.avi

51. Student Name Server Utah School of Computing slide 50 Ready for Launch Fall 2010

52. Student Name Server Utah School of Computing slide 51 B & O Touchless Remote - 1 Bang & Olufsen (see folder of neat material in resource folder) Fall 2010

53. Student Name Server Utah School of Computing slide 52 Conclusions Like poetry, extraordinarily succinct Can be highly Universal, International -Subject to bad cultural misinterpretations Increasingly widespread use -Olympics -Travel -Commerce Fall 2010

54. Student Name Server Utah School of Computing slide 53 Utah School of Computing End Gestures Gestures

55. Student Name Server Utah School of Computing slide 54 BOOKMARKBOOKMARK Fall 2010

56. Student Name Server Utah School of Computing slide 55 Complete Final Turn Up (Instructio ns to pilot) Suspend Catapult Operation All Clear or Affirmative Brakes off or Brakes On (Fist clenched = Suspend Operation) Fall 2010

57. Student Name Server Utah School of Computing slide 56 I have control. (Taking over from previous controller) Hang Fire (Pilot to hold on until further instructions) Lower Launch Bar or Raise Launch Bar The pilot salutes when ready to launch. The Plane Director returns salute to acknowledge pilot's readiness. Fall 2010

58. Student Name Server Utah School of Computing slide 57 BOOKMARKBOOKMARK Fall 2010

59. Student Name Server Utah School of Computing slide 58 Fall 2010 <http://www.youtube.com/v/Rmh tFk2zCmM?version=3http://www.youtube.com/v/Rmh tFk2zCmM?version=3 Logitech Harmony 900

60. Student Name Server Utah School of Computing slide 59 Fall 2010

61. Student Name Server Utah School of Computing slide 60 Fall 2010

62. Student Name Server Utah School of Computing slide 61 Fall 2010

63. Student Name Server Utah School of Computing slide 62 Fall 2010