A Nose Gesture Interface Device: Extending Virtual Realities

2 Saved the most important for last “A Nose Gesture Interface Device: Extending Virtual Realities” Tyson R. Henry, Scott E. Hudson, Andrey K. Yeatts, Brad A. Myers, and Steven Feiner, Proceedings of UIST ‘91, November , 1991, Hilton Head, NC, pp n

3 Some of the most important VR work ever published n Had its own special session at UIST ‘91 n Reprinted in Presence (the main VR journal), April n Will recreate the presentation here

A Nose Gesture Interface Device: Extending Virtual Realities Tyson Henry*University of New Mexico Scott Hudson*Carnegie Mellon Andrey YeattsUniversity of Arizona Brad MyersCarnegie Mellon Steven FeinerColumbia University *at the University of Arizona in 1991

5 Motivation n Current virtual reality systems are just too limited n Goal: improved sense of presence è Extensions to other senses è Full body interaction

6 Rhino-Virtual Realities The potential of the nose has been sorely neglected in previous systems To remedy this we have developed...

7 The DATANOSE™

8 Offers Support for True Multi-Modal Interaction Works with conventional graphical interfaces...

9

10 A New Suction Based Dragging Technique: “Hoovering”

11 Also works with older (text based) interface styles...

12

13 Hardware Design The Early Prototypes…

14 First Prototype n Fully functional – Exceeded all specs n But unexpectedly did not gain user acceptance

15 Design iteration n Next prototypes miniaturized the olfactory output system and explored new commercially appealing packaging...

16 Rabbit Nose Platform Worked better, but whiskers interfered with interaction

17 Next Iteration Didn’t work very well...

18 Pig Nose Platform Issues with users squealing

19 Dog Nose Platform Drooling problems...

20 This one didn’t work at all Subjects had an inexplicable urge to tell bad puns

21 After a few small modifications it worked better But pun problem persisted

22 The final prototype...

23 Groucho Marx Nose Platform

24 DATANOSE™ Features n Full featured miniature olfactory I/O system n Fully mobile operation

25 Works in the lab...

26 Down the hall...

27 To places mobile computing has never gone before...

28 Advanced Interaction Techniques 3D Rotation Task – True User-Centered Rotation

29

30

31

32

33

34 Interacting with Multiple Devices n The DATANOSE™ works smoothly with conventional I/O devices...

35 Keyboard

36 Mouse

37 Valuators (Knobs)

38 n Also has great potential in computer supported cooperative work applications...

39

40 Finally, can support fluid interaction with large data sets...

41

42 Applications: An Example Virtual World Searched for an appropriate application domain...

43 Applications: An Example Virtual World Implemented: Dog’s World – A user’s view

44

45

46

47 CSCW Extensions: The Collaborative Dog’s World...

48

49 A New Toolkit n To avoid the high cost of developing rhino-interfaces, a new toolkit was developed n SYSTEM – An acronym standing for...

50 A New Toolkit n To avoid the high cost of developing rhino-interfaces, a new toolkit was developed n SYSTEM – a System that reallY doeS creaTE user interfaces that have really nice featuMs

51 Uses The Seeheim Model n A major advance in itself

52 More Important... n We have been able to answer the most important research question about the model...

53 Uses The Seeheim Model What is that little box at the bottom!?!

54 Important Discovery The Seeheim model works much better if you put everything in the little box An improved model...

55 Improved Model

56 The Final SMELL-HEIM Model

57 Another Major Advance n A completely new approach to dialog management – Did an extensive literature search F Never been done before – Will revolutionize UI software work

58 Another Major Advance n A completely new approach to dialog management – Did an extensive literature search F Never been done before – Will revolutionize UI software work n Finite State Machine Controllers!

59 SYSTEM supports easy to use graphical editor for FSM controllers

60 SYSTEM supports easy to use graphical editor for FSM controllers

61 Usability Testing Significant new testing after the paper was submitted

62 User Testing Results Really Really Liked It Really Liked It Sort of Liked It Hated It Subject #1 Subject #2

63 User Testing Results n Both users really really liked it! Really Really Liked It Really Liked It Sort of Liked It Hated It Subject #1 Subject #2

64 Future Work n Extending to other body parts – DATA ARM™ – DATA EYEBALLS™

65

66 Future Work (cont.) n Extending to other body parts – DATA FOOT™ – DATA MOUTH™ Warning: Our research shows that these devices should not be used together!

67 Conclusion Overall a dramatic breakthrough in virtual research

Questions?

69