1. Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research www.research.microsoft.com Tovi Grossman Ken Hinckley Patrick Baudisch Maneesh Agrawala Ravin Balakrishnan Dynamic Graphics Project Dept of Computer Science University of Toronto www.dgp.toronto.edu

2. Pen-Based Interfaces Great for notes, sketches Lack of shortcuts problematic

3. Pen-Based Interfaces Great for notes, sketches Lack of shortcuts problematic Round trip problem

4. Localized User Interfaces Gesture Interaction Tivoli (Moran, Chiu, Melle. UIST ’97) SKETCH (Zeleznik, Herndon & Hughes. SIGGRAPH ’96) DENIM (Newman, Lin, Hong & Landay. HCI ’03) Menu Interaction Marking Menu (Kurtenbach & Buxton. CHI ’93) Flow Menu (Guimbretière & Winograd. UIST ’03) Scroll ring (Smith & schraefel. Moscovich & Hughes. UIST ’04) Hybrid Scriboli (Hinckley, Baudisch, Ramos, & Guimbretière. CHI ’05)

5. Localized User Interfaces Gesture Interaction Ink confused with gesture Explicitly switch with button Menu Interaction Activated with button

6. Localized User Interfaces

9. Design Challenge 1.Localized user interface 2.Clearly distinct from ink input 3.No button required

10. Tracking menus Fitzmaurice G., Khan A., Pieke R., Buxton B., Kurtenbach G. UIST 2003

11. Hover Widgets Gesture in tracking state Widget fades in Click on widget

12. Hover Widgets

13. Design Considerations Shape

14. Design Considerations Shape Recognition

15. Design Considerations Shape Recognition Visualization

16. DEMO

17. Experiment

18. Independent Variables Technique (Hover Widget, Icon) GridN (4, 8, 12) Distance (300, 600, 900, 1200)

19. Results Reduced Movement Time

20. Results Reduced Movement Time Increased Accuracy

21. Summary New distinct command layer Button free Localized UI Reduce time Minimal shift of attention

22. Future Work Customize & adapt

23. Future Work Customize & adapt Large displays

24. Acknowledgements Members of The Microsoft Research Adaptive Systems & Interaction group Members of the Microsoft Research Visualization and Interaction Group Members of the University of Toronto Dynamic Graphics Lab David Thiel Study Participants

25. Questions?

26. Using the Tracking State Tool tips

27. Using the Tracking State Tool tips Input panel gesture

28. Pilot Study

29. False Activations

30. Visualization

31. Learning