Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.

Slides:

Advertisements

Similar presentations

Ken Hinckley, Shengdong Zhao, Raman Sarin, Patrick Baudisch, Edward Cutrell, Michael Shilman & Desney Tan oronto.

Advertisements

Interaction patrick baudisch microsoft research adaptive systemsinteraction focus friday, may 18, large screens.

What Was I Thinking??. Key Terms 1. Control 1. Control 2. Design Mode 2. Design Mode 3. Event 3. Event 4. Form 4. Form 5. Interface 5. Interface 6. Properties.

Introduction to Computers Section 6A. home The Operating System (OS) The operating system (OS) is software that controls the interaction between hardware.

1 Official Interface Guidelines by David Catmull User interface documentation published by Apple and Microsoft.

1 Windows CIS*2450 Advancing Computing Techniques.

Shift: A Technique for Operating Pen-Based Interfaces Using Touch Daniel Vogel University of Toronto Patrick Baudisch Microsoft Research.

Interfaces for Staying in the Flow Benjamin B. Bederson Computer Science Department Human-Computer Interaction Lab University of Maryland

Enabling Always-Available Input with Muscle-Computer Interfaces T. Scott Saponas University of Washington Desney S. Tan Microsoft Research Dan Morris Microsoft.

Try It: Curvature Dial: Eyes free parameter entry for GUIs mc schraefel, Graham Smith, Patrick.

ShadowGuides: Visualizations for In-Situ Learning of Multi-Touch and Whole-Hand Gestures Dustin Freeman University of Toronto Hrvoje Benko Meredith Ringel.

Lecture 12: Interactive Tools: Prototypers (HyperCard, Director, Visual Basic), Interface Builders, Sketching Tools Brad Myers Advanced User Interface.

1 Ken Hinckley Gonzalo Ramos (Intern – U. Toronto) Francois Guimbretiere (Visiting Researcher -UMD) Patrick Baudisch Marc Smith Microsoft Research May.

DENIM A Brief Tutorial By Philip Luedke. Introduction An Informal Tool For Early Stage Web Site and UI Design Early Stage Web Site and UI Design DENIM.

1 Ken Hinckley Patrick Baudisch Gonzalo Ramos Francois Guimbretiere Microsoft Research Scriboli: High Performance Pen Interfaces.

DENIM: Finding a Tighter Fit with Web Design Practice James Lin, Mark W. Newman, Jason I. Hong, James A. Landay April 6, 2000 CHI 2000, The Hague

1 CS 544 Human Abilities Human Motor Capabilities Acknowledgement: Some of the material in these lectures is based on material prepared for similar courses.

SIMS 213: User Interface Design & Development Marti Hearst Thurs, March 13, 2003.

Combining Informal and Tangible Interfaces for Early Stages of Web Site Design Raecine Sapien Mentor: Mark Newman Professor: Dr. James Landay This presentation.

1 High Performance Pen Interfaces Ken Hinckley Microsoft Research October 22 nd, 2004

Exploring the Basics of Windows XP. Objectives Start Windows XP and tour the desktop Explore the Start menu Run software programs, switch between them,

Introduction to HCI Marti Hearst (UCB SIMS) SIMS 213, UI Design & Development January 21, 1999.

DENIM A Sketching Tool for Prototyping Web and Desktop UIs Mark Newman and Jimmy Lin Group for User Interface Research UC Berkeley July 8, 1999.

Exploring the Basics of Windows XP

1 / 23 Microsoft Tablet PC Technology Thomas Dodds Declan O’Gorman David Pickles Stephen Pond An overview of Microsoft Tablet PC technology and current.

User Interface Design Tools for the Future Multimodal UI Research in the HCC James A. Landay Jason Hong, Scott Klemmer, Jimmy Lin, Mark Newman, & Anoop.

Design Considerations & User Experience Guidelines for Mobile Tablet Applications Arnie Lund Director, User Experience David Hale Developer Experience.

Supporting Beyond-Surface Interaction for Tabletop Display Systems by Integrating IR Projections Hui-Shan Kao Advisor : Dr. Yi-Ping Hung.

Towards a Unified Interaction Framework for Ubicomp User Interfaces Jason I. Hong Scott Lederer Mark W. Newman G r o u p f o r User Interface Research.

Ken Hinckley, Shengdong Zhao, Raman Sarin, Patrick Baudisch, Edward Cutrell, Michael Shilman & Desney Tan oronto r.

Designing a Graphical User Interface (GUI) Krisana Chinnasarn, Ph.D. January 2007.

Tool for Sketching Statecharts (TSS) Shahla Almasri COMP 762B: Modelling and Simulation Based Design April 4 th, 2005 April 4 th,

What We Can Learn From SILK and DENIM Presenter: Shahla Almasri COMP 762B: Modelling and Simulation Based Design March 2 nd, 2005.

1 Ken Hinckley Patrick Baudisch Gonzalo Ramos Francois Guimbretiere Microsoft Research Delimiters for Selection-Action Pen Gesture Phrases in Scriboli.

XP New Perspectives on Windows XP Tutorial 1 Exploring the Basics.

Exploring and Reducing the Effects of Orientation on Text Readability in Volumetric Displays Tovi Grossman Daniel Wigdor Ravin Balakrishnan.

Snap-and-go helping users align objects without the modality of traditional snapping patrick baudisch ed cutrell ken hinckley adam eversole microsoft research.

HCI For Pen Based Computing Cont. Richard Anderson CSE 481 B Winter 2007.

Tovi Grossman, Ravin Balakrishnan Dep. of Computer Science Univ. of Toronto CHI 2004.

Generating Abstract User Interfaces from an Informal Design Adrien Coyette University of Louvain Information Systems Unit Louvain-la-Neuve BELGIUM.

Visual Basic.NET BASICS Lesson 1 A First Look at Microsoft Visual Basic.NET.

1 Ken Hinckley Patrick Baudisch Gonzalo Ramos Francois Guimbretiere Microsoft Research Scriboli: High Performance Pen Interfaces.

We interact with documents in two separate worlds: the electronic world of the workstation, and the physical world of the desk. Interaction styles in these.

Microsoft Visual Basic 2005 BASICS Lesson 1 A First Look at Microsoft Visual Basic.

4 November 2000Bridging the Gap Workshop 1 Control of avatar gestures Francesca Barrientos Computer Science Division UC Berkeley.

®® Microsoft Windows 7 for Power Users Tutorial 1 Exploring the Windows 7 Operating System.

Chapter 23: GUI Design Spreadsheet-Based Decision Support Systems Prof. Name Position (123) University Name.

Gesture Input and Gesture Recognition Algorithms.

CMPF114 Computer Literacy Chapter 3 The Visual Basic Environment 1.

Suzanne Kieffer, Adrien Coyette, Jean Vanderdonckt Université catholique de Louvain, Belgium {suzanne.kieffer, adrien.coyette,

A Sketching Tool for Designing Anyuser, Anyplatform, Anywhere User Interfaces A Sketching Tool for Designing Anyuser, Anyplatform, Anywhere User Interfaces.

Transitioning from Implicit to Explicit, Public to Personal, Interaction with Multiple Users Daniel Vogel, Ravin Balakrishnan Department of Computer Science.

CHANGING THE VOLUME Click the volume icon in the bottom right hand corner of the screen.

Project Course in Pen- Based Computing Fall 2007 Tablet Flash Cards YoungJoo Jeong Manoj Kintali Dave Hacker.

Pen Based User Interface II CSE 481b January 25, 2005.

Pen Based User Interface Issues CSE 490RA January 25, 2005.

Welcome eager young artists! Ms. Edelman Sunday, June 05, 2016  DO NOW: take out your notebook and a pen. Review your notes from yesterday.

Informal PUIs: No Recognition Required James Landay Jason Hong Scott Klemmer James Lin Mark Newman.

Gesture Input and Gesture Recognition Algorithms

On Beyond GUI: Wearable, Heterogeneous, Adaptive

Helping Users Access and Manipulate Occluded Content in 2D Drawings

Design AH Computing.

Improving drag-and-drop on wall-size displays

for graphical input devices

HCI For Pen Based Computing

HCI for Pen Computing CSE 481b January 24, 2006.

Map of Human Computer Interaction

UI Issues, Neural Nets, RTS

Chapter 9 System Control

Presentation transcript:

Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research Tovi Grossman Ken Hinckley Patrick Baudisch Maneesh Agrawala Ravin Balakrishnan Dynamic Graphics Project Dept of Computer Science University of Toronto

Pen-Based Interfaces Great for notes, sketches Lack of shortcuts problematic

Pen-Based Interfaces Great for notes, sketches Lack of shortcuts problematic Round trip problem

Localized User Interfaces Gesture Interaction Tivoli (Moran, Chiu, Melle. UIST ’97) SKETCH (Zeleznik, Herndon & Hughes. SIGGRAPH ’96) DENIM (Newman, Lin, Hong & Landay. HCI ’03) Menu Interaction Marking Menu (Kurtenbach & Buxton. CHI ’93) Flow Menu (Guimbretière & Winograd. UIST ’03) Scroll ring (Smith & schraefel. Moscovich & Hughes. UIST ’04) Hybrid Scriboli (Hinckley, Baudisch, Ramos, & Guimbretière. CHI ’05)

Localized User Interfaces Gesture Interaction Ink confused with gesture Explicitly switch with button Menu Interaction Activated with button

Localized User Interfaces

Design Challenge 1.Localized user interface 2.Clearly distinct from ink input 3.No button required

Tracking menus Fitzmaurice G., Khan A., Pieke R., Buxton B., Kurtenbach G. UIST 2003

Hover Widgets Gesture in tracking state Widget fades in Click on widget

Hover Widgets

Design Considerations Shape

Design Considerations Shape Recognition

Design Considerations Shape Recognition Visualization

DEMO

Experiment

Independent Variables Technique (Hover Widget, Icon) GridN (4, 8, 12) Distance (300, 600, 900, 1200)

Results Reduced Movement Time

Results Reduced Movement Time Increased Accuracy

Summary New distinct command layer Button free Localized UI Reduce time Minimal shift of attention

Future Work Customize & adapt

Future Work Customize & adapt Large displays

Acknowledgements Members of The Microsoft Research Adaptive Systems & Interaction group Members of the Microsoft Research Visualization and Interaction Group Members of the University of Toronto Dynamic Graphics Lab David Thiel Study Participants

Questions?

Using the Tracking State Tool tips

Using the Tracking State Tool tips Input panel gesture

Pilot Study

False Activations

Visualization

Learning