1. Ken Hinckley Koji Yatani Pen + Touch = New Tools

2. Handhelds Slates Drafting Boards Tabletops Wall Displays Touch or Pen… DIRECT INPUT A SHIFT TO

3. ISN’T THE FUTURE ABOUT TOUCH? WHY THE PEN?

4. To help explain, let me introduce my nemesis.

5. MR. I.M.A. BIGBODY, CORPORATE DENIZEN, THIRD RATE INC.

6. “I CAN TYPE FASTER THAN I CAN WRITE. ”

8. TYPE THIS.

9. OR THIS.

10. OR MAYBE THIS.

11. YOU CAN’T TYPE THE SOUL OF A NEW IDEA.

12. BUT IT’S NOT ALL ABOUT THE PEN.

13. FIRST YOU NEED TO GRAB THE NAPKIN.

14. “JUST TELL ME WHICH IS BEST, TOUCH OR PEN. ”

16. OF HANDS AND HANDEDNESS

17. PAPER NOTEBOOK OBSERVATIONS B1: Tuck the pen, interleave stylus and fingers B2: Hold Clippings while Writing B3: Specific Roles for Pen and Fingers B4: Two-handed actions

18. B5: Drawing along Edges B6: Hold Page while Flipping PAPER NOTEBOOK OBSERVATIONS

19. BE EVOCATIVE OF PAPER WITHOUT BEING BEHOLDEN TO IT.

20. Q: Which hand do you write with, Right or Left?

21. A: Both! Guiard, 1987: NPH defines frame of reference. Right vs. Left is the wrong question to ask.

22. What is the logic of the division of labor between pen and touch in interface design?

23. Video – search on “manual deskterity”

24. Users easily interleaved pen & touch – obvious Staple, Xacto Cut, and Peel off Copy particularly resonated with users The particular tools were not always of interest Some example comments: REACTIONS FROM USERS “The way it works is just like the way I already work in my notebook.” “I wouldn’t have guessed the gestures worked that way, but once I tried it, it felt pretty natural.”

26. DESIGN PROPERTIES OF PEN + TOUCH

27. 27

29. Pen + Touch: distinct interaction states Touch + Touch ambiguous : pinch Zero-force, incidental Contact is an inherent property of (soft) Touch – GREAT! Just touch it to do something. – TERRIBLE! Just touch it, and it might do something. WHY NOT ALL MULTITOUCH?

30. Minimal on-screen UI, widgets, & buttons. Holding touch integrates (1) Object Selection with (2) Pen Mode Switching. And also… (3) provides salient feedback of temporary state. (4) unambiguously phrases together multiple elementary pen and touch inputs. SOME INTRIGUING PROPERTIES…

31. Differentiated vs. Interchangeable – E.g. Common controls Mobile vs. Stationary – Hand-held use vs. on-desk use, with graceful degradation between the two – One-handed interactions for core actions – Two-handed interactions to take full advantage of expressiveness of pen + touch DESIGN DIMENSIONS

32. Interleaved vs. Simultaneous – Pen + touch has the most novelty – Touch-pen-touch has tremendous value Elementary Inputs vs. Phrases – Not just assign device/hand to individual interactions – – Workflow across multiple subtasks… DESIGN DIMENSIONS

33. SUMMARY

34. IF WE’RE ONLY THINKING ABOUT TOUCH, WE’RE BLOWING IT.

35. EXPERIENCES TO STAND OUT… IF WE WANT OUR

36. Not pen. Not touch. Not pen OR touch. Pen AND Touch, designed in concert

37. “TOUCH OR PEN ARE JUST NEW WAYS TO CONTROL THE MOUSE, SO WHAT’S THE BIG DEAL? ”

38. YOU’RE FIRED! “TOUCH OR PEN ARE JUST NEW WAYS TO CONTROL THE MOUSE, SO WHAT’S THE BIG DEAL? ”

41. Pen Writes Touch Manipulates

42. Pen + Touch Yields New Tools

43. PEN + TOUCH GESTURES staple straightedgestamp Xacto cut brush peel off copy

48. Pen Writes Touch Manipulates

49. fluidity of annotation + manipulation navigation zooming object creation

50. Pen + Touch Yields New Tools

51. PROPERTIES SHARED BY PEN AND TOUCH

52. PEN IS BEST! Mechanical intermediary: familiar tool, lever arm, affords precision!

53. TOUCH IS BEST! No mechanical intermediary! Nothing to lose! No time to unsheathe!

54. PEN IS BEST! Point at a specific spot on the coin

55. TOUCH IS BEST! Grab the whole coin

56. EVERY COIN HAS TWO SIDES.