1. Ken Hinckley Principal Researcher Microsoft Research Michel Pahud Bill Buxton Direct Display Interaction via Simultaneous Pen and Multi-Touch Input

2. Handhelds Slates Drafting Boards Tabletops Wall Displays Touch, or Pen. DIRECT INPUT A SHIFT TO

3. ISN’T THIS ABOUT THE FUTURE OF TOUCH? WHY THE PEN?

4. To help explain, let me introduce my nemesis.

5. MR. I.M.A. BIGBODY, CORPORATE DENIZEN, THIRD RATE INC.

6. “I CAN TYPE FASTER THAN I CAN WRITE. ”

8. TYPE THIS.

9. OR THIS.

10. OR MAYBE THIS.

11. YOU CAN’T TYPE THE SOUL OF A NEW IDEA.

12. BUT IT’S NOT ALL ABOUT THE PEN.

13. FIRST YOU NEED TO GRAB THE NAPKIN.

14. “JUST TELL ME WHICH IS BEST, TOUCH OR PEN. ”

16. PROPERTIES SHARED BY PEN AND TOUCH

17. PEN IS BEST! Mechanical intermediary: familiar tool, lever arm, affords precision!

18. TOUCH IS BEST! No mechanical intermediary! Nothing to lose! No time to unsheathe!

19. PEN IS BEST! Definite, intentional pressure to leave a mark

20. TOUCH IS BEST! Just rest your hand… No force required BUT… “Midas Touch”

21. EVERY COIN HAS TWO SIDES.

22. OF HANDS AND HANDEDNESS

23. Q: Which hand do you write with, Right or Left?

24. A: Yes Guiard, 1987: NPH defines frame of reference. Right vs. Left is the wrong question to ask.

25. What is the logic of the division of labor between pen and touch in interface design?

26. Pen Writes Touch Manipulates

27. fluidity of annotation + manipulation navigation zooming object creation

28. Pen + Touch Yields New Tools

29. Video Dell XT2 Demo

30. PEN + TOUCH GESTURES

31. SUMMARY

32. IF YOU’RE ONLY THINKING ABOUT TOUCH, YOU’RE BLOWING IT.

33. GET OFF THE MULTI-TOUCH ESCALATOR.

35. Not pen. Not touch. Not pen OR touch. Pen AND Touch, designed in concert

36. “TOUCH OR PEN ARE JUST NEW WAYS TO CONTROL THE MOUSE, SO WHAT’S THE BIG DEAL? ”

37. YOU’RE FIRED! “TOUCH OR PEN ARE JUST NEW WAYS TO CONTROL THE MOUSE, SO WHAT’S THE BIG DEAL? ”