Ken Hinckley Principal Researcher Microsoft Research Michel Pahud Bill Buxton Direct Display Interaction via Simultaneous Pen and Multi-Touch Input

Handhelds Slates Drafting Boards Tabletops Wall Displays Touch, or Pen. DIRECT INPUT A SHIFT TO

ISN’T THIS ABOUT THE FUTURE OF TOUCH? WHY THE PEN?

To help explain, let me introduce my nemesis.

MR. I.M.A. BIGBODY, CORPORATE DENIZEN, THIRD RATE INC.

“I CAN TYPE FASTER THAN I CAN WRITE. ”

TYPE THIS.

OR THIS.

OR MAYBE THIS.

YOU CAN’T TYPE THE SOUL OF A NEW IDEA.

BUT IT’S NOT ALL ABOUT THE PEN.

FIRST YOU NEED TO GRAB THE NAPKIN.

“JUST TELL ME WHICH IS BEST, TOUCH OR PEN. ”

PROPERTIES SHARED BY PEN AND TOUCH

PEN IS BEST! Mechanical intermediary: familiar tool, lever arm, affords precision!

TOUCH IS BEST! No mechanical intermediary! Nothing to lose! No time to unsheathe!

PEN IS BEST! Definite, intentional pressure to leave a mark

TOUCH IS BEST! Just rest your hand… No force required BUT… “Midas Touch”

EVERY COIN HAS TWO SIDES.

OF HANDS AND HANDEDNESS

Q: Which hand do you write with, Right or Left?

A: Yes Guiard, 1987: NPH defines frame of reference. Right vs. Left is the wrong question to ask.

What is the logic of the division of labor between pen and touch in interface design?

Pen Writes Touch Manipulates

fluidity of annotation + manipulation navigation zooming object creation

Pen + Touch Yields New Tools

Video Dell XT2 Demo

PEN + TOUCH GESTURES

SUMMARY

IF YOU’RE ONLY THINKING ABOUT TOUCH, YOU’RE BLOWING IT.

GET OFF THE MULTI-TOUCH ESCALATOR.

Not pen. Not touch. Not pen OR touch. Pen AND Touch, designed in concert

“TOUCH OR PEN ARE JUST NEW WAYS TO CONTROL THE MOUSE, SO WHAT’S THE BIG DEAL? ”

YOU’RE FIRED! “TOUCH OR PEN ARE JUST NEW WAYS TO CONTROL THE MOUSE, SO WHAT’S THE BIG DEAL? ”