Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions Multi touch interactions, interactive surfaces & computer vision techniques Illustration from (some) Microsoft Research projects (and from somewhere else too) Form factor issues and devices

Founded in 1991 Staff of over 800 covering 55 areas Core research facility for entire company Centrally funded, sets own agenda Internationally recognized research teams Strong engagement with Microsoft product groups Research labs Redmond, Washington San Francisco, California Mountain View, California Cambridge, United Kingdom Beijing, People’s Republic of China Bengalore, India Joint Labs

« Le présent est indéfini, le futur n’a de réalité qu’en tant qu’espoir présent, le passé n’a de réalité qu’en tant que souvenir présent. » Jorge Luis Borges Fictions

Research

"I don't know why we call it a mouse. It started that way and we never changed it.“ Doug Engelbart, Stanford University, 1968 The mother of all demos The mother of all demos complete recording at ttp://sloan.stanford.edu/mousesite/1968Demo.html

8

9 Large displays «Hiding» computers Peripheral awareness «Augmenting» surfaces Seamless transitions More natural interactions Multi-touch interactions Collaboration New kind of devices Perceived affordances

10 Ubiquitous computing (Ubicomp) integrates computation into the environment, rather than having computers which are distinct objects Augmented reality (AR) is a field of computer research which deals with the combination of real world and computer generated data Mixed Reality (MR) is the merging of real world and virtual worlds to produce a new environment where physical and digital objects can co-exist and interact Tangible User Interface (TUI) is a User interface in which a person interacts with digital information through the physical environment is a User interface in which a person interacts with digital information through the physical environment

11

The Soap device Patrick Baudisch Microsoft Research Redmond

Sensing surfaces Rear projection sheet Glass IR Filter Camera Projector IR light Objects on surface of table

Augmenting Surfaces

Short-throw projector, very wide angle lens on the camera Lens distortion & projective transform correction for camera-projector alignment Off-axis IR LED illuminant Very few assumptions about the appearance of the surface All calibration is done at the “factory”

17 Play Anywhere Andy Wilson Microsoft Research, Redmond

« Touchlight » Andy Wilson Microsoft Research Redmond 18

Play Together Daniel C. Robbins, Andy Wilson Microsoft Research, Redmond

21 The Picture Bowl Shahram Izadi, Alex Taylor Microsoft Research, Cambridge

The ReacTable & the MediaTable Sergi Jordà & al. Universitat Pompeu Fabra, Barcelona

24 Surface computing (Other) Jeff Han – New-York University

25

The Future

Display Technology

Laser Projection

It took almost 15 years before the mouse became mainstream Everything is best for something and worst for something else! Emerging user experience concepts and techniques Multi-touch interactions Table-top and wall display sensing Robust computer vision techniques Promising new devices and technology 29

30

Tangible bits project, MIT Media Lab Doug Engelbart’s 68 demo Microsoft Research The ReacTable The ReacTable Flat & rollable displays Laser projection

© 2007 Microsoft France Votre potentiel, notre passion TM