Is there a Box in your future? George G. Robertson Principal Researcher Visualization and Interaction Research Microsoft Corporation George G. Robertson Principal Researcher Visualization and Interaction Research Microsoft Corporation

Star Cops and Box 1987 BBC science fiction detective series Nathan Spring is Commander of a new International Space Police Force in 2027 Box is a small digital personal assistance that Nathan carries with him 1987 BBC science fiction detective series Nathan Spring is Commander of a new International Space Police Force in 2027 Box is a small digital personal assistance that Nathan carries with him

Box Characteristics Voice communication Monitor all activity in vicinity Access to information world wide Ability to display & interact with information on any display surface Problem solving assistant Voice communication Monitor all activity in vicinity Access to information world wide Ability to display & interact with information on any display surface Problem solving assistant “Look for connections … that’s any connection, however tenuous.” Nathan Spring

Can we build Box now? Use PPC Phone or Smartphone Voice communication Monitor all activity in vicinity Access to information world wide Ability to display & interact with information on any display surface Problem solving assistant Use PPC Phone or Smartphone Voice communication Monitor all activity in vicinity Access to information world wide Ability to display & interact with information on any display surface Problem solving assistant

Related Work Pebbles – Myers (CACM 2001) Collaboration Remote mouse (or remote control) PDAs  PCs SharedNotes – Greenberg (Personal Technologies 1999) Shared notes PDAs  shared displays Pebbles – Myers (CACM 2001) Collaboration Remote mouse (or remote control) PDAs  PCs SharedNotes – Greenberg (Personal Technologies 1999) Shared notes PDAs  shared displays

Related Work (cont.) Pick and Drop – Rekimoto (CHI 1998) Moving objects PDA  display WinCuts – Tan (CHI 2004) Shared window regions Laptop  shared display Dynamo – Izadi (UIST 2003) Exchanging media Laptop  shared display Pick and Drop – Rekimoto (CHI 1998) Moving objects PDA  display WinCuts – Tan (CHI 2004) Shared window regions Laptop  shared display Dynamo – Izadi (UIST 2003) Exchanging media Laptop  shared display

Related Work (cont.) Personal Server – Want (UbiComp 2002) Use of surrounding computing infrastructure A portable personal identity Display-free device  networked resources Personalized Shared Ubiquitous Devices – Hilbert & Trevor (Interactions 2004) Documents accessed via browser PC or PDA  display Personal Server – Want (UbiComp 2002) Use of surrounding computing infrastructure A portable personal identity Display-free device  networked resources Personalized Shared Ubiquitous Devices – Hilbert & Trevor (Interactions 2004) Documents accessed via browser PC or PDA  display

Box 0.9 – What Might It Do? Portable personal identity (secure) Portable personal workspace Access to things I’ve been working on Access through the cloud (or cached) Display my work on any nearby display Share my work with others Port my work from one location to another Portable personal identity (secure) Portable personal workspace Access to things I’ve been working on Access through the cloud (or cached) Display my work on any nearby display Share my work with others Port my work from one location to another

Building Box 0.9 – Initial Steps Collaboration with Dan BYU XICE – Extended Interaction Everywhere Collaboration with Dan BYU XICE – Extended Interaction Everywhere Pocket PC Phone Smartphone Wall Display

Building Box 0.9 – Initial Steps Application runs on mobile device Shared display used for display & input Application runs on mobile device Shared display used for display & input App running here puts window up on shared display XICE manages scene graph

Building Box 0.9 – Initial Steps Either mobile device can initiate window management operations App running here puts 2 nd window up on shared display

Building Box 0.9 – Initial Steps Input can be local to mobile device Or on the shared display Input can be local to mobile device Or on the shared display

Building Box 0.9 – Initial Steps Input can be redirected to enable shared applications Input from here

Building Box 0.9 – Initial Steps Input can be redirected to enable shared applications Is processed here

Building Box 0.9 – Next Steps Shared multi-scale applications Notepad Outliner Sticky notes Drawing PowerPoint lite IE Excel lite Shared multi-scale applications Notepad Outliner Sticky notes Drawing PowerPoint lite IE Excel lite

Your Own Box Would you like one of these? Questions? Would you like one of these? Questions?

© 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.