1. Post-Desktop User Interfaces iStuff and the Search for the Great Unified Input Theory Jan Borchers Stanford University CS547, Oct 17, 2002

2. The Ubicomp Vision “The most profound technologies are those that disappear.” [Weiser] We only notice tools when they fail us. [Heidegger]

3. Creating GUIs (1960s)

4. Creating GUIs Today

5. Creating Ubicomp Interfaces Today

6. The Idea A Physical User Interface Toolkit to Facilitate Ubicomp UI Research

7. Others Have Been There HandyBoard [MIT] Tangible Bits [MIT] Context Toolkit [GaTech] Phidgets [Calgary] Etc...

8. Leveraging Infrastructure iRoom iROS Event Heap

9. Event Heap Architecture Event Heap Application2Application1 TCP/IP connection

10. Event Heap Architecture Event Heap MultiBrowse RMultiBrowse S TCP/IP connection IE “show URL” Example: MultiBrowse a URL to a different machine

11. iStuff Architecture Event Heap Proxy (on PC) iStuff Device Transceiver iStuff component Application Wireless connection TCP/IP connection

12. iStuff Architecture Event Heap Proxy (on PC) wireless button RF Receiver iStuff component Application RF connection TCP/IP connection “button1 pressed” iButton example

13. iStuff Architecture Event Heap Proxy (on PC) portable radio FM transmitter iSpeaker component Application FM connection TCP/IP connection “speak text” iSpeaker example

14. iStuff Components iSpeaker iLight iBuzzer Anoto Pen iMouse iMike iDog X10 iStylus iSlider RF iButtons Input Output

15. import iwork.eheap2.*; class speaktext { static void main(String []args) { try{ EventHeap theHeap=new EventHeap(args[0]); Event myEvent=new Event("AudioEvent"); myEvent.setPostValue("AudioCommand", "Read"); myEvent.setPostValue("Text", args[1]); theHeap.putEvent(myEvent); } catch(Exception e) { e.printStackTrace(); } Event Heap App to Speak Text >speaktext iw-room2.stanford.edu "Hello World"

16. iStuff Architecture: PatchPanel Event Heap PatchPanelProxy (on PC) wireless button RF Receiver iStuff component Application RF connection TCP/IP connection “button1 pressed” “mark video” Intermediary for abstraction

17. PatchPanel

18. Evaluation Start the Room iPen iPong SuperSlider

19. Evaluation iClub Meeting Annotation

20. Great Unified Input Theory Why are we doing this? “Mouse & Keyboard” for Ubicomp? Selection and Focus for Ubicomp? Taxonomy of Modalities iWall

21. Post-Desktop Era We are living in exciting times!

22. Heidegger revisited “Technology is the extension into the physical world of our intentionality”?

23. Thanks! Maureen Stone Merrie Ringel Michael Champlin Josh Tyler Tico Ballagas Ya’ir Aizenman Joyce Ho...and many others! istuff.stanford.edu