stanford hci group / cs376 research topics in human-computer interaction Tangible Interaction / Augmented Reality Scott Klemmer 12 October 2004

2 Tangible UIs / Augmented Reality Baychi tonight: Don Norman User Experience: Why Do So Many Organizations Believe They Own It? Kresge Auditorium, 7:45- 9:45pm

12 October Tangible UIs / Augmented Reality Human Subjects  oR/hs  me before class on Thursday that you have read and understand the guidelines

12 October Tangible UIs / Augmented Reality “The future is already here. It is just not uniformly distributed” —William Gibson mentioned in Bill Buxton, Forward Into the Past, Time Magazine, 10/11/ xtessay.html

12 October Tangible UIs / Augmented Reality Graphical User Interfaces  Potato, keyboard, small “desktop”  Seated, single-user  Structured tasks (word processing, spreadsheets, …)

12 October Tangible UIs / Augmented Reality Tangible User Interfaces  Augment the physical world, integrating digital information with everyday physical objects  Generally, physical input controls graphical or audio output

12 October Tangible UIs / Augmented Reality Three main types  Everyday (no actuation)  Mechatronic (actuated)  Ambient (actuated)

12 October Tangible UIs / Augmented Reality

12 October Tangible UIs / Augmented Reality Web Design Practice  Interviews with 11 professional designers [Newman DIS 2000]  Post-It notes on large surfaces  affinity diagrams  Brainstorming  collaborative  solo  Advantages  persistent  immersive & haptic  fluid, informal interface  Difficulties  hard to edit  …to share  …to make digital Contextual Design, by Hugh Beyer and Karen Holtzblatt Wall of a design room at a Silicon Valley web design firm THE DESIGNERS’ OUTPOST

12 October Tangible UIs / Augmented Reality THE DESIGNERS’ OUTPOST

12 October Tangible UIs / Augmented Reality The Designers’ Outpost  Combining... affordances of paper and advantages of electronic media to support design practice [Klemmer et al, UIST 01]  Electronic wall surface (180 cm diagonal SMART Board)  Regular Post-it notes  Computer vision, stylus, & physical tools UI

12 October Tangible UIs / Augmented Reality

12 October Tangible UIs / Augmented Reality Vision System I N F R A S T R U C T U R E Rear Camera Vision (640x480, 7fps) THE DESIGNERS’ OUTPOST

12 October Tangible UIs / Augmented Reality I N F R A S T R U C T U R E Vision System THE DESIGNERS’ OUTPOST

12 October Tangible UIs / Augmented Reality Geo-referenced I/O THE DESIGNERS’ OUTPOST

12 October Tangible UIs / Augmented Reality

12 October Tangible UIs / Augmented Reality Collaborage [Moran et al, UIST99] Rasa [McGee et al, CHI02] Illuminating Light [CHI98]

12 October Tangible UIs / Augmented Reality Paper Flight Strips [Mackay et al, CHI98] MediaBlocks [Ullmer] Palette [Nelson, CHI99]

12 October Tangible UIs / Augmented Reality Audio Notebook [Stifelman, CHI01] Listen Reader [Back, CHI01] Books with Voices [CHI03]

12 October Tangible UIs / Augmented Reality

12 October Tangible UIs / Augmented Reality

12 October Tangible UIs / Augmented Reality