Supporting Collaboration: Digital Desktops to Intelligent Rooms Mary Lou Maher Design Computing and Cognition Group Faculty of Architecture University of Sydney September 2004

Use of Models in Physical Meetings In face-to-face collaboration, a wide variety of communication cues are used. Speech Paralinguistic Paraverbals Prosodics Intonation Audio Gaze Gesture Face Expression Body Position Visual Object Manipulation Writing/Drawing Spatial Relationship Object Presence Environmental

Collaborative Task Space Face-to-face collaboration –People surround a table –It is easy to see each other Computer supported collaboration –People sit side by side –It is hard to see each other Communication SpaceTask Space Communication SpaceTask Space

3D Desktop

Meta Desk

iNavigator

Design Workbench

Physical Input to Digital Models Design tool  Building Blocks (Anderson et al., 2000) Visualisation tool  BUILD-IT (Fjeld et al., 2000)

Augmented Reality: Superimpose digital on the physical Seamless Interaction Natural Communication

ARToolKit Tracking ARToolKit - Computer vision based tracking libraries

Combining Physical and Digital

Intelligent Rooms/Buildings Highly interactive environments that use embedded computation to observe and participate in normal, everyday events. Such environments have cameras for eyes, microphones for ears, and uses a variety of computer vision, speech and gesture recognition systems to allow people to interact naturally with digital information. This kind of environment changes what it means to use a computer. Rather than view a computer as a stand-alone box good only for word processing or , sensors are embedded in ordinary objects so that people can interact with them the way they do with other people, by speech, gesture, movement, affect, and context.

House of the Future at MIT Buildings as Interfaces to Digital Information Media House in Barcelona