Mixed Reality Research in Design Xiangyu Wang, Ph.D. Design Computing Honour Pre. Seminar March 2008

Agenda Augmented Reality for Urban Design Tangible Augmented Reality for Design Learning Augmented Virtuality for Remote Design Collaboration

Introduction Mixed Reality Continuum (Milgram et al. 1999) Identification of Mixed Reality within the Reality-Virtuality Continuum

Tangible Augmented Reality for Design Learning Tangible interface (haptic)+Augmented Reality(visual)

Tangible Augmented Reality for Design Learning The Actuated Workbench based on tangible user interface (Pangaro, G., Maynes-Aminzade, D., Ishii, H., 2003)

Tangible Augmented Reality for Design Learning A 3D graphics image overlaid onto the scene (Asai, Kobayashi and Kondo 2005)

Tangible Augmented Reality for Design Learning Theoretical process for applying tangible AR concept and technology into design learning

Tangible Augmented Reality for Design Learning Setup sketch for tangible AR system

Taxonomy of Mixed Reality Learning Environments Dimensions of the taxonomy –Learning media and tools –Learning styles –Learning modality

Taxonomy of Mixed Reality Learning Environments Approximate locations of MRLE examples within the MR global continuum

Augmented Virtuality for Remote Design Collaboration The objective is to define and prototype an AV interface that maximizes the designer’s ability to comprehend the design and effect corresponding actions in the display space under the given conditions.

System Architecture Max/Msp Jitter Google SketchUp Pro 6

System Architecture Real video stream as environment texture. “See through the window” as if he/she is in the remote location. Video as Texture

AV Space Implementation Multi-Projection System.

AV Space Implementation An Augmented Virtuality scene rendered by multi-projection screen.

AV Space Implementation Photo as Texture (Information Board)

AV Space Implementation AV Design Environment 1 AV Design Environment 2 It clearly shows the detailed environmental view.