Bimber & Raskar Spatial Augmented Reality  Oliver Bimber  University of Weimar  Ramesh Raskar  Mitsubishi Electric Research Labs  Masahiko Inami  University of Electro-Communications (UEC Tokyo)

Bimber & Raskar Spatial Augmented Reality Welcome  AR Display Approaches  Traditional, Goggle-bound, Alternative  Spatial Augmentation  Projectors, Non-planar, Mobile objects, Change appearance, Interaction  Exploiting Optical Elements  Mirrors, Beam splitters, Holograms  Beyond Visual Augmentation  Audio, Touch, Smell, Vestibular  Applications  Prototypes in Art, Research and Industry

Bimber & Raskar Spatial Augmented Reality A Non-traditional Approach  Painting with Light  [Bandyopadhyay, Raskar, Fuchs 2001]

Bimber & Raskar Spatial Augmented Reality Goals  Understand advantages of Spatial AR  Discuss issues in traditional AR approaches  Explore alternative AR methods  Graphics, Vision, Optics techniques  Rendering and calibration methods  See new applications in art and industry  What we will not cover  Fundamentals of AR and VR

Bimber & Raskar Spatial Augmented Reality Speaker Oliver Bimber is currently a Junior Professor for Augmented Reality at the Bauhaus University Weimar, Germany. He serves on the editorial board of the IEEE Computer magazine (graphics and multimedia editor). Bimber invented several AR displays, such as the Virtual Showcase, Interactive Holograms and Augmented Paintings. He published in several journals, such as IEEE Computer, IEEE CG&A, Presence, Computers and Graphics, and at many graphics, AR and VR conferences. Bimber is member of IEEE, Eurographics, ACM and ACM Siggraph. He has exhibited in the Emerging Technology Laboratory of Siggraph’02 and was a speaker in the Siggraph’02 course “Building Interactive Workspaces”. Together with Ramesh Raskar, Bimber organized this course at Eurographics 2003 and 2004

Bimber & Raskar Spatial Augmented Reality Speaker Ramesh Raskar is a Senior Research Scientist at MERL- Cambridge Research. His research interests include projector-based graphics, projective geometry and non-photorealistic rendering. During his doctoral research at U. of North Carolina at Chapel Hill, he developed a framework for projector based 3D graphics, which can simplify the constraints on conventional immersive displays, and enable new projector-assisted applications. He has published several articles on immersive projector-based displays, spatially augmented reality and has introduced Shader Lamps, a new approach for projector-based augmentation. He was a course organizer and speaker for Siggraph He is a member of the ACM and IEEE.

Bimber & Raskar Spatial Augmented Reality Speaker Masahiko Inami is a professor in the Department of Mechanical Engineering and Intelligent Systems at the University of Electro-Communications (UEC Tokyo), Japan. He directs the Human Interface and Interactive System research group. His research interests include multi-modal augmented reality, augmented human perception, display- based computing and telexistence. Optical Camouflage, one of his doctoral research at University of Tokyo, was chosen as one of the coolest inventions of the year by TIME Magazine in His technical papers have appeared in IEEE CG&A, resence, IEEE VR and other conferences. He has exhibited 15 installations at the Emerging Technologies of SIGGRAPH 1997 through He is a member of the ACM and IEEE Computer Society.

Bimber & Raskar Spatial Augmented Reality Opportunities  Think beyond goggle-bound AR  Learn techniques using projectors, flat displays and optics  Explore more realistic augmented environments  Learn how to build your own spatial AR displays (only covered in tutorial notes).  Learn how to extend your own software framework to support spatial AR displays  Get an impression on applicability

Bimber & Raskar Spatial Augmented Reality Virtual ReflectanceVirtual Illumination InteractionVirtual Motion ShaderLamps

Bimber & Raskar Spatial Augmented Reality

Bimber & Raskar Spatial Augmented Reality

Bimber & Raskar Spatial Augmented Reality Find tag location using handheld Projector Photosensing Wireless Tags Many geometric ops R F I R F I D Interactive stabilized projection (Radio Frequency Id & Geometry) G

Bimber & Raskar Spatial Augmented Reality Optical Camouflage

Bimber & Raskar Spatial Augmented Reality Haptic and Tactile Sensation

Bimber & Raskar Spatial Augmented Reality Survey  How many of you are users of VR system ?  How many of you are users of AR system ?  How many of you are involved in AR design/development ?  How many do active programming ?  What type of AR do you use: HMD ? Handheld ? Projector ?  Field of work: Academics? Industry ? Research ? Art ?

Bimber & Raskar Siggraph 2005 Spatial Augmented Reality

Exhibition –AK Peters –Booth #412 Meet the Authors Wed (11am-noon)

Course Evaluations 4 Random Individuals will win an ATI Radeon tm HD2900XT

Bimber & Raskar Siggraph 2005 Spatial Augmented Reality y 8:30 Overview 8:40 Today’s AR Display Approaches (Bimber) 9:05 New Directions in Augmentation (Raskar) 10:15 Break 10:30 Beyond Visual Augmentation (Inami) 11:05 Augmentation on Everyday Surfaces (Bimber) 11:45 Prototypes (All) 12:05 Discussion Spatial Augmented Reality Course Page : A.K.Peters, Exhibition Booth #412 Coupons available Free Download on Website Book  ETech:  Prakash : Lighting Aware Motion Capture  Pocket Projectors, Projector-Based AR, 3D Displays  EG’2007 Star Report: Projector-Camera Systems  Course Evaluation 

Bimber & Raskar Siggraph 2005 Spatial Augmented Reality ACourse Introduction and Overview (Raskar, 10 minutes) BIntroduction to Current approaches (Bimber, 40 minutes) CNew Directions in Augmentation (Raskar, 50 minutes) Q&A(All, 5 minutes) Break DAugmentation on Everyday Surfaces (Bimber, 30 minutes) 10:30 EBeyond Visual Augmentation(Inami, 30 minutes) 11:00 FPrototypes and Experiences(Bimber, Raskar, 35 minutes) 11:30 Q&A(All, 10 minutes)