Mixed Reality Trompe l’oëil in the 21st Century

Slides:



Advertisements
Similar presentations
Lecture 0: Course Overview
Advertisements

Augmented Reality David Johnson.
LECTURE 1 INTRODUCTION TO MULTIMEDIA
BPC: Art and Computation – Fall 2006 Introduction to virtual environments Glenn Bresnahan
Graphics. Applications  Digital media  Entertainment  Art  Visualization  Science  Modeling  Games  Software  Virtual Reality.
Introduction to Computer Graphics Survey (Chapter 1) Graphics Systems (Chapter 2)
Mixed Reality Research in Design Xiangyu Wang, Ph.D. Design Computing Honour Pre. Seminar March 2008.
FYP Project LYU0303: 1 Video Object Tracking and Replacement for Post TV Production.
Computer Services Technology, Computer Networking, and Computer Animation.
© 2010 Pearson Addison-Wesley. All rights reserved. Addison Wesley is an imprint of 1-1 HCI Human Computer Interaction Week 10.
By: Whitney Price THE ART INSTITUTE OF ATLANTA. ABOUT The Art Institute of Atlanta offers many programs that involve all different types of art. Such.
Converging Contemporary Technologies Intermediate 2 Computing MMT Topic 6.
SOFTWARE.
Mixed Reality University of Central Florida Media Convergence IST School of Electrical Engineering & Computer Science Digital Media Department.
What is Multimedia? Multimedia is a combination of text, art, sound, animation, and video. It is delivered to the user by electronic or digitally manipulated.
Electronic Visualization Laboratory University of Illinois at Chicago Interaction between Real and Virtual Humans: Playing Checkers R. Torre, S. Balcisoy.
Cornell CS465 Fall 2004 Lecture 1© 2004 Steve Marschner 1 CS465: Computer Graphics I Professor: Steve Marschner.
Dr. Sana’a Wafa Al-Sayegh
©2005 University of Central Floridawww.mcl.ucf.eduMedia Convergence Laboratory Provocative Statement: Truly interactive stories have yet to be successfully.
REVES research group REndering for Virtual Environments with Sound REVES/INRIA, Sophia-Antipolis, France Contact:
Multimedia. Definition What is Multimedia? Multimedia can have a many definitions these include: Multimedia means that computer information can be represented.
People in multimedia Systems. Multimedia Systems Multimedia systems are designed by a team of people who specialise in a particular field, For example:
COMP4070 Computer Graphics Dr. Amy Zhang. Welcome! 2  Introductions  Administrative Matters  Course Outline  What is Computer Graphics?
Where’s the Reality in Augmented Reality? Mark Billinghurst HIT Lab NZ University of Canterbury.
Social Immersive Media Amer Obeidah Basic Interaction Design Carnegie Mellon University.
Computer Visualization BIM Curriculum 03. Topics  History  Computer Visualization Methods  Visualization Workflow  Technology Background.
Invitation to Computer Science 5th Edition
1 Computer Graphics Introduction. 2 What is computer graphics Computer graphics is concerned with producing images and animations (or sequences of images)
Introduction to Virtual Environments Slater, Sherman and Bowman readings.
Computer Animation Lecture #1 송오영 Sejong University Department of Digital Contents.
10/7/2015art.live - 3 rd IST Concertation meeting 3 rd IST Concertation Meeting art.live (IST 10942) Xavier Marichal, UCL ADERSA - ADETTI - Casterman -
2 CEVI (Interactive Rendering Center) is a research center linked to the Language and Information Systems department in the Universitat Jaume I. Research.
DIGITAL MEDIA Graduate Program School of Literature, Communication & Culture Ivan Allen College DIGITAL MEDIA Graduate Program School of Literature, Communication.
GENESIS OF VIRTUAL REALITY  The term ‘Virtual reality’ (VR) was initially coined by Jaron Lanier, founder of VPL Research (1989)..
COIT23003 Games Development 1. Overview of Game Design.
Augmented reality Prepared by: Khyati Kataria 08DCE001
MULTIMEDIA Hardware 4/24/2017.
Vray Siamak khalighi V-Ray is a rendering engine that is used as an extension of certain 3D computer graphics software. It is a rendering engine.
Career Advisor Symposium March 2010 Professor Young J. Choi Founder, HIT Lab Australia James Riggall Human Interface Technology Laboratory (HIT.
W E L C O M E. A U G M E N T E D R E A L I T Y A SEMINAR BY JEFFREY J M EC7A ROLL NO:
FYP Project LYU0304: “Monster Battle”: A Prototype of Augmented Reality Card Game.
Augmented Reality Authorized By: Miss.Trupti Pardeshi. NDMVP, Comp Dept. Augmented Reality 1/ 23.
TELE IMMERSION AMAN BABBER
Credit:  Multimedia has been used in many aspects in our lives, for example in the field of business, entertainment.
© ExplorNet’s Centers for Quality Teaching and Learning 1 Objective % Understand career planning in a digital media environment.
A Framework for Perceptual Studies in Photorealistic Augmented Reality Martin Knecht 1, Andreas Dünser 2, Christoph Traxler 1, Michael Wimmer 1 and Raphael.
3D Animation 1. Introduction Dr. Ashraf Y. Maghari Information Technology Islamic University of Gaza Ref. Book: The Art of Maya.
Virtual Reality - by Arpit Gupta. Introduction  Virtual reality is an artificial environment that is created with software and presented to the user.
CCNA Exploration v4.0 Network fundamentals CCNA Exploration v4.0 Network fundamentals.
Research in Computer Graphics, Visualization and Human- Computer Interaction CSc 8900/9900 Ying Zhu Associate Professor Department of Computer Science.
Virtual Reality Prepared By Name - Abhilash Mund Regd.No Branch - Comp.sc & engg.
Mixed Reality Augmented Reality (AR) Augmented Virtuality (AV)
CSc4820/6820 Computer Graphics Algorithms Lecture 28
Crowds (and research in computer animation and games)
Analyst Programmer, Advanced Visualization Lab
Introduction to Virtual Environments & Virtual Reality
BIM MAPPING.
Nov. 11, Visualization with 3D CG
Objective % Understand career planning in a digital media environment.
(c) 2001 by The McGraw-Hill Companies, Inc. All rights reserved.
Crowds (and research in computer animation and games)
AN INTRODUCTION TO COMPUTER GRAPHICS Subject: Computer Graphics Lecture No: 01 Batch: 16BS(Information Technology)
Introduction to Computer Graphics
Interactive media.
Looking Ahead Tipaporn Satitpong
– Graphics and Visualization
COMPUTER GRAPHICS with OpenGL (3rd Edition) Donald Hearn M
It’s not just about games.
December 12th, 2003 Benjamin Lok
Presentation transcript:

Mixed Reality Trompe l’oëil in the 21st Century Charles Hughes, School of Computer Science Media Convergence Laboratory School of Film and Digital Media June 15, 2005

To deceive the viewer as to its reality. Trompe l’oëil To deceive the viewer as to its reality. The most extravagant blending of painting, architecture and painting of architecture for an environment can be witnessed within the Sistine Chapel. Michelangelo intended to blur the lines between the architecture and celestial visions.

See-Through HMDs Optical Video

Extending Mixed Reality “Magic is behind the eyeballs” Augmented Reality Augmented Virtuality VIRTUAL REALITY The success of any and all illusion is not with the painting techniques, technology or artist. The real “Magic is behind the eyeballs”. How does the audience actually blur those lines with its imagination? With thousands of years of experienced-based entertainment, we use any proportion necessary of reality and virtuality, the key is to engage the imagination to complete the effect. Video Games Dark Rides IMAGINED Rides

Examples from our Media Convergence Lab MR Experiences Examples from our Media Convergence Lab

Entertainment

Time Portal (AR) MR @ SIGGRAPH’03 Visual+audio+SFX Animatic Play Time Portal Animatic (sets story line) and SIGGRAPH Excerpt – 3minutes + 35 seconds. Animatic

Collaboration

Placing Real Entities into Virtual Environments Augmented Virtuality AUGMENTED VIRTUALITY AV is about bringing real things into virtual spaces. AV is to Virtual Reality what AR is to reality. There are things that want to be presented in the virtual world, but virtual reality is not able to replicate or defeats its intrinsic purpose. For instance in a virtual museum where you want to showcase the actual object with all its rich detail and patina. A virtual model will defeat the purpose of an artifact. In the case of our project MS Isle, we wanted to bring real people and their natural gesture within a totally virtual fantasy world. The reason not to go completely virtual is the importance of human to human interaction. Placing Real Entities into Virtual Environments

Demo Dome Characteristics Relative to CAVE Lightweight Inexpensive Can have distinct POVs E.g., consider a city planner and an architect Each wants specialized information But both need to have a common context

Education

MR Sea Creature @ OSC MR ROVER Artist’s Concept

Water’s Journey through …

Training

MR MINI-MOUT Instead of going to the field first, we have created a mini-MOUT at RDEcom. Instead of bringing it to the MOUT, we have brought the MOUT to us. It has turned into a rich facility to test complex human performance issues. Show MOUT2 Asset Planning – 45 seconds

Merging Realities VR Actors Vehicular Sniper VR Sets SFX Hostiles CGF HUD FFW It includes critical items that we will be able to rapidly create scenarios for training and testing. With current HMD, the resolution is dependent on the HMD Cameras. Play MOUT2MR – 2 minutes. Multi-Player MOUT VR Cues Merging Realities

Research

MR Software Suite Platform neutral Story Engine Audio Engine Agent-based Plug-in architecture Audio Engine Constraint-based speaker usage Graphics Engine DMX Engine Protocols Command and control streams Behavior, GUI and device interfaces

Visual Rendering Interactive-time and Realistic (GPU) Global Illumination Shading and shadows Interaction of real and virtual Ambient lighting Color mapping so virtual react Story-based rendering Various HDR projects

Fire/Shadows This starts three seconds after viewing slide. It runs for 1:06 and shows real-time illumination, simple fire (with a fan blowing it) and shadow casting (virtual on real) due to a virtual flashlight.

Pegasus in CSB These start separated by one second within the current window. This allows the audience to see what the corrected colors just behind the uncorrected The corrected merely adjusts its colors and luminance to shift in the direction of the current background. That makes it appear as if the colors of the coke machine reflect off the Pegasus and the colors wash out when passing by the windows. That’s just pure deception. The videos are just 16 seconds long. You need to point out that no actual illumination algorithms are used here; we just change the colors on the virtual character to react to those of its background, the real world video feed. Is this real-time? YES, and performance can be improved greatly on the new GPUs; this is a video done in May before release of nVidia GeForce 6800.Can we do better with the color blending? YES, and we will.

Charles E. Hughes School of Computer Science & Media Convergence Lab & School of Film and Digital Media & Text and Technology Program (English) E-Mail: ceh@cs.ucf.edu Home Page: http://www.cs.ucf.edu/~ceh/