NVIDIA Lecture 10 Copyright  Pat Hanrahan Image-Based Rendering: 1st Wave Definition: Using images to enhance the realism of 3D graphics Brute Force in.

Slides:



Advertisements
Similar presentations
An Introduction to Light Fields Mel Slater. Outline Introduction Rendering Representing Light Fields Practical Issues Conclusions.
Advertisements

Introduction to Image-Based Rendering Jian Huang, CS 594, Spring 2002 A part of this set of slides reference slides used at Standford by Prof. Pat Hanrahan.
Light Fields PROPERTIES AND APPLICATIONS. Outline  What are light fields  Acquisition of light fields  from a 3D scene  from a real world scene 
Real-Time Rendering TEXTURING Lecture 02 Marina Gavrilova.
Real-Time Rendering SPEACIAL EFFECTS Lecture 03 Marina Gavrilova.
Dana Cobzas-PhD thesis Image-Based Models with Applications in Robot Navigation Dana Cobzas Supervisor: Hong Zhang.
Image-Based Modeling, Rendering, and Lighting
Advanced Computer Graphics CSE 190 [Spring 2015], Lecture 14 Ravi Ramamoorthi
Copyright  Philipp Slusallek Cs fall IBR: Model-based Methods Philipp Slusallek.
18.1 Si31_2001 SI31 Advanced Computer Graphics AGR Lecture 18 Image-based Rendering Light Maps What We Did Not Cover Learning More...
Advanced Computer Graphics (Fall 2010) CS 283, Lecture 16: Image-Based Rendering and Light Fields Ravi Ramamoorthi
Advanced Computer Graphics (Spring 2005) COMS 4162, Lecture 21: Image-Based Rendering Ravi Ramamoorthi
History of computer graphics CS Introduction to Computer Graphics Autumn quarter, 2000 Slides for September 28 lecture.
Representations of Visual Appearance COMS 6160 [Spring 2007], Lecture 4 Image-Based Modeling and Rendering
Image-Based Modeling and Rendering CS 6998 Lecture 6.
Image-Based Rendering Computer Vision CSE576, Spring 2005 Richard Szeliski.
Image-Based Lighting : Computational Photography Alexei Efros, CMU, Fall 2005 © Eirik Holmøyvik …with a lot of slides donated by Paul Debevec.
View interpolation from a single view 1. Render object 2. Convert Z-buffer to range image 3. Re-render from new viewpoint 4. Use depths to resolve overlaps.
High-Quality Video View Interpolation
 Marc Levoy History of computer graphics CS Introduction to Computer Graphics Autumn quarter, 2006 Slides for September 26 lecture.
Image-based Rendering of Real Objects with Complex BRDFs.
Copyright  Philipp Slusallek IBR: View Interpolation Philipp Slusallek.
Image or Object? Michael F. Cohen Microsoft Research.
CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.
 Marc Levoy History of computer graphics CS Introduction to Computer Graphics Autumn quarter, 2003 Slides for September 25 lecture.
Surface Light Fields for 3D Photography Daniel Wood Daniel Azuma Wyvern Aldinger Brian Curless Tom Duchamp David Salesin Werner Stuetzle.
Introduction to Computer Vision CS223B, Winter 2005.
Computational Photography Light Field Rendering Jinxiang Chai.
Graphics research and courses at Stanford
CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.
 Marc Levoy IBM / IBR “The study of image-based modeling and rendering is the study of sampled representations of geometry.”
 Marc Levoy IBM / IBR “The study of image-based modeling and rendering is the study of sampled representations of geometry.”
 Marc Levoy Choosing the right course CS 148 Winter, Hanrahan, not SCPD undergraduates only requires 107 terminal course broad and conceptual CS.
 Marc Levoy History of computer graphics CS Introduction to Computer Graphics Autumn quarter, 2001 Slides for September 27 lecture.
View interpolation from a single view 1. Render object 2. Convert Z-buffer to range image 3. Re-render from new viewpoint 4. Use depths to resolve overlaps.
The Story So Far The algorithms presented so far exploit: –Sparse sets of images (some data may not be available) –User help with correspondences (time.
University of Texas at Austin CS 378 – Game Technology Don Fussell CS 378: Computer Game Technology Beyond Meshes Spring 2012.
Computer Graphics Inf4/MSc Computer Graphics Lecture 11 Texture Mapping.
Light Field. Modeling a desktop Image Based Rendering  Fast Realistic Rendering without 3D models.
Real-Time High Quality Rendering CSE 291 [Winter 2015], Lecture 6 Image-Based Rendering and Light Fields
Erdem Alpay Ala Nawaiseh. Why Shadows? Real world has shadows More control of the game’s feel  dramatic effects  spooky effects Without shadows the.
Computer Visualization BIM Curriculum 03. Topics  History  Computer Visualization Methods  Visualization Workflow  Technology Background.
Advanced Computer Graphics (Spring 2013) CS 283, Lecture 15: Image-Based Rendering and Light Fields Ravi Ramamoorthi
Image-Based Rendering. 3D Scene = Shape + Shading Source: Leonard mcMillan, UNC-CH.
Dynamically Reparameterized Light Fields Aaron Isaksen, Leonard McMillan (MIT), Steven Gortler (Harvard) Siggraph 2000 Presented by Orion Sky Lawlor cs497yzy.
Graphics Graphics Korea University cgvr.korea.ac.kr 1 Chapter 6 Special Effects 강 신 진강 신 진
C O M P U T E R G R A P H I C S Guoying Zhao 1 / 14 C O M P U T E R G R A P H I C S Guoying Zhao 1 / 14 Going-through.
Image-based rendering Michael F. Cohen Microsoft Research.
03/12/03© 2003 University of Wisconsin Last Time NPR Assignment Projects High-Dynamic Range Capture Image Based Rendering Intro.
High-Resolution Interactive Panoramas with MPEG-4 발표자 : 김영백 임베디드시스템연구실.
CSC 461: Lecture 3 1 CSC461 Lecture 3: Models and Architectures  Objectives –Learn the basic design of a graphics system –Introduce pipeline architecture.
Image-based Rendering. © 2002 James K. Hahn2 Image-based Rendering Usually based on 2-D imagesUsually based on 2-D images Pre-calculationPre-calculation.
CS 395: Adv. Computer Graphics Light Fields and their Approximations Jack Tumblin
Spring 2015 CSc 83020: 3D Photography Prof. Ioannis Stamos Mondays 4:15 – 6:15
Modeling Light cs129: Computational Photography
03/09/05© 2005 University of Wisconsin Last Time HDR Image Capture Image Based Rendering –Improved textures –Quicktime VR –View Morphing NPR Papers: Just.
CSL 859: Advanced Computer Graphics Dept of Computer Sc. & Engg. IIT Delhi.
112/5/ :54 Graphics II Image Based Rendering Session 11.
Subject Name: Computer Graphics Subject Code: Textbook: “Computer Graphics”, C Version By Hearn and Baker Credits: 6 1.
Photo VR Editor: A Panoramic and Spherical Environment Map Authoring Tool for Image-Based VR Browsers Jyh-Kuen Horng, Ming Ouhyoung Communications and.
CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.
Hypermedia: QuickTime VR Authoring Studio 1.0 By Peter Leong & Wallace Napier.
Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.
Sub-Surface Scattering Real-time Rendering Sub-Surface Scattering CSE 781 Prof. Roger Crawfis.
Visualization Technology Basic Masaki Hayashi Nov.10, 2015 Visualization with 3D CG.
Presented by 翁丞世  View Interpolation  Layered Depth Images  Light Fields and Lumigraphs  Environment Mattes  Video-Based.
Advanced Computer Graphics
Jun Shimamura, Naokazu Yokoya, Haruo Takemura and Kazumasa Yamazawa
Steps Towards the Convergence of Graphics, Vision, and Video
© 2005 University of Wisconsin
Presentation transcript:

NVIDIA Lecture 10 Copyright  Pat Hanrahan Image-Based Rendering: 1st Wave Definition: Using images to enhance the realism of 3D graphics Brute Force in Image-Space, L. Williams Texture maps for surface detail Mipmapping (antialiasing) Zbuffers for hidden surfaces Shadow mattes and maps Object tags

NVIDIA Lecture 10 Copyright  Pat Hanrahan Image-Based Rendering: 2nd Wave Represent (model and render) environments without using traditional geometric representations (polygons) Examples QuickTimeVR and panoramic image representations Light fields or virtual holograms Color + Range images Coupling viewing and morphing Advantages Cost independent of scene complexity Imagery from real or virtual scenes Modest computation compared to classical C.G.

NVIDIA Lecture 10 Copyright  Pat Hanrahan Applications Capture 3D environments MIT’s ASPEN MovieMap, Cyan’s MYST and RIVEN Museums, real estate, products, sets, planets Interactive 3D Graphics and Games Representations of complex environments (lod) Background environments Textured portals 3D sprites, billboards and imposters Post rendering warps Frame interpolation, priority rendering (Talisman) Latency compentation: HMDs, networked telepresence Stereo from single RGBZ image

NVIDIA Lecture 10 Copyright  Pat Hanrahan Apple’s QuickTime VR OutwardInward

NVIDIA Lecture 10 Copyright  Pat Hanrahan History of Panoramas Robert Barker’s Panorama (1792) 50’ high, 400’ circumference, platform for viewing Raoul Brimoin-Sanson’s Cineorama (1897) 10 synchronized projectors, 300’ circumference Disney’s CircleVision 9 35mm projectors Mirrored panoramic camera Modern IMAX and OMNIMAX theaters

NVIDIA Lecture 10 Copyright  Pat Hanrahan Panoramic Cameras Rotating Cameras Kodak Cirkut Globuscope Stationary Cameras Be Here

NVIDIA Lecture 10 Copyright  Pat Hanrahan Mars Pathfinder Panorama

NVIDIA Lecture 10 Copyright  Pat Hanrahan Creating a Cylindrical Panorama From

NVIDIA Lecture 10 Copyright  Pat Hanrahan Stitching Prewarping Lens Distortion, Radiometry, Cylindrical projection Image Registration Feature alignment, Pixel difference minimization, Fourier correlation Global Alignment Gap closing Mutual image aligment Compositing Blending, Nearest Neighbor Example courtesy James Davis

NVIDIA Lecture 10 Copyright  Pat Hanrahan Commercial Products QuickTime VR, LivePicture, IBM (Panoramix) VideoBrush IPIX (PhotoBubbles), Be Here, etc.

NVIDIA Lecture 10 Copyright  Pat Hanrahan Future Directions Geometry + panoramas Hot spots Hierarchical panoramas Stereo / depth-mapped panoramas Video panoramas

NVIDIA Lecture 10 Copyright  Pat Hanrahan Light Field Key Ideas: 4D function - Valid outside convex hull 2D slice = image - Insert to create - Extract to display Inward or outward

NVIDIA Lecture 10 Copyright  Pat Hanrahan Two Plane Parametrization Object Focal plane (st) Camera plane (uv)

NVIDIA Lecture 10 Copyright  Pat Hanrahan

NVIDIA Lecture 10 Copyright  Pat Hanrahan Reconstruction

NVIDIA Lecture 10 Copyright  Pat Hanrahan Original prototype gantry Issues: focal plane, aperture, support, lighting

NVIDIA Lecture 10 Copyright  Pat Hanrahan New light field gantry Applications: digitizing light fields measuring BRDFs range scanning Designed by Marc Levoy et al.

NVIDIA Lecture 10 Copyright  Pat Hanrahan Light Field Camera prototype (32 z 2) long-term goal (32 z 32) light field imaging chip compression chip Concept: Pat Hanrahan Mark Horowitz Marc Levoy

NVIDIA Lecture 10 Copyright  Pat Hanrahan Dayton Taylor’s Multiple Camera Rig

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.