Siggraph’2000, July 27, 2000 Jin-Xiang Chai Xin Tong Shing-Chow Chan Heung-Yeung Shum Microsoft Research, China Plenoptic Sampling SIGGRAPH’2000.

Slides:

Advertisements

Similar presentations

Computer Graphics Inf4/MSc Computer Graphics Lecture Notes #16 Image-Based Modelling, Rendering and Lighting.

Advertisements

Introduction to Image-Based Rendering Jian Huang, CS 594, Spring 2002 A part of this set of slides reference slides used at Standford by Prof. Pat Hanrahan.

Measuring BRDFs. Why bother modeling BRDFs? Why not directly measure BRDFs? True knowledge of surface properties Accurate models for graphics.

Light Fields PROPERTIES AND APPLICATIONS. Outline  What are light fields  Acquisition of light fields  from a 3D scene  from a real world scene 

Light Field Rendering Shijin Kong Lijie Heng.

Lightfields, Lumigraphs, and Image-based Rendering.

Dana Cobzas-PhD thesis Image-Based Models with Applications in Robot Navigation Dana Cobzas Supervisor: Hong Zhang.

Unstructured Lumigraph Rendering

Advanced Computer Graphics CSE 190 [Spring 2015], Lecture 14 Ravi Ramamoorthi

Copyright  Philipp Slusallek Cs fall IBR: Model-based Methods Philipp Slusallek.

Light Readings Forsyth, Chapters 4, 6 (through 6.2) by Ted Adelson.

Computational Photography: Image-based Modeling Jinxiang Chai.

Advanced Computer Graphics (Fall 2010) CS 283, Lecture 16: Image-Based Rendering and Light Fields Ravi Ramamoorthi

CSCE 641 Computer Graphics: Image-based Modeling Jinxiang Chai.

Advanced Computer Graphics (Spring 2005) COMS 4162, Lecture 21: Image-Based Rendering Ravi Ramamoorthi

Representations of Visual Appearance COMS 6160 [Spring 2007], Lecture 4 Image-Based Modeling and Rendering

Image-Based Modeling and Rendering CS 6998 Lecture 6.

Advanced Computer Graphics (Fall 2010) CS 283, Lecture 17: Frequency Analysis and Signal Processing for Rendering Ravi Ramamoorthi

Image-Based Rendering Produce a new image from real images. Combining images Interpolation More exotic methods.

Approximate Soft Shadows on Arbitrary Surfaces using Penumbra Wedges Tomas Akenine-Möller Ulf Assarsson Department of Computer Engineering, Chalmers University.

Lecture 20: Light, color, and reflectance CS6670: Computer Vision Noah Snavely.

3D from multiple views : Rendering and Image Processing Alexei Efros …with a lot of slides stolen from Steve Seitz and Jianbo Shi.

Copyright  Philipp Slusallek IBR: View Interpolation Philipp Slusallek.

Image or Object? Michael F. Cohen Microsoft Research.

CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.

Linear View Synthesis Using a Dimensionality Gap Light Field Prior

Computational Photography Light Field Rendering Jinxiang Chai.

Rendering with Concentric Mosaics Heung-Yeung Shum Li-Wei he Microsoft Research.

CIS 681 Distributed Ray Tracing. CIS 681 Anti-Aliasing Graphics as signal processing –Scene description: continuous signal –Sample –digital representation.

CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.

CS 563 Advanced Topics in Computer Graphics View Interpolation and Image Warping by Brad Goodwin Images in this presentation are used WITHOUT permission.

 Marc Levoy IBM / IBR “The study of image-based modeling and rendering is the study of sampled representations of geometry.”

CS 563 Advanced Topics in Computer Graphics Introduction To IBR By Cliff Lindsay Slide Show ’99 Siggraph[6]

Measure, measure, measure: BRDF, BTF, Light Fields Lecture #6

Image Based Rendering And Modeling Techniques And Their Applications Jiao-ying Shi State Key laboratory of Computer Aided Design and Graphics Zhejiang.

The Story So Far The algorithms presented so far exploit: –Sparse sets of images (some data may not be available) –User help with correspondences (time.

Real-Time High Quality Rendering CSE 291 [Winter 2015], Lecture 6 Image-Based Rendering and Light Fields

Advanced Computer Graphics (Spring 2013) CS 283, Lecture 15: Image-Based Rendering and Light Fields Ravi Ramamoorthi

Image-Based Rendering. 3D Scene = Shape + Shading Source: Leonard mcMillan, UNC-CH.

Image Based Rendering(IBR) Jiao-ying Shi State Key laboratory of Computer Aided Design and Graphics Zhejiang University, Hangzhou, China

Dynamically Reparameterized Light Fields Aaron Isaksen, Leonard McMillan (MIT), Steven Gortler (Harvard) Siggraph 2000 Presented by Orion Sky Lawlor cs497yzy.

Image-based rendering Michael F. Cohen Microsoft Research.

03/12/03© 2003 University of Wisconsin Last Time NPR Assignment Projects High-Dynamic Range Capture Image Based Rendering Intro.

Lightfields, Lumigraphs, and Other Image-Based Methods.

Real-Time Rendering Digital Image Synthesis Yung-Yu Chuang 01/03/2006 with slides by Ravi Ramamoorthi and Robin Green.

Adaptively Sampled Distance Fields Representing Shape for Computer Graphics Ronald N. Perry and Sarah F. Frisken Mitsubishi Electric Research Laboratories.

Image-based Rendering. © 2002 James K. Hahn2 Image-based Rendering Usually based on 2-D imagesUsually based on 2-D images Pre-calculationPre-calculation.

03/24/03© 2003 University of Wisconsin Last Time Image Based Rendering from Sparse Data.

CS 395: Adv. Computer Graphics Light Fields and their Approximations Jack Tumblin

1 Plenoptic Imaging Chong Chen Dan Schonfeld Department of Electrical and Computer Engineering University of Illinois at Chicago May

Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing.

Plenoptic Modeling: An Image-Based Rendering System Leonard McMillan & Gary Bishop SIGGRAPH 1995 presented by Dave Edwards 10/12/2000.

03/09/05© 2005 University of Wisconsin Last Time HDR Image Capture Image Based Rendering –Improved textures –Quicktime VR –View Morphing NPR Papers: Just.

Image-Based Rendering A Brief Overview David Luebke University of Virginia.

The Plenoptic Function Lázaro Hermoso Beltrán. 2 Previous Concepts “The body of the air is full of an infinite number of radiant pyramids caused by the.

CSL 859: Advanced Computer Graphics Dept of Computer Sc. & Engg. IIT Delhi.

Panorama artifacts online –send your votes to Li Announcements.

112/5/ :54 Graphics II Image Based Rendering Session 11.

Lecture 34: Light, color, and reflectance CS4670 / 5670: Computer Vision Noah Snavely.

CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.

Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.

Real-Time Lens Blur Effects and Focus Control Sungkil Lee, Elmar Eisemann, and Hans-Peter Seidel Sunyeong Kim Nov. 23 nd

Sub-Surface Scattering Real-time Rendering Sub-Surface Scattering CSE 781 Prof. Roger Crawfis.

CIS 681 Distributed Ray Tracing. CIS 681 Anti-Aliasing Graphics as signal processing –Scene description: continuous signal –Sample –digital representation.

Advanced Computer Graphics

Real-Time Soft Shadows with Adaptive Light Source Sampling

Distributed Ray Tracing

Image-Based Rendering

Distributed Ray Tracing

Distributed Ray Tracing

Presentation transcript:

Siggraph’2000, July 27, 2000 Jin-Xiang Chai Xin Tong Shing-Chow Chan Heung-Yeung Shum Microsoft Research, China Plenoptic Sampling SIGGRAPH’2000

Siggraph’2000, July 27, D Graphics vs. IBR Traditional 3D graphics approaches Interactive Hardware support Image-based approaches Realistic Fast Easier to construct

Siggraph’2000, July 27, 2000 Rendering with No Geometry Plenoptic functions 7D: Complete function (Adelson & Bergen) 5D: Ignore time and wavelength (McMillan & Bishop) 4D: Inside bounding box (Lightfield/Lumigraph) 3D: Moving in a planar region (Concentric Mosaics) 2D: At the same viewpoint (Panorama)

Siggraph’2000, July 27, 2000 Light Field/Lumigraph Rendering Image Plane Camera Plane Light Field Capture Rendering

Siggraph’2000, July 27, 2000 The Minimum Sampling Problem How many images are needed for anti-aliased light field rendering?

Siggraph’2000, July 27, 2000 The Minimum Sampling Problem Complexity of the scene Depth Texture Number of input images Output resolution

Siggraph’2000, July 27, 2000 The Minimum Sampling Problem Previous work on light field sampling Holographic Stereogram (Halle ’ 94) Prefiltering light field (Levoy and Hanrahan ’ 96 )

Siggraph’2000, July 27, 2000 Our Approach Light field rendering = Signal reconstruction Minimum sampling from Nyquist limits High dimensionality Nonlinear A spectral analysis of 2D light field signal

Siggraph’2000, July 27, 2000 A Spectral Analysis Spectral analysis of 2D continuous light field

Siggraph’2000, July 27, 2000 A Constant Plane Z vt t v Z1Z1 Z1Z1

Siggraph’2000, July 27, 2000 Two Constant Planes Z vt Z1Z1 Z2Z2 t v Z1Z1 Z2Z2

Siggraph’2000, July 27, 2000 Between Two Planes Z vt t v Z1Z1 Z1Z1 Z2Z2 Z2Z2

Siggraph’2000, July 27, 2000 Between Two Planes Z vt t v Z1Z1 Z1Z1 Z2Z2 Z2Z2

Siggraph’2000, July 27, 2000 A Spectral Analysis Spectral analysis of sampled light field

Siggraph’2000, July 27, 2000 Sampled: Camera Spacing

Siggraph’2000, July 27, 2000 Sampled: Image Resolution

Siggraph’2000, July 27, 2000 Light Field Reconstruction

Siggraph’2000, July 27, 2000 Light Field Reconstruction

Siggraph’2000, July 27, 2000 Light Field Reconstruction

Siggraph’2000, July 27, 2000 Rendering With Optimal Plane

Siggraph’2000, July 27, 2000 Light Field Reconstruction

Siggraph’2000, July 27, 2000 Minimum Sampling Curve Joint Image and Geometry Space Minimum Sampling Curve Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, 2000 Minimum Sampling Curve Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, 2000 Minimum Sampling Curve Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, 2000 Minimum Sampling Curve Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, 2000 Minimum Sampling Curve Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, 2000 Minimum Sampling Curve Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, 2000 Minimum Sampling Curve Redundant for Rendering Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, 2000 More Geometry: 3 Layers Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, Layers Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, Layers Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, Layers Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, Layers Number of Depth Layers Accurate Depth Number of Images 2x2 8x8 4x4 16x16 32x32

Siggraph’2000, July 27, 2000 A Geometrical Intuition Z min Z opt Camera iCamera i+1

Siggraph’2000, July 27, 2000 A Geometrical Intuition Z min Z opt Camera iCamera i+1 Disparity Error < 1 Pixel Rendering Camera

Siggraph’2000, July 27, 2000 A Geometrical Intuition Z min Z opt Camera iCamera i+1 Rendering Camera

Siggraph’2000, July 27, 2000 A Geometrical Intuition Z min Z opt Camera i Camera i+1 Rendering Camera

Siggraph’2000, July 27, 2000 A Geometrical Intuition Z min Z opt Camera i Camera i+1 Rendering Camera

Siggraph’2000, July 27, 2000 Optimal Distance Rendering Camera A Geometrical Intuition Camera iCamera i+1 Zmax Zmin Depth Layer 1 Depth Layer 2 Optimal Distance

Siggraph’2000, July 27, 2000 Plenoptic Sampling 48X48 Images No Depth 16X16 Images 3Bits Depth

Siggraph’2000, July 27, 2000 Plenoptic Sampling 48X48 Images without Depth24X24 Images with 7Bits Depth Antialiasing Rendering Needs 2930X2930 images = 5,000GB Antialiasing Rendering Needs 24X24 RGBD images = 0.5GB

Siggraph’2000, July 27, 2000 Plenoptic Sampling Number of Depth Layers 1 Number of Images Light Field Rendering Redundancy Minimum Sampling Rate

Siggraph’2000, July 27, 2000 Plenoptic Sampling Number of Depth Layers Number of Images Redundant for Rendering Maximum Resources Joint Image and Geometry Space 1

Siggraph’2000, July 27, 2000 Plenoptic Sampling Number of Depth Layers Number of Images Higher Output Resolution

Siggraph’2000, July 27, 2000 Unifying 3D Graphics and IBR? The same rendering quality can be achieved with a combination of images and geometry

Siggraph’2000, July 27, 2000 IBR: Sampling Sampling: design principles for IBR Application 1: Geometry-assisted image dataset reduction Application 2: Image-based geometry simplification Application 3: Rendering-driven vision reconstruction

Siggraph’2000, July 27, 2000 Future Work Occlusion: More accurate model of spectral support Surface model: Remove the limitation of constant depth model BRDF: Beyond Lambertian model

Siggraph’2000, July 27, 2000 End of the Talk Thank you