Light Field Rendering Shijin Kong Lijie Heng.

Slides:



Advertisements
Similar presentations
Camera Basics What is a photograph and why do we take pictures? What is a camera?
Advertisements

Digital Image Processing
Lytro The first light field camera for the consumer market
CS 376b Introduction to Computer Vision 04 / 21 / 2008 Instructor: Michael Eckmann.
Fourier Slice Photography
Light Fields PROPERTIES AND APPLICATIONS. Outline  What are light fields  Acquisition of light fields  from a 3D scene  from a real world scene 
© 2010 Adobe Systems Incorporated. All Rights Reserved. T. Georgiev, Adobe Systems A. Lumsdaine, Indiana University The Multi-Focus Plenoptic Camera.
Lightfields, Lumigraphs, and Image-based Rendering.
Light Field Stitching with a Plenoptic Camera Zhou Xue LCAV - École Polytechnique Fédérale de Lausanne Dec
Dana Cobzas-PhD thesis Image-Based Models with Applications in Robot Navigation Dana Cobzas Supervisor: Hong Zhang.
Sampling, Aliasing, & Mipmaps
Advanced Computer Graphics (Spring 2005) COMS 4162, Lecture 21: Image-Based Rendering Ravi Ramamoorthi
View interpolation from a single view 1. Render object 2. Convert Z-buffer to range image 3. Re-render from new viewpoint 4. Use depths to resolve overlaps.
Image Forgery Detection by Gamma Correction Differences.
High-Quality Video View Interpolation
Image-Based Rendering Produce a new image from real images. Combining images Interpolation More exotic methods.
Copyright  Philipp Slusallek IBR: View Interpolation Philipp Slusallek.
Image or Object? Michael F. Cohen Microsoft Research.
CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.
Siggraph’2000, July 27, 2000 Jin-Xiang Chai Xin Tong Shing-Chow Chan Heung-Yeung Shum Microsoft Research, China Plenoptic Sampling SIGGRAPH’2000.
Linear View Synthesis Using a Dimensionality Gap Light Field Prior
Computational Photography Light Field Rendering Jinxiang Chai.
Rendering with Concentric Mosaics Heung-Yeung Shum Li-Wei he Microsoft Research.
CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.
 Marc Levoy IBM / IBR “The study of image-based modeling and rendering is the study of sampled representations of geometry.”
View interpolation from a single view 1. Render object 2. Convert Z-buffer to range image 3. Re-render from new viewpoint 4. Use depths to resolve overlaps.
1 Basics of Digital Imaging Digital Image Capture and Display Kevin L. Lorick, Ph.D. FDA, CDRH, OIVD, DIHD.
The Story So Far The algorithms presented so far exploit: –Sparse sets of images (some data may not be available) –User help with correspondences (time.
Aperture and Depth of Field. APERTURE (F/STOP) 1.What is it? 2.Where is it? 3.What does it do? 4.When do you use it? 5.Why would you use F/2.8? 6.Why.
Aperture and Depth of Field. Review What are the three controls on the camera that control proper exposure?
Light Field. Modeling a desktop Image Based Rendering  Fast Realistic Rendering without 3D models.
Digital Photography Basics. Pixels A pixel is a contraction if the term PIcture ELement. Digital images are made up of small squares, just like a tile.
Real-Time High Quality Rendering CSE 291 [Winter 2015], Lecture 6 Image-Based Rendering and Light Fields
MERL, MIT Media Lab Reinterpretable Imager Agrawal, Veeraraghavan & Raskar Amit Agrawal, Ashok Veeraraghavan and Ramesh Raskar Mitsubishi Electric Research.
EXPOSURE How we can manipulate shutter speed, aperture & ISO to achieve different visual results.
Virtual Environments with Light Fields and Lumigraphs CS April 2002 Presented by Mike Pilat.
Lenses Are classified by their Focal Length. The distance from the optical center of a lens to the front surface of the imaging device.
Image-Based Rendering. 3D Scene = Shape + Shading Source: Leonard mcMillan, UNC-CH.
Dynamically Reparameterized Light Fields Aaron Isaksen, Leonard McMillan (MIT), Steven Gortler (Harvard) Siggraph 2000 Presented by Orion Sky Lawlor cs497yzy.
Computational photography CS4670: Computer Vision Noah Snavely.
Definitions Megarays - number of light rays captured by the light field sensor. Plenoptic - camera that uses a mirrolens array to capture 4D light field.
Image-based rendering Michael F. Cohen Microsoft Research.
An Interactive Background Blurring Mechanism and Its Applications NTU CSIE 1 互動式背景模糊.
03/12/03© 2003 University of Wisconsin Last Time NPR Assignment Projects High-Dynamic Range Capture Image Based Rendering Intro.
High-Resolution Interactive Panoramas with MPEG-4 발표자 : 김영백 임베디드시스템연구실.
Astrophotography The Basics. Image Capture Devices Digital Compact cameras Webcams Digital SLR cameras Astronomical CCD cameras.
03/24/03© 2003 University of Wisconsin Last Time Image Based Rendering from Sparse Data.
PCB Soldering Inspection. Structured Highlight approach Structured Highlight method is applied to illuminating and imaging specular surfaces which yields.
03/09/05© 2005 University of Wisconsin Last Time HDR Image Capture Image Based Rendering –Improved textures –Quicktime VR –View Morphing NPR Papers: Just.
CSL 859: Advanced Computer Graphics Dept of Computer Sc. & Engg. IIT Delhi.
The Physics of Photography
112/5/ :54 Graphics II Image Based Rendering Session 11.
FREE-VIEW WATERMARKING FOR FREE VIEW TELEVISION Alper Koz, Cevahir Çığla and A.Aydın Alatan.
 Marc Levoy Using Plane + Parallax to Calibrate Dense Camera Arrays Vaibhav Vaish, Bennett Wilburn, Neel Joshi, Marc Levoy Computer Science Department.
CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.
An Interactive Background Blurring Mechanism and Its Applications NTU CSIE Yan Chih-Yu Advisor: Wu Ja-Ling, Ph.D. 1.
Chapter 2: The Lens. Focal Length is the distance between the center of a lens and the film plane when focused at infinity.
APERTURE.  The aperture is the size of the lens opening. It controls the amount of light let in:  A larger aperture lets in more light, while a smaller.
Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.
Camera surface reference images desired ray ‘closest’ ray focal surface ‘closest’ camera Light Field Parameterization We take a non-traditional approach.
CS559: Computer Graphics Lecture 36: Raytracing Li Zhang Spring 2008 Many Slides are from Hua Zhong at CUM, Paul Debevec at USC.
Understanding Aperture (a beginner’s guide) Understanding Aperture (a beginner’s guide)
Auto-stereoscopic Light-Field Display By: Jesus Caban George Landon.
Digital Image -M.V.Ramachandranwww.youtube.com/postmanchandru
Lenses Are classified by their Focal Length.
Aperture and Depth of Field
Advanced Computer Graphics
Depth of Field Objective: to photograph a subject with a foreground and background, giving a better understanding of aperture and its relation to depth.
Image-Based Rendering
© 2005 University of Wisconsin
Presentation transcript:

Light Field Rendering Shijin Kong Lijie Heng

Overview Purpose Algorithm Discussion Applications 1. representation of light field-4D (u, v, s, t) 2. creation 3. compression 4. display Discussion Applications

Purpose To generate a new view from an arbitrary position Previous methods Environment maps - depth information Interpolating - correspondence points

Purpose-Cont. Limit: “fill in the gaps”, incorrect correspondences To avoid these problems, a new method was proposed in this paper by using light field

What is Light Field In the real 3D world, how to represent a ray? Using 5D Plenoptic Function

4D Representation In free space (no occluders), oriented lines could be represented in 4D

Representation of Light Field

Creation of Light Field Rendered Images

Creation of Light Fields Aliasing Low-pass filter

Display Show video

Discussion Advantages Limitations 1. easy, robust 2. fast to create new views -sampling Limitations Large amount of data Building acquisition device Fixed focal surface

Discussion Limitations Large amount of data Building acquisition device Fixed focal surface

Compression VQ Lempel-Zic Coding

Compression -Cont.

Discussion Limitations Large amount of data Building acquisition device Fixed focal surface

Acquisition-Option1 Using a single camera -hard to manipulate -need refocus -aliasing/blurriness

Signal Camera

Acquisition-Option2 Using an array of cameras -fixed -inflexible

Camera Arrays

Acquisition-Option3 Using an microlens array to replace the camera array -easy to use -reduce aliasing

Hand-held Plenoptic Camera

Hand-held Plenoptic Camera- Cont.

More on Plenoptic Camera Higher image resolution, increased sharpness of the refocused photographs. Shorter exposures and lower image noise

Discussion Limitations Large amount of data Building acquisition device Fixed focal surface

Dynamic Reparameterized Light Fields Focal Surface is fixed when create light fields What if recover pixels that are not on the focal surface Reparameterize to required focal surface

Dynamic Reparameterized Light Fields Move to desired new focal surface Create a new 4D space with new focal surface Recove ray with Reparameterization (u, v, s, t) => (u, v, f, g)F

Dynamic Reparameterized Light Fields Recover ray r Resample from ray (s’, t’, f, g) and (s’’, t’’, f, g) Interpolation, reconstruction with filter, … , etc

Dynamic Reparameterized Light Fields

Dynamic Reparameterized Light Fields Change the shape of focal surface Gives focus on 3D object rather than planes

Dynamic Reparameterized Light Fields

Dynamic Reparameterized Light Fields

Variable Apertures Also can generate variable aperture Aperture Control amount of light Control depth of fields Aperture Filter: Control how many cameras are used to resample a required ray Larger apertures produce images with narrow range of focus

Aperture Filters

Variable Apertures

Variable Apertures

Application of Light Fields Multipersepective panorama Lens simulation

Applications of Light Field Multipersepective panorama

Applications of Light Field Lens simulation Simulate lens with large aperture

Future of Light Field Need better ways to capture larger collection of viewpoints Reconstruct 3D shape with vision algorithms More images captured allow peeking arround occlusions

Thank you! Questions?

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2024 SlidePlayer.com. Inc. All rights reserved.