Interactive Deformation of Light Fields Billy Chen Eyal Ofek Heung-Yeung Shum Marc Levoy.

Slides:

Advertisements

Similar presentations

Real-Time Rendering 靜宜大學資工研究所蔡奇偉副教授 2010©.

Advertisements

Xianyou Hou, Li-Yi Wei, Heung-Yeung Shum, Baining Guo Real-time Multi-perspective Rendering on Graphics Hardware.

Object Space EWA Surface Splatting: A Hardware Accelerated Approach to High Quality Point Rendering Liu Ren Hanspeter Pfister Matthias Zwicker CMU.

Interactive Deformation of Light Fields Billy Chen, Marc Levoy Stanford University Eyal Ofek, Heung-Yeung Shum Microsoft Research Asia To appear in the.

Spherical Convolution in Computer Graphics and Vision Ravi Ramamoorthi Columbia Vision and Graphics Center Columbia University SIAM Imaging Science Conference:

Fourier Slice Photography

Light Fields PROPERTIES AND APPLICATIONS. Outline  What are light fields  Acquisition of light fields  from a 3D scene  from a real world scene 

Real-Time Rendering TEXTURING Lecture 02 Marina Gavrilova.

Mesostructure Rendering Techniques

Unstructured Lumigraph Rendering

Rasterization and Ray Tracing in Real-Time Applications (Games) Andrew Graff.

Advanced Computer Graphics CSE 190 [Spring 2015], Lecture 14 Ravi Ramamoorthi

CS6500 Adv. Computer Graphics © Chun-Fa Chang, Spring 2003 Texture Mapping II April 10, 2003.

SIGGRAPH Course 30: Performance-Driven Facial Animation Section: Markerless Face Capture and Automatic Model Construction Part 2: Li Zhang, Columbia University.

Advanced Computer Graphics (Fall 2010) CS 283, Lecture 16: Image-Based Rendering and Light Fields Ravi Ramamoorthi

Advanced Computer Graphics (Spring 2005) COMS 4162, Lecture 21: Image-Based Rendering Ravi Ramamoorthi

09/11/2006 Bharathi Manivannan A.S Motion Warping International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH’95 - -Andrew Witkin.

Image-Based Modeling and Rendering CS 6998 Lecture 6.

Image-Based Rendering Produce a new image from real images. Combining images Interpolation More exotic methods.

HK UST * Hong Kong University of Science and Technology HK UST Modeling Hair from Multiple Views Y. Wei, E. Ofek, L. Quan and H. Shum.

Image or Object? Michael F. Cohen Microsoft Research.

CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.

Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng.

 Marc Levoy History of computer graphics CS Introduction to Computer Graphics Autumn quarter, 2003 Slides for September 25 lecture.

Siggraph’2000, July 27, 2000 Jin-Xiang Chai Xin Tong Shing-Chow Chan Heung-Yeung Shum Microsoft Research, China Plenoptic Sampling SIGGRAPH’2000.

CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.

NVIDIA Lecture 10 Copyright  Pat Hanrahan Image-Based Rendering: 1st Wave Definition: Using images to enhance the realism of 3D graphics Brute Force in.

LOCUS Demo Stefan Zickler. Two “different” classes Class “Car Side Views” Class “Car Rears”

 Marc Levoy IBM / IBR “The study of image-based modeling and rendering is the study of sampled representations of geometry.”

 Marc Levoy IBM / IBR “The study of image-based modeling and rendering is the study of sampled representations of geometry.”

CS 563 Advanced Topics in Computer Graphics Introduction To IBR By Cliff Lindsay Slide Show ’99 Siggraph[6]

Rendering Pipeline Aaron Bloomfield CS 445: Introduction to Graphics Fall 2006 (Slide set originally by Greg Humphreys)

CSCE 641 Computer Graphics: Image-based Modeling Jinxiang Chai.

CIS 581 Interactive Computer Graphics (slides based on Dr. Han-Wei Shen’s slides) Instructor: Rick Parent Credit: 4 Class: MWF 10:30.

Real-Time High Quality Rendering CSE 291 [Winter 2015], Lecture 6 Image-Based Rendering and Light Fields

Cornell CS465 Fall 2004 Lecture 1© 2004 Steve Marschner 1 CS465: Computer Graphics I Professor: Steve Marschner.

Marching Cubes: A High Resolution 3D Surface Construction Algorithm

Computer Graphics Computer Graphics is everywhere: Visual system is most important sense: High bandwidth Natural communication Fast developments in Hardware.

Advanced Computer Graphics (Spring 2013) CS 283, Lecture 15: Image-Based Rendering and Light Fields Ravi Ramamoorthi

Image-Based Rendering. 3D Scene = Shape + Shading Source: Leonard mcMillan, UNC-CH.

Efficient Editing of Aged Object Textures By: Olivier Clément Jocelyn Benoit Eric Paquette Multimedia Lab.

Interactive Rendering of Meso-structure Surface Details using Semi-transparent 3D Textures Vision, Modeling, Visualization Erlangen, Germany November 16-18,

Image-based rendering Michael F. Cohen Microsoft Research.

I 3D: Interactive Planar Reconstruction of Objects and Scenes Adarsh KowdleYao-Jen Chang Tsuhan Chen School of Electrical and Computer Engineering Cornell.

Image-based Rendering. © 2002 James K. Hahn2 Image-based Rendering Usually based on 2-D imagesUsually based on 2-D images Pre-calculationPre-calculation.

Stereo Many slides adapted from Steve Seitz.

1 Plenoptic Imaging Chong Chen Dan Schonfeld Department of Electrical and Computer Engineering University of Illinois at Chicago May

Spring 2015 CSc 83020: 3D Photography Prof. Ioannis Stamos Mondays 4:15 – 6:15

12/7/10 Looking Back, Moving Forward Computational Photography Derek Hoiem, University of Illinois Photo Credit Lee Cullivan.

Interreflections : The Inverse Problem Lecture #12 Thanks to Shree Nayar, Seitz et al, Levoy et al, David Kriegman.

CS559: Computer Graphics Lecture 8: Warping, Morphing, 3D Transformation Li Zhang Spring 2010 Most slides borrowed from Yungyu ChuangYungyu Chuang.

- Laboratoire d'InfoRmatique en Image et Systèmes d'information

112/5/ :54 Graphics II Image Based Rendering Session 11.

 Marc Levoy Using Plane + Parallax to Calibrate Dense Camera Arrays Vaibhav Vaish, Bennett Wilburn, Neel Joshi, Marc Levoy Computer Science Department.

Discontinuous Displacement Mapping for Volume Graphics, Volume Graphics 2006, July 30, Boston, MA Discontinuous Displacement Mapping for Volume Graphics.

 Vaibhav Vaish Synthetic Aperture Focusing Using Dense Camera Arrays Vaibhav Vaish Computer Graphics Laboratory Stanford University.

CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.

Paper presentation topics 2. More on feature detection and descriptors 3. Shape and Matching 4. Indexing and Retrieval 5. More on 3D reconstruction 1.

Measurement and editing of metallic car paint BRDF Martin Rump Computer Graphics Group University of Bonn, Germany.

Don Norman’s Fall 2003 Seminar 8-Dimensional Digital Photography for Historical Preservation Jack Tumblin

Image-Based Modeling of Complex Surfaces Todd Zickler DEAS, Harvard University.

Non-Photorealistic Rendering FORMS. Model dependent Threshold dependent View dependent Outline form of the object Interior form of the object Boundary.

CS559: Computer Graphics Lecture 36: Raytracing Li Zhang Spring 2008 Many Slides are from Hua Zhong at CUM, Paul Debevec at USC.

1 Real-Time High-Quality View-dependent Texture Mapping using Per-Pixel Visibility Damien Porquet Jean-Michel Dischler Djamchid Ghazanfarpour MSI Laboratory,

Advanced Computer Graphics

Image-Based Rendering

Texture for Volume Character Animation Peiyi Shen and Philip Willis

Interactive Computer Graphics

Efficient Deformable Template Matching for Face Tracking

Voicu Popescu, Chunhui Mei, Jordan Dauble, Elisha Sacks

Presentation transcript:

Interactive Deformation of Light Fields Billy Chen Eyal Ofek Heung-Yeung Shum Marc Levoy

Image-based rendering Levoy et al., 1996Shum et al., 1999 Zitnick et al., 2004Uyttendaele et al., 2004

Previous work Seitz, S., Kutulakos, K. N. Plenoptic image editing, In Proc. ICCV Zhang, Z., Wang, L., Guo, B., Shum, H.-Y, Feature-based light field morphing, In Proc. SIGGRAPH Weyrich, T., Pfister, H., Gross, M., Rendering deformable surface reflectance fields, In IEEE Transactions on Computer Graphics and Visualization.

Light field deformation

Outline Coaxial light fields Framework for deformation Splitting Deforming Rendering Results

Outline Coaxial light fields Framework for deformation Splitting Deforming Rendering Results

Coaxial light fields … …

Outline Framework for deformation Splitting Deforming Rendering Results

Splitting a light field A sub-light field consists of a bundle of rays a deformation box u s

Sub-light field example

Projector-based light field segmentation

…

Outline Coaxial light fields Framework for deformation Splitting Deforming Rendering Results

Deformation

Ray warping preserves mapping specified by the animator preserves C 0 continuity of points maps lines to lines

Inverse view ray warping

Hardware accelerated warping front id mapback id map deformation 256 x 256 resolution texture map anisoptric filter for mip-mapped texture 64 x 64 triangles real-time with a NVIDIA GeForce 3

Outline Coaxial light fields Framework for deformation Splitting Deforming Rendering Results

For each camera pixel 1.Segment ray 2.Warp ray 3.Render ray 4.Mask ray Rendering and visibility

Results

Conclusion A pipeline for deforming light fields Light field segmentation Ray warping Rendering multiple light fields Coaxial light fields Enables interactive deformation of photorealistic objects Applications: photo-realistic rapid prototyping, games

Thank you Reviewers NSF (IIS ) DARPA (NBCH ) Elizabeth Chen, Vaibhav Vaish, Gaurav Garg

Failure cases

Video of acquisition process

Deformation and compositing