Proxy Plane Fitting for Line Light Field Rendering Presented by Luv Kohli COMP238 December 17, 2002.

Slides:

Advertisements

Similar presentations

Light Fields PROPERTIES AND APPLICATIONS. Outline  What are light fields  Acquisition of light fields  from a 3D scene  from a real world scene 

Advertisements

Project 3 Results

Lightfields, Lumigraphs, and Image-based Rendering.

Unstructured Lumigraph Rendering

Advanced Computer Graphics CSE 190 [Spring 2015], Lecture 14 Ravi Ramamoorthi

Computer Vision : CISC 4/689

Light Readings Forsyth, Chapters 4, 6 (through 6.2) by Ted Adelson.

Modeling Light : Rendering and Image Processing Alexei Efros.

Wrap Up : Rendering and Image Processing Alexei Efros.

Advanced Computer Graphics (Fall 2010) CS 283, Lecture 16: Image-Based Rendering and Light Fields Ravi Ramamoorthi

CSCE 641 Computer Graphics: Image-based Modeling Jinxiang Chai.

Advanced Computer Graphics (Spring 2005) COMS 4162, Lecture 21: Image-Based Rendering Ravi Ramamoorthi

Multiple View Geometry : Computational Photography Alexei Efros, CMU, Fall 2005 © Martin Quinn …with a lot of slides stolen from Steve Seitz and.

Creating Adaptive Views for Group Video Teleconferencing – An Image-Based Approach Creating Adaptive Views for Group Video Teleconferencing – An Image-Based.

1 Combining Approximate Geometry with VDTM – A Hybrid Approach to 3D Video Teleconferencing Celso Kurashima 2, Ruigang Yang 1, Anselmo Lastra 1 1 Department.

1 Image-Based Visual Hulls Paper by Wojciech Matusik, Chris Buehler, Ramesh Raskar, Steven J. Gortler and Leonard McMillan [

Image-Based Visual Hulls Wojciech Matusik Chris Buehler Leonard McMillan Wojciech Matusik Chris Buehler Leonard McMillan Massachusetts Institute of Technology.

Representations of Visual Appearance COMS 6160 [Spring 2007], Lecture 4 Image-Based Modeling and Rendering

Image-Based Modeling and Rendering CS 6998 Lecture 6.

Image-Based Rendering Computer Vision CSE576, Spring 2005 Richard Szeliski.

Image-Based Rendering Produce a new image from real images. Combining images Interpolation More exotic methods.

Lecture 20: Light, color, and reflectance CS6670: Computer Vision Noah Snavely.

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL An Incremental Weighted Least Squares Approach To Surface Light Fields Greg Coombe Anselmo Lastra.

3D from multiple views : Rendering and Image Processing Alexei Efros …with a lot of slides stolen from Steve Seitz and Jianbo Shi.

Copyright  Philipp Slusallek IBR: View Interpolation Philipp Slusallek.

Image or Object? Michael F. Cohen Microsoft Research.

CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.

Computational Photography Light Field Rendering Jinxiang Chai.

Intromission Theory: Plato, Euclid, Ptolemy, da Vinci. Plato for instance, wrote in the fourth century B. C. that light emanated from the eye, seizing.

CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.

CS 563 Advanced Topics in Computer Graphics View Interpolation and Image Warping by Brad Goodwin Images in this presentation are used WITHOUT permission.

 Marc Levoy IBM / IBR “The study of image-based modeling and rendering is the study of sampled representations of geometry.”

 Marc Levoy IBM / IBR “The study of image-based modeling and rendering is the study of sampled representations of geometry.”

Midterm went out on Tuesday (due next Tuesday) Project 3 out today Announcements.

CS 563 Advanced Topics in Computer Graphics Introduction To IBR By Cliff Lindsay Slide Show ’99 Siggraph[6]

Wrap Up : Computational Photography Alexei Efros, CMU, Fall 2005 © Robert Brown.

Multiple View Geometry : Computational Photography Alexei Efros, CMU, Fall 2006 © Martin Quinn …with a lot of slides stolen from Steve Seitz and.

Image Based Rendering And Modeling Techniques And Their Applications Jiao-ying Shi State Key laboratory of Computer Aided Design and Graphics Zhejiang.

David Luebke Modeling and Rendering Architecture from Photographs A hybrid geometry- and image-based approach Debevec, Taylor, and Malik SIGGRAPH.

CSCE 641 Computer Graphics: Image-based Modeling Jinxiang Chai.

Real-Time High Quality Rendering CSE 291 [Winter 2015], Lecture 6 Image-Based Rendering and Light Fields

Computer Vision Spring ,-685 Instructor: S. Narasimhan WH 5409 T-R 10:30am – 11:50am Lecture #15.

Being There: Capturing and Experiencing a Sense of Place Richard Szeliski Microsoft Research Symposium on Computational Photography and Video.

Computational Photography and Videography Christian Theobalt and Ivo Ihrke Winter term 09/10.

Announcements Project 1 artifact winners Project 2 questions

Virtual Environments with Light Fields and Lumigraphs CS April 2002 Presented by Mike Pilat.

Advanced Computer Graphics (Spring 2013) CS 283, Lecture 15: Image-Based Rendering and Light Fields Ravi Ramamoorthi

Dynamically Reparameterized Light Fields Aaron Isaksen, Leonard McMillan (MIT), Steven Gortler (Harvard) Siggraph 2000 Presented by Orion Sky Lawlor cs497yzy.

Image-based rendering Michael F. Cohen Microsoft Research.

Lightfields, Lumigraphs, and Other Image-Based Methods.

03/24/03© 2003 University of Wisconsin Last Time Image Based Rendering from Sparse Data.

1 Plenoptic Imaging Chong Chen Dan Schonfeld Department of Electrical and Computer Engineering University of Illinois at Chicago May

Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing.

Spring 2015 CSc 83020: 3D Photography Prof. Ioannis Stamos Mondays 4:15 – 6:15

03/09/05© 2005 University of Wisconsin Last Time HDR Image Capture Image Based Rendering –Improved textures –Quicktime VR –View Morphing NPR Papers: Just.

CSL 859: Advanced Computer Graphics Dept of Computer Sc. & Engg. IIT Delhi.

Panorama artifacts online –send your votes to Li Announcements.

112/5/ :54 Graphics II Image Based Rendering Session 11.

Lecture 34: Light, color, and reflectance CS4670 / 5670: Computer Vision Noah Snavely.

Low Latency Rendering with Dataflow Architectures EngD Project Sebastian Friston Supervisor: Anthony Steed.

October 19, STEREO IMAGING (continued). October 19, RIGHT IMAGE PLANE LEFT IMAGE PLANE RIGHT FOCAL POINT LEFT FOCAL POINT BASELINE d FOCAL.

High Resolution Surface Reconstruction from Overlapping Multiple-Views

CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.

Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.

Non-Photorealistic Rendering FORMS. Model dependent Threshold dependent View dependent Outline form of the object Interior form of the object Boundary.

Auto-stereoscopic Light-Field Display By: Jesus Caban George Landon.

Presented by 翁丞世  View Interpolation  Layered Depth Images  Light Fields and Lumigraphs  Environment Mattes  Video-Based.

Presented by 翁丞世  View Interpolation  Layered Depth Images  Light Fields and Lumigraphs  Environment Mattes  Video-Based.

Light Fields on the Cheap Jason Yang Final Project Presentation.

Presentation transcript:

Proxy Plane Fitting for Line Light Field Rendering Presented by Luv Kohli COMP238 December 17, 2002

Group Teleimmersion Project in UNC’s Office of the Future group Goal: create a system for many-to- many video teleconferencing –Attempt to provide best approximate view for all participants while maintaining sense of presence

Approach Use light field rendering techniques to create novel views of participants Participant’s viewpoint tends to be limited to eye level with small lateral motions –Motivation for using a 1D linear array of cameras instead of a full 2D setup

Line Light Field Less data required, so real-time capture, transmission, and rendering possible

Multiple focal planes Current system only allows one focal plane –Background out of focus –Participants out of focus if they move away from focal plane Use plane fitting and multiple focal planes instead

Plane fitting Determine a focal plane for each participant using stereo correlation of silhouette points Epipolar constraint: (u,v) C1C1 C2C2

Plane fitting (2) Segment foreground objects out Find silhouette points Use stereo correlation of silhouette points to find approximate plane –Silhouette point in one image corresponds to epipolar line in second image

Multiple focal planes Use techniques described in Dynamically Reparameterized Light Fields (Isaksen, McMillan, Gortler) paper Conceptually, shoot a ray through light field and determine which focal planes it intersects Choose focal plane closest to geometry in scene – use scoring function σ

Multiple focal planes: scoring

Focal plane on participants

Focal plane on background

Focal plane on front objects

Multiple focal planes

Issues and future work Implementation issues Will plane-fitting and multiple focal planes be viable in a real-time networking environment? Work can be done in parallel Will this enhance the feeling of immersion?

References "Creating Adaptive Views for Group Video Teleconferencing -- An Image-Based Approach " Ruigang Yang, Celso Kurashima, Andrew Nashel, Herman Towles, Anselmo Lastra, Henry Fuchs. Presented at International Workshop on Immersive Telepresence, December 6, 2002, Juan Les Pins, France. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M.F. Cohen. The Lumigraph. In Proceedings of SIGGRAPH 1996, pages 43-54, New Orleans, August 1996.

References M. Levoy and P. Hanrahan. Light Field Rendering. In Proceedings of SIGGRAPH 1996, pages 31-42, New Orleans, August A. Isaksen, L. McMillan, and S. J. Gortler. Dynamically reparameterized light fields. Technical Report LCS-TR- 778, Massachusetts Institute of Technology, May 1999.

References C. Kurashima, R. Yang, A. Lastra. Combining Approximate Geometry with View-Dependent Texture Mapping – A Hybrid Approach to 3D Video Teleconferencing. Presented at SIBGRAPI 2002, XV Brazilian Symposium on Computer Graphics and Image Processing (07 – 10 October 2002, Fortaleza, CE, Brazil). L. McMillan and Gary Bishop. Plenoptic Modeling: An Image-Based Rendering System. In Proceedings of SIGGRAPH 1995, pages , 1995.