Transparent Object Reconstruction via Coded Transport of Intensity Supplemental Video Paper ID: 846.

Slides:



Advertisements
Similar presentations
Computer Graphics In4/MSc Computer Graphics Lecture Notes #15 Illumination III View Independent Rendering.
Advertisements

Po-Hsiang Chen Advisor: Sheng-Jyh Wang. People  Shree K. Nayar  Ramesh Raskar  Ren Ng 2.
Fire Protection Laboratory Methods Day
15-1 Refraction.  The bending of a light as it passes at an angle from one medium to another.  Refraction occurs when light changes velocity. Figure.
Light Fields PROPERTIES AND APPLICATIONS. Outline  What are light fields  Acquisition of light fields  from a 3D scene  from a real world scene 
MAE513 Spring 2001 Prof. Hui Meng & Dr. David Song Dept. of Mechanical & Aerospace Engineering Advanced Diagnostics for Thermo- Fluids Laser Flow Diagnostics.
Robust Object Tracking via Sparsity-based Collaborative Model
Light Field Rendering Shijin Kong Lijie Heng.
10/14/14 Image-based Lighting Computational Photography Derek Hoiem, University of Illinois Many slides from Debevec, some from Efros T2.
CSCE 641: Photon Mapping Jinxiang Chai. Outline Rendering equation Photon mapping.
Purdue University - School of Aeronautics and Astronautics AAE 520 Experimental Aerodynamics Optical Techniques for Flow Visualization Shadowgraph Schlieren.
Reflectance and Texture of Real-World Surfaces KRISTIN J. DANA Columbia University BRAM VAN GINNEKEN Utrecht University SHREE K. NAYAR Columbia University.
CSCE 641 Computer Graphics: Image-based Modeling Jinxiang Chai.
1 Lecture 9 Lighting Light Sources Reflectance Camera Models.
C F V Light In Side S > 0 Real Object Light Out Side S ’ > 0 Real Image C This Side, R > 0 S < 0 Virtual Object S ’ < 0 Virtual Image C This Side, R
Newton’s Rings Another method for observing interference in light waves is to place a planoconvex lens on top of a flat glass surface, as in Figure 24.8a.
Three-Dimensional Concepts
The Maryland Optics Group Far-Field Optical Microscope with Nanometer-Scale Resolution Igor I. Smolyaninov and Christopher C. Davis Department of Electrical.
Modelling Realistic Water & Fire Sérgio Leal Socrates/Erasmus student at: AK Computer Graphics Institute for Computer Graphics and Vision Technical University.
Presentation of LR2V Kadi Bouatouch IRISA
RAY TRACING WITH DISPERSION CSS552 – Topics in Rendering Winter 2011 Final Project by: Kohei Ueda Shivani Srikanteshwara Mary Ann Chiramattel Kunjachan.
CSC418 Computer Graphics n Raytracing n Shadows n Global Illumination.
SCPY152 General Physics II June 19, 2015 Udom Robkob, Physics-MUSC
3D Holographic Projection Technology ABIN BABY ROLL NO: 03.
Aerospace Engineering Iowa State University 311L Schlieren & Shadowgraph Methods Aerospace Engineering 311L.
Camera Calibration & Stereo Reconstruction Jinxiang Chai.
Advanced Optics Lab at San Jose State University Ramen Bahuguna Department of Physics.
Computer Tomography By Moustafa M. Mohamed. Introduction to Medical Imaging Uses of medical imaging Obtain information about internal body organs or the.
11/15/11 Image-based Lighting Computational Photography Derek Hoiem, University of Illinois Many slides from Debevec, some from Efros T2.
10/17/97Optical Diffraction Tomography1 A.J. Devaney Department of Electrical Engineering Northeastern University Boston, MA USA
Multiple Scattering in Vision and Graphics Lecture #21 Thanks to Henrik Wann Jensen.
Dynamically Reparameterized Light Fields Aaron Isaksen, Leonard McMillan (MIT), Steven Gortler (Harvard) Siggraph 2000 Presented by Orion Sky Lawlor cs497yzy.
IMAGE MOSAICING Summer School on Document Image Processing
Wavefront Tracing for Precise Bokeh Evaluation Real-time Rendering of Physically Based Optical Effects in Theory and Practice Masanori KAKIMOTO Tokyo.
What Does Motion Reveal About Transparency ? Moshe Ben-Ezra and Shree K. Nayar Columbia University ICCV Conference October 2003, Nice, France This work.
Correspondence-Free Determination of the Affine Fundamental Matrix (Tue) Young Ki Baik, Computer Vision Lab.
Multiscale analysis of gas absorption in liquids Wylock, Dehaeck, Mikaelian, Larcy, Talbot, Colinet, Haut Transfers, Interfaces and Processes (TIPs) Université.
PCB Soldering Inspection. Structured Highlight approach Structured Highlight method is applied to illuminating and imaging specular surfaces which yields.
Interference Applications Physics 202 Professor Lee Carkner Lecture 25.
Obtaining Bidirectional Texture Reflectance of Human Skin by means of a Kaleidoscope Jude Radloff Supervised by Shaun Bangay and Adele Lobb Computer Science.
Compressive Structured Light for Recovering Inhomogeneous Participating Media Jinwei Gu, Shree Nayar, Eitan Grinspun Peter Belhumeur, and Ravi Ramamoorthi.
Mirrors and Lenses Chapter 23, Section 1. Mirror and Lens Assignment Use p. 668 – 673 in your text Draw the following pictures ◦ Plane mirror ◦ Concave.
0 Assignment 1 (Due: 3/9) The projections of two parallel lines, l 1 and l 2, which lie on the ground plane G, onto the image plane I converge at a point.
Relighting with 4D Incident Light Fields Vincent Masselus Pieter Peers Philip Dutré Yves D. Willems.
Is the velocity of the wave shown above. For reflection of light, we have the situation shown in Figure 1. The two plane mirrors in Figure 2 are at 90.
Sunlight, as the rainbow shows us, is a composite
Eigen Texture Method : Appearance compression based method Surface Light Fields for 3D photography Presented by Youngihn Kho.
PHYSICS – Total Internal Reflection and Lenses. LEARNING OBJECTIVES Core Describe the formation of an optical image by a plane mirror, and give its characteristics.
Compound Light Microscope
Multifocal method using Liquid Crystal
Rendering Pipeline Fall, 2015.
Image-based Lighting Computational Photography
Ch. 30 Lenses.
The Multisensor Camera
Image Restoration using Model-based Tracking
Reconstruction For Rendering distribution Effect
Tianshuai Liu1, Junyan Rong1, Peng Gao1, Hongbing Lu1
SPHERICAL MIRROR EQUATIONS
PHYSICS – Total Internal Reflection and Lenses
Three-Dimensional Concepts. Three Dimensional Graphics  It is the field of computer graphics that deals with generating and displaying three dimensional.
Real-Time Volume Graphics [06] Local Volume Illumination
Patrick O’Gara et al. JIMG 2008;1:
Macroscopic Interferometry with Electrons, not Photons
MFM setup. MFM setup. The excitation lasers are combined in a fiber through an acousto-optic tunable filter, collimated, reflected on a dichroic mirror.
Microscopes.
Plants from Images CS 658.
Basic Camera Function The camera converts an optical image into electrical signals that are reconverted by a television receiver into visible screen images.
Distributed Ray Tracing
SPHERICAL MIRROR EQUATIONS
Wide-field multiphoton imaging through scattering media without correction by Adrià Escobet-Montalbán, Roman Spesyvtsev, Mingzhou Chen, Wardiya Afshar.
Presentation transcript:

Transparent Object Reconstruction via Coded Transport of Intensity Supplemental Video Paper ID: 846

Turbulence / Gas Flame Water Glass Transparent Objects

Aeronautical Engineering Applications Graphic Rendering Live Cell Imaging

Light Field Probes Intrusive Methods Wetzstein et al., ICCP 2011 Schlieren Imaging Yu et al., CVPR 2013 Atcheson et al., SIGGRAPH Asia 2008 Imperical College Lodon Hullin et al., SIGGRAPH 2008 Trifonov et al., EGSR 2006 Related Work Non-intrusive Methods

Collimated Coded Illumination Moveable Sensor Plane Object Our Method We propose to reconstruct transparent object using two different intensity projections based on transport of intensity equation.

Transport of Intensity In Volumetric Object Case: In Thin Object Case: Obtaining Outgoing Light Field via Transport of Intensity Equation Collimated Coded Illumination Moveable Sensor Plane Object

Estimate Ray-ray Correspondences Using Spatial Intensity Codes Light Path Approximation Collimated Coded Illumination Moveable Sensor Plane Object

Tomographic Volume Reconstruction Collimated Coded Illumination Moveable Sensor Plane Object Rotating Different perspectives 3D Volume

Collimated Coded IlluminationMoveable Sensor Plane Object Sensor 1 Sensor 2 Illumination 2 Illumination 1 Sensor 3 Illumination 3 Dynamic Volume Reconstruction … … … …

Experimental Results

Simulation Results: Thin refractive object Simulation Setting Reconstruction

Target Object Simulation Results: Homogeneous Volume Reconstructed 2D Projections of 3D Refractive Index Field

Simulation Results: Homogeneous Volume Reconstructed volume Target Object

Simulation Results: Inhomogeneous Volume Reconstructed Isosurface and Refractive Index Field Target Object

Our Prototype Projector Refractive sample Collimating lens Collimating lens Cameras Beam splitter & screens

Prototype Result: Thin refractive object Target Object Reconstructed Rendered

Prototype Result: Dynamic refractive index fields Target Object Reconstructed Image Pairs

Prototype Result: Refractive Volumetric Reconstruction Reconstructed volume Target Object Reconstructed Refractive Index Surface Reconstruction -90° -45° 0° 45° 90°