Polarized 3D: High-Quality Depth Sensing with Polarization Cues

Slides:



Advertisements
Similar presentations
Discontinuity Preserving Stereo with Small Baseline Multi-Flash Illumination Rogerio Feris 1, Ramesh Raskar 2, Longbin Chen 1, Karhan Tan 3 and Matthew.
Advertisements

Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves & Seeing Through Waves Nondestructive Methods for Recovering.
Y y function). For a simple object, such as a wall, the environment response can be modelled as a single dirac. A wall further away would have a shifted.
O(N 1.5 ) divide-and-conquer technique for Minimum Spanning Tree problem Step 1: Divide the graph into  N sub-graph by clustering. Step 2: Solve each.
3D Morphing using Multiplanar Representation
KinectFusion: Real-Time Dense Surface Mapping and Tracking
--- some recent progress Bo Fu University of Kentucky.
System Integration and Experimental Results Intelligent Robotics Research Centre (IRRC) Department of Electrical and Computer Systems Engineering Monash.
Polarization-based Inverse Rendering from Single View Daisuke Miyazaki Robby T. Tan Kenji Hara Katsushi Ikeuchi.
Shadow Scanning [Bouguet 1999] Desk Lamp Camera Stick or pencil Desk The idea [Bouguet and Perona’98] J.-Y. Bouguet and P. Perona, “3D Photography on your.
Extracting Objects from Range and Radiance Images Computer Science Division University of California at Berkeley Computer Science Division University of.
Localization in indoor environments by querying omnidirectional visual maps using perspective images Miguel Lourenco, V. Pedro and João P. Barreto ICRA.
A Versatile Depalletizer of Boxes Based on Range Imagery Dimitrios Katsoulas*, Lothar Bergen*, Lambis Tassakos** *University of Freiburg **Inos Automation-software.
Shape-from-Polarimetry: Recovering Sea Surface Topography Shape-from-Polarimetry: Howard Schultz Department of Computer Science University of Massachusetts.
Advanced Computer Vision Introduction Goal and objectives To introduce the fundamental problems of computer vision. To introduce the main concepts and.
May 2004SFS1 Shape from shading Surface brightness and Surface Orientation --> Reflectance map READING: Nalwa Chapter 5. BKP Horn, Chapter 10.
Projection Defocus Analysis for Scene Capture and Image Display Li Zhang Shree Nayar Columbia University IIS SIGGRAPH Conference July 2006, Boston,
Thermal Compensation Review David Ottaway LIGO Laboratory MIT.
Photometric Stereo & Shape from Shading
Image-based Water Surface Reconstruction with Refractive Stereo Nigel Morris University of Toronto.
Computer vision: models, learning and inference
MERL, MIT Media Lab Reinterpretable Imager Agrawal, Veeraraghavan & Raskar Amit Agrawal, Ashok Veeraraghavan and Ramesh Raskar Mitsubishi Electric Research.
Modeling And Visualization Of Aboriginal Rock Art in The Baiame Cave
TTM4142 Networked Multimedia Systems A Robust Human-Silhouette Extraction Technique for Interactive Virtual Environments Presentation by Leif Arne Rønningen,
Computer Graphics Panos Trahanias ΗΥ358 Spring 2009.
Gwangju Institute of Science and Technology Intelligent Design and Graphics Laboratory Multi-scale tensor voting for feature extraction from unstructured.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
KinectFusion : Real-Time Dense Surface Mapping and Tracking IEEE International Symposium on Mixed and Augmented Reality 2011 Science and Technology Proceedings.
Xiaoguang Han Department of Computer Science Probation talk – D Human Reconstruction from Sparse Uncalibrated Views.
Visual Perception PhD Program in Information Technologies Description: Obtention of 3D Information. Study of the problem of triangulation, camera calibration.
Surface Computing Turning everyday surfaces into interactive intelligent interfaces Co-located input and output Mixed reality: tangible objects, natural.
Udo_ME2006.ppt, © Udo v. Toussaint, 11. July Bayesian Analysis of Ellipsometry Measurements Udo v. Toussaint and Thomas Schwarz-Selinger Ellipsometry.
Structured Light Based Depth Edge Detection for Object Shape Recovery Cheolhwon Kim, Jiyoung Park, Juneho Yi School of Information and Communication Engineering.
Dynamic Refraction Stereo 7. Contributions Refractive disparity optimization gives stable reconstructions regardless of surface shape Require no geometric.
PCB Soldering Inspection. Structured Highlight approach Structured Highlight method is applied to illuminating and imaging specular surfaces which yields.
Lec 22: Stereo CS4670 / 5670: Computer Vision Kavita Bala.
Interreflections : The Inverse Problem Lecture #12 Thanks to Shree Nayar, Seitz et al, Levoy et al, David Kriegman.
Advanced Computer Graphics Shadow Techniques CO2409 Computer Graphics Week 20.
模式识别国家重点实验室 中国科学院自动化研究所 National Laboratory of Pattern Recognition Institute of Automation, Chinese Academy of Sciences Context Enhancement of Nighttime.
Tutorial Visual Perception Towards Computer Vision
December 11, 2002MVA20021 Determining Shapes of Transparent Objects from Two Polarization Images Daisuke Miyazaki Masataka Kagesawa Katsushi Ikeuchi The.
Shape from Shading Course web page: vision.cis.udel.edu/cv February 26, 2003  Lecture 6.
Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.
1Ellen L. Walker 3D Vision Why? The world is 3D Not all useful information is readily available in 2D Why so hard? “Inverse problem”: one image = many.
Reflectance Function Estimation and Shape Recovery from Image Sequence of a Rotating object Jiping Lu, Jim Little UBC Computer Science ICCV ’ 95.
Understanding the effect of lighting in images Ronen Basri.
Articulated Human Pose Estimation using Gaussian Kernel Correlation
3D Scanning Based on Computer Vision
AAFS 2004 Dallas Zeno Geradts
MAN-522 Computer Vision Spring
제 5 장 스테레오.
Photorealistic Rendering vs. Interactive 3D Graphics
Image-based Lighting Computational Photography
This file is intended to be used with the blog post “Drawing in PowerPoint: Spheres, Planets and Balls” at
Rogerio Feris 1, Ramesh Raskar 2, Matthew Turk 1
Optical Coherence Tomography
Macroscopic Interferometry
Innovative Front-End Signal Processing
© University of Wisconsin, CS559 Fall 2004
VOLUMETRIC VIDEO // PLENOPTIC LIGHTFIELD // MULTI CAMERA METHODOLOGIES
The Brightness Constraint
Target Reconstruction through Fusion of Vision and LIDAR for AR&D On-Orbit 3D Reconstruction in absolute scale is necessary for autonomous rendezvous on-orbit.
Macroscopic Interferometry with Electrons, not Photons
Camera Culture Camera Culture Ramesh Raskar Ramesh Raskar
Science of Crime Scenes
Experiments can be reproduced using off-the-shelf ToF cameras
Capturing and Sharing the Experience
Shape from Shading and Texture
Camera Culture Ramesh Raskar Camera Culture MIT Media Lab.
What is the Range of Surface Reconstructions from a Gradient Field?
Presentation transcript:

Polarized 3D: High-Quality Depth Sensing with Polarization Cues Achuta Kadambi, Vage Taamazyan, Boxin Shi, and Ramesh Raskar Camera Culture Group, MIT Media Lab Contribution Verification Results Robustness to various lighting condition Uncontrolled lighting, complex object Low-cost depth sensing Depth + normal fusion Shape from polarization Correcting normals from polarization A passive 3D camera capturing high-quality shape Robust to lighting, material variation, and diffuse interreflection Robust shape reconstruction fusing normals and depths Solution Exploiting normals from polarization to enhance the quality of a coarse depth map A physics-based framework, wherein the coarse depth map is used to resolve azimuthal ambiguity and correct for refractive distortion A spanning tree integration schemes, specifically designed for polarization normals, which uses the degree of polarization as a weighting parameter Robustness to various material Full gradients Mini. Spanning Tree Comparison with HQ Laser Scan Surface: GT Full integ. MST integ. Robustness to diffuse interreflection Depth: GT Kinect Pol. Ours Normal: GT Kinect Pol. Ours Compare with other depth enhancement techniques Take-home message: “Coarse depth map + normals from polarization” reconstructs 3D shape with various materials, under uncontrolled lighting condition, and with diffuse interreflection.