Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba.

Slides:



Advertisements
Similar presentations
Multi-view Stereo via Volumetric Graph-cuts
Advertisements

1 Photometric Stereo Reconstruction Dr. Maria E. Angelopoulou.
DEVELOPMENT OF A COMPUTER PLATFORM FOR OBJECT 3D RECONSTRUCTION USING COMPUTER VISION TECHNIQUES Teresa C. S. Azevedo João Manuel R. S. Tavares Mário A.
Photometric Image Formation
The fundamental matrix F
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #12.
The Steerable Projector and Camera Unit in an Instrumented Environment Lübomira Spassova Saarland University, Saarbrücken, Germany.
Machine Vision Laboratory The University of the West of England Bristol, UK 2 nd September 2010 ICEBT Photometric Stereo in 3D Biometrics Gary A. Atkinson.
Measuring BRDFs. Why bother modeling BRDFs? Why not directly measure BRDFs? True knowledge of surface properties Accurate models for graphics.
Eyes for Relighting Extracting environment maps for use in integrating and relighting scenes (Noshino and Nayar)
MASKS © 2004 Invitation to 3D vision Lecture 7 Step-by-Step Model Buidling.
Extracting Objects from Range and Radiance Images Computer Science Division University of California at Berkeley Computer Science Division University of.
Intelligent Systems Lab. Extrinsic Self Calibration of a Camera and a 3D Laser Range Finder from Natural Scenes Davide Scaramuzza, Ahad Harati, and Roland.
Shape-from-X Class 11 Some slides from Shree Nayar. others.
Dana Cobzas-PhD thesis Image-Based Models with Applications in Robot Navigation Dana Cobzas Supervisor: Hong Zhang.
Shape from Contours and Multiple Stereo A Hierarchical, Mesh-Based Approach Hendrik Kück, Wolfgang Heidrich, Christian Vogelgsang.
Deriving Lights from Pixels Presented By: WAIL ALI EL EBEEDY By: By: Web Address: ArchitectureWeek - Tools - Deriving Lights from Pixels _0528.htm.
Measurement, Inverse Rendering COMS , Lecture 4.
Stereoscopic Light Stripe Scanning: Interference Rejection, Error Minimization and Calibration By: Geoffrey Taylor Lindsay Kleeman Presented by: Ali Agha.
Multi-view stereo Many slides adapted from S. Seitz.
Visibility Subspaces: Uncalibrated Photometric Stereo with Shadows Kalyan Sunkavalli, Harvard University Joint work with Todd Zickler and Hanspeter Pfister.
Flexible Bump Map Capture From Video James A. Paterson and Andrew W. Fitzgibbon University of Oxford Calibration Requirement:
Projected image of a cube. Classical Calibration.
Rendering Silhouettes with Virtual Lights Domingo Martin Juan Carlos Torres.
Introduction of the intrinsic image. Intrinsic Images The method of Finlayson & Hordley ( 2001 ) Two assumptions 1. the camera ’ s sensors are sufficiently.
Describing Visual Air Quality Is A Complex Issue Depending On: characteristics of observer optical characteristics of target illumination of scene optical.
Face Relighting with Radiance Environment Maps Zhen Wen 1, Zicheng Liu 2, Thomas Huang 1 Beckman Institute 1 University of Illinois Urbana, IL61801, USA.
Computer Graphics Inf4/MSc Computer Graphics Lecture Notes #16 Image-Based Lighting.
3D OBJECT MANIPULATION IN A SINGLE PHOTOGRAPH USING STOCK 3D MODELS.
Novel Depth Cues from Uncalibrated Near-field Lighting Sanjeev J. Koppal and Srinivasa Narasimhan Carnegie Mellon University Sponsors: ONR and NSF.
My Research Experience Cheng Qian. Outline 3D Reconstruction Based on Range Images Color Engineering Thermal Image Restoration.
Modeling And Visualization Of Aboriginal Rock Art in The Baiame Cave
Reconstructing Relief Surfaces George Vogiatzis, Philip Torr, Steven Seitz and Roberto Cipolla BMVC 2004.
Shading (introduction to rendering). Rendering  We know how to specify the geometry but how is the color calculated.
A HIGH RESOLUTION 3D TIRE AND FOOTPRINT IMPRESSION ACQUISITION DEVICE FOR FORENSICS APPLICATIONS RUWAN EGODA GAMAGE, ABHISHEK JOSHI, JIANG YU ZHENG, MIHRAN.
3D Surface Reconstruction from 2D Images (Survey)
Peter Sturm INRIA Grenoble – Rhône-Alpes (Institut National de Recherche en Informatique et Automatique) An overview of multi-view stereo and other topics.
Image-Based Rendering from a Single Image Kim Sang Hoon Samuel Boivin – Andre Gagalowicz INRIA.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
Xiaoguang Han Department of Computer Science Probation talk – D Human Reconstruction from Sparse Uncalibrated Views.
Visual Perception PhD Program in Information Technologies Description: Obtention of 3D Information. Study of the problem of triangulation, camera calibration.
COLLEGE OF ENGINEERING UNIVERSITY OF PORTO COMPUTER GRAPHICS AND INTERFACES / GRAPHICS SYSTEMS JGB / AAS 1 Shading (Shading) & Smooth Shading Graphics.
Y. Moses 11 Combining Photometric and Geometric Constraints Yael Moses IDC, Herzliya Joint work with Ilan Shimshoni and Michael Lindenbaum, the Technion.
Reconstructing 3D mesh from video image sequences supervisor : Mgr. Martin Samuelčik by Martin Bujňák specifications Master thesis
Shape from Shading and Texture. Lambertian Reflectance Model Diffuse surfaces appear equally bright from all directionsDiffuse surfaces appear equally.
December 4, 2014Computer Vision Lecture 22: Depth 1 Stereo Vision Comparing the similar triangles PMC l and p l LC l, we get: Similarly, for PNC r and.
Sources, Shadows, and Shading
PCB Soldering Inspection. Structured Highlight approach Structured Highlight method is applied to illuminating and imaging specular surfaces which yields.
Lec 22: Stereo CS4670 / 5670: Computer Vision Kavita Bala.
Computer Vision Lecture #10 Hossam Abdelmunim 1 & Aly A. Farag 2 1 Computer & Systems Engineering Department, Ain Shams University, Cairo, Egypt 2 Electerical.
Tutorial Visual Perception Towards Computer Vision
CS 325 Introduction to Computer Graphics 03 / 29 / 2010 Instructor: Michael Eckmann.
Student Name: Honghao Chen Supervisor: Dr Jimmy Li Co-Supervisor: Dr Sherry Randhawa.
Looking at people and Image-based Localisation Roberto Cipolla Department of Engineering Research team
Shape from Shading Course web page: vision.cis.udel.edu/cv February 26, 2003  Lecture 6.
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.
1Ellen L. Walker 3D Vision Why? The world is 3D Not all useful information is readily available in 2D Why so hard? “Inverse problem”: one image = many.
3D Object Reconstruction Using Multiple Linear Light Sources in Image Scanner Advisor :趙春棠 Chun-Tang Chao Master :鍾明軒 Ming-Hsuan Chung 01.
Reflectance Function Estimation and Shape Recovery from Image Sequence of a Rotating object Jiping Lu, Jim Little UBC Computer Science ICCV ’ 95.
Render methods. Contents Levels of rendering Wireframe Plain shadow Gouraud Phong Comparison Gouraud-Phong.
Model Refinement from Planar Parallax Anthony DickRoberto Cipolla Department of Engineering University of Cambridge.
EECS 274 Computer Vision Sources, Shadows, and Shading.
1 Real-Time High-Quality View-dependent Texture Mapping using Per-Pixel Visibility Damien Porquet Jean-Michel Dischler Djamchid Ghazanfarpour MSI Laboratory,
MAN-522 Computer Vision Spring
Multiple View Geometry
CS4670 / 5670: Computer Vision Kavita Bala Lec 27: Stereo.
Comparing NARF and SIFT Key Point Extraction Algorithms
3D Data Acquisition Previous work
Video Compass Jana Kosecka and Wei Zhang George Mason University
Shape from Shading and Texture
Presentation transcript:

Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba Research

Our technique Aquire high-res mesh from images taken under changing camera position and illumination Changing illumination uncovers fine geometric detail Assumptions: –Lambertian surface, isolated highlights –Single, distant light-source –Silhouettes of object can be extracted

Image Acquisition Setup

In a nutshell: Estimate light direction in each image With known light directions can estimate surface normals n from pixel intensities i Integrate normals to get geometry n i l

Calibration object –Fully known geometry –Light can be estimated from intensity of all points Light estimation

Visual hull Light estimation

Virtual calibration object –Partially known geometry –Light can be estimated from intensity of correct points

Surface Evolution: Deformable 3D Mesh Evolve mesh until it is predicted appearance under recovered illumination matches images

Results

Advantages –Fully uncalibrated. Camera position and illumination are recovered from images alone –Low cost, practical and efficient alternative to laser range scanning –First image based method to obtain full 3D geometry of untextured objects