Announcements Project 3a due today Project 3b due next Friday.

Slides:



Advertisements
Similar presentations
1 Photometric Stereo Reconstruction Dr. Maria E. Angelopoulou.
Advertisements

Photometric Image Formation
Computer Vision Radiometry. Bahadir K. Gunturk2 Radiometry Radiometry is the part of image formation concerned with the relation among the amounts of.
CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu Lecture 5 – Image formation (photometry)
Announcements Project 2 due today Project 3 out today –demo session at the end of class.
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #12.
Lecture 35: Photometric stereo CS4670 / 5670 : Computer Vision Noah Snavely.
3D Modeling from a photograph
Capturing light Source: A. Efros. Image formation How bright is the image of a scene point?
Computer Vision CS 776 Spring 2014 Photometric Stereo and Illumination Cones Prof. Alex Berg (Slide credits to many folks on individual slides)
Review Pinhole projection model What are vanishing points and vanishing lines? What is orthographic projection? How can we approximate orthographic projection?
1. What is Lighting? 2 Example 1. Find the cubic polynomial or that passes through the four points and satisfies 1.As a photon Metal Insulator.
Shape-from-X Class 11 Some slides from Shree Nayar. others.
Lecture 23: Photometric Stereo CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein.
AA II z f Surface Radiance and Image Irradiance Same solid angle Pinhole Camera Model.
Course Review CS/ECE 181b Spring Topics since Midterm Stereo vision Shape from shading Optical flow Face recognition project.
Capturing light Source: A. Efros. Review Pinhole projection models What are vanishing points and vanishing lines? What is orthographic projection? How.
Lecture 21: Light, reflectance and photometric stereo
Computer Vision Sources, shading and photometric stereo Marc Pollefeys COMP 256.
Objectives Learn to shade objects so their images appear three- dimensional Learn to shade objects so their images appear three- dimensional Introduce.
Lecture 32: Photometric stereo, Part 2 CS4670: Computer Vision Noah Snavely.
Basic Principles of Surface Reflectance Lecture #3 Thanks to Shree Nayar, Ravi Ramamoorthi, Pat Hanrahan.
Object recognition under varying illumination. Lighting changes objects appearance.
1 Dr. Scott Schaefer Radiosity. 2/38 Radiosity 3/38 Radiosity Physically based model for light interaction View independent lighting Accounts for indirect.
Photometric Stereo Merle Norman Cosmetics, Los Angeles Readings R. Woodham, Photometric Method for Determining Surface Orientation from Multiple Images.
Photometric Stereo & Shape from Shading
Lecture 20: Light, reflectance and photometric stereo
Light and shading Source: A. Efros.
Computer Vision Spring ,-685 Instructor: S. Narasimhan PH A18B T-R 10:30am – 11:50am Lecture #13.
EECS 274 Computer Vision Light and Shading. Radiometry – measuring light Relationship between light source, surface geometry, surface properties, and.
Reflectance Map: Photometric Stereo and Shape from Shading
Computer Vision - A Modern Approach Set: Sources, shadows and shading Slides by D.A. Forsyth Sources and shading How bright (or what colour) are objects?
Analysis of Lighting Effects Outline: The problem Lighting models Shape from shading Photometric stereo Harmonic analysis of lighting.
Y. Moses 11 Combining Photometric and Geometric Constraints Yael Moses IDC, Herzliya Joint work with Ilan Shimshoni and Michael Lindenbaum, the Technion.
Shape from Shading and Texture. Lambertian Reflectance Model Diffuse surfaces appear equally bright from all directionsDiffuse surfaces appear equally.
Capturing light Source: A. Efros.
Sources, Shadows, and Shading
Radiometry and Photometric Stereo 1. Estimate the 3D shape from shading information Can you tell the shape of an object from these photos ? 2.
Understanding the effect of lighting in images Ronen Basri.
Course 10 Shading. 1. Basic Concepts: Light Source: Radiance: the light energy radiated from a unit area of light source (or surface) in a unit solid.
111/17/ :21 Graphics II Global Rendering and Radiosity Session 9.
Announcements Office hours today 2:30-3:30 Graded midterms will be returned at the end of the class.
November 4, THE REFLECTANCE MAP AND SHAPE-FROM-SHADING.
Color and Brightness Constancy Jim Rehg CS 4495/7495 Computer Vision Lecture 25 & 26 Wed Oct 18, 2002.
Shape from Shading Course web page: vision.cis.udel.edu/cv February 26, 2003  Lecture 6.
Multiple Light Source Optical Flow Multiple Light Source Optical Flow Robert J. Woodham ICCV’90.
Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.
1Ellen L. Walker 3D Vision Why? The world is 3D Not all useful information is readily available in 2D Why so hard? “Inverse problem”: one image = many.
Tal Amir Advanced Topics in Computer Vision May 29 th, 2015 COUPLED MOTION- LIGHTING ANALYSIS.
Radiometry of Image Formation Jitendra Malik. A camera creates an image … The image I(x,y) measures how much light is captured at pixel (x,y) We want.
Understanding the effect of lighting in images Ronen Basri.
Radiometry of Image Formation Jitendra Malik. What is in an image? The image is an array of brightness values (three arrays for RGB images)
EECS 274 Computer Vision Sources, Shadows, and Shading.
Advanced Computer Graphics
MAN-522 Computer Vision Spring
Instructor: S. Narasimhan
Merle Norman Cosmetics, Los Angeles
Image formation and the shape from shading problem
Image formation and the shape from shading problem
Capturing light Source: A. Efros.
Radiosity Dr. Scott Schaefer.
Announcements Project 3b due Friday.
Part One: Acquisition of 3-D Data 2019/1/2 3DVIP-01.
Depthmap Reconstruction Based on Monocular cues
Announcements Today: evals Monday: project presentations (8 min talks)
Lecture 28: Photometric Stereo
What fraction of the incident light is reflected toward the viewer?
Announcements Project 3 out today demo session at the end of class.
Shape from Shading and Texture
Physical Problem of Simultaneous Linear Equations in Image Processing
Presentation transcript:

Announcements Project 3a due today Project 3b due next Friday

Last time we learned: Light, light field BRDF Reflectance models: Specular Lambertian Phong etc.

Diffuse reflection governed by Lambert’s law Viewed brightness does not depend on viewing direction Brightness does depend on direction of illumination This is the model most often used in computer vision Lambertian (diffuse) reflection L, N, V unit vectors I e = outgoing radiance I i = incoming radiance Lambert’s Law: BRDF for Lambertian surface

Lambertian reflection image intensity at a single point Lets assume that can achieve this by dividing each pixel in the image by is light source intensity Lighting direction (same for all points) Surface normal at a point Albedo at a point

Shape from shading Input: Output: - Single Image- 3D shape of the object in the image I(x,y) Z(x,y)

Shape from shading Input: Output: - Single Image- 3D shape of the object in the image Problem is ill-posed: many shapes can give rise to same image. Common assumptions: - Lighting is known - Lambertian reflectance + uniform albedo - Boundary conditions are known

Shape from shading Suppose You can directly measure angle between normal and light source Not quite enough information to compute surface shape But can be if you add some additional info, for example –Assume normals along the sihouette are known –Constraints on neighboring normals—“integrability” –Smoothness

Surface Normal A surface A point on the surface: Tangent directions

Shape from shading Assume that And get that Two unknowns

Shape from shading But both unknowns come from an integrable surface: Z(x,y) thus we can use the integrability constraint:

Shape from shading is called Eikonal equation can be solved using variation of Dijkstra’s algorithm Need to know the extrema points for this

Results

Shape from shading It is hard to get shape from shading work well in practice. The assumptions are quite restrictive But this is recovery of 3D from single 2D image Fewer assumptions are needed if we have several images of the same object under different lightings

Photometric stereo Input: Output: - Several Images- 3D shape of the * same object object in the images * different lightings - Albedo * same pose - Lighting

Photometric stereo N L1L1 L2L2 V L3L3 Can write this as a matrix equation:

Solving the equations

More than three lights Get better results by using more lights What’s the size of L T L? Least squares solution: Solve for N, k d as before

Example Recovered albedo Recovered normal field Forsyth & Ponce, Sec. 5.4