Announcements Today: evals Monday: project presentations (8 min talks)

Slides:



Advertisements
Similar presentations
Photometric Image Formation
Advertisements

Computer Vision Radiometry. Bahadir K. Gunturk2 Radiometry Radiometry is the part of image formation concerned with the relation among the amounts of.
Announcements Project 2 due today Project 3 out today –demo session at the end of class.
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #12.
Lecture 35: Photometric stereo CS4670 / 5670 : Computer Vision Noah Snavely.
3D Modeling from a photograph
Capturing light Source: A. Efros. Image formation How bright is the image of a scene point?
Computer Vision CS 776 Spring 2014 Photometric Stereo and Illumination Cones Prof. Alex Berg (Slide credits to many folks on individual slides)
Basic Principles of Surface Reflectance
Shadow Scanning [Bouguet 1999] Desk Lamp Camera Stick or pencil Desk The idea [Bouguet and Perona’98] J.-Y. Bouguet and P. Perona, “3D Photography on your.
Shape-from-X Class 11 Some slides from Shree Nayar. others.
Based on slides created by Edward Angel
1 Angel: Interactive Computer Graphics 5E © Addison-Wesley 2009 Shading I.
University of New Mexico
Lecture 23: Photometric Stereo CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein.
Capturing light Source: A. Efros. Review Pinhole projection models What are vanishing points and vanishing lines? What is orthographic projection? How.
Visibility Subspaces: Uncalibrated Photometric Stereo with Shadows Kalyan Sunkavalli, Harvard University Joint work with Todd Zickler and Hanspeter Pfister.
Lecture 21: Light, reflectance and photometric stereo
Basic Principles of Surface Reflectance
Computer Vision Sources, shading and photometric stereo Marc Pollefeys COMP 256.
Objectives Learn to shade objects so their images appear three- dimensional Learn to shade objects so their images appear three- dimensional Introduce.
Lecture 32: Photometric stereo, Part 2 CS4670: Computer Vision Noah Snavely.
Basic Principles of Surface Reflectance Lecture #3 Thanks to Shree Nayar, Ravi Ramamoorthi, Pat Hanrahan.
Photometric Stereo Merle Norman Cosmetics, Los Angeles Readings R. Woodham, Photometric Method for Determining Surface Orientation from Multiple Images.
Photometric Stereo & Shape from Shading
Lecture 33: Computational photography CS4670: Computer Vision Noah Snavely.
Lecture 20: Light, reflectance and photometric stereo
1 Angel: Interactive Computer Graphics 4E © Addison-Wesley 2005 Shading I Ed Angel Professor of Computer Science, Electrical and Computer Engineering,
Lighting affects appearance. Light Source emits photons Photons travel in a straight line When they hit an object they: bounce off in a new direction.
CS 480/680 Computer Graphics Shading I Dr. Frederick C Harris, Jr.
Computer Vision Spring ,-685 Instructor: S. Narasimhan PH A18B T-R 10:30am – 11:50am Lecture #13.
Structure from images. Calibration Review: Pinhole Camera.
Lecture 12 Modules Employing Gradient Descent Computing Optical Flow Shape from Shading.
Computer Vision - A Modern Approach Set: Sources, shadows and shading Slides by D.A. Forsyth Sources and shading How bright (or what colour) are objects?
Analysis of Lighting Effects Outline: The problem Lighting models Shape from shading Photometric stereo Harmonic analysis of lighting.
Y. Moses 11 Combining Photometric and Geometric Constraints Yael Moses IDC, Herzliya Joint work with Ilan Shimshoni and Michael Lindenbaum, the Technion.
Shape from Shading and Texture. Lambertian Reflectance Model Diffuse surfaces appear equally bright from all directionsDiffuse surfaces appear equally.
Capturing light Source: A. Efros.
Sources, Shadows, and Shading
EECS 274 Computer Vision Sources, Shadows, and Shading.
Radiometry and Photometric Stereo 1. Estimate the 3D shape from shading information Can you tell the shape of an object from these photos ? 2.
Understanding the effect of lighting in images Ronen Basri.
Course 10 Shading. 1. Basic Concepts: Light Source: Radiance: the light energy radiated from a unit area of light source (or surface) in a unit solid.
Announcements Office hours today 2:30-3:30 Graded midterms will be returned at the end of the class.
1 Introduction to Computer Graphics with WebGL Ed Angel Professor Emeritus of Computer Science Founding Director, Arts, Research, Technology and Science.
Shape from Shading Course web page: vision.cis.udel.edu/cv February 26, 2003  Lecture 6.
Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.
1Ellen L. Walker 3D Vision Why? The world is 3D Not all useful information is readily available in 2D Why so hard? “Inverse problem”: one image = many.
3D Object Reconstruction Using Multiple Linear Light Sources in Image Scanner Advisor :趙春棠 Chun-Tang Chao Master :鍾明軒 Ming-Hsuan Chung 01.
Active Lighting for Appearance Decomposition Todd Zickler DEAS, Harvard University.
Tal Amir Advanced Topics in Computer Vision May 29 th, 2015 COUPLED MOTION- LIGHTING ANALYSIS.
OpenGL Shading. 2 Objectives Learn to shade objects so their images appear three-dimensional Introduce the types of light-material interactions Build.
Lighting and Reflection Angel Angel: Interactive Computer Graphics5E © Addison-Wesley
Understanding the effect of lighting in images Ronen Basri.
EECS 274 Computer Vision Sources, Shadows, and Shading.
Computer vision: geometric models Md. Atiqur Rahman Ahad Based on: Computer vision: models, learning and inference. ©2011 Simon J.D. Prince.
Announcements Project 3a due today Project 3b due next Friday.
MAN-522 Computer Vision Spring
Merle Norman Cosmetics, Los Angeles
Image formation and the shape from shading problem
Image formation and the shape from shading problem
CSC461: Lecture 23 Shading Computation
Capturing light Source: A. Efros.
Lighting.
Lecturer: Dr. A.H. Abdul Hafez
Announcements Project 3b due Friday.
Isaac Gang University of Mary Hardin-Baylor
Lecture 28: Photometric Stereo
Announcements Project 3 out today demo session at the end of class.
Shape from Shading and Texture
Presentation transcript:

Announcements Today: evals Monday: project presentations (8 min talks)

Merle Norman Cosmetics, Los Angeles Photometric Stereo Merle Norman Cosmetics, Los Angeles Readings R. Woodham, Photometric Method for Determining Surface Orientation from Multiple Images. Optical Engineering 19(1)139-144 (1980). (PDF)

Diffuse reflection Simplifying assumptions image intensity of P Simplifying assumptions I = Re: camera response function f is the identity function: can always achieve this in practice by solving for f and applying f -1 to each pixel in the image Ri = 1: light source intensity is 1 can achieve this by dividing each pixel in the image by Ri

Shape from shading Suppose You can directly measure angle between normal and light source Not quite enough information to compute surface shape But can be if you add some additional info, for example assume a few of the normals are known (e.g., along silhouette) constraints on neighboring normals—“integrability” smoothness Hard to get it to work well in practice plus, how many real objects have constant albedo?

Photometric stereo L2 L3 L1 N V Can write this as a matrix equation:

Solving the equations

More than three lights Get better results by using more lights Least squares solution: Solve for N, kd as before What’s the size of LTL?

Computing light source directions Trick: place a chrome sphere in the scene the location of the highlight tells you where the light source is

Recall the rule for specular reflection For a perfect mirror, light is reflected about N We see a highlight when V = R then L is given as follows:

Depth from normals Get a similar equation for V2 Each normal gives us two linear constraints on z compute z values by solving a matrix equation (project 3)

Project 3

Limitations Big problems Smaller problems doesn’t work for shiny things, semi-translucent things shadows, inter-reflections Smaller problems camera and lights have to be distant calibration requirements measure light source directions, intensities camera response function Newer work addresses some of these issues Some pointers for further reading: Zickler, Belhumeur, and Kriegman, "Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction." IJCV, Vol. 49 No. 2/3, pp 215-227. Hertzmann & Seitz, “Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs.” IEEE Trans. PAMI 2005