A survey of Light Source Detection Methods Nathan Funk University of Alberta Nov. 2003.

Slides:



Advertisements
Similar presentations
Announcements Project 2 due today Project 3 out today –demo session at the end of class.
Advertisements

Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #12.
Lecture 35: Photometric stereo CS4670 / 5670 : Computer Vision Noah Snavely.
3D Modeling from a photograph
Machine Vision Laboratory The University of the West of England Bristol, UK 2 nd September 2010 ICEBT Photometric Stereo in 3D Biometrics Gary A. Atkinson.
Capturing light Source: A. Efros. Image formation How bright is the image of a scene point?
Shadow Scanning [Bouguet 1999] Desk Lamp Camera Stick or pencil Desk The idea [Bouguet and Perona’98] J.-Y. Bouguet and P. Perona, “3D Photography on your.
Shape-from-X Class 11 Some slides from Shree Nayar. others.
December 5, 2013Computer Vision Lecture 20: Hidden Markov Models/Depth 1 Stereo Vision Due to the limited resolution of images, increasing the baseline.
Illumination Model How to compute color to represent a scene As in taking a photo in real life: – Camera – Lighting – Object Geometry Material Illumination.
Lecture 23: Photometric Stereo CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein.
Visibility Subspaces: Uncalibrated Photometric Stereo with Shadows Kalyan Sunkavalli, Harvard University Joint work with Todd Zickler and Hanspeter Pfister.
Lecture 32: Photometric stereo, Part 2 CS4670: Computer Vision Noah Snavely.
Object recognition under varying illumination. Lighting changes objects appearance.
Photometric Stereo Merle Norman Cosmetics, Los Angeles Readings R. Woodham, Photometric Method for Determining Surface Orientation from Multiple Images.
Photometric Stereo & Shape from Shading
Computer Graphics Inf4/MSc Computer Graphics Lecture Notes #16 Image-Based Lighting.
Light and shading Source: A. Efros.
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #18.
Computer Vision Spring ,-685 Instructor: S. Narasimhan PH A18B T-R 10:30am – 11:50am Lecture #13.
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm.
Computer Graphics An Introduction. Computer Graphics 26/9/2008Lecture 12 What’s this course all about? We will cover… Graphics programming and algorithms.
1/20 Obtaining Shape from Scanning Electron Microscope Using Hopfield Neural Network Yuji Iwahori 1, Haruki Kawanaka 1, Shinji Fukui 2 and Kenji Funahashi.
Computer Vision - A Modern Approach Set: Sources, shadows and shading Slides by D.A. Forsyth Sources and shading How bright (or what colour) are objects?
Analysis of Lighting Effects Outline: The problem Lighting models Shape from shading Photometric stereo Harmonic analysis of lighting.
Digital Face Replacement in Photographs CSC2530F Project Presentation By: Shahzad Malik January 28, 2003.
-Global Illumination Techniques
Y. Moses 11 Combining Photometric and Geometric Constraints Yael Moses IDC, Herzliya Joint work with Ilan Shimshoni and Michael Lindenbaum, the Technion.
December 4, 2014Computer Vision Lecture 22: Depth 1 Stereo Vision Comparing the similar triangles PMC l and p l LC l, we get: Similarly, for PNC r and.
Capturing light Source: A. Efros.
Sources, Shadows, and Shading
1 Shadows (2) ©Anthony Steed Overview n Shadows – Umbra Recap n Penumbra Analytical v. Sampling n Analytical Aspect graphs Discontinuity meshing.
PCB Soldering Inspection. Structured Highlight approach Structured Highlight method is applied to illuminating and imaging specular surfaces which yields.
Radiometry and Photometric Stereo 1. Estimate the 3D shape from shading information Can you tell the shape of an object from these photos ? 2.
Illumination and Shading How to shade surfaces based on the position,orientation,characteristics of the surfaces and the light sources illuminating them.
Understanding the effect of lighting in images Ronen Basri.
Programming 3D Applications CE Displaying Computer Graphics Week 3 Lecture 5 Bob Hobbs Faculty of Computing, Engineering and Technology Staffordshire.
Course 10 Shading. 1. Basic Concepts: Light Source: Radiance: the light energy radiated from a unit area of light source (or surface) in a unit solid.
Paint Effects.  Uses: paint brush strokes paint particle effects Traditional paint program ○ paint images on a canvas ○ paint repeatable textures that.
1 Chapter 5: Sources, Shadows, Shading Light source: Anything emits light that is internally generated Exitance: The internally generated power per unit.
A Non-Photorealistic Lighting Model For Automatic Technical Illustration Presented by: Chris Lattner April 8, 2003 CS497yzy.
CSE 140: Computer Vision Camillo J. Taylor Assistant Professor CIS Dept, UPenn.
Color and Brightness Constancy Jim Rehg CS 4495/7495 Computer Vision Lecture 25 & 26 Wed Oct 18, 2002.
Shape from Shading Course web page: vision.cis.udel.edu/cv February 26, 2003  Lecture 6.
Multiple Light Source Optical Flow Multiple Light Source Optical Flow Robert J. Woodham ICCV’90.
1Ellen L. Walker 3D Vision Why? The world is 3D Not all useful information is readily available in 2D Why so hard? “Inverse problem”: one image = many.
Reflectance Function Estimation and Shape Recovery from Image Sequence of a Rotating object Jiping Lu, Jim Little UBC Computer Science ICCV ’ 95.
Illumination Model How to compute color to represent a scene As in taking a photo in real life: – Camera – Lighting – Object Geometry Material Illumination.
Tal Amir Advanced Topics in Computer Vision May 29 th, 2015 COUPLED MOTION- LIGHTING ANALYSIS.
Render methods. Contents Levels of rendering Wireframe Plain shadow Gouraud Phong Comparison Gouraud-Phong.
Radiometry of Image Formation Jitendra Malik. A camera creates an image … The image I(x,y) measures how much light is captured at pixel (x,y) We want.
Radiometry of Image Formation Jitendra Malik. What is in an image? The image is an array of brightness values (three arrays for RGB images)
EECS 274 Computer Vision Sources, Shadows, and Shading.
Announcements Project 3a due today Project 3b due next Friday.
MAN-522 Computer Vision Spring
Instructor: S. Narasimhan
CS4670 / 5670: Computer Vision Kavita Bala Lec 27: Stereo.
Volume Visualization Chap. 10 November 20 , 2008 Jie Zhang Copyright ©
Rogerio Feris 1, Ramesh Raskar 2, Matthew Turk 1
Merle Norman Cosmetics, Los Angeles
Image formation and the shape from shading problem
Image formation and the shape from shading problem
Announcements Project 3b due Friday.
Part One: Acquisition of 3-D Data 2019/1/2 3DVIP-01.
Depthmap Reconstruction Based on Monocular cues
Announcements Today: evals Monday: project presentations (8 min talks)
Lecture 28: Photometric Stereo
What fraction of the incident light is reflected toward the viewer?
Announcements Project 3 out today demo session at the end of class.
Shape from Shading and Texture
Presentation transcript:

A survey of Light Source Detection Methods Nathan Funk University of Alberta Nov. 2003

What is Light Source Detection? Problem of Computer Vision Typically given a single image of a scene Where is the light coming from? Goal: Recover directions, intensities, and types (directional, point, area…) of light sources.

Example 1

Example 2

Motivations, Applications Scene reconstruction Find shape of objects Shape from shading Augmented reality Place an artificial object in a real scene Wrong lighting is obvious to us [Zhang “Illumination Determination…”, 2000] Artificial Real

Common Assumptions Directional light sources Lambertian surface Smooth surfaces Other: Analysis of specific object Known number of sources Orthographic projection

Pentland (1982) Statistical approach Analyse intensity changes in X and Y directions Only single source Similar methods: Lee & Rosenfeld (1985) – targeted for sphere Brooks & Horn (1985) – attempt to recover shape X Y

Weinshall (1990) Analyse intensities along occluding boundaries Look for extreme points of intensity profile Single source Yang & Yuille (1991) use similar approach Extended to detect multiple sources [Nillius “Automatic Estimation…”, 2001]

Hougen & Ahuja (1993) Arbitrary known geometry Known number of sources Solve set of irradiance equations (one for each sampled point in the image) Add illustration

Zhang & Yang (2000) Uses sphere model Find cut-off curves  High precision estimation of direction Each cut-off curves identifies the direction of a light source Detects multiple sources

Wang & Samaras (2002) Similar to Zhang & Yang Known geometry Map arbitrary surface to sphere Then apply same techniques as Zhang

Li, Lin, Lu, and Shum (2003) “Multiple-cue Illumination Estimation” Uses shading, shadows, and specular reflections First technique to deal with textured objects

Feature Comparison Arbitrary Given Geometry Unknown Geometry Multiple Sources High Precision Textured Surfaces Pentland Weinshall Yang & Yuille Hougen & Ahuja Zhang & Yang Wang & Samaras Li, Lin, Lu & Shum

Challenges Processing real images is difficult! Arbitrary unknown objects Textured objects Other types of light sources (not just directional ones) Reflected light