Fast Separation of Direct and Global Images Using High Frequency Illumination Shree K. Nayar Gurunandan G. Krishnan Columbia University SIGGRAPH Conference.

Slides:

Advertisements

Similar presentations

Computer Vision Radiometry. Bahadir K. Gunturk2 Radiometry Radiometry is the part of image formation concerned with the relation among the amounts of.

Advertisements

Announcements Project 2 due today Project 3 out today –demo session at the end of class.

Lecture 35: Photometric stereo CS4670 / 5670 : Computer Vision Noah Snavely.

3D Modeling from a photograph

Lecture 24: Segmentation CS6670: Computer Vision Noah Snavely From Sandlot ScienceSandlot Science.

Procam and Campro Shree K. Nayar Computer Science Columbia University Support: NSF, ONR Procams 2006 PROCAMS Shree K. Nayar,

Micro Phase Shifting Mohit Gupta and Shree K. Nayar Computer Science Columbia University Supported by: NSF and ONR.

--- some recent progress Bo Fu University of Kentucky.

Po-Hsiang Chen Advisor: Sheng-Jyh Wang. People  Shree K. Nayar  Ramesh Raskar  Ren Ng 2.

Spherical Convolution in Computer Graphics and Vision Ravi Ramamoorthi Columbia Vision and Graphics Center Columbia University SIAM Imaging Science Conference:

Measuring BRDFs. Why bother modeling BRDFs? Why not directly measure BRDFs? True knowledge of surface properties Accurate models for graphics.

Computational Photography, Fall 2013

Subsurface scattering Model of light transport in translucent materials Marble, jade, milk, skin Light penetrates material and exits at different point.

1. What is Lighting? 2 Example 1. Find the cubic polynomial or that passes through the four points and satisfies 1.As a photon Metal Insulator.

Shape-from-X Class 11 Some slides from Shree Nayar. others.

Caustics of Catadioptric Cameras

A Signal-Processing Framework for Inverse Rendering Ravi Ramamoorthi Pat Hanrahan Stanford University.

Shape and Reflectance Estimation Techniques Dana Cobzas PIMS postdoc.

Illumination Model How to compute color to represent a scene As in taking a photo in real life: – Camera – Lighting – Object Geometry Material Illumination.

Lecture 23: Photometric Stereo CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein.

A Signal-Processing Framework for Forward and Inverse Rendering COMS , Lecture 8.

Matting and Transparency : Computational Photography Alexei Efros, CMU, Fall 2007.

Photorealistic Rendering of Rain Streaks Department of Computer Science Columbia University Kshitiz Garg Shree K. Nayar SIGGRAPH Conference July 2006,

Basic Principles of Surface Reflectance

Image-based Rendering of Real Objects with Complex BRDFs.

Rendering General BSDFs and BSSDFs Randy Rauwendaal.

Announcements Final project presentations on Wednesday Each group has 10 minutes Place.ppt talk in artifact directory Final reports due on Friday at 11:59pm.

1 Lecture 9 Lighting Light Sources Reflectance Camera Models.

Structured Light in Scattering Media Srinivasa Narasimhan Sanjeev Koppal Robotics Institute Carnegie Mellon University Sponsor: ONR Shree Nayar Bo Sun.

Projection Defocus Analysis for Scene Capture and Image Display Li Zhang Shree Nayar Columbia University IIS SIGGRAPH Conference July 2006, Boston,

BSSRDF: Bidirectional Surface Scattering Reflectance Distribution Functions Jared M. Dunne C95 Adv. Graphics Feb. 7, 2002 Based on: "A Practical Model.

A Signal-Processing Framework for Forward and Inverse Rendering Ravi Ramamoorthi Stanford University Columbia University: Feb 11, 2002.

Basic Principles of Surface Reflectance Lecture #3 Thanks to Shree Nayar, Ravi Ramamoorthi, Pat Hanrahan.

Measure, measure, measure: BRDF, BTF, Light Fields Lecture #6

Specular Reflections from Rough Surfaces Lecture #4 Thanks to Shree Nayar, Ravi Ramamoorthi, Pat Hanrahan.

Computer Graphics Inf4/MSc Computer Graphics Lecture Notes #16 Image-Based Lighting.

Light and shading Source: A. Efros.

Computer Vision Spring ,-685 Instructor: S. Narasimhan PH A18B T-R 10:30am – 11:50am Lecture #13.

Image-Based Rendering from a Single Image Kim Sang Hoon Samuel Boivin – Andre Gagalowicz INRIA.

Analysis of Subsurface Scattering under Generic Illumination Y. Mukaigawa K. Suzuki Y. Yagi Osaka University, Japan ICPR2008.

Computer Graphics Global Illumination: Photon Mapping, Participating Media Lecture 12 Taku Komura.

Radiometry and Photometric Stereo 1. Estimate the 3D shape from shading information Can you tell the shape of an object from these photos ? 2.

Image-Based Rendering of Diffuse, Specular and Glossy Surfaces from a Single Image Samuel Boivin and André Gagalowicz MIRAGES Project.

Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs Computer Science Division University of California at Berkeley.

Interreflections : The Inverse Problem Lecture #12 Thanks to Shree Nayar, Seitz et al, Levoy et al, David Kriegman.

Diffuse Reflections from Rough Surfaces Lecture #5

776 Computer Vision Jan-Michael Frahm, Enrique Dunn Spring 2012.

Announcements Office hours today 2:30-3:30 Graded midterms will be returned at the end of the class.

- Laboratoire d'InfoRmatique en Image et Systèmes d'information

1 Chapter 5: Sources, Shadows, Shading Light source: Anything emits light that is internally generated Exitance: The internally generated power per unit.

Shape from Shading Course web page: vision.cis.udel.edu/cv February 26, 2003  Lecture 6.

1Ellen L. Walker 3D Vision Why? The world is 3D Not all useful information is readily available in 2D Why so hard? “Inverse problem”: one image = many.

Illumination Model How to compute color to represent a scene As in taking a photo in real life: – Camera – Lighting – Object Geometry Material Illumination.

Tal Amir Advanced Topics in Computer Vision May 29 th, 2015 COUPLED MOTION- LIGHTING ANALYSIS.

Analyzing Impossible Images Steve Seitz University of Washington Computational Photography Symposium May 23, 2004.

Radiometry of Image Formation Jitendra Malik. A camera creates an image … The image I(x,y) measures how much light is captured at pixel (x,y) We want.

Matting and Transparency : Computational Photography Alexei Efros, CMU, Spring 2010.

CS552: Computer Graphics Lecture 33: Illumination and Shading.

Bo Sun Kalyan Sunkavalli Ravi Ramamoorthi Peter Belhumeur Shree Nayar Columbia University Time-Varying BRDFs.

MAN-522 Computer Vision Spring

Introduction Computational Photography Seminar: EECS 395/495

A Practical Analytic Single Scattering Model for Real Time Rendering

Image-based Lighting Computational Photography

Advanced Computer Graphics

Shading Variation in observed color across an object

Image formation and the shape from shading problem

Image Based Modeling and Rendering (PI: Malik)

Matting, Transparency, and Illumination

Camera Culture Camera Culture Ramesh Raskar Ramesh Raskar

Experiments can be reproduced using off-the-shelf ToF cameras

Presentation transcript:

Fast Separation of Direct and Global Images Using High Frequency Illumination Shree K. Nayar Gurunandan G. Krishnan Columbia University SIGGRAPH Conference Boston, July 2006 Support: ONR, NSF, MERL Michael D. Grossberg City College of New York Ramesh Raskar MERL

source surface P Direct and Global Illumination A A : Direct B B : Interrelection C C : Subsurface D participating medium D : Volumetric translucent surface E E : Diffusion camera

Related Work (Seitz et. al., ICCV 05) Inverse Light Transport (Sen et. al., Siggraph 05) T Dual Photography

Fast Separation of Direct and Global Images Create Novel Images of the Scene Enhance Brightness Based Vision Methods New Insights into Material Properties

direct global radiance Direct and Global Components: Interreflections surface i camera source j BRDF and geometry

High Frequency Illumination Pattern surface camera source fraction of activated source elements + i

High Frequency Illumination Pattern surface fraction of activated source elements camera source + - i

Separation from Two Images directglobal

Other Global Effects: Subsurface Scattering translucent surface camera source i j

Other Global Effects: Volumetric Scattering surface camera source participating medium i j

Diffuse Interreflections Specular Interreflections Volumetric Scattering Subsurface Scattering Diffusion

Scene

DirectGlobal

Real World Examples: Can You Guess the Images?

Eggs: Diffuse Interreflections DirectGlobal

Wooden Blocks: Specular Interreflections DirectGlobal

Novel Images

Mirror Ball: Failure Case DirectGlobal

Photometric Stereo using Direct Images Bowl Shape Source 1 Source 2 Source 3 Direct Global Nayar et al., 1991

Kitchen Sink: Volumetric Scattering Volumetric Scattering: Chandrasekar 50, Ishimaru 78 DirectGlobal

Novel Image

Peppers: Subsurface Scattering DirectGlobal

Novel Images

Hand DirectGlobal Skin: Hanrahan and Krueger 93, Uchida 96, Haro 01, Jensen et al. 01, Cula and Dana 02, Igarashi et al. 05, Weyrich et al. 05

Face: Without and With Makeup GlobalDirect GlobalDirect Without Makeup With Makeup

Blonde Hair Hair Scattering: Stamm et al. 77, Bustard and Smith 91, Lu et al. 00 Marschner et al. 03 DirectGlobal

Variants of Separation Method Shadow of Line Occluder Shadow of Mesh Occluders Coded Structured Light Shifted Sinusoids

Summary Fast and Simple Separation Method Wide Variety of Global Effects No Prior Knowledge of Material Properties Implications: Generation of Novel Images Enhance Computer Vision Methods Insights into Properties of Materials