Inferring Reflectance Functions from Wavelet Noise Pieter Peers Philip Dutré Pieter Peers Philip Dutré June 30 th 2005 Department of Computer Science.

Slides:

Advertisements

Similar presentations

A Common Framework for Ambient Illumination in the Dichromatic Reflectance Model Color and Reflectance in Imaging and Computer Vision Workshop 2009 October.

Advertisements

A Robust Super Resolution Method for Images of 3D Scenes Pablo L. Sala Department of Computer Science University of Toronto.

Automatic Color Gamut Calibration Cristobal Alvarez-Russell Michael Novitzky Phillip Marks.

Computer Vision Radiometry. Bahadir K. Gunturk2 Radiometry Radiometry is the part of image formation concerned with the relation among the amounts of.

3D Modeling from a photograph

Spherical Convolution in Computer Graphics and Vision Ravi Ramamoorthi Columbia Vision and Graphics Center Columbia University SIAM Imaging Science Conference:

Capturing light Source: A. Efros. Image formation How bright is the image of a scene point?

CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.

CHAPTER 8 MULTIPLE REGRESSION ANALYSIS: THE PROBLEM OF INFERENCE

6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.

Physics-based Illuminant Color Estimation as an Image Semantics Clue Christian Riess Elli Angelopoulou Pattern Recognition Lab (Computer Science 5) University.

Presenter: Yufan Liu November 17th,

Modelling, calibration and rendition of colour logarithmic CMOS image sensors Dileepan Joseph and Steve Collins Department of Engineering Science University.

Shadow removal algorithms Shadow removal seminar Pavel Knur.

Uncalibrated Geometry & Stratification Sastry and Yang

Colour Constancy T.W. Hung. Colour Constancy – Human A mechanism enables human to perceive constant colour of a surface over a wide range of lighting.

Linear View Synthesis Using a Dimensionality Gap Light Field Prior

A Theory of Locally Low Dimensional Light Transport Dhruv Mahajan (Columbia University) Ira Kemelmacher-Shlizerman (Weizmann Institute) Ravi Ramamoorthi.

Object recognition under varying illumination. Lighting changes objects appearance.

Basic Image Processing January 26, 30 and February 1.

Curve fit noise=randn(1,30); x=1:1:30; y=x+noise ………………………………… [p,s]=polyfit(x,y,1);

Correlation & Regression

Regression and Correlation Methods Judy Zhong Ph.D.

Photo-realistic Rendering and Global Illumination in Computer Graphics Spring 2012 Stochastic Radiosity K. H. Ko School of Mechatronics Gwangju Institute.

The Free-form Light Stage Vincent Masselus Philip Dutré Frederik Anrys Department of Computer Science.

6.1 What is Statistics? Definition: Statistics – science of collecting, analyzing, and interpreting data in such a way that the conclusions can be objectively.

Interactive Virtual Relighting and Remodelling of Real Scenes C. Loscos 1, MC. Frasson 1,2,G. Drettakis 1, B. Walter 1, X. Granier 1, P. Poulin 2 (1) iMAGIS*

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Confidence Interval Estimation.

Computer Science 631 Lecture 7: Colorspace, local operations

Digital Face Replacement in Photographs CSC2530F Project Presentation By: Shahzad Malik January 28, 2003.

Introduction to Linear Regression

Capturing light Source: A. Efros.

Sources, Shadows, and Shading

Experimenting with Multi- dimensional Wavelet Transformations Tarık Arıcı and Buğra Gedik.

View-Dependent Precomputed Light Transport Using Nonlinear Gaussian Function Approximations Paul Green 1 Jan Kautz 1 Wojciech Matusik 2 Frédo Durand 1.

All-Frequency Shadows Using Non-linear Wavelet Lighting Approximation Ren Ng Stanford Ravi Ramamoorthi Columbia SIGGRAPH 2003 Pat Hanrahan Stanford.

Estimation Chapter 8. Estimating µ When σ Is Known.

8-1 Chapter 8: Image Restoration Image enhancement: Overlook degradation processes, deal with images intuitively Image restoration: Known degradation processes;

Relighting with 4D Incident Light Fields Vincent Masselus Pieter Peers Philip Dutré Yves D. Willems.

Announcements Office hours today 2:30-3:30 Graded midterms will be returned at the end of the class.

Practical Poissonian-Gaussian Noise Modeling and Fitting for Single- Image Raw-Data Reporter: 沈廷翰陳奇業.

Mitsubishi Electric Research Labs Progressively Refined Reflectance Fields from Natural Illumination Wojciech Matusik Matt Loper Hanspeter Pfister.

28. Multiple regression The Practice of Statistics in the Life Sciences Second Edition.

Ch14: Linear Least Squares 14.1: INTRO: Fitting a pth-order polynomial will require finding (p+1) coefficients from the data. Thus, a straight line (p=1)

On robust Monte Carlo algorithms for multi-pass global illumination Frank Suykens – De Laet 17 September 2002.

Accurate Image Based Relighting through Optimization Pieter Peers Philip Dutré Department of Computer Science K.U.Leuven, Belgium.

Color and Brightness Constancy Jim Rehg CS 4495/7495 Computer Vision Lecture 25 & 26 Wed Oct 18, 2002.

Non-Linear Kernel-Based Precomputed Light Transport Paul Green MIT Jan Kautz MIT Wojciech Matusik MIT Frédo Durand MIT Henrik Wann Jensen UCSD.

From the population to the sample The sampling distribution FETP India.

Global Illumination (3) Path Tracing. Overview Light Transport Notation Path Tracing Photon Mapping.

All-Frequency Shadows Using Non-linear Wavelet Lighting Approximation Ren Ng Stanford Ravi Ramamoorthi Columbia Pat Hanrahan Stanford.

EECS 274 Computer Vision Sources, Shadows, and Shading.

1 CSCE 441: Computer Graphics Lighting Jinxiang Chai.

Bias-Variance Analysis in Regression  True function is y = f(x) +  where  is normally distributed with zero mean and standard deviation .  Given a.

Simple Linear Regression and Correlation (Continue..,) Reference: Chapter 17 of Statistics for Management and Economics, 7 th Edition, Gerald Keller. 1.

Global predictors of regression fidelity A single number to characterize the overall quality of the surrogate. Equivalence measures –Coefficient of multiple.

The simple linear regression model and parameter estimation

AP Statistics Chapter 14 Section 1.

Scale Invariant Feature Transform (SIFT)

The general linear model and Statistical Parametric Mapping

Statistics in Applied Science and Technology

Simple Linear Regression - Introduction

CHAPTER 29: Multiple Regression*

The Regression Model Suppose we wish to estimate the parameters of the following relationship: A common method is to choose parameters to minimise the.

Uncalibrated Geometry & Stratification

Finite Wordlength Effects

Basic Image Processing

Chapter 15: Wavelets (i) Fourier spectrum provides all the frequencies

Berlin Chen Department of Computer Science & Information Engineering

Artistic Rendering Final Project Initial Proposal

Presentation transcript:

Inferring Reflectance Functions from Wavelet Noise Pieter Peers Philip Dutré Pieter Peers Philip Dutré June 30 th 2005 Department of Computer Science

Image-based Relighting / Environment Matting Scene (fixed viewpoint)

Image-based Relighting / Environment Matting … Scene (fixed viewpoint) Novel Incident Illumination +

Image-based Relighting / Environment Matting … … Scene (fixed viewpoint) Novel Incident Illumination Compute Relit Image + =

Image-based Relighting / Environment Matting … … Scene (fixed viewpoint) Novel Incident Illumination Compute Relit Image + = Reflectance Function

Examples of Reflectance Functions Diffuse Ball Specular Ball

Examples of Reflectance Functions Diffuse Ball Specular Ball

Examples of Reflectance Functions Diffuse Ball Specular Ball Reflectance Function

Reflectance Functions (frequency domain) Diffuse Ball Specular Ball Reflectance Function (frequency domain)

Reflectance Functions (wavelet domain) Diffuse Ball Specular Ball Reflectance Function (wavelet domain)

Relight a Pixel Novel Incident Illumination Specular Ball Relit pixel value? Reflectance Function (wavelet space)

Relight a Pixel Novel Incident Illumination Specular Ball Reflectance Function (wavelet space)Incident Illumination (wavelet space)

Relight a Pixel Novel Incident Illumination Specular Ball Reflectance Function (wavelet space)Incident Illumination (wavelet space) ((  )

Relight a Pixel Novel Incident Illumination Specular Ball Reflectance Function (wavelet space)Incident Illumination (wavelet space) ((  ) Only non-zero coefficients

Directly Observing Reflectance Functions Controlled Incident Illumination Photograph of Specular Ball Emit (e.g. from CRT)

Directly Observing Reflectance Functions Controlled Incident Illumination Photograph of Specular Ball Reflectance Function (unknown) Observed pixel Controlled Incident Illumination (wavelet space)

Directly Observing Reflectance Functions Controlled Incident Illumination Photograph of Specular Ball Unknown Reflectance Function (wavelet space) ((  ) Controlled Incident Illumination (wavelet space)

Directly Observing Reflectance Functions Controlled Incident Illumination Photograph of Specular Ball Controlled Incident Illumination (wavelet space) ((  ) Only non-zero coefficients Observed coefficient Unknown Reflectance Function (wavelet space)

Number of Observations Specular Ball Reflectance Function (wavelet space) #Photographs = #Illumination pixels Incident Illumination

Number of Observations Problem Specular Ball Reflectance Function (wavelet space) Incident Illumination 1000 x 1000 #Photographs = #Illumination pixels

Wavelet Noise Illumination Wavelet Noise Normal distribution of wavelet coefficients Mean : 0.0 Standard deviation : 1.0 Rescale Wavelet Noise Pattern to fit into [0..1] range Wavelet Noise Pattern Wavelet Noise Pattern (wavelet space) Advantages Arbitrary number of different patterns possible Any reflectance function gives a non-zero response Constant average luminance

Estimating Wavelet Coefficients (Unknown) Reflectance Function Wavelet Noise Assume: positions of are known Question: what are the magnitudes? ((  ) = Observed Pixel Value

Estimating Wavelet Coefficients ( )  = Leave out zero coefficients (of the reflectance function) Wavelet Noise (linearized) Reflectance Function (linearized) Observed Pixel Value

Estimating Wavelet Coefficients  = … Multiple observations matrix-vector multiplication … Wavelet Noise Reflectance Function Observed Pixel Values # emitted patterns # observations

Estimating Wavelet Coefficients  = Finding magnitudes : Linear Least Squares problem … … Wavelet Noise Reflectance Function Observed Pixel Values

Estimating Wavelet Coefficients  = Estimation error when only a part is approximated? … … Wavelet Noise Reflectance Function Observed Pixel Values

Partial Estimation  + … …… = = … Wavelet Noise Reflectance Function Observed Pixel Values

Partial Estimation According to a normal distribution  + … …… = = … Wavelet Noise Reflectance Function Observed Pixel Values

Partial Estimation According to a normal distribution  + … …… = = … Wavelet Noise Reflectance Function Observed Pixel Values Normal distribution

Partial Estimation  + … … = = … Wavelet Noise Reflectance Function Observed Pixel Values Finding the best approximation for : Linear Least Squares problem NoIseNoIse

Inferring Reflectance Functions Reflectance Function (2D wavelet space) Priority Queue of Candidates

Inferring Reflectance Functions Reflectance Function (2D wavelet space) Priority Queue of Candidates

Inferring Reflectance Functions Reflectance Function (2D wavelet space) Priority Queue of Candidates

Reflectance Function (2D wavelet space) Inferring Reflectance Functions Priority Queue of Candidates

Inferring Reflectance Functions Reflectance Function (2D wavelet space) Priority Queue of Candidates

Inferring Reflectance Functions Reflectance Function (2D wavelet space) Priority Queue of Candidates

Inferring Reflectance Functions Reflectance Function (2D wavelet space) Priority Queue of Candidates

Inferring Reflectance Functions Reflectance Function (2D wavelet space) Priority Queue of Candidates

Overview Record photographs Emit Wavelet Noise Predetermined number of photographs

Overview Record photographs Infer Reflectance Functions Reflectance Function Progressive Algorithm For each pixel

Overview Record photographs Infer Reflectance Functions Compute Relit Image Relight Incident Illumination

Results 64 Haar Wavelet Coefficients 256 Photographs Reference Photograph

Results 64 Haar Wavelet Coefficients 256 Photographs Reference Photograph

Results 64 Haar Wavelet Coefficients 256 Photographs Reference Photograph

Results 64 Haar Wavelet Coefficients 256 Photographs Reference Photograph

Results 64 Haar Wavelet Coefficients 256 Photographs Reference Photograph

Results 128 Haar Wavelet Coefficients 512 Photographs Reference Photograph

Results: High Frequency Illumination

Conclusion & Future Work Inferring Reflectance Functions from Wavelet Noise –No restriction on material properties –Stochastic illumination patterns –Trade-off quality versus acquisition time Future Work –Noise filtering –Higher-order wavelets