Kartic Subr, Derek Nowrouzezahrai, Wojciech Jarosz, Jan Kautz and Kenny Mitchell Disney Research, University of Montreal, University College London.

Slides:



Advertisements
Similar presentations
Bidirectional Photon Mapping Jiří Vorba Charles University in Prague Faculty of Mathematics and Physics 1.
Advertisements

Sample Approximation Methods for Stochastic Program Jerry Shen Zeliha Akca March 3, 2005.
Combining Monte Carlo Estimators If I have many MC estimators, with/without various variance reduction techniques, which should I choose?
Monte Carlo Methods and Statistical Physics
Many-light methods – Clamping & compensation
Anton S. Kaplanyan Karlsruhe Institute of Technology, Germany Path Space Regularization Framework.
Photorealistic Rendering. Ray tracing v. photorealistic rendering What illumination effects are not captured by ray tracing? What illumination effects.
Shu-Jheng Huang 1 / 25 Structured Importance Sampling of Environment Maps Agarwal, S., R. Ramamoorthi, S. Belongie, and H. W. Jensen.
Path Differentials for MC Rendering Frank Suykens Department of Computer Science K.U.Leuven, Belgium Dagstuhl 2001: Stochastic methods in Rendering.
Monte Carlo Integration Robert Lin April 20, 2004.
Advanced Computer Graphics (Spring 2005) COMS 4162, Lectures 18, 19: Monte Carlo Integration Ravi Ramamoorthi Acknowledgements.
Advanced Computer Graphics (Fall 2009) CS 294, Rendering Lecture 5: Monte Carlo Path Tracing Ravi Ramamoorthi
CF-3 Bank Hapoalim Jun-2001 Zvi Wiener Computational Finance.
1 Variance Reduction via Lattice Rules By Pierre L’Ecuyer and Christiane Lemieux Presented by Yanzhi Li.
Monte Carlo Integration COS 323 Acknowledgment: Tom Funkhouser.
Advanced Computer Graphics (Spring 2006) COMS 4162, Lecture 20: Monte Carlo Path Tracing Ravi Ramamoorthi Acknowledgements.
1 Monte Carlo Global Illumination Brandon Lloyd COMP 238 December 16, 2002.
Monte Carlo Integration Digital Image Synthesis Yung-Yu Chuang with slides by Pat Hanrahan and Torsten Moller.
Direct Illumination with Lazy Visibility Evaluation David Hart Philip Dutré Donald P. Greenberg Cornell University SIGGRAPH 99.
Global Illumination Jian Huang, CS 594, Fall 2002 This set of slides reference text book and the course note of Dutre et. al on SIGGRAPH 2001.
Hypothesis Testing in Linear Regression Analysis
1 CE 530 Molecular Simulation Lecture 7 David A. Kofke Department of Chemical Engineering SUNY Buffalo
Analysis of Monte Carlo Integration Fall 2012 By Yaohang Li, Ph.D.
1 Statistical Mechanics and Multi- Scale Simulation Methods ChBE Prof. C. Heath Turner Lecture 11 Some materials adapted from Prof. Keith E. Gubbins:
01/24/05© 2005 University of Wisconsin Last Time Raytracing and PBRT Structure Radiometric quantities.
Selected Topics in Global Illumination Computation Jaroslav Křivánek Charles University, Prague
F.F. Assaad. MPI-Stuttgart. Universität-Stuttgart Numerical approaches to the correlated electron problem: Quantum Monte Carlo.  The Monte.
University of Texas at Austin CS384G - Computer Graphics Fall 2008 Don Fussell Distribution Ray Tracing.
Monte Carlo Integration II Digital Image Synthesis Yung-Yu Chuang with slides by Pat Hanrahan and Torsten Moller.
Monte Carlo I Previous lecture Analytical illumination formula This lecture Numerical evaluation of illumination Review random variables and probability.
1 Ratio estimation under SRS Assume Absence of nonsampling error SRS of size n from a pop of size N Ratio estimation is alternative to under SRS, uses.
M. Zwicker Univ. of Bern W. Jarosz Disney Research J. Lehtinen
Module 1: Statistical Issues in Micro simulation Paul Sousa.
02/10/03© 2003 University of Wisconsin Last Time Participating Media Assignment 2 –A solution program now exists, so you can preview what your solution.
Fourier Analysis of Stochastic Sampling For Assessing Bias and Variance in Integration Kartic Subr, Jan Kautz University College London.
Basic Numerical Procedure
Fourier Depth of Field Cyril Soler, Kartic Subr, Frédo Durand, Nicolas Holzschuch, François Sillion INRIA, UC Irvine, MIT CSAIL.
Importance Resampling for Global Illumination Justin F. Talbot Master’s Thesis Defense Brigham Young University Provo, UT.
Importance Resampling for Global Illumination Justin Talbot, David Cline, and Parris Egbert Brigham Young University Provo, UT.
A Theory of Monte Carlo Visibility Sampling
CS348B Lecture 9Pat Hanrahan, Spring 2005 Overview Earlier lecture Statistical sampling and Monte Carlo integration Last lecture Signal processing view.
On robust Monte Carlo algorithms for multi-pass global illumination Frank Suykens – De Laet 17 September 2002.
Handling Difficult Light Paths (virtual spherical lights) Miloš Hašan UC Berkeley Realistic Rendering with Many-Light Methods.
Chapter 19 Monte Carlo Valuation. Copyright © 2006 Pearson Addison-Wesley. All rights reserved Monte Carlo Valuation Simulation of future stock.
02/12/03© 2003 University of Wisconsin Last Time Intro to Monte-Carlo methods Probability.
Quasi-Random Techniques Don P. Mitchell. MC Integration for Rendering Ray tracing yields point samples f(x i ) Discontinuous f thwarts efficient methods.
Computer Graphics III – Monte Carlo integration Direct illumination
Variance Reduction Fall 2012
Photo-realistic Rendering and Global Illumination in Computer Graphics Spring 2012 Stochastic Path Tracing Algorithms K. H. Ko School of Mechatronics Gwangju.
University of Texas at Austin CS395T - Advanced Image Synthesis Spring 2007 Don Fussell Photon Mapping and Irradiance Caching.
01/26/05© 2005 University of Wisconsin Last Time Raytracing and PBRT Structure Radiometric quantities.
Global Illumination (3) Path Tracing. Overview Light Transport Notation Path Tracing Photon Mapping.
Distributed Ray Tracing. Can you get this with ray tracing?
Computer graphics III – Low-discrepancy sequences and quasi-Monte Carlo methods Jaroslav Křivánek, MFF UK
Computer graphics III – Multiple Importance Sampling Jaroslav Křivánek, MFF UK
Computer graphics III – Monte Carlo integration II Jaroslav Křivánek, MFF UK
Monte Carlo Integration Digital Image Synthesis Yung-Yu Chuang 12/3/2008 with slides by Pat Hanrahan and Torsten Moller.
Computer graphics III – Rendering equation and its solution
Noise Filtering in Monte Carlo Rendering
Introduction to Monte Carlo Method
Sampling and Reconstruction of Visual Appearance
Rutgers Intelligent Transportation Systems (RITS) Laboratory
The Rendering Equation
Primary Sample Space Path Guiding
Monte Carol Integration
Monte Carlo Rendering Central theme is sampling:
Lecture 4 - Monte Carlo improvements via variance reduction techniques: antithetic sampling Antithetic variates: for any one path obtained by a gaussian.
Jaroslav Křivánek, MFF UK
A Survey on Gradient-Domain Rendering
Monte Carlo Integration
Presentation transcript:

Kartic Subr, Derek Nowrouzezahrai, Wojciech Jarosz, Jan Kautz and Kenny Mitchell Disney Research, University of Montreal, University College London

direct illumination is an integral Exitant radianceIncident radiance

abstracting away the application… 0

numerical integration implies sampling 0 sampled integrand secondary estimate using N samples

render 1 (N spp) render 2 (N spp) render 1000 (N spp) Histogram of radiance at pixel each pixel is a secondary estimate (path tracing)

why bother? I am only interested in 1 image

error visible across neighbouring pixels

histograms of 1000 N-sample estimates estimated value (bins) Number of estimates reference stochastic estimator 2 stochastic estimator 1 deterministic estimator

error includes bias and variance estimated value (bins) Number of estimates reference bias variance

error of unbiased stochastic estimator = sqrt(variance) error of deterministic estimator = bias

Variance depends on samps. per estimate ‘N’ estimated value (bins) Number of estimates estimated value (bins) Number of estimates Histogram of 1000 estimates with N =10 Histogram of 1000 estimates with N =50

increasing ‘N’, error approaches bias N error

convergence rate of estimator N error log-N log-error convergence rate = slope

comparing estimators log-error log-N Estimator 2 Estimator 1 Estimator 3

the “better” estimator depends on application log-error log-N Estimator 2 Estimator 1 real-timeOffline sample budget

typical estimators (anti-aliasing) log-error log-N random MC (-0.5) MC with jittered sampling (-1.5) QMC (-1) randomised QMC (-1.5) MC with importance sampling (-0.5)

What happens when strategies are combined? ZY = + combined estimate single estimate using estimator 1 single estimate using estimator 2 () / 2 ? & what about convergence?

What happens when strategies are combined? Non-trivial, not intuitive needs formal analysis can combination improve convergence or only constant?

we derived errors in closed form…

combinations of popular strategies

Improved convergence by combining … Strategy AStrategy BStrategy C New strategy D Observed convergence of D is better than that of A, B or C

exciting result! Strategy AStrategy BStrategy C New strategy D jittered antithetic importance Observed convergence of D is better than that of A, B or C

related work Correlated and antithetic sampling Combining variance reduction schemes Monte Carlo sampling Variance reduction Quasi-MC methods

goals 1.Assess combinations of strategies

Intuition (now) Formalism (suppl. mat)

recall combined estimator ZY = + combined estimate single estimate using estimator 1 single estimate using estimator 2 () / 2

applying variance operator ZY = + combined estimate single estimate using estimator 1 single estimate using estimator 2 V ( ) () / cov (, ) /4 Y

variance reduction via negative correlation ZY = + V ( ) () / cov (, ) /4 Y combined estimate single estimate using estimator 1 single estimate using estimator 2 best case is when X and Y have a correlation of -1

“antithetic” estimates yield zero variance! ZY = + V ( ) () / cov (, ) /4 Y combined estimate single estimate using estimator 1 single estimate using estimator 2

antithetic estimates vs antithetic samples? Y Y = f(t) x f(x) s t Y

antithetic estimates vs antithetic samples? x f(x) s t Y if t=1-s, corr(s,t)=-1 - (s,t) are antithetic samples - (X,Y) are not antithetic estimates unless f(x) is linear! - worse, cov(X,Y) could be positive and increase overall variance

antithetic sampling within strata x f(x) s t ?

integrand not linear within many strata But where linear, variance is close to zero As number of strata is increased, more benefit –i.e. if jittered, benefit increases with ‘N’ –thus affects convergence Possibility of increased variance in many strata Improve by also using importance sampling?

review: importance sampling as warp x f(x) g(x) uniform Ideal case: warped integrand is a constant

with antithetic: linear function sufficient x with

with stratification + antithetic: piece-wise linear is sufficient x Warped integrand

summary of strategies antithetic sampling –zero variance for linear integrands (unlikely case) stratification (jittered sampling) –splits function into approximately piece-wise linear importance function –zero variance if proportional to integrand (academic case)

summary of combination Stratify Find importance function that warps into linear func. Use antithetic samples Resulting estimator: Jittered Antithetic Importance sampling (JAIS)

details (in paper) Generating correlated samples in higher dimensions Testing if correlation is positive (when variance increases)

results Low discrepancy Jittered antithetic MIS

results

comparisons using Veach’s scene antithetic jittered LH cube JA+MIS

comparison with MIS

comparison with solid angle IS

comparison without IS

limitation GI implies high dimensional domain Glossy objects create non-linearities

limitation: high-dimensional domains

conclusion Which sampling strategy is best? –Integrand? –Number of secondary samples? –Bias vs variance? Convergence of combined strategy –could be better than any of the components’ convergences Jittered Antithetic Importance sampling –Shows potential in early experiments

future work Explore correlations in high dimensional integrals Analyse combinations with QMC sampling Re-asses notion of importance, for antithetic importance sampling

acknowledgements I was funded through FI-Content, a European (EU-FI PPP) project. Herminio Nieves - HN48 Flying Car model. Blochi - Helipad Golden Hour environment map.

thank you

Theoretical results