Computer graphics III – Low-discrepancy sequences and quasi-Monte Carlo methods Jaroslav Křivánek, MFF UK

Slides:



Advertisements
Similar presentations
Structural reliability analysis with probability- boxes Hao Zhang School of Civil Engineering, University of Sydney, NSW 2006, Australia Michael Beer Institute.
Advertisements

Kartic Subr, Derek Nowrouzezahrai, Wojciech Jarosz, Jan Kautz and Kenny Mitchell Disney Research, University of Montreal, University College London.
Q UASIRANDOM S EQUENCES AND D ISCREPANCY SWIM Princeton 2009 Keren Gu Jenny Huang Heidi Chen.
Monte-Carlo Techniques Roger Crawfis. June 9, 2015OSU/CIS 5412 Monte-Carlo Integration Overview 1.Generating Psuedo-Random Numbers 2.Multidimensional.
Sampling Attila Gyulassy Image Synthesis. Overview Problem Statement Random Number Generators Quasi-Random Number Generation Uniform sampling of Disks,
Monte Carlo Integration Robert Lin April 20, 2004.
Advanced Computer Graphics (Spring 2005) COMS 4162, Lectures 18, 19: Monte Carlo Integration Ravi Ramamoorthi Acknowledgements.
CF-3 Bank Hapoalim Jun-2001 Zvi Wiener Computational Finance.
1 Variance Reduction via Lattice Rules By Pierre L’Ecuyer and Christiane Lemieux Presented by Yanzhi Li.
Generating Continuous Random Variables some. Quasi-random numbers So far, we learned about pseudo-random sequences and a common method for generating.
Quasi-Monte Carlo Methods for Option Pricing
1 Monte Carlo Global Illumination Brandon Lloyd COMP 238 December 16, 2002.
Fast integration using quasi-random numbers J.Bossert, M.Feindt, U.Kerzel University of Karlsruhe ACAT 05.
Monte Carlo Integration Digital Image Synthesis Yung-Yu Chuang with slides by Pat Hanrahan and Torsten Moller.
Sampling and Reconstruction Digital Image Synthesis Yung-Yu Chuang 10/25/2005 with slides by Pat Hanrahan, Torsten Moller and Brian Curless.
1 CE 530 Molecular Simulation Lecture 7 David A. Kofke Department of Chemical Engineering SUNY Buffalo
Analysis of Monte Carlo Integration Fall 2012 By Yaohang Li, Ph.D.
1 Statistical Mechanics and Multi- Scale Simulation Methods ChBE Prof. C. Heath Turner Lecture 11 Some materials adapted from Prof. Keith E. Gubbins:
Random Number Generators CISC/QCSE 810. What is random? Flip 10 coins: how many do you expect will be heads? Measure 100 people: how are their heights.
PATTERN RECOGNITION AND MACHINE LEARNING
01/24/05© 2005 University of Wisconsin Last Time Raytracing and PBRT Structure Radiometric quantities.
University of Texas at Austin CS384G - Computer Graphics Fall 2008 Don Fussell Distribution Ray Tracing.
1 Lesson 2: RNGs and Choosing from distributions Random number generators (RNG) Random number generators (RNG) General need for random numbers General.
Monte Carlo I Previous lecture Analytical illumination formula This lecture Numerical evaluation of illumination Review random variables and probability.
Module 1: Statistical Issues in Micro simulation Paul Sousa.
02/10/03© 2003 University of Wisconsin Last Time Participating Media Assignment 2 –A solution program now exists, so you can preview what your solution.
Chapter 4 Stochastic Modeling Prof. Lei He Electrical Engineering Department University of California, Los Angeles URL: eda.ee.ucla.edu
GPU-based Image Processing Methods in Higher Dimensions and their Application to Tomography Reconstruction Szirmay-Kalos, László Budapest Uni of Tech Sapporo,
4. Numerical Integration. Standard Quadrature We can find numerical value of a definite integral by the definition: where points x i are uniformly spaced.
Quasi-Monte Carlo Methods Fall 2012 By Yaohang Li, Ph.D.
Monté Carlo Simulation  Understand the concept of Monté Carlo Simulation  Learn how to use Monté Carlo Simulation to make good decisions  Learn how.
Duy & Piotr. How to reconstruct a high quality image with the least amount of samples per pixel the least amount of resources And preserving the image.
Instant Radiosity Alexander Keller University Kaiserslautern Present by Li-Fong Lin.
CS348B Lecture 9Pat Hanrahan, Spring 2005 Overview Earlier lecture Statistical sampling and Monte Carlo integration Last lecture Signal processing view.
Chapter 19 Monte Carlo Valuation. Copyright © 2006 Pearson Addison-Wesley. All rights reserved Monte Carlo Valuation Simulation of future stock.
02/12/03© 2003 University of Wisconsin Last Time Intro to Monte-Carlo methods Probability.
Quasi-Random Techniques Don P. Mitchell. MC Integration for Rendering Ray tracing yields point samples f(x i ) Discontinuous f thwarts efficient methods.
Computer Graphics III – Monte Carlo integration Direct illumination
Numerical quadrature for high-dimensional integrals László Szirmay-Kalos.
Computer Graphics III Winter Term 2015 Organization Jaroslav Křivánek, MFF UK
CS774. Markov Random Field : Theory and Application Lecture 15 Kyomin Jung KAIST Oct
MAT 4830 Mathematical Modeling 04 Monte Carlo Integrations
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
01/26/05© 2005 University of Wisconsin Last Time Raytracing and PBRT Structure Radiometric quantities.
Global Illumination (3) Path Tracing. Overview Light Transport Notation Path Tracing Photon Mapping.
Computer graphics III – Multiple Importance Sampling Jaroslav Křivánek, MFF UK
Introduction to Computer Simulation of Physical Systems (Lecture 10) Numerical and Monte Carlo Methods (CONTINUED) PHYS 3061.
Computer graphics III – Monte Carlo integration II Jaroslav Křivánek, MFF UK
Monte Carlo Integration Digital Image Synthesis Yung-Yu Chuang 12/3/2008 with slides by Pat Hanrahan and Torsten Moller.
Computer graphics III – Rendering equation and its solution
Computer graphics III – Path tracing Jaroslav Křivánek, MFF UK
Generalization Performance of Exchange Monte Carlo Method for Normal Mixture Models Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology.
Monte Carlo methods to price compound options
Introduction to Monte Carlo Method
Computer Graphics III Winter Term 2017 Organization
Basic simulation methodology
4. Numerical Integration
Ray Tracing via Markov Chain Monte-Carlo Method
Chapter 4a Stochastic Modeling
5. Quasi-Monte Carlo Method
Chapter 4a Stochastic Modeling
Lecture 2 – Monte Carlo method in finance
Computer Graphics III Monte Carlo estimators – Exercises
Lecture 4 - Monte Carlo improvements via variance reduction techniques: antithetic sampling Antithetic variates: for any one path obtained by a gaussian.
Statistical Methods for Data Analysis Random number generators
Computer graphics III – Path tracing
Jaroslav Křivánek, MFF UK
Computer Graphics III Winter Term 2016 Organization
Monte Carlo Integration
Sampling Plans.
Presentation transcript:

Computer graphics III – Low-discrepancy sequences and quasi-Monte Carlo methods Jaroslav Křivánek, MFF UK

Quasi-Monte Carlo Goal: Use point sequences that cover the integration domain as uniformly as possible, while keeping a ‘randomized’ look of the point set Low Discrepancy (more uniform) High Discrepancy (clusters of points) CG III (NPGR010) - J. Křivánek 2015

Transformation of point sets Image credit: Alexander Keller CG III (NPGR010) - J. Křivánek 2015

MC vs. QMC Image credit: Alexander Keller CG III (NPGR010) - J. Křivánek 2015

Quasi Monte Carlo (QMC) methods Use of strictly deterministic sequences instead of random numbers All formulas as in MC, just the underlying proofs cannot reply on the probability theory (nothing is random) Based on sequences low-discrepancy sequences CG III (NPGR010) - J. Křivánek 2015

Defining discrepancy s-dimensional “brick” function: True volume of the “brick” function: MC estimate of the volume of the “brick”: total number of sample points number of sample points that actually fell inside the “brick” CG III (NPGR010) - J. Křivánek 2015

Discrepancy Discrepancy (of a point sequence) is the maximum possible error of the MC quadrature of the “brick” function over all possible brick shapes:  serves as a measure of the uniformity of a point set  must converge to zero as N -> infty  the lower the better (cf. Koksma-Hlawka Inequality) CG III (NPGR010) - J. Křivánek 2015

Koksma-Hlawka inequality  the KH inequality only applies to f with finite variation  QMC can still be applied even if the variation of f is infinite „variation“ of f CG III (NPGR010) - J. Křivánek 2015

Van der Corput Sequence (base 2) point placed in the middle of the interval then the interval is divided in half has low-discrepancy Table credit: Laszlo Szirmay-Kalos CG III (NPGR010) - J. Křivánek 2015

Van der Corput Sequence b... Base radical inverse CG III (NPGR010) - J. Křivánek 2015

Van der Corput Sequence (base b) double RadicalInverse(const int Base, int i) { double Digit, Radical, Inverse; Digit = Radical = 1.0 / (double) Base; Inverse = 0.0; while(i) { Inverse += Digit * (double) (i % Base); Digit *= Radical; i /= Base; } return Inverse; } CG III (NPGR010) - J. Křivánek 2015

Radical inversion based points in higher dimension Image credit: Alexander Keller CG III (NPGR010) - J. Křivánek 2015

Use in path tracing Objective: Generated paths should cover the entire high-dimensional path space uniformly Approach:  Paths are interpreted as “points” in a high-dimensional path space  Each path is defined by a long vector of “random numbers” Subsequent random events along a single path use subsequent components of the same vector  Only when tracing the next path, we switch to a brand new “random vector” (e.g. next vector from a Halton sequence) CG III (NPGR010) - J. Křivánek 2015

Quasi-Monte Carlo (QMC) Methods Disadvantages of QMC:  Regular patterns can appear in the images (instead of the more acceptable noise in purely random MC) CG III (NPGR010) - J. Křivánek 2015

Stratified sampling Henrik Wann Jensen 10 paths per pixel CG III (NPGR010) - J. Křivánek 2015

Quasi-Monte Carlo Henrik Wann Jensen 10 paths per pixel CG III (NPGR010) - J. Křivánek 2015

Fixní náhodná sekvence Henrik Wann Jensen 10 paths per pixel CG III (NPGR010) - J. Křivánek 2015