5. Quasi-Monte Carlo Method

Slides:



Advertisements
Similar presentations
Chapter 8 Vocabulary. Section 8.1 Vocabulary Sequences An infinite sequence is a function whose domain is the set of positive integers. The function.
Advertisements

Section 9.1 – Sequences.
Memory Aid Help.  b 2 = c 2 - a 2  a 2 = c 2 - b 2  “c” must be the hypotenuse.  In a right triangle that has 30 o and 60 o angles, the longest.
ORDER STATISTICS.
Supremum and Infimum Mika Seppälä.
Lecture 3 Nonparametric density estimation and classification
Q UASIRANDOM S EQUENCES AND D ISCREPANCY SWIM Princeton 2009 Keren Gu Jenny Huang Heidi Chen.
Benjamin Doerr Max-Planck-Institut für Informatik Saarbrücken Component-by-Component Construction of Low-Discrepancy Point Sets joint work with Michael.
Math Calculus I August 9 (but first, a quick review…)
Efficient Statistical Pruning for Maximum Likelihood Decoding Radhika Gowaikar Babak Hassibi California Institute of Technology July 3, 2003.
Probabilistic Methods in Coding Theory: Asymmetric Covering Codes Joshua N. Cooper UCSD Dept. of Mathematics Robert B. Ellis Texas A&M Dept. of Mathematics.
© Love Ekenberg The Algorithm Concept, Big O Notation, and Program Verification Love Ekenberg.
Sequence A list of objects arranged in a particular order.
Theorem 1-a Let be a sequence: L L a) converges to a real number L iff every subsequence of converge to L Illustrations 0 0.
1 O. Teytaud *, S. Gelly *, S. Lallich **, E. Prudhomme ** *Equipe I&A-TAO, LRI, Université Paris-Sud, Inria, UMR-Cnrs 8623 **Equipe ERIC, Université Lyon.
Fast integration using quasi-random numbers J.Bossert, M.Feindt, U.Kerzel University of Karlsruhe ACAT 05.
Problem 1 Given a high-resolution computer image of a map of an irregularly shaped lake with several islands, determine the water surface area. Assume.
6. Markov Chain. State Space The state space is the set of values a random variable X can take. E.g.: integer 1 to 6 in a dice experiment, or the locations.
Memory Aid Help.  b 2 = c 2 - a 2  a 2 = c 2 - b 2  “c” must be the hypotenuse.  In a right triangle that has 30 o and 60 o angles, the longest.
Simulation of Random Walk How do we investigate this numerically? Choose the step length to be a=1 Use a computer to generate random numbers r i uniformly.
Chapter 3: The Fundamentals: Algorithms, the Integers, and Matrices
9.1 Sequences. A sequence is a list of numbers written in an explicit order. n th term Any real-valued function with domain a subset of the positive integers.
Lecture 2 Number Representation and accuracy
11.1 SEQUENCES Spring 2010 Math 2644 Ayona Chatterjee.
Chapter 4 Stochastic Modeling Prof. Lei He Electrical Engineering Department University of California, Los Angeles URL: eda.ee.ucla.edu
Introduction to Real Analysis Dr. Weihu Hong Clayton State University 8/21/2008.
1 ORDER STATISTICS AND LIMITING DISTRIBUTIONS. 2 ORDER STATISTICS Let X 1, X 2,…,X n be a r.s. of size n from a distribution of continuous type having.
Quasi-Monte Carlo Methods Fall 2012 By Yaohang Li, Ph.D.
Domain Theory and Multi-Variable Calculus Abbas Edalat Imperial College London Joint work with Andre Lieutier, Dirk Pattinson.
Numerical quadrature for high-dimensional integrals László Szirmay-Kalos.
CSCI 115 Chapter 1 Fundamentals. CSCI 115 §1.1 Sets and Subsets.
Taylor series are used to estimate the value of functions (at least theoretically - now days we can usually use the calculator or computer to calculate.
Computer graphics III – Low-discrepancy sequences and quasi-Monte Carlo methods Jaroslav Křivánek, MFF UK
SEQUENCES A function whose domain is the set of all integers greater than or equal to some integer n 0 is called a sequence. Usually the initial number.
Chapter 3 The Fundamentals: Algorithms, the integers, and matrices Section 3.4: The integers and division Number theory: the part of mathematics involving.
Volumes of Bitnets Carlos Rodriguez SUNY Albany.
Andrey Markov, public domain image
Discrete Mathematics Lecture 6
Problem 1: Service System Capacity
Basic simulation methodology
4. Numerical Integration
Sequences & Summations
Chapter 4a Stochastic Modeling
6. Markov Chain.
Basis and Dimension Basis Dimension Vector Spaces and Linear Systems
Introduction to Integration
Chapter 4a Stochastic Modeling
Lecture 2 – Monte Carlo method in finance
ORDER STATISTICS AND LIMITING DISTRIBUTIONS
Computing and Statistical Data Analysis Stat 3: The Monte Carlo Method
Copyright © Cengage Learning. All rights reserved.
Topic 1: Data Representation
Chapter 2.
2.III. Basis and Dimension
Field.
Copyright © Cengage Learning. All rights reserved.
Lecture 4 - Monte Carlo improvements via variance reduction techniques: antithetic sampling Antithetic variates: for any one path obtained by a gaussian.
Sequences and Summation Notation
Quantum Foundations Lecture 2
Sequences & Summations
Chapter 5 Limits and Continuity.
ORDER STATISTICS AND LIMITING DISTRIBUTIONS
Nonparametric density estimation and classification
Jaroslav Křivánek, MFF UK
Algorithms Presented By:- Mr. Anup Ashok Shinde BBA (C.A) Dept.
Linear Time Sorting.
Sequences & Summations
Errors and Error Analysis Lecture 2
Chapter 5 Integration Section R Review.
Sampling Plans.
Presentation transcript:

5. Quasi-Monte Carlo Method For a complete and mathematical introduction to quasi-Monte Carlo method, see the book by H Niederreiter, “Random Number Generation and Quasi-Monte Carlo Methods”, SIAM, (1992).

Quasi-Monte Carlo Using specially designed so-called low discrepancy sequences X0, X1, …, XN in d dimensions Fast convergence of (log N)d/N Applicable for relatively small dimension d (e.g., about 10)

Koksma-Hlawka theorem where the integral domain Id is over an unit hypercube in d dimensions, V(f) is total variation of f, D(…) is discrepancy. Lower bound D(X0, X1, …) > O( (log N)(d-1)/2).

Discrepancy D(X1,X2,…,XN) = supJ| A(J) – N V(J) | here J is a subset ∏i=1d[0,yi) of Id, A(J) is the number of point Xi belonging to J. V(J) is the volume of J. The discrepancy D(…) is the max difference between expected and exact numbers among all set J. Sup (supremum, also known as least upper bound) of a set S is the smallest y such that for every x in S, x <= y. The opposite is inf(imum).

Discrepancy, 2D example (0,1) D is the maximum difference between the number of points and their enclosing area times N in the rectangular area, for all possible shapes of rectangles starting at the lower left corner. (0,0) (1,0)

Low Discrepancy Sequence In an infinite sequence, if the first N points satisfy D(X0, X1, …., XN) ≤ Cd (log N)d for every N, then it is called a low discrepancy sequence. Cd is some constant independent of N. What is D if Xi is completely random (uniformly distributed)?

Halton Sequence n binary reverse decimal 0 00000 0.00000 0.000 0 00000 0.00000 0.000 1 00001 0.10000 0.500 2 00010 0.01000 0.250 3 00011 0.11000 0.750 4 00100 0.00100 0.125 00101 0.10100 0.625 00110 0.01100 0.375 00111 0.11100 0.875 … The Halton sequence can be constructed in any base b for b a prime number. For the n-th number, we take the base b representation of the n, n=∑rar(n)br-1, and using this sequence (in reverse order) to construction a base b decimal number, ∑r ar(n) b-r. For a d-dimensional point, we use d different bases for each of the dimensions.

Generalized Faure Sequence Write integer n =0, 1, 2, …, in its binary expansion: The jth dimension of nth number is computed from We can use general base b ≥ 2 as well.

Generator Matrices The matrices C(j) defines the sequence. The Faure sequence is defined by taking C(j) = Pj-1 where [P]kr = (k+r)!/(k! r!)