Fast integration using quasi-random numbers J.Bossert, M.Feindt, U.Kerzel University of Karlsruhe ACAT 05.

Slides:



Advertisements
Similar presentations
Lesson 10: Linear Regression and Correlation
Advertisements

Structural reliability analysis with probability- boxes Hao Zhang School of Civil Engineering, University of Sydney, NSW 2006, Australia Michael Beer Institute.
Q UASIRANDOM S EQUENCES AND D ISCREPANCY SWIM Princeton 2009 Keren Gu Jenny Huang Heidi Chen.
Simulation Where real stuff starts. ToC 1.What, transience, stationarity 2.How, discrete event, recurrence 3.Accuracy of output 4.Monte Carlo 5.Random.
Sampling Attila Gyulassy Image Synthesis. Overview Problem Statement Random Number Generators Quasi-Random Number Generation Uniform sampling of Disks,
Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.
Random-Variate Generation. Need for Random-Variates We, usually, model uncertainty and unpredictability with statistical distributions Thereby, in order.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 7-1 Chapter 7 Confidence Interval Estimation Statistics for Managers.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Basic Business Statistics 10 th Edition.
NORM BASED APPROACHES FOR AUTOMATIC TUNING OF MODEL BASED PREDICTIVE CONTROL Pastora Vega, Mario Francisco, Eladio Sanz University of Salamanca – Spain.
1 Variance Reduction via Lattice Rules By Pierre L’Ecuyer and Christiane Lemieux Presented by Yanzhi Li.
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Sampling Distributions
Generating Continuous Random Variables some. Quasi-random numbers So far, we learned about pseudo-random sequences and a common method for generating.
Bootstrapping LING 572 Fei Xia 1/31/06.
8-1 Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall Chapter 8 Confidence Interval Estimation Statistics for Managers using Microsoft.
Copyright ©2011 Pearson Education 8-1 Chapter 8 Confidence Interval Estimation Statistics for Managers using Microsoft Excel 6 th Global Edition.
A) Transformation method (for continuous distributions) U(0,1) : uniform distribution f(x) : arbitrary distribution f(x) dx = U(0,1)(u) du When inverse.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 8-1 Statistics for Managers Using Microsoft® Excel 5th Edition.
Chapter 9 Hypothesis Testing II. Chapter Outline  Introduction  Hypothesis Testing with Sample Means (Large Samples)  Hypothesis Testing with Sample.
Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 7-1 Chapter 7 Confidence Interval Estimation Statistics for Managers.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 7-1 Chapter 7 Confidence Interval Estimation Statistics for Managers.
ETM 607 – Random Number and Random Variates
1 CE 530 Molecular Simulation Lecture 7 David A. Kofke Department of Chemical Engineering SUNY Buffalo
Analysis of Monte Carlo Integration Fall 2012 By Yaohang Li, Ph.D.
1 Statistical Mechanics and Multi- Scale Simulation Methods ChBE Prof. C. Heath Turner Lecture 11 Some materials adapted from Prof. Keith E. Gubbins:
Random Number Generators CISC/QCSE 810. What is random? Flip 10 coins: how many do you expect will be heads? Measure 100 people: how are their heights.
 1  Outline  stages and topics in simulation  generation of random variates.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Basic Business Statistics 11 th Edition.
Confidence Interval Estimation
Chap 8-1 Copyright ©2013 Pearson Education, Inc. publishing as Prentice Hall Chapter 8 Confidence Interval Estimation Business Statistics: A First Course.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Confidence Interval Estimation.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Basic Business Statistics 11 th Edition.
Continuous Probability Distributions Continuous random variable –Values from interval of numbers –Absence of gaps Continuous probability distribution –Distribution.
1 Lesson 3: Choosing from distributions Theory: LLN and Central Limit Theorem Theory: LLN and Central Limit Theorem Choosing from distributions Choosing.
University of Ottawa - Bio 4118 – Applied Biostatistics © Antoine Morin and Scott Findlay 08/10/ :23 PM 1 Some basic statistical concepts, statistics.
Chem Math 252 Chapter 5 Regression. Linear & Nonlinear Regression Linear regression –Linear in the parameters –Does not have to be linear in the.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 8-1 Statistics for Managers Using Microsoft® Excel 5th Edition.
Chapter 4 Stochastic Modeling Prof. Lei He Electrical Engineering Department University of California, Los Angeles URL: eda.ee.ucla.edu
Applying Neural Networks Michael J. Watts
Monte Carlo Methods So far we have discussed Monte Carlo methods based on a uniform distribution of random numbers on the interval [0,1] p(x) = 1 0  x.
Experimental research in noise influence on estimation precision for polyharmonic model frequencies Natalia Visotska.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Quasi-Monte Carlo Methods Fall 2012 By Yaohang Li, Ph.D.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 8-1 Confidence Interval Estimation.
Monte-Carlo Simulation. Mathematical basis The discounted price is a martingale (MA4257 and MA5248).
Robust System Design Session #11 MIT Plan for the Session Quiz on Constructing Orthogonal Arrays (10 minutes) Complete some advanced topics on OAs Lecture.
Chap 8-1 Chapter 8 Confidence Interval Estimation Statistics for Managers Using Microsoft Excel 7 th Edition, Global Edition Copyright ©2014 Pearson Education.
CS348B Lecture 9Pat Hanrahan, Spring 2005 Overview Earlier lecture Statistical sampling and Monte Carlo integration Last lecture Signal processing view.
Sampling Fundamentals 2 Sampling Process Identify Target Population Select Sampling Procedure Determine Sampling Frame Determine Sample Size.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 8-1 Statistics for Managers Using Microsoft® Excel 5th Edition.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 7-1 Business Statistics: A Decision-Making Approach 6 th Edition Chapter.
Numerical quadrature for high-dimensional integrals László Szirmay-Kalos.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Business Statistics: A First Course 5 th Edition.
Computer graphics III – Low-discrepancy sequences and quasi-Monte Carlo methods Jaroslav Křivánek, MFF UK
Confidence Intervals Cont.
Introduction to Monte Carlo Method
Basic simulation methodology
Stat 31, Section 1, Last Time Sampling Distributions
NATCOR Stochastic Modelling Course Inventory Control – Part 2
Chapter 4a Stochastic Modeling
Statistical Methods For Engineers
Chapter 4a Stochastic Modeling
Lecture 2 – Monte Carlo method in finance
Confidence Interval Estimation
Mean, Median, Mode The Mean is the simple average of the data values. Most appropriate for symmetric data. The Median is the middle value. It’s best.
Sampling Distribution Models
Statistical Methods for Data Analysis Random number generators
Jaroslav Křivánek, MFF UK
Presentation transcript:

Fast integration using quasi-random numbers J.Bossert, M.Feindt, U.Kerzel University of Karlsruhe ACAT 05

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen2 Outline Numerical integration Discrepancy The Koksma-Hlawka inequality Pseudo- and quasi-random numbers Generators for quasi-random numbers Optimising the discrepancy Quasi-random numbers in n dimensions Comparison Examples

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen3 Numerical integration Integral evaluation using MC technique interprete integral as expectation value estimate by averaging over N samples: use uniformly distributed pseudo-random numbers to sample define error:

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen4 Discrepancy measure of roughness (deviation from desired flat distribution) large discrepancy small discrepancy

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen5 Discrepancy cont... in 2 dimensions: local discrepancy (number of points in J proportional to ratio of area of J to unit square) generalised to s dimensions # points in J N # points in unit square

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen6 Discrepancy cont... Discrepancy of a ensemble P with norm: *: one corner of J in (0,0) of unit square

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen7 Koksma-Hlawka inequality relates error on numerical integration with discrepancy : two handles to minimise error  : minimise variation of function variable transformation importance sampling sample with numbers with low discrepancy

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen8 Pseudo-random numbers follow deterministric pattern created by e.g. linear congruence generator statistically independent from each other simulated “real” random numbers Beware of period of generator (e.g. Ranlux: ) Discrepancy:

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen9 Lattice 1d: equidistant points have minimal discrepancy first idea: extend to s dimensions ! lattice need N=n d points (otherwise no lattice) e.g. n=4, d=2 ! N=16

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen10 Quasi-random numbers constructed to be evenly distributed not independent from each other need to know total number N from beginning good for integration, not simulation low discrepancy series: faster convergence, smaller error

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen11 Quasi-random series van der Corput series: other series: Halton: extending Corput series to several dimensions Hammersly: replace 1 st dim. of Halton series by lattice ) lower discrepancy radically inverse function:

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen12 (T,M,S) nets and (T,S) series (t,s) series: class of quasi-random numbers using radically inverse functions with low discrepancy (t,m,s) net: each elementary interval E (Vol(E) = b t-m ) contains b t points of series with b m total points elementary interval E (2,6,2) net: 2 6 = 64 total points 2 2 = 4 points in E basis

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen13 Pseudo- vs. Quasi-random generate 2048 numbers pseudo random quasi random

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen14 Comparison lattice pseudo- random quasi- random

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen15 Generator examples Sobol Faure Niederreiter empty structure appears

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen16 regions with much lower discrepancy Optimising discrepancy Minima for N = 2 k “tune” discrepancy by carefully choosing needed N

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen17 several dimensions compare discrepancy in several dimensions ! quasi-random numbers good in few dimensions: Niederreiter s=2 s=10 3 orders of manitude

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen18 Example: Breit-Wigner numerical integration of multi-dim. BW e.g. 2 dimensions: deviation from real integral value: ( ¢ ) ¢ ¢ ¢ ¢ ¢ ¢ · · · · · · · · · · · · · · latticeHammerslyNiederreiterSobolFaureHaltonPseudoN

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen19 Optimising numerical integration Example: convolution of BW with resolution per event (B 0 mixing analysis) use quasi-random numbers ) fewer numbers N needed for evaluation transform for optimal function sampling ) importance-sampling

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen20 Q-VEGAS VEGAS: package for numerical integration in several dimensions: start with uniform intervals evaluate function values in these intervals iteratively adopt interval structure to shape of function Q-VEGAS: use quasi-random numbers instead of pseudo-random numbers: faster and more accurate evaluation

xx May 2005Ulrich Kerzel, University of Karlsruhe, ACAT 05 - Zeuthen21 Summary Low discrepancy (=evenly distributed) numbers important in numerical integration. Quasi-random numbers superior in few dimensions: faster convergence higher accuracy Wide range of applications, e.g. Q-Vegas instead of