The Monte Carlo Method: an Introduction Detlev Reiter Research Centre Jülich (FZJ) D -52425 Jülich

Slides:



Advertisements
Similar presentations
RSLAB-NTU Lab for Remote Sensing Hydrology and Spatial Modeling 1 An Introduction to R Pseudo Random Number Generation (PRNG) Prof. Ke-Sheng Cheng Dept.
Advertisements

Slides prepared by Timothy I. Matis for SpringSim’06, April 4, 2006 Estimating Rare Event Probabilities Using Truncated Saddlepoint Approximations Timothy.
Monte Carlo Methods and Statistical Physics
CDA6530: Performance Models of Computers and Networks Chapter 5: Generating Random Number and Random Variables TexPoint fonts used in EMF. Read the TexPoint.
Probability Theory STAT 312 STAT 312 Dr. Zakeia AlSaiary.
Introduction to Sampling based inference and MCMC Ata Kaban School of Computer Science The University of Birmingham.
BAYESIAN INFERENCE Sampling techniques
Simulation Where real stuff starts. ToC 1.What, transience, stationarity 2.How, discrete event, recurrence 3.Accuracy of output 4.Monte Carlo 5.Random.
Computational statistics 2009 Random walk. Computational statistics 2009 Random walk with absorbing barrier.
Simulation Modeling and Analysis
Machine Learning CUNY Graduate Center Lecture 7b: Sampling.
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Generating Continuous Random Variables some. Quasi-random numbers So far, we learned about pseudo-random sequences and a common method for generating.
#10 MONTE CARLO SIMULATION Systems Fall 2000 Instructor: Peter M. Hahn
K. Desch – Statistical methods of data analysis SS10
A) Transformation method (for continuous distributions) U(0,1) : uniform distribution f(x) : arbitrary distribution f(x) dx = U(0,1)(u) du When inverse.
Monte Carlo Methods in Partial Differential Equations.
Lecture II-2: Probability Review
Hedge with an Edge An Introduction to the Mathematics of Finance Riaz Ahmed & Adnan Khan Lahore Uviersity of Management Sciences Monte Carlo Methods.
Computer Simulation A Laboratory to Evaluate “What-if” Questions.
Lecture 12 Monte Carlo Simulations Useful web sites:
Problem 1 Given a high-resolution computer image of a map of an irregularly shaped lake with several islands, determine the water surface area. Assume.
Introduction to Monte Carlo Methods D.J.C. Mackay.
1 CE 530 Molecular Simulation Lecture 7 David A. Kofke Department of Chemical Engineering SUNY Buffalo
Buffon’s Needle Todd Savage. Buffon's needle problem asks to find the probability that a needle of length ‘l’ will land on a line, given a floor with.
Simulation of Random Walk How do we investigate this numerically? Choose the step length to be a=1 Use a computer to generate random numbers r i uniformly.
1 Statistical Mechanics and Multi- Scale Simulation Methods ChBE Prof. C. Heath Turner Lecture 11 Some materials adapted from Prof. Keith E. Gubbins:
01/24/05© 2005 University of Wisconsin Last Time Raytracing and PBRT Structure Radiometric quantities.
Particle Filtering in Network Tomography
1 Sampling and Sampling Distributions Dr. Jerrell T. Stracener, SAE Fellow Leadership in Engineering EMIS 7370/5370 STAT 5340 : PROBABILITY AND STATISTICS.
Short Resume of Statistical Terms Fall 2013 By Yaohang Li, Ph.D.
Modeling and Simulation CS 313
Introduction to Monte Carlo Simulation. What is a Monte Carlo simulation? In a Monte Carlo simulation we attempt to follow the `time dependence’ of a.
Monte Carlo Simulation and Personal Finance Jacob Foley.
General Principle of Monte Carlo Fall 2013 By Yaohang Li, Ph.D.
Chapter 14 Monte Carlo Simulation Introduction Find several parameters Parameter follow the specific probability distribution Generate parameter.
Machine Learning Lecture 23: Statistical Estimation with Sampling Iain Murray’s MLSS lecture on videolectures.net:
Monte Carlo I Previous lecture Analytical illumination formula This lecture Numerical evaluation of illumination Review random variables and probability.
Basic Monte Carlo (chapter 3) Algorithm Detailed Balance Other points.
Module 1: Statistical Issues in Micro simulation Paul Sousa.
Random Numbers and Simulation  Generating truly random numbers is not possible Programs have been developed to generate pseudo-random numbers Programs.
1 Lesson 8: Basic Monte Carlo integration We begin the 2 nd phase of our course: Study of general mathematics of MC We begin the 2 nd phase of our course:
P T A typical experiment in a real (not virtual) space 1.Some material is put in a container at fixed T & P. 2.The material is in a thermal fluctuation,
Monte Carlo Methods.
02/10/03© 2003 University of Wisconsin Last Time Participating Media Assignment 2 –A solution program now exists, so you can preview what your solution.
Monte Carlo Methods1 T Special Course In Information Science II Tomas Ukkonen
Monte Carlo Methods So far we have discussed Monte Carlo methods based on a uniform distribution of random numbers on the interval [0,1] p(x) = 1 0  x.
Monté Carlo Simulation  Understand the concept of Monté Carlo Simulation  Learn how to use Monté Carlo Simulation to make good decisions  Learn how.
Lecture 11 Pairs and Vector of Random Variables Last Time Pairs of R.Vs. Marginal PMF (Cont.) Joint PDF Marginal PDF Functions of Two R.Vs Expected Values.
Improved Cross Entropy Method For Estimation Presented by: Alex & Yanna.
Lecture 2 Molecular dynamics simulates a system by numerically following the path of all particles in phase space as a function of time the time T must.
Molecular Modelling - Lecture 2 Techniques for Conformational Sampling Uses CHARMM force field Written in C++
Expectation. Let X denote a discrete random variable with probability function p(x) (probability density function f(x) if X is continuous) then the expected.
The generalization of Bayes for continuous densities is that we have some density f(y|  ) where y and  are vectors of data and parameters with  being.
Introduction to Sampling Methods Qi Zhao Oct.27,2004.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Lecture 3 Types of Probability Distributions Dr Peter Wheale.
Gil McVean, Department of Statistics Thursday February 12 th 2009 Monte Carlo simulation.
Kevin Stevenson AST 4762/5765. What is MCMC?  Random sampling algorithm  Estimates model parameters and their uncertainty  Only samples regions of.
Introduction to Computer Simulation of Physical Systems (Lecture 10) Numerical and Monte Carlo Methods (CONTINUED) PHYS 3061.
Computational Physics (Lecture 11) PHY4061. Variation quantum Monte Carlo the approximate solution of the Hamiltonian Time Independent many-body Schrodinger’s.
Problem 1: Service System Capacity CustomersServed Customers Queue Server Problem: Can a server taking an average of x time units meet the demand? Solution.
Lesson 8: Basic Monte Carlo integration
Random Numbers and Simulation
Review of Probability Theory
Basic simulation methodology
Intro to Sampling Methods
Lecture 2 – Monte Carlo method in finance
Statistical Methods for Data Analysis Random number generators
More Monte Carlo Methods
Presentation transcript:

The Monte Carlo Method: an Introduction Detlev Reiter Research Centre Jülich (FZJ) D Jülich Tel.: / Vorlesung HHU Düsseldorf, WS 07/08 March 2008

There are two dominant methods of simulation for complex many particle systems 1)Molecular Dynamics Solve the classical equations of motion from mechanics. Particles interact via a given interaction potential. Deterministic behaviour (within numerical precision). Find temporal evolution. 2) Monte Carlo Simulation Find mean values (expectation values) of some system components. Random behaviour from given probability distribution laws. The Monte Carlo technique is a very far spread technique, because it is not limited to systems of particles.

This lecture Brief introduction: simulation What is the Monte Carlo Method Random number generation Integration by Monte Carlo Tomorrow: one (of many) particular application: particle transport by Monte Carlo

4 ASDEX-UPDRADE (IPP Garching)

Monte Carlo particle trajectories, ions and neutral particles

Basic principle of the Monte Carlo method The task: calculate (estimate) a number I (one number only. Not an entire functional dependence). Historic example: A dull way to calculate  –Numerically: look for an appropriate convergent series and evaluate this approximately –by Monte Carlo: look for a stochastic model (i.e.: (  p, X ): probability space with random variable X ) Example: throw a needle an a sheet with equidistant parallel stripes. Distance between stripes: D, length of needle: L, L<D.

The needle experiment of Comte de Buffon, 1733 (french biologist, ) What is the probability p, that a needle (length L), which randomly falls on a sheet, crosses one of the lines (distance D)? First application of Monte Carlo Method (N trials, n „hits“)

Y t =1, if crossing, Y t =0 else, then

Today: Using a computer to generate random events: We need to be able to generate random numbers X with any given probability function f(x), or a given cumulative distribution F(x). 1)Uniformly distributed random numbers 2)General random numbers: can be obtained from a sequence of independent uniform random numbers

ab f(x) 1/(b-a) Random number generation

We will see next: Any continuous distribution can be generated from uniform random numbers on [0,1] Any discrete distribution can be generated from uniform random numbers on [0,1] Hence: Any given distribution can be generated from uniform random numbers on [0,1]

Strategy: try to transform F to another distribution, such that inverse of new F is explicitly known.

Example: Normal (Gaussian) distribution Cumulative distr. functionInverse cumul. distr. fct. best format of storing distributions for Monte Carlo applications: „Inverse cumulative distribution function F -1 (x)“, x uniform [0,1]

Exercise (and most important example:) Generate random numbers from a Gaussian. Let X, Y two independent Gaussian random numbers. Transform to polar coordiantes (Jacobian!) R, Φ Sample Φ (trivial, it is uniform on 2π) Apply inversion method for R Transform sampled Φ, R back to X, Y. This is a pair of Gaussians. (Box-Muller Method)

Exponential distribution by „inversion“ (see tomorrow ) Note: Z and 1-Z have same distrib.

Cauchy: e.g.: natural Line broadening

( stepwise constant, with steps at points T)

X y=f(x) sample x from f(x) f(x): distribution density enclosing rectangle z, uniform y uniform Reject z Accept z, take x=z Rejection

NEXT: Any Monte Carlo estimate can be regarded as a mean value, i.e. an integral (or sum) over a given probability distribution, ususally in a high dimensional space (e.g. of random walks….) Generic Monte Carlo: Integration Hence: How does Monte Carlo integration work?

X f(x) I = ∫ f(x) dx I: unknown area known area x 1, uniform x 2 uniform miss hit Hit or Miss

Suggestion: try again with previous example from dull and crude Monte Carlo

Outlook: next lecture (tomorrow)

END