GENERATING NON-UNIFORM RANDOM DEVIATES

Slides:



Advertisements
Similar presentations
Central Limit Theorem. So far, we have been working on discrete and continuous random variables. But most of the time, we deal with ONE random variable.
Advertisements

CPSC 531:Random-Variate Generation
Chapter 8 Random-Variate Generation
Use of moment generating functions. Definition Let X denote a random variable with probability density function f(x) if continuous (probability mass function.
Review of Basic Probability and Statistics
Random-Variate Generation. Need for Random-Variates We, usually, model uncertainty and unpredictability with statistical distributions Thereby, in order.
Simulation Modeling and Analysis
Today Today: Chapter 5 Reading: –Chapter 5 (not 5.12) –Suggested problems: 5.1, 5.2, 5.3, 5.15, 5.25, 5.33, 5.38, 5.47, 5.53, 5.62.
Time Series Basics Fin250f: Lecture 3.1 Fall 2005 Reading: Taylor, chapter
A gentle introduction to Gaussian distribution. Review Random variable Coin flip experiment X = 0X = 1 X: Random variable.
Standard Normal Distribution
The moment generating function of random variable X is given by Moment generating function.
TOPIC 5 Normal Distributions.
1 Random Variables and Probability Distributions: Discrete versus Continuous For this portion of the session, the learning objective is:  Learn that the.
Properties of Random Numbers
Approximations to Probability Distributions: Limit Theorems.
Continuous Probability Distribution  A continuous random variables (RV) has infinitely many possible outcomes  Probability is conveyed for a range of.
Functions of Random Variables. Methods for determining the distribution of functions of Random Variables 1.Distribution function method 2.Moment generating.
0 Simulation Modeling and Analysis: Input Analysis K. Salah 8 Generating Random Variates Ref: Law & Kelton, Chapter 8.
Commonly Used Distributions Andy Wang CIS Computer Systems Performance Analysis.
Moment Generating Functions
K. Shum Lecture 16 Description of random variables: pdf, cdf. Expectation. Variance.
Continuous Distributions The Uniform distribution from a to b.
LECTURE 25 SIMULATION AND MODELING Md. Tanvir Al Amin, Lecturer, Dept. of CSE, BUET CSE 411.
Convergence in Distribution
Copyright © 2010 Pearson Addison-Wesley. All rights reserved. Chapter 6 Some Continuous Probability Distributions.
Discrete distribution word problems –Probabilities: specific values, >, =, … –Means, variances Computing normal probabilities and “inverse” values: –Pr(X
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
MATH 4030 – 4B CONTINUOUS RANDOM VARIABLES Density Function PDF and CDF Mean and Variance Uniform Distribution Normal Distribution.
ETM 607 – Random-Variate Generation
7 sum of RVs. 7-1: variance of Z Find the variance of Z = X+Y by using Var(X), Var(Y), and Cov(X,Y)
Using the Tables for the standard normal distribution.
Week 121 Law of Large Numbers Toss a coin n times. Suppose X i ’s are Bernoulli random variables with p = ½ and E(X i ) = ½. The proportion of heads is.
1 Sampling distributions The probability distribution of a statistic is called a sampling distribution. : the sampling distribution of the mean.
Chapter 31Introduction to Statistical Quality Control, 7th Edition by Douglas C. Montgomery. Copyright (c) 2012 John Wiley & Sons, Inc.
Central Limit Theorem Let X 1, X 2, …, X n be n independent, identically distributed random variables with mean  and standard deviation . For large n:
Chapter 6 Large Random Samples Weiqi Luo ( 骆伟祺 ) School of Data & Computer Science Sun Yat-Sen University :
Ver Chapter 5 Continuous Random Variables 1 Probability/Ch5.
Generating Random Variates
R. Kass/W04 P416 Lec 3 1 Lecture 3 The Gaussian Probability Distribution Function Plot of Gaussian pdf x p(x)p(x) Introduction l The Gaussian probability.
Sampling and Sampling Distributions
Random number generation
EMIS 7300 SYSTEMS ANALYSIS METHODS FALL 2005
Random Variable 2013.
ASV Chapters 1 - Sample Spaces and Probabilities
Functions and Transformations of Random Variables
Chapter 4 Continuous Random Variables and Probability Distributions
Chapter 5 Joint Probability Distributions and Random Samples
The Gaussian Probability Distribution Function
Random Variates 2 M. Overstreet Spring 2005
The distribution function F(x)
Chapter 7: Sampling Distributions
Moment Generating Functions
Sampling Distribution of the Sample Mean
ASV Chapters 1 - Sample Spaces and Probabilities
Random-Variate Generation
Probability Review for Financial Engineers
Using the Tables for the standard normal distribution
Example Suppose X ~ Uniform(2, 4). Let . Find .
Lecture Slides Elementary Statistics Twelfth Edition
POPULATION (of “units”)
Chapter 8 Random-Variate Generation
GENERATING NON-UNIFORM RANDOM DEVIATES
Continuous distributions
Functions of Random variables
ASV Chapters 1 - Sample Spaces and Probabilities
Chapter 3 : Random Variables
Random Variate Generation
Continuous Distributions
Generating Random Variates
Presentation transcript:

GENERATING NON-UNIFORM RANDOM DEVIATES 12/9/2018 VMASC MSIM 710/810

BASICS (as evolved) Generate one or more independent U[0, 1] Create deviate using these as input Use few Uniforms Be Fast Be Simple Be EXACT (we’ll relax this later) 12/9/2018 VMASC MSIM 710/810

INVERSE TRANSFORM METHOD Generate U~U[0, 1] Find x such that F(x) = U, return x Recall F(x) = P[X <= x] Since F is a monotonically increasing function in x, we can reliably use F-1 F-1(U) = x 12/9/2018 VMASC MSIM 710/810

INVERSE TRANSFORM METHOD PROOF! 12/9/2018 VMASC MSIM 710/810

PROOF BY PICTURE 12/9/2018 VMASC MSIM 710/810

EXAMPLE Weibull (a = 1.5, b = 6) example 12/9/2018 VMASC MSIM 710/810

WEIBULL 12/9/2018 VMASC MSIM 710/810

WEIBULL Trickeration: 1-U and U are identically distributed 12/9/2018 VMASC MSIM 710/810

DISCRETE DISTRIBUTIONS P[X=xi]=pi 12/9/2018 VMASC MSIM 710/810

NORMALS F, the CDF of the Normal Distribution, cannot be written down in closed form What to Do? exploit the Central Limit Theorem use conditional probability for a new method 12/9/2018 VMASC MSIM 710/810

EXPLOITING THE CLT Result: sum of n i.i.d. random variables (m, s2)  N(nm, ns2) Method (Composite) Generate U1, U2, ..., U30 ~U[0, 1] SUM ~ N(30 * ½, 30 * 1/6) (SUM – 15)/sqrt(5) ~ N(0, 1) CLT approximation is more exact with data having symetric distributions “30” comes from very old folklore (Galton) 12/9/2018 VMASC MSIM 710/810

ACCEPTANCE-REJECTION METHOD To generate variate X from inaccessible CDF FX... Generate x uniformly in the Range of X Generate U~U[0, max(f(x))] if U <= fX(x), return x otherwise, try again 12/9/2018 VMASC MSIM 710/810

Proof: Consider this slice 12/9/2018 VMASC MSIM 710/810

EXACT COMPOSITION METHODS n Summed exponentials make a Gamma(n, l) Two summed Uniforms make a Triangular Summed Bernouli’s make a Binomial See ... Handy T&R Facts.pdf 12/9/2018 VMASC MSIM 710/810