Chapter 4 Particular Methods for Non- Uniform Random Variables.

Slides:



Advertisements
Similar presentations
Special random variables Chapter 5 Some discrete or continuous probability distributions.
Advertisements

Chapter 3 Some Special Distributions Math 6203 Fall 2009 Instructor: Ayona Chatterjee.
Exponential Distribution. = mean interval between consequent events = rate = mean number of counts in the unit interval > 0 X = distance between events.
Chapter 8 Random-Variate Generation
Chapter 8 Random-Variate Generation Banks, Carson, Nelson & Nicol Discrete-Event System Simulation.
Random number generation Algorithms and Transforms to Univariate Distributions.
5.1 Sampling Distributions for Counts and Proportions.
Engineering Probability and Statistics - SE-205 -Chap 4 By S. O. Duffuaa.
Random-Variate Generation. Need for Random-Variates We, usually, model uncertainty and unpredictability with statistical distributions Thereby, in order.
Simulation Modeling and Analysis
Section 5.7 Suppose X 1, X 2, …, X n is a random sample from a Bernoulli distribution with success probability p. Then Y = X 1 + X 2 + … + X n has a distribution.
Random Number Generation
Random-Variate Generation. 2 Purpose & Overview Develop understanding of generating samples from a specified distribution as input to a simulation model.
Chapter 7: Variation in repeated samples – Sampling distributions
A random variable that has the following pmf is said to be a binomial random variable with parameters n, p The Binomial random variable.
511 Friday Feb Math/Stat 511 R. Sharpley Lecture #15: Computer Simulations of Probabilistic Models.
Continuous Random Variables and Probability Distributions
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 4 Continuous Random Variables and Probability Distributions.
Properties of Random Numbers
1 Sampling Distribution Theory ch6. 2  Two independent R.V.s have the joint p.m.f. = the product of individual p.m.f.s.  Ex6.1-1: X1is the number of.
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
Continuous Probability Distribution  A continuous random variables (RV) has infinitely many possible outcomes  Probability is conveyed for a range of.
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
Random-Number Generation. 2 Properties of Random Numbers Random Number, R i, must be independently drawn from a uniform distribution with pdf: Two important.
ETM 607 – Random Number and Random Variates
The paired sample experiment The paired t test. Frequently one is interested in comparing the effects of two treatments (drugs, etc…) on a response variable.
Random variables Petter Mostad Repetition Sample space, set theory, events, probability Conditional probability, Bayes theorem, independence,
HAWKES LEARNING SYSTEMS math courseware specialists Copyright © 2010 by Hawkes Learning Systems/Quant Systems, Inc. All rights reserved. Chapter 8 Continuous.
0 Simulation Modeling and Analysis: Input Analysis K. Salah 8 Generating Random Variates Ref: Law & Kelton, Chapter 8.
Chapter 5 Statistical Models in Simulation
Continuous Probability Distributions  Continuous Random Variable  A random variable whose space (set of possible values) is an entire interval of numbers.
Moment Generating Functions
Chapter 8 The Binomial and Geometric Distributions YMS 8.1
1. Normal Approximation 1. 2 Suppose we perform a sequence of n binomial trials with probability of success p and probability of failure q = 1 - p and.
Modular 11 Ch 7.1 to 7.2 Part I. Ch 7.1 Uniform and Normal Distribution Recall: Discrete random variable probability distribution For a continued random.
Generalized Linear Models All the regression models treated so far have common structure. This structure can be split up into two parts: The random part:
Chapter 10 – Sampling Distributions Math 22 Introductory Statistics.
Discrete Probability Distributions. Random Variable Random variable is a variable whose value is subject to variations due to chance. A random variable.
AP Statistics Chapter 8 Notes. The Binomial Setting If you roll a die 20 times, how many times will you roll a 4? Will you always roll a 4 that many times?
1 Two Functions of Two Random Variables In the spirit of the previous lecture, let us look at an immediate generalization: Suppose X and Y are two random.
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
Stats Probability Theory Summary. The sample Space, S The sample space, S, for a random phenomena is the set of all possible outcomes.
B AD 6243: Applied Univariate Statistics Data Distributions and Sampling Professor Laku Chidambaram Price College of Business University of Oklahoma.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
Expectation. Let X denote a discrete random variable with probability function p(x) (probability density function f(x) if X is continuous) then the expected.
Starting point for generating other distributions.
Random Variable The outcome of an experiment need not be a number, for example, the outcome when a coin is tossed can be 'heads' or 'tails'. However, we.
Chapter 8 Random-Variate Generation Banks, Carson, Nelson & Nicol Discrete-Event System Simulation.
Sampling and estimation Petter Mostad
1 Probability and Statistical Inference (9th Edition) Chapter 5 (Part 2/2) Distributions of Functions of Random Variables November 25, 2015.
Continuous Random Variables and Probability Distributions
Chapter 5 Sampling Distributions. Introduction Distribution of a Sample Statistic: The probability distribution of a sample statistic obtained from a.
Continuous Random Variables Lecture 26 Section Mon, Mar 5, 2007.
Chapter 31Introduction to Statistical Quality Control, 7th Edition by Douglas C. Montgomery. Copyright (c) 2012 John Wiley & Sons, Inc.
Chapter 6 Large Random Samples Weiqi Luo ( 骆伟祺 ) School of Data & Computer Science Sun Yat-Sen University :
Gil McVean, Department of Statistics Thursday February 12 th 2009 Monte Carlo simulation.
Chapter 5 Special Distributions Weiqi Luo ( 骆伟祺 ) School of Data & Computer Science Sun Yat-Sen University :
Chapter 3 Generating Uniform Random Variables. In any kind of simulation, we need data, or we have to produce them. Especially in Monte Marco simulation.
Chapter 3 Generating Uniform Random Variables. In any kind of simulation, we need data, or we have to produce them. Especially in Monte Marco simulation.
1. 2 At the end of the lesson, students will be able to (c)Understand the Binomial distribution B(n,p) (d) find the mean and variance of Binomial distribution.
1 Opinionated in Statistics by Bill Press Lessons #15.5 Poisson Processes and Order Statistics Professor William H. Press, Department of Computer Science,
Statistics -Continuous probability distribution 2013/11/18.
Chapter 3 Generating Uniform Random Variables. In any kind of simulation, we need data, or we have to produce them. Especially in Monte Marco simulation.
Sampling and Sampling Distributions
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
Other confidence intervals
Chapter 8 Random-Variate Generation
Chapter 3 : Random Variables
Presentation transcript:

Chapter 4 Particular Methods for Non- Uniform Random Variables

Here we want to use some trnasformation in order to convert uniform random variables into other distribution. By using control limit theorem, we can convert the uniform distribution to normal distribution. If we simulate n independent U(0,1) random numbers, then

Then as the distribution of N tends to be a normal distribution. If, N has a triangular distribution. If, N has a nice bell-shaped distribution. With n=12, since and Then is approximately normal random variable with A BASIC program is given in Fig.4.1 which is very simple.

The Box-Muller Method: If and are two independent, Then in 1958 (Box abd Muller) showed that are two independent random variable (exactly).

If we have two, with and define point (, ) in Cartesian plane (coordinate), then in the polar coordinate we have: are two independent variables with having distribution and with exponential distribution of mean 2. Then to simulate we need take and to simulate we take. So, from we go to generate. The BASIC program is given in Fig.4.1

The Polar Marsaglia Method: If then: 2U is U(0,2) and V=2U-1 is U(-1,1) Then specify a point at random in the sequence with :

By repeating of selection of such point and rejection of points outside unit circle, the polar coordinates ( ) are independent with has and has. So this pair is the same as required in Box-Muller method. So a pair of, are given by,

If : The rejection proportion is A BASIC program for polar Marsaglia (Marsaglia and Bray 1964) is given in Fig.4.3. and is used in IMSL routine GGNPM.

Exponential variables Random variables with exponential and gamma distributions are frequently used to model waiting times in queues of various kind. The simplest way to produce an exponential PDF of for is to set : Where: U(0,1) If : Then Y has exponential p.d.f of

Gamma variates To produce Gamma distributed random variables, first we choose with p.d.f for Then : has a Gamma distribution Then, to generate Gamma from uniform distribution, we set: Where are independent U(0,1). We can also write :

Chi-square variables For Chi-square distribution, we simply set For m, even, we use the above approach. For m, odd, we can obtain, at frist, By : Then adding to it, where N is an independent N(0,1) normal random variable. Both NAG and IMSL computer package use convolutions of exponential p.d.f in their routine to simulate of Gamma and Chi-square random variables.

Binomial Variables A binomial random variable X can be written as: Where, the are independent Bernoulli random variables, each taking the values with probability p, or, with probability (1-p). Thus to simulate an X, we need just to simulate n independent U(0,1) random variables,, and set if and set if. In IMSL routine, and GGBN for n<35, re-use of uniform random variable is employed

Belles (1972) simulate B(n,p) by simply count how many of are less than p, (for n>35). If n is large, we can first ordering the { } and them observe the location of p within the ordered samples. For n=7 and p=0.5 we denote the ordered samples { } In this example X=3 as a realization of B(7, ).

If we write U in binary form to n places, the probability of 0,1 is. Then we add number of 1 to generate of B(n, )=9. EX: = To generate B(n, ), we generate another independent U(0,1): = Then take place-by-place multiplication of the binary digits X=7 with B(17, )

Poisson variates If E i is random variables with exponential Distribution: λ=e -λx then S k =Σ i=1 k E i has Γ(k,λ) distribution. If S k <=1<S k+1 then K has Poisson distribution with λ. S1=E1, if S1>1 then K=0 otherwise; S2=E1+E2, now if S2>1 then K=1, and so on. The Basic program is shown in Fig.4.4.

If: Sk>1, then: >1 Then: