Moment Generating Functions

Slides:



Advertisements
Similar presentations
Special random variables Chapter 5 Some discrete or continuous probability distributions.
Advertisements

Some additional Topics. Distributions of functions of Random Variables Gamma distribution,  2 distribution, Exponential distribution.
Chapter 3 Some Special Distributions Math 6203 Fall 2009 Instructor: Ayona Chatterjee.
Exponential Distribution. = mean interval between consequent events = rate = mean number of counts in the unit interval > 0 X = distance between events.
Week11 Parameter, Statistic and Random Samples A parameter is a number that describes the population. It is a fixed number, but in practice we do not know.
Use of moment generating functions. Definition Let X denote a random variable with probability density function f(x) if continuous (probability mass function.
Review of Basic Probability and Statistics
Engineering Probability and Statistics - SE-205 -Chap 4 By S. O. Duffuaa.
Probability Densities
1 Engineering Computation Part 6. 2 Probability density function.
Estimation of parameters. Maximum likelihood What has happened was most likely.
Chapter Five Continuous Random Variables McGraw-Hill/Irwin Copyright © 2004 by The McGraw-Hill Companies, Inc. All rights reserved.
Probability and Statistics Review
A random variable that has the following pmf is said to be a binomial random variable with parameters n, p The Binomial random variable.
2. Random variables  Introduction  Distribution of a random variable  Distribution function properties  Discrete random variables  Point mass  Discrete.
The moment generating function of random variable X is given by Moment generating function.
Some standard univariate probability distributions
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 4 Continuous Random Variables and Probability Distributions.
Some standard univariate probability distributions
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
Some Continuous Probability Distributions Asmaa Yaseen.
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
CIS 2033 based on Dekking et al. A Modern Introduction to Probability and Statistics, 2007 Instructor Longin Jan Latecki Chapter 7: Expectation and variance.
Moment Generating Functions 1/33. Contents Review of Continuous Distribution Functions 2/33.
Functions of Random Variables. Methods for determining the distribution of functions of Random Variables 1.Distribution function method 2.Moment generating.
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL Review of Exam 2 Sections 4.6 – 5.6 Jiaping Wang Department of Mathematical Science 04/01/2013, Monday.
Topic 4 - Continuous distributions
Chapter 3 Basic Concepts in Statistics and Probability
4.2 Variances of random variables. A useful further characteristic to consider is the degree of dispersion in the distribution, i.e. the spread of the.
Statistics for Engineer Week II and Week III: Random Variables and Probability Distribution.
Some standard univariate probability distributions Characteristic function, moment generating function, cumulant generating functions Discrete distribution.
Functions of Random Variables. Methods for determining the distribution of functions of Random Variables 1.Distribution function method 2.Moment generating.
Use of moment generating functions 1.Using the moment generating functions of X, Y, Z, …determine the moment generating function of W = h(X, Y, Z, …).
Continuous Distributions The Uniform distribution from a to b.
Probability & Statistics I IE 254 Summer 1999 Chapter 4  Continuous Random Variables  What is the difference between a discrete & a continuous R.V.?
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
Expectation for multivariate distributions. Definition Let X 1, X 2, …, X n denote n jointly distributed random variable with joint density function f(x.
Chapter 12 Continuous Random Variables and their Probability Distributions.
Stats Probability Theory Summary. The sample Space, S The sample space, S, for a random phenomena is the set of all possible outcomes.
1 3. Random Variables Let ( , F, P) be a probability model for an experiment, and X a function that maps every to a unique point the set of real numbers.
Expectation. Let X denote a discrete random variable with probability function p(x) (probability density function f(x) if X is continuous) then the expected.
INTRODUCTORY MATHEMATICAL ANALYSIS For Business, Economics, and the Life and Social Sciences  2011 Pearson Education, Inc. Chapter 16 Continuous Random.
IE 300, Fall 2012 Richard Sowers IESE. 8/30/2012 Goals: Rules of Probability Counting Equally likely Some examples.
Chapter 5a:Functions of Random Variables Yang Zhenlin.
CONTINUOUS RANDOM VARIABLES
Sampling and estimation Petter Mostad
Topic 5: Continuous Random Variables and Probability Distributions CEE 11 Spring 2002 Dr. Amelia Regan These notes draw liberally from the class text,
Chapter 5: The Basic Concepts of Statistics. 5.1 Population and Sample Definition 5.1 A population consists of the totality of the observations with which.
DATA ANALYSIS AND MODEL BUILDING LECTURE 4 Prof. Roland Craigwell Department of Economics University of the West Indies Cave Hill Campus and Rebecca Gookool.
Statistics -Continuous probability distribution 2013/11/18.
Continuous Distributions
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
Statistical Modelling
Random Variable 2013.
Engineering Probability and Statistics - SE-205 -Chap 4
The Exponential and Gamma Distributions
Expectations of Random Variables, Functions of Random Variables
Continuous Random Variables
CONTINUOUS RANDOM VARIABLES
Chapter 7: Sampling Distributions
Moment Generating Functions
Moment Generating Functions
Probability Review for Financial Engineers
Lecture 5 b Faten alamri.
Functions of Random variables
Chapter 3 : Random Variables
The Binomial Distributions
Continuous Distributions
MATH 3033 based on Dekking et al
Moments of Random Variables
Presentation transcript:

Moment Generating Functions

Continuous Distributions The Uniform distribution from a to b

The Normal distribution (mean m, standard deviation s)

The Exponential distribution

Weibull distribution with parameters a and b.

The Weibull density, f(x) (a = 0.9, b = 2) (a = 0.7, b = 2) (a = 0.5, b = 2)

The Gamma distribution Let the continuous random variable X have density function: Then X is said to have a Gamma distribution with parameters a and l.

Expectation of functions of Random Variables

X is discrete X is continuous

Moments of Random Variables

The kth moment of X.

the kth central moment of X where m = m1 = E(X) = the first moment of X .

Rules for expectation

Rules:

Moment generating functions

Moment Generating function of a R.V. X

Examples The Binomial distribution (parameters p, n)

The Poisson distribution (parameter l) The moment generating function of X , mX(t) is:

The Exponential distribution (parameter l) The moment generating function of X , mX(t) is:

The Standard Normal distribution (m = 0, s = 1) The moment generating function of X , mX(t) is:

We will now use the fact that We have completed the square This is 1

The Gamma distribution (parameters a, l) The moment generating function of X , mX(t) is:

We use the fact Equal to 1

Properties of Moment Generating Functions

mX(0) = 1 Note: the moment generating functions of the following distributions satisfy the property mX(0) = 1

We use the expansion of the exponential function:

Now

Property 3 is very useful in determining the moments of a random variable X. Examples

To find the moments we set t = 0.

The moments for the exponential distribution can be calculated in an alternative way. This is note by expanding mX(t) in powers of t and equating the coefficients of tk to the coefficients in: Equating the coefficients of tk we get:

The moments for the standard normal distribution We use the expansion of eu. We now equate the coefficients tk in:

If k is odd: mk = 0. For even 2k:

Moments Moment generating functions Summary Moments Moment generating functions

Moments of Random Variables The moment generating function

Examples The Binomial distribution (parameters p, n) The Poisson distribution (parameter l)

The Exponential distribution (parameter l) The Standard Normal distribution (m = 0, s = 1)

The Gamma distribution (parameters a, l) The Chi-square distribution (degrees of freedom n) (a = n/2, l = 1/2)

Properties of Moment Generating Functions mX(0) = 1

The log of Moment Generating Functions Let lX (t) = ln mX(t) = the log of the moment generating function

Thus lX (t) = ln mX(t) is very useful for calculating the mean and variance of a random variable

Examples The Binomial distribution (parameters p, n)

The Poisson distribution (parameter l)

The Exponential distribution (parameter l)

The Standard Normal distribution (m = 0, s = 1)

The Gamma distribution (parameters a, l)

The Chi-square distribution (degrees of freedom n)