Random Variables and their Properties

Slides:



Advertisements
Similar presentations
Estimation  Samples are collected to estimate characteristics of the population of particular interest. Parameter – numerical characteristic of the population.
Advertisements

Use of moment generating functions. Definition Let X denote a random variable with probability density function f(x) if continuous (probability mass function.
Continuous Random Variable (1). Discrete Random Variables Probability Mass Function (PMF)
Review of Basic Probability and Statistics
G. Cowan Lectures on Statistical Data Analysis Lecture 2 page 1 Statistical Data Analysis: Lecture 2 1Probability, Bayes’ theorem 2Random variables and.
Statistical Inference Chapter 12/13. COMP 5340/6340 Statistical Inference2 Statistical Inference Given a sample of observations from a population, the.
1 Engineering Computation Part 6. 2 Probability density function.
A gentle introduction to Gaussian distribution. Review Random variable Coin flip experiment X = 0X = 1 X: Random variable.
Today Today: Chapter 9 Assignment: 9.2, 9.4, 9.42 (Geo(p)=“geometric distribution”), 9-R9(a,b) Recommended Questions: 9.1, 9.8, 9.20, 9.23, 9.25.
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Continuous random variables Uniform and Normal distribution (Sec. 3.1, )
Probability and Statistics Review
A random variable that has the following pmf is said to be a binomial random variable with parameters n, p The Binomial random variable.
2. Random variables  Introduction  Distribution of a random variable  Distribution function properties  Discrete random variables  Point mass  Discrete.
The moment generating function of random variable X is given by Moment generating function.
7-1 Introduction The field of statistical inference consists of those methods used to make decisions or to draw conclusions about a population. These.
Statistical Theory; Why is the Gaussian Distribution so popular? Rob Nicholls MRC LMB Statistics Course 2014.
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
Discrete Probability Distributions A sample space can be difficult to describe and work with if its elements are not numeric.A sample space can be difficult.
Moment Generating Functions 1/33. Contents Review of Continuous Distribution Functions 2/33.
Functions of Random Variables. Methods for determining the distribution of functions of Random Variables 1.Distribution function method 2.Moment generating.
Chapter 5 Statistical Models in Simulation
Statistics for Engineer Week II and Week III: Random Variables and Probability Distribution.
Moment Generating Functions
Traffic Modeling.
Random Sampling, Point Estimation and Maximum Likelihood.
Chapter 14 Monte Carlo Simulation Introduction Find several parameters Parameter follow the specific probability distribution Generate parameter.
Functions of Random Variables. Methods for determining the distribution of functions of Random Variables 1.Distribution function method 2.Moment generating.
Continuous Distributions The Uniform distribution from a to b.
Chapter 7 Point Estimation
Probability Distributions
Basic Concepts of Probability CEE 431/ESS465. Basic Concepts of Probability Sample spaces and events Venn diagram  A Sample space,  Event, A.
MATH 4030 – 4B CONTINUOUS RANDOM VARIABLES Density Function PDF and CDF Mean and Variance Uniform Distribution Normal Distribution.
ETM 607 – Random-Variate Generation
1 Standard error Estimated standard error,s,. 2 Example 1 While measuring the thermal conductivity of Armco iron, using a temperature of 100F and a power.
Point Estimation of Parameters and Sampling Distributions Outlines:  Sampling Distributions and the central limit theorem  Point estimation  Methods.
Random Variables. Numerical Outcomes Consider associating a numerical value with each sample point in a sample space. (1,1) (1,2) (1,3) (1,4) (1,5) (1,6)
Statistics Sampling Distributions and Point Estimation of Parameters Contents, figures, and exercises come from the textbook: Applied Statistics and Probability.
STA347 - week 91 Random Vectors and Matrices A random vector is a vector whose elements are random variables. The collective behavior of a p x 1 random.
CHAPTER Discrete Models  G eneral distributions  C lassical: Binomial, Poisson, etc Continuous Models  G eneral distributions 
Random Variables By: 1.
Probability Distributions
Concepts in Probability, Statistics and Stochastic Modeling
STAT 311 REVIEW (Quick & Dirty)
Cumulative distribution functions and expected values
ETM 607 – Spreadsheet Simulations
7-1 Introduction The field of statistical inference consists of those methods used to make decisions or to draw conclusions about a population. These.
Parameter Estimation 主講人:虞台文.
STATISTICS Random Variables and Distribution Functions
Handout on Statistics Summary for Financial Analysis: Random Variables, Probability and Probability Distributions, Measures of Central Tendency, Dispersion,
The distribution function F(x)
AP Statistics: Chapter 7
Chapter 5 Statistical Models in Simulation
Maximum Likelihood Find the parameters of a model that best fit the data… Forms the foundation of Bayesian inference Slide 1.
Alafia river: Autocorrelation Autocorrelation of standardized flow.
Moment Generating Functions
Probability & Statistics Probability Theory Mathematical Probability Models Event Relationships Distributions of Random Variables Continuous Random.
More about Posterior Distributions
MEGN 537 – Probabilistic Biomechanics Ch.3 – Quantifying Uncertainty
Probability Review for Financial Engineers
POINT ESTIMATOR OF PARAMETERS
POPULATION (of “units”)
QQ Plot Quantile to Quantile Plot Quantile: QQ Plot:
Chapter 14 Monte Carlo Simulation
Chapter 3 : Random Variables
M248: Analyzing data Block A UNIT A3 Modeling Variation.
Experiments, Outcomes, Events and Random Variables: A Revisit
Continuous Distributions
1/2555 สมศักดิ์ ศิวดำรงพงศ์
Applied Statistics and Probability for Engineers
Generating Random Variates
Presentation transcript:

Random Variables and their Properties Learn fundamental theoretical concepts of random variables and probability distributions Describe the representation of randomness and data variability using probability distributions. Characterize probability distributions through attributes such as moments (mean, variance, skewness…) and other measures of central tendency. Estimate parameters of probability distributions from sample data

Text Coverage (Kottegoda and Rosso) 3.1 Random Variables, probability distributions and density functions (p86-94) 3.2 Descriptors of Random Variables 3.2.1 Expectation and other probability measures (p94-103) 3.2.3 Estimation of Parameters by method of moments (p107-109), Maximum Likelihood (p112-114), Jackknife and Bootstrap (p116-117)

A random variable X is a variable whose outcomes (values) are governed by the laws of chance. Discrete Values Probability Mass Function PX(x)=Pr(X=x)

Cumulative Distribution Function FX(x)=Pr[X ≤ x]

Continuous Variable Probability density function

Cumulative distribution function

Moments of Random Variables

Estimation of parameters Hillsborough River at Zephyr Hills, September flows = 8621 mgal S = 8194 mgal n = 31 mgal

Method of Moments Gamma distribution =1.1 =1.3 x 10-3

Method of Moments Log-Normal distribution =0.643 =8.29

Likelihood ln(L)= -311 (for gamma) ln(L)= -312 (for log normal) Could use maximization of L or ln(L) to select parameters rather than fitting moments

Generating a random variable from a given distribution F(U) F(X) U X Generate U from a uniform distribution between 0 and 1 Solve for X=F-1(U) Basis P(X<x)=P(U<F(x))=P(F-1(U)<x) F-1(U) is randomly distributed with CDF F(x)

Generating a Pseudo random number There is a lot of lore about this. Refer to: Press, W. H., B. P. Flannery, S. A. Teukolsky and W. T. Vetterling, (1988), Numerical Recipes in C : The Art of Scientific Computing, Cambridge University Press, New York, 735 p. Congruential method Each r is an integer random number between 0 and m-1. by (m-1) gives a number between 0 and 1 that repeats after at most m numbers. Numerical recipes gives "good" choices for a, c and m. R has built in functions runif to generate uniform random numbers, as well as other distributions, e.g rnorm, rgamma.

Generating a random variable from a discrete distribution in matlab F(U) F(X) U X Xs=[x1 x2 x3 …] % Vector of x values Px=[p1 p2 p3 …] % Vector of pmf values CDFx=cumsum(Px) % CDF vector U=rand(1) % Uniform random number 0-1 X = Xs(find(CDFx>U,1) ) % Inverse of CDF