Lecture 28 Dr. MUMTAZ AHMED MTH 161: Introduction To Statistics.

Slides:



Advertisements
Similar presentations
MOMENT GENERATING FUNCTION AND STATISTICAL DISTRIBUTIONS
Advertisements

Chapter 2 Multivariate Distributions Math 6203 Fall 2009 Instructor: Ayona Chatterjee.
Use of moment generating functions. Definition Let X denote a random variable with probability density function f(x) if continuous (probability mass function.
Lecture note 6 Continuous Random Variables and Probability distribution.
Review of Basic Probability and Statistics
5.4 Joint Distributions and Independence
TRANSFORMATION OF FUNCTION OF A RANDOM VARIABLE UNIVARIATE TRANSFORMATIONS.
1 Def: Let and be random variables of the discrete type with the joint p.m.f. on the space S. (1) is called the mean of (2) is called the variance of (3)
Joint Distributions, Marginal Distributions, and Conditional Distributions Note 7.
Discrete Random Variables and Probability Distributions
Chapter 6 Continuous Random Variables and Probability Distributions
Class notes for ISE 201 San Jose State University
Tch-prob1 Chapter 4. Multiple Random Variables Ex Select a student’s name from an urn. S In some random experiments, a number of different quantities.
1 Engineering Computation Part 5. 2 Some Concepts Previous to Probability RANDOM EXPERIMENT A random experiment or trial can be thought of as any activity.
Visual Recognition Tutorial1 Random variables, distributions, and probability density functions Discrete Random Variables Continuous Random Variables.
A random variable that has the following pmf is said to be a binomial random variable with parameters n, p The Binomial random variable.
2. Random variables  Introduction  Distribution of a random variable  Distribution function properties  Discrete random variables  Point mass  Discrete.
The moment generating function of random variable X is given by Moment generating function.
Continuous Random Variables and Probability Distributions
Chapter 4: Joint and Conditional Distributions
Chapter 5 Continuous Random Variables and Probability Distributions
Discrete Random Variables and Probability Distributions
5-1 Two Discrete Random Variables Example Two Discrete Random Variables Figure 5-1 Joint probability distribution of X and Y in Example 5-1.
Joint Probability distribution
Jointly distributed Random variables
5-1 Two Discrete Random Variables Example Two Discrete Random Variables Figure 5-1 Joint probability distribution of X and Y in Example 5-1.
Modern Navigation Thomas Herring
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
Chapter6 Jointly Distributed Random Variables
Sampling Distributions  A statistic is random in value … it changes from sample to sample.  The probability distribution of a statistic is called a sampling.
Joint Probability Distributions Leadership in Engineering
Review of Probability.
Pairs of Random Variables Random Process. Introduction  In this lecture you will study:  Joint pmf, cdf, and pdf  Joint moments  The degree of “correlation”
: Appendix A: Mathematical Foundations 1 Montri Karnjanadecha ac.th/~montri Principles of.
Random variables Petter Mostad Repetition Sample space, set theory, events, probability Conditional probability, Bayes theorem, independence,
MTH 161: Introduction To Statistics
DATA ANALYSIS Module Code: CA660 Lecture Block 3.
Lecture 14: Multivariate Distributions Probability Theory and Applications Fall 2005 October 25.
Moment Generating Functions
MTH 161: Introduction To Statistics
Lectures prepared by: Elchanan Mossel Yelena Shvets Introduction to probability Stat 134 FAll 2005 Berkeley Follows Jim Pitman’s book: Probability Section.
Functions of Random Variables. Methods for determining the distribution of functions of Random Variables 1.Distribution function method 2.Moment generating.
LECTURE IV Random Variables and Probability Distributions I.
1 G Lect 8b G Lecture 8b Correlation: quantifying linear association between random variables Example: Okazaki’s inferences from a survey.
ENGR 610 Applied Statistics Fall Week 3 Marshall University CITE Jack Smith.
Chapter 2 Random variables 2.1 Random variables Definition. Suppose that S={e} is the sampling space of random trial, if X is a real-valued function.
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
1 Since everything is a reflection of our minds, everything can be changed by our minds.
Expectation for multivariate distributions. Definition Let X 1, X 2, …, X n denote n jointly distributed random variable with joint density function f(x.
Stats Probability Theory Summary. The sample Space, S The sample space, S, for a random phenomena is the set of all possible outcomes.
Operations on Multiple Random Variables
Using the Tables for the standard normal distribution.
IE 300, Fall 2012 Richard Sowers IESE. 8/30/2012 Goals: Rules of Probability Counting Equally likely Some examples.
Chapter 5a:Functions of Random Variables Yang Zhenlin.
Math 4030 – 6a Joint Distributions (Discrete)
Review of Probability. Important Topics 1 Random Variables and Probability Distributions 2 Expected Values, Mean, and Variance 3 Two Random Variables.
Lecture 3 1 Recap Random variables Continuous random variable Sample space has infinitely many elements The density function f(x) is a continuous function.
Lecture 29 Dr. MUMTAZ AHMED MTH 161: Introduction To Statistics.
1 Probability and Statistical Inference (9th Edition) Chapter 4 Bivariate Distributions November 4, 2015.
Continuous Random Variables and Probability Distributions
Joint Moments and Joint Characteristic Functions.
Virtual University of Pakistan Lecture No. 26 Statistics and Probability Miss Saleha Naghmi Habibullah.
Geology 6600/7600 Signal Analysis 04 Sep 2014 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
2.2 Discrete Random Variables 2.2 Discrete random variables Definition 2.2 –P27 Definition 2.3 –P27.
Lecture 21 Dr. MUMTAZ AHMED MTH 161: Introduction To Statistics.
MTH 161: Introduction To Statistics
The distribution function F(x)
Keller: Stats for Mgmt & Econ, 7th Ed
Using the Tables for the standard normal distribution
Presentation transcript:

Lecture 28 Dr. MUMTAZ AHMED MTH 161: Introduction To Statistics

Review of Previous Lecture In last lecture we discussed: Finding Area Under Normal Curve using MS-Excel Normal Approximation to Binomial Distribution Central Limit Theorem Related examples 2

Objectives of Current Lecture In the current lecture: Joint Distributions Moment Generating Functions Covariance Related Examples 3

Joint Distributions 4

Joint Distributions Types of Joint Distribution: Discrete Continuous Mixed A bivariate distribution may be discrete when The possible values of (X,Y) are finite or countably infinite. It is continuous if (X,Y) can assume all values in some non-countable set of plane. It is said to be mixed if one r.v. is discrete and other is continuous. 5

Discrete Joint Distributions 6

Bivariate Distributions Joint Probability Function also called Bivariate Probability Function 7 X\Yy1y1 y2y2 …ynyn P(X=x j ) x1x1 f(x 1,y 1 )f(x 1,y 2 )…f(x 1,y n )g(x 1 ) x2x2 f(x 2,y 1 )f(x 2,y 2 )…f(x 2,y n )g(x 2 ) ……………… xmxm f(x m,y 1 )f(x m,y 2 )…f(x m,y n )g(x 3 ) P(Y=y j )h(y 1 )h(y 2 )…h(y n )1

Bivariate Distributions Marginal Probability Functions: Marginal Distribution of X Marginal Distribution of Y 8 X\Yy1y1 y2y2 …ynyn P(X=x j ) x1x1 f(x 1,y 1 )f(x 1,y 2 )…f(x 1,y n )g(x 1 ) x2x2 f(x 2,y 1 )f(x 2,y 2 )…f(x 2,y n )g(x 2 ) ……………… xmxm f(x m,y 1 )f(x m,y 2 )…f(x m,y n )g(x 3 ) P(Y=y j )h(y 1 )h(y 2 )…h(y n )1

Bivariate Distributions Conditional Probability Functions: Conditional Probability of X/Y Conditional Probability of Y/X 9 X\Yy1y1 y2y2 …ynyn P(X=x j ) x1x1 f(x 1,y 1 )f(x 1,y 2 )…f(x 1,y n )g(x 1 ) x2x2 f(x 2,y 1 )f(x 2,y 2 )…f(x 2,y n )g(x 2 ) ……………… xmxm f(x m,y 1 )f(x m,y 2 )…f(x m,y n )g(x 3 ) P(Y=y j )h(y 1 )h(y 2 )…h(y n )1

Bivariate Distributions Independence: Two r.v.s X and Y are said to be independent iff for all possible pairs of values (x i, y j ), the joint probability function f(x,y) can be expressed as the product of the two marginal probability functions. 10

Bivariate Distributions Example: An urn contains 3 black, 2 red and 3 green balls and 2 balls are selected at random from it. If X is the number of black balls and Y is the number of red balls selected, then find the joint probability distribution of X and Y. Solution: Total Balls=3black+2red+3green=8 balls Possible values of both X & Y are={0,1,2} The Joint Frequency Distribution 11 X\Y012g(x) 03/286/281/2810/28 19/286/28015/28 23/2800 H(y)15/2812/281/281

Bivariate Distributions The Joint Frequency Distribution P(X=0 |Y=1)=? 12 X\Y012g(x) 03/286/281/2810/28 19/286/28015/28 23/2800 H(y)15/2812/281/281 P(X+Y<=1)=? P(X+Y<=1)=f(0,0)+f(0,1)+f(1,0) =3/28+6/28+9/28=18/28

Moment Generating Function The moment-generating function of a random variable is an alternative specification of its probability distribution. Thus, it provides the basis of an alternative route to analytical results compared with working directly with probability density functions or cumulative distribution functions. In addition to univariate distributions, moment-generating functions can be multivariate distributions, and can even be extended to more general cases. There are relations between the behavior of the moment-generating function of a distribution and properties of the distribution. 13

Moment Generating Function 14

Moment Generating Function Moment Generating Functions of some important distributions: If X is a Bernoulli r.v. with parameter p: If X is a Binomial r.v. with parameters n and p: If X is a Poisson r.v. with parameters λ: If X is a Normal r.v. with parameters  and σ 2 : 15

Characteristic Function The M.G.F. doesn’t exist for many probability distributions. We then use another function, called characteristic function (c.f.). The characteristic function of a r.v. is defined as: 16

Covariance 17

Covariance Covariance ranges between minus infinity to plus infinity. The covariance is positive if the deviations of the two variables from their respective means tend to have the same sign and negative if the deviations tend to have opposite signs. A positive covariance indicates a positive association between the two variables. A negative covariance indicates a negative association between the two variables. A zero covariance indicates neither positive nor negative association between the two variables. 18

Covariance Sample Covariance can be written as: 19

Variance of Sum or Difference of r.v.’s Let X and Y be two r.v.’s, then: 20

Review Let’s review the main concepts: Joint Distributions Moment Generating Functions Covariance Related Examples 21

Next Lecture In next lecture, we will study: Describing Bivariate Data Scatter Plot Concept of Correlation Properties of Correlation Related examples and Excel Demo 22