Section 8 – Joint, Marginal, and Conditional Distributions.

Slides:



Advertisements
Similar presentations
Random Variables ECE460 Spring, 2012.
Advertisements

Joint and marginal distribution functions For any two random variables X and Y defined on the same sample space, the joint c.d.f. is For an example, see.
Chapter 5 Some Important Discrete Probability Distributions
Chapter 5 Discrete Random Variables and Probability Distributions
Lectures prepared by: Elchanan Mossel Yelena Shvets Introduction to probability Stat 134 FAll 2005 Berkeley Follows Jim Pitman’s book: Probability Sections.
Independence of random variables
Probability Theory STAT 312 STAT 312 Dr. Zakeia AlSaiary.
Chapter 2: Probability Random Variable (r.v.) is a variable whose value is unknown until it is observed. The value of a random variable results from an.
Chapter 4 Discrete Random Variables and Probability Distributions
Today Today: More of Chapter 2 Reading: –Assignment #2 is up on the web site – –Please read Chapter 2 –Suggested.
Statistical Inference Most data comes in the form of numbers We have seen methods to describe and summarise patterns in data. Most data are samples (subsets)
1 Review of Probability Theory [Source: Stanford University]
Sections 4.1, 4.2, 4.3 Important Definitions in the Text:
Today Today: Chapter 5 Reading: –Chapter 5 (not 5.12) –Exam includes sections from Chapter 5 –Suggested problems: 5.1, 5.2, 5.3, 5.15, 5.25, 5.33,
Probability &Statistics Lecture 8
Tch-prob1 Chapter 4. Multiple Random Variables Ex Select a student’s name from an urn. S In some random experiments, a number of different quantities.
2. Random variables  Introduction  Distribution of a random variable  Distribution function properties  Discrete random variables  Point mass  Discrete.
Chapter 4: Joint and Conditional Distributions
Review of Probability and Statistics
The joint probability distribution function of X and Y is denoted by f XY (x,y). The marginal probability distribution function of X, f X (x) is obtained.
Today Today: More Chapter 5 Reading: –Important Sections in Chapter 5: Only material covered in class Note we have not, and will not cover moment/probability.
Random Variable and Probability Distribution
5-1 Two Discrete Random Variables Example Two Discrete Random Variables Figure 5-1 Joint probability distribution of X and Y in Example 5-1.
Joint Probability distribution
5-1 Two Discrete Random Variables Example Two Discrete Random Variables Figure 5-1 Joint probability distribution of X and Y in Example 5-1.
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
NIPRL Chapter 2. Random Variables 2.1 Discrete Random Variables 2.2 Continuous Random Variables 2.3 The Expectation of a Random Variable 2.4 The Variance.
Joint Distribution of two or More Random Variables
Chapter6 Jointly Distributed Random Variables
Prof. SankarReview of Random Process1 Probability Sample Space (S) –Collection of all possible outcomes of a random experiment Sample Point –Each outcome.
Definition of Covariance The covariance of X & Y, denoted Cov(X,Y), is the number where  X = E(X) and  Y = E(Y). Computational Formula:
Two Random Variables W&W, Chapter 5. Joint Distributions So far we have been talking about the probability of a single variable, or a variable conditional.
1 Lecture 4. 2 Random Variables (Discrete) Real-valued functions defined on a sample space are random vars. determined by outcome of experiment, we can.
0 K. Salah 2. Review of Probability and Statistics Refs: Law & Kelton, Chapter 4.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc.. Chap 5-1 Chapter 5 Some Important Discrete Probability Distributions Basic Business Statistics.
1 Chapter 16 Random Variables. 2 Expected Value: Center A random variable assumes a value based on the outcome of a random event.  We use a capital letter,
Random Variables. A random variable X is a real valued function defined on the sample space, X : S  R. The set { s  S : X ( s )  [ a, b ] is an event}.
1 G Lect 4a G Lecture 4a f(X) of special interest: Normal Distribution Are These Random Variables Normally Distributed? Probability Statements.
STA347 - week 51 More on Distribution Function The distribution of a random variable X can be determined directly from its cumulative distribution function.
1 G Lect 2M Examples of Correlation Random variables and manipulated variables Thinking about joint distributions Thinking about marginal distributions:
Probability Refresher. Events Events as possible outcomes of an experiment Events define the sample space (discrete or continuous) – Single throw of a.
7 sum of RVs. 7-1: variance of Z Find the variance of Z = X+Y by using Var(X), Var(Y), and Cov(X,Y)
Chapter 5a:Functions of Random Variables Yang Zhenlin.
Math 4030 – 6a Joint Distributions (Discrete)
Lecture 3 1 Recap Random variables Continuous random variable Sample space has infinitely many elements The density function f(x) is a continuous function.
Chapter Eight Expectation of Discrete Random Variable
1 Probability and Statistical Inference (9th Edition) Chapter 4 Bivariate Distributions November 4, 2015.
Section 10.5 Let X be any random variable with (finite) mean  and (finite) variance  2. We shall assume X is a continuous type random variable with p.d.f.
The Erik Jonsson School of Engineering and Computer Science Chapter 4 pp William J. Pervin The University of Texas at Dallas Richardson, Texas.
ELEC 303, Koushanfar, Fall’09 ELEC 303 – Random Signals Lecture 9 – Continuous Random Variables: Joint PDFs, Conditioning, Continuous Bayes Farinaz Koushanfar.
Chapter 2: Probability. Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance.
Virtual University of Pakistan Lecture No. 26 Statistics and Probability Miss Saleha Naghmi Habibullah.
1 Chapter 4 Mathematical Expectation  4.1 Mean of Random Variables  4.2 Variance and Covariance  4.3 Means and Variances of Linear Combinations of Random.
Conditional Probability 423/what-is-your-favorite-data-analysis-cartoon 1.
Chapter 15 Random Variables.
Probability and Statistics for Computer Scientists Second Edition, By: Michael Baron Chapter 3: Discrete Random Variables and Their Distributions CIS.
PRODUCT MOMENTS OF BIVARIATE RANDOM VARIABLES
Chapter 16 Random Variables.
Chapter 15 Random Variables.
Review of Probability Concepts
Chapter 3: Getting the Hang of Statistics
Tutorial 9: Further Topics on Random Variables 2
How accurately can you (1) predict Y from X, and (2) predict X from Y?
Independence of random variables
Chapter 3: Getting the Hang of Statistics
Handout Ch 4 實習.
RANDOM VARIABLES, EXPECTATIONS, VARIANCES ETC.
Financial Econometrics Fin. 505
Further Topics on Random Variables: Covariance and Correlation
Further Topics on Random Variables: Covariance and Correlation
Presentation transcript:

Section 8 – Joint, Marginal, and Conditional Distributions

Joint Distribution of X and Y

CDF of a Joint Distribution

Expectation of a function of Jointly Distributed RV’s Recall: Now:

Marginal Distribution Formulas Caution: When the probability space is non- rectangular, make sure to set limits of integration correctly – Example 8-9 in Actex

Independent RV’s: X & Y

Marginal Distribution of X and Y Before this chapter, we were dealing with one random variable – These RV’s had f(x)  this was a marginal distribution for X – fx(X) = Probability that that value of X occurs This is what we’ve already been doing! Coin-dice example: – X: coin toss (Tails=0, Heads=1) – If get heads roll 1 die, if tails roll 2 – Y=Total number rolled on dice – fx(0) =.5, fx(1) =.5 – fy(1) = fx,y(1,1)=(.5)(1/6)  there is no possible y= 1 if x = 0 – fy(2) = fx,y(0,2) + fx,y(1,2) = (.5)(1/36)+(.5)(1/6) Sum (over all x) any events where y = 2

Conditional Distribution of Y given X=x

Expectation & Variance of Conditional Expectation – Find the conditional PDF from previous formula – Apply the expectation formula like usual Variance (trickier!) – Find the conditional PDF from previous formula – Apply the expectation formula like usual Find conditional mean: E[Y|X=x) Find conditional second moment: E[Y^2|X=x] Use the variance formula like usual, using these components

Two Formulas for f(x,y) For any X, Y Special case for when X, Y are independent

Covariance between X & Y Covariance = 0 for independent X, Y Positive for large X with large Y Negative for large X with small Y (vice versa) Formula is similar to our familiar variance formula

Moment Generating Function of a Joint Distribution The E(e^tX) and M’(0) approaches both work Can get E(XY), E(X), E(Y) from this  Cov(X,Y)

Bivariate Normal Distribution “The Bivariate Normal Distribution has occurred infrequently on Exam P More information in Actex (p. 236)

Properties If X and Y are independent: Products of expectations are expectations of products – E[g(X) * h(Y)]=E[g(X)] * E[h(Y)] Particularly useful: E[XY] = E[X] * E[Y] This is why Cov(X,Y) = 0 when X&Y are independent Cov[aX + bY + c, dZ + eW + f] = adCov[X,Z] + aeCov[X,W] + bdCov[Y,Z] + beCov[Y,W] Lower case constants, upper case RV’s Similer to the foil method…i.e.(a+b)(c+d)=ac+ad+bc+bd Var[aX + bY + c] =a 2 *Var[X] + b 2 *Var[Y] + 2ab*Cov[X,Y] Remember:The sign of a, b affect Cov term

Formulas to Understand Graphically Make sure that you understand these formulas as graphical concepts – Be able to set up these problems by thinking instead of memorizing

There’s some real work to do! From here on out, STAT 414 is really not enough Go through all of the examples in the chapter and be comfortable setting up double integrals to find probabilities Understand all of the properties/formulas – There are more properties on p than what I covered This is some of the most conceptually difficult material on the entire exam that is frequently tested Practice problems! Bring questions for next time!