Let X 1, X 2,..., X n be a set of independent random variables having a common distribution, and let E[ X i ] = . then, with probability 1 Strong law of large numbers

Let X 1, X 2,..., X n be a set of independent random variables having a common distribution with mean  and variance  Then the distribution of Central Limit Theorem

Let X and Y be two discrete random variables, then the conditional probability mass function of X given that Y = y is defined as for all values of y for which P ( Y = y )>0. Conditional probability and conditional expectations

Let X and Y be two discrete random variables, then the conditional probability mass function of X given that Y = y is defined as for all values of y for which P ( Y = y )>0. The conditional expectation of X given that Y = y is defined as Conditional probability and conditional expectations

Let X and Y be two continuous random variables, then the conditional probability density function of X given that Y = y is defined as for all values of y for which f Y ( y )>0.

Let X and Y be two continuous random variables, then the conditional probability density function of X given that Y = y is defined as for all values of y for which f Y ( y )>0. The conditional expectation of X given that Y = y is defined as

Proof

The sum of a random number of random variables Example: The number N of customers that place orders each day with an online bookstore is a random variable with expected value E [ N ].

The sum of a random number of random variables Example: The number N of customers that place orders each day with an online bookstore is a random variable with expected value E [ N ]. The number of books X i that each customer i ( i = 1, 2,..., N ) purchases is also a random variable E [ X i ] with expected value E [ X i ].

The sum of a random number of random variables Example: The number N of customers that place orders each day with an online bookstore is a random variable with expected value E [ N ]. The number of books X i that each customer i ( i = 1, 2,..., N ) purchases is also a random variable E [ X i ] with expected value E [ X i ]. What is the expected value of the total number of books Y sold each day? What is its variance?

The sum of a random number of random variables Example: The number N of customers that place orders each day with an online bookstore is a random variable with expected value E [ N ]. The number of books X i that each customer i ( i = 1, 2,..., N ) purchases is also a random variable E [ X i ] with expected value E [ X i ]. What is the expected value of the total number of books Y sold each day? What is its variance? Assume that the number of books are independent and identically distributed with the same mean E [ X i ]= E [ X ] and variance Var[ X i ]= E [ X ] for i =1,..., N. Also assume the number of books purchased per customer is independent of the total number of customers.

The expected value

The variance

If N is Poisson distributed with parameter, the random Y = X 1 + X X N is called a compound Poisson random variable

Let E denote some event. Define a random variable X by Computing probabilities by conditioning

Let E denote some event. Define a random variable X by Computing probabilities by conditioning

Let E denote some event. Define a random variable X by Computing probabilities by conditioning

Example 1: Let X and Y be two independent continuous random variables with densities f X and f Y. What is P ( X < Y )?

Example 2: Let X and Y be two independent continuous random variables with densities f X and f Y. What is the distribution of X + Y ?

Example 3: (Thinning of a Poisson) Suppose X is a