Section 1.3: A General Discussion of Mean Values

Slides:



Advertisements
Similar presentations
Probability Distribution
Advertisements

Probability and the Binomial
Partly based on material by Sherry O’Sullivan
Special random variables Chapter 5 Some discrete or continuous probability distributions.
Chapter 1: Introduction to Statistical Methods
Variance and Standard Deviation The Expected Value of a random variable gives the average value of the distribution The Standard Deviation shows how spread.
Copyright © 2009 Pearson Education, Inc. Chapter 16 Random Variables.
The moment generating function of random variable X is given by Moment generating function.
Normal and Sampling Distributions A normal distribution is uniquely determined by its mean, , and variance,  2 The random variable Z = (X-  /  is.
Sect. 1.5: Probability Distributions for Large N: (Continuous Distributions)
Chapter 9 Statistics Section 9.2 Measures of Variation.
Continuous Distributions The Uniform distribution from a to b.
1 Chapter 16 Random Variables. 2 Expected Value: Center A random variable assumes a value based on the outcome of a random event.  We use a capital letter,
Random Variables Chapter 16.
The Mean of a Discrete RV The mean of a RV is the average value the RV takes over the long-run. –The mean of a RV is analogous to the mean of a large population.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 5 Discrete Random Variables.
Mean and Standard Deviation of Discrete Random Variables.
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
Expectation. Let X denote a discrete random variable with probability function p(x) (probability density function f(x) if X is continuous) then the expected.
Objectives The student will be able to:
Random Variables. Numerical Outcomes Consider associating a numerical value with each sample point in a sample space. (1,1) (1,2) (1,3) (1,4) (1,5) (1,6)
1 6. Mean, Variance, Moments and Characteristic Functions For a r.v X, its p.d.f represents complete information about it, and for any Borel set B on the.
7.2 Means & Variances of Random Variables AP Statistics.
Statistics and probability Dr. Khaled Ismael Almghari Phone No:
Lesson Discrete Distribution Binomial. Knowledge Objectives Describe the conditions that need to be present to have a binomial setting. Define a.
Chapter 6 Normal Approximation to Binomial Lecture 4 Section: 6.6.
Chapter Normal Probability Distributions 1 of 25 5  2012 Pearson Education, Inc. All rights reserved.
Sampling and Sampling Distributions
Chapter 15 Random Variables.
Chapter 7 Review.
Chapter 5 Normal Probability Distributions.
Standard Errors Beside reporting a value of a point estimate we should consider some indication of its precision. For this we usually quote standard error.
Sampling Distribution Models
Discrete Random Variables
Normal Distribution and Parameter Estimation
Statistical Mechanics
Chapter 15 Random Variables
Probability & Statistics
Keller: Stats for Mgmt & Econ, 7th Ed
Introduction to Statistical Methods
Chapter 6: Sampling Distributions
Statistical Data Analysis - Lecture10 26/03/03
PROBABILITY DISTRIBUTION Dr.Fatima Alkhalidi
The Gaussian Probability Distribution Function
Chapter 16 Random Variables
Sample Mean Distributions
“Théorie Analytique des Probabilités”, 1812
Chapter 7 Sampling Distributions.
Parameter, Statistic and Random Samples
Means and Variances of Random Variables
Chapter 16 Random Variables.
Chapter 15 Random Variables.
For the 1 Dimensional Random Walk Problem
The Normal Probability Distribution Summary
Probability & Statistics
Example Suppose X ~ Uniform(2, 4). Let . Find .
Elementary Statistics
For the 1 Dimensional Random Walk Problem
7.5 The Normal Curve Approximation to the Binomial Distribution
Chapter 16 Random Variables Copyright © 2009 Pearson Education, Inc.
CHAPTER 15 SUMMARY Chapter Specifics
Exam 2 - Review Chapters
PROBABILITY DISTRIBUTION
Chapter 5 Normal Probability Distributions.
Chapter 16 Random Variables Copyright © 2010 Pearson Education, Inc.
Continuous Distributions
Lecture Slides Essentials of Statistics 5th Edition
MGS 3100 Business Analysis Regression Feb 18, 2016
Presentation transcript:

Section 1.3: A General Discussion of Mean Values

P(u1), P(u2), P(u3),….., P(uM-1), P(uM) The Binomial Distribution is only one example of a discrete probability distribution. Now, we’ll have a brief discussion of a General Distribution. Most of the following is valid for ANY discrete probability distribution. Let u = a variable which can take on any of M discrete values: u1,u2,u3,…,uM-1,uM with probabilities P(u1), P(u2), P(u3),….., P(uM-1), P(uM)

ū ≡ <u> ≡ (S2/S1) u1,u2,u3,…,uM-1,uM with probabilities u  a variable which can take on any of M discrete values: u1,u2,u3,…,uM-1,uM with probabilities P(u1), P(u2), P(u3),….., P(uM-1), P(uM) The Mean (average) value of u is defined as the ratio of two sums: ū ≡ <u> ≡ (S2/S1) Here, S1 ≡ ∑iP(ui) or S1 ≡ P(u1) + P(u2) + P(u3) +…+ P(uM-1) + P(uM) For a properly normalized distribution, we must have: S1 = ∑iP(ui) = 1. We’ll assume this from now on.

Note: μ ≡ Standard notation for the ū ≡ <u> ≡ (S2/S1) As just stated, S1 = 1, so ū ≡ <u> ≡ S2 Here, S2 ≡ ∑iuiP(ui) or S2 ≡ u1P(u1) + u2P(u2) + u3P(u3) + …+ uM-1P(uM-1) + uMP(uM) Note: μ ≡ Standard notation for the mean value. So, μ ≡ ū ≡ <u>

1. The Mean Value, μ ≡ ū ≡ <u> Sometimes, ū is called the 1st moment of P(u). If F(u) is any function of u, the mean value of F(u) is: <F> ≡ ∑iF(ui)P(ui) Some simple mean values that are useful for describing any probability distribution P(u): 1. The Mean Value, μ ≡ ū ≡ <u> This is a measure of the central value of u about which the various values of ui are distributed. Consider the quantity Δu ≡ u - ū (deviation from the mean). It’s mean is: <Δu> = <u - ū> = ū – ū = 0  The mean value of the deviation from the mean is always zero!

<(Δu)2> ≥ 0, or <u2> ≥ (<u>)2 Now, look at (Δu)2 = (u - <u>)2 (square of the deviation from the mean). It’s mean value is: σ2  <(Δu)2> = <(u - <u>)2> = <u2 -2uū – (ū)2> σ2 = <u2> - 2<u><u> – (<u>)2  <u2> - (<u>)2 This is called the “Mean Square Deviation” (from the mean). It is also called several different (equivalent!) other names: The Dispersion or Variance or the 2nd Moment of P(u) about the mean. σ2 ≡ <(Δu)2> is a measurelof the spread of the u values about the mean ū. Note that <(Δu)2> = 0 if & only if ui = ū for all i. It can easily be shown that, <(Δu)2> ≥ 0, or <u2> ≥ (<u>)2 Note: σ2 ≡ Standard notation for the variance.

<(Δu)n> ≡ <(u - <u>)n> Could also define the nth moment of P(u) about the mean: <(Δu)n> ≡ <(u - <u>)n> In Physics this is rarely used beyond n = 2 & almost never beyond n = 3 or 4. NOTE: From math: A knowledge of the probability distribution function P(u) gives complete information about the distribution of the values of u. But, a knowledge of only a few moments, like knowing just ū & <(Δu)2> implies only partial, though useful knowledge of the distribution. A knowledge of only some moments is not enough to uniquely determine P(u). Math Theorem In order to uniquely determine a distribution P(u), we need to know ALL moments of it. That is we need all moments for n = 0,1,2,3….  .

Section 1.4 Mean Values for the Random Walk Problem Also we’ll discuss a few math “tricks” for doing discrete sums! We’ve found that: For N steps, the probability of making n1 steps to the right & n2 = N - n1 to the left is the Binomial Distribution: WN(n1) = [N!/(n1!n2!)]pn1qn2 p = the probability of a step to the right, q = 1 – p = the probability of a step to the left.

∑(n1 = 0N) WN(n1) = 1? ∑(n1 = 0N) WN(n1) = 1. Binomial Distribution: WN(n1) = [N!/(n1!n2!)]pn1qn2 p = the probability of a step to the right, q = 1 – p = the probability of a step to the left. First, lets verify normalization: ∑(n1 = 0N) WN(n1) = 1? Recall the binomial expansion: (p + q)N = ∑(n1 = 0N) [N!/(n1!n2!)]pn1qn2 = ∑(n1 = 0N) WN(n1) But, (p + q) = 1, so (p + q)N = 1, so ∑(n1 = 0N) WN(n1) = 1.

= ∑(n1 = 0N) n1[N!/(n1!(N-n1)!] pn1qN-n1 (1) Question 1: What is the mean number of steps to the right? <n1> ≡ ∑(n1 = 0N) n1WN(n1) = ∑(n1 = 0N) n1[N!/(n1!(N-n1)!] pn1qN-n1 (1) Do this sum by looking it up in a table OR we can use a “trick” as follows. The following is a general procedure which usually works, even if it doesn’t always have mathematical “rigor”. Temporarily, treat p & q as “arbitrary”, continuous variables, ignoring that p + q =1. NOTE, if p is a continuous variable, then clearly: n1pn1 ≡ p[(pn1)/p]

n1pn1 ≡ p[(pn1)/p] μ = <n1> = Np <n1> ≡ ∑(n1 = 0N) n1WN(n1) = ∑(n1 = 0N) n1[N!/(n1!(N-n1)!] pn1qN-n1 (1) Temporarily, treat p & q as “arbitrary”, continuous variables. If p is a continuous variable, then: n1pn1 ≡ p[(pn1)/p] Use this in (1) (interchanging sum & derivative): <n1> = ∑(n1 = 0N) [N!/(n1!(N-n1)!]n1pn1qn2 = ∑(n1 = 0N) [N!/(n1!(N-n1)!]p[(pn1)/p]qn2 = p[/p]∑(n1 = 0N) [N!/(n1!(N-n1)!]pn1qN-n1 = p[/p](p + q)N = pN(p + q)N-1 In our special case (p + q) = 1, (p + q)N-1 = 1, so μ = <n1> = Np

The mean number of steps to <n1> + <n2> = N(p + q) = N Summary: For the Binomial Distribution, The mean number of steps to the right is: <n1> = Np We might have guessed this! Similarly, we can also easily show that The mean number of steps to the left is: <n2> = Nq Of course, <n1> + <n2> = N(p + q) = N as it should!

What is the mean displacement, <x> = <m>ℓ? Question 2: What is the mean displacement, <x> = <m>ℓ? Clearly, m = n1 – n2, so <m> = <n1> - <n2> = N( p – q) & <x> = <m> ℓ = N( p – q)ℓ If p = q = ½, <m> = 0 so, <x> = <m>ℓ = 0

σ2 = <(Δn1)2> = <(n1)2> - (<n1>)2 Question 3: What is the dispersion (variance)? σ2 = <(Δn1)2> = <(n1 - <n1>)2> in the number of steps to the right? That is, what is the spread in n1 values about <n1>? Our general discussion has shown: σ2 = <(Δn1)2> = <(n1)2> - (<n1>)2

σ2 = <(Δn1)2> = <(n1)2> - (<n1>)2 We’ve just seen that the mean  = <n1> = Np So, we first need to calculate <(n1)2> <(n1)2> = ∑(n1 = 0N) (n1)2 WN(n1) = ∑(n1 = 0N) (n1)2[N!/(n1!(N-n1)!]pn1qN-n1 (2) Use a similar “trick” as we did before & note that: (n1)2pn1 ≡ [p(/p)]2pn1

<(n1)2> = (Np)2 + Npq = (<n1>)2 + Npq After math (in the book) & using p + q = 1, we find: <(n1)2> = (Np)2 + Npq = (<n1>)2 + Npq So, finally, using <(Δn1)2> = <(n1)2> - (<n1>)2 σ is the dispersion or variance of the binomial distribution. The root mean square (rms) deviation from the mean is defined in general as:  [<(Δn1)2>]½. For the binomial distribution, this is σ = [Npq]½ Note that σ  The Distribution Width σ2 = <(Δn1)2> = Npq

Summary: For the Binomial Distribution Dispersion or variance in number of steps to right: Root mean square (rms) deviation from the mean: σ  [<(Δn1)2>]½ = [Npq]½ and σ  Distribution Width Again note that: <n1> = Np. So, the relative width of the distribution is: (σ/μ) = [Npq]½(Np) = (q½)(pN)½ If p = q, this is: (σ/μ) = 1(N)½ = (N)-½  As N increases, the mean value increases  N but the relative width decreases  (N)-½ σ2 = <(Δn1)2> = Npq

Question 4: <x2> = <(Δm)2>ℓ2 = <(m - <m>)2>ℓ2 What is the dispersion <x2> = <(Δm)2>ℓ2 = <(m - <m>)2>ℓ2 in the net displacement? Or, what is the spread in m values about <m>? We had, m = n1 – n2 = 2n1 – N. So, <m> = 2<n1> – N. Δm = m - <m> = (2n1 – N) – (2<n1> - N) = 2(n1 – <n1>) = 2(Δn1) (Δm)2 = 4(Δn1)2.So, <(Δm)2> = 4<(Δn1)2> Using <(Δn1)2> = Npq, this becomes: l If p = q = ½, <(Δm)2> = N <(Δm)2> = 4Npq

WN(n1) = [N!/(n1!n2!)]pn1qn2 Relative Width: (/ ) = (q½)(pN)½ Summary: 1 Dimensional Random Walk Problem The Probability Distribution is Binomial: WN(n1) = [N!/(n1!n2!)]pn1qn2 Mean number of steps to the right: μ = <n1> = Np Dispersion in n1: <(Δn1)2> = Npq Relative Width: (/ ) = (q½)(pN)½ for N increasing, the mean value increases  N, & the relative width decreases  (N)-½