The standard error of the sample mean and confidence intervals How far is the average sample mean from the population mean? In what interval around mu.

Slides:



Advertisements
Similar presentations
Statistics Review.
Advertisements

A Sampling Distribution
Sampling: Final and Initial Sample Size Determination
Chapter 5 Introduction to Inferential Statistics.
T scores and confidence intervals using the t distribution.
The standard error of the sample mean and confidence intervals
t scores and confidence intervals using the t distribution
The standard error of the sample mean and confidence intervals
Chapter 5 Introduction to Inferential Statistics.
Topics: Inferential Statistics
Chapter 1 The mean, the number of observations, the variance and the standard deviation.
Correlation 2 Computations, and the best fitting line.
Correlation 2 Computations, and the best fitting line.
Confidence intervals using the t distribution. Chapter 6 t scores as estimates of z scores; t curves as approximations of z curves Estimated standard.
1 The Basics of Regression Regression is a statistical technique that can ultimately be used for forecasting.
Chapter 4 Translating to and from Z scores, the standard error of the mean and confidence intervals Welcome Back! NEXT.
1 Hypothesis Testing In this section I want to review a few things and then introduce hypothesis testing.
1 More about the Confidence Interval of the Population Mean.
The standard error of the sample mean and confidence intervals How far is the average sample mean from the population mean? In what interval around mu.
Chapter 5 Introduction to Inferential Statistics.
Chapter 1 The mean, the number of observations, the variance and the standard deviation.
Chapter 1 The mean, the number of observations, the variance and the standard deviation.
Sampling We have a known population.  We ask “what would happen if I drew lots and lots of random samples from this population?”
Wednesday, October 3 Variability. nominal ordinal interval.
Need to know in order to do the normal dist problems How to calculate Z How to read a probability from the table, knowing Z **** how to convert table values.
Chapter 1-6 Review Chapter 1 The mean, variance and minimizing error.
C82MCP Diploma Statistics School of Psychology University of Nottingham 1 Overview Central Limit Theorem The Normal Distribution The Standardised Normal.
1 The Sample Mean rule Recall we learned a variable could have a normal distribution? This was useful because then we could say approximately.
T scores and confidence intervals using the t distribution.
Chapter 7 Probability and Samples: The Distribution of Sample Means
Chapter 11: Random Sampling and Sampling Distributions
Determining the Size of
QUIZ CHAPTER Seven Psy302 Quantitative Methods. 1. A distribution of all sample means or sample variances that could be obtained in samples of a given.
1 Psych 5500/6500 Statistics and Parameters Fall, 2008.
Standard Error of the Mean
Chapter 6: Sampling Distributions
Confidence Intervals. Estimating the difference due to error that we can expect between sample statistics and the population parameter.
© Copyright McGraw-Hill CHAPTER 6 The Normal Distribution.
Essentials of Marketing Research
Estimation Statistics with Confidence. Estimation Before we collect our sample, we know:  -3z -2z -1z 0z 1z 2z 3z Repeated sampling sample means would.
Introductory Statistics for Laboratorians dealing with High Throughput Data sets Centers for Disease Control.
A Sampling Distribution
Dan Piett STAT West Virginia University
Estimation of Statistical Parameters
PARAMETRIC STATISTICAL INFERENCE
Smith/Davis (c) 2005 Prentice Hall Chapter Six Summarizing and Comparing Data: Measures of Variation, Distribution of Means and the Standard Error of the.
The Guessing Game The entire business of Statistics is dedicated to the purpose of trying to guess the value of some population parameter. In what follows.
Chapter 18: Sampling Distribution Models
Chapter 7 Estimation Procedures. Basic Logic  In estimation procedures, statistics calculated from random samples are used to estimate the value of population.
Objectives The student will be able to: find the variance of a data set. find the standard deviation of a data set.
1 Psych 5500/6500 The t Test for a Single Group Mean (Part 1): Two-tail Tests & Confidence Intervals Fall, 2008.
Dr. Serhat Eren 1 CHAPTER 6 NUMERICAL DESCRIPTORS OF DATA.
1 Chapter 7 Sampling Distributions. 2 Chapter Outline  Selecting A Sample  Point Estimation  Introduction to Sampling Distributions  Sampling Distribution.
Chapter 18: Sampling Distribution Models
Sampling distributions rule of thumb…. Some important points about sample distributions… If we obtain a sample that meets the rules of thumb, then…
Stats Lunch: Day 3 The Basis of Hypothesis Testing w/ Parametric Statistics.
© 2008 McGraw-Hill Higher Education The Statistical Imagination Chapter 8. Parameter Estimation Using Confidence Intervals.
1 Mean Analysis. 2 Introduction l If we use sample mean (the mean of the sample) to approximate the population mean (the mean of the population), errors.
INFERENTIAL STATISTICS DOING STATS WITH CONFIDENCE.
Ex St 801 Statistical Methods Inference about a Single Population Mean (CI)
The accuracy of averages We learned how to make inference from the sample to the population: Counting the percentages. Here we begin to learn how to make.
Monday, September 27 More basics.. _ “Life is a series of samples, you can infer the truth from the samples but you never see the truth.”
Sample Means. Parameters The mean and standard deviation of a population are parameters. Mu represents the population mean. Sigma represents the population.
Chapter 6: Sampling Distributions
GOVT 201: Statistics for Political Science
The Normal Distribution
Distribution of the Sample Means
Chapter 18: Sampling Distribution Models
Introduction to Sampling Distributions
Presentation transcript:

The standard error of the sample mean and confidence intervals How far is the average sample mean from the population mean? In what interval around mu can we expect to find 95% or 99% or sample means

An introduction to random samples When we speak about samples in statistics, we are talking about random samples. Random samples are samples that are obtained in line with very specific rules. If those rules are followed, the sample will be representative of the population from which it is drawn.

Random samples: Some principles In a random sample, each and every score must have an equal chance of being chosen each time you add a score to the sample. Thus, the same score can be selected more than once, simply by chance. (This is called sampling with replacement.) The number of scores in a sample is called “n.” (Small n, not capital N.) Sample statistics based on random samples provide least squared, unbiased estimates of their population parameters.

The first way a random sample is representative of its population One way a random sample will be representative of the population is that the sample mean will be a good estimate of the population mean. Sample means are better estimates of mu than are individual scores. Thus, on the average, sample means are closer to mu than are individual scores.

The variance and the standard deviation are the basis for the rest of this chapter. In Chapter 1 you learned to compute the average squared distance of individual scores from mu. We called it the variance. Taking a square root, you got the standard deviation. Now we are going to ask a slightly different question and transform the variance and standard deviation in another way.

As you add scores to a random sample Each randomly selected score tends to correct the sample mean back toward mu If we have several samples drawn from a single population, as we add scores to each sample, each sample mean gets closer to mu. Since they are all getting closer to mu, they will also be getting closer to each other.

As you add scores to a random sample – larger vs. smaller samples The larger the random samples, the closer their means will be to mu, on the average. The larger the random samples, the closer their means will be to each other, on the average.

Let’s see how that happens Population is 1320 students taking a test.  is 72.00,  = 12 Let’s randomly sample one student at a time and see what happens.We’ll create a random sample with 8 students’ scores in the sample.

Test Scores FrequencyFrequency score Sample scores: Standard deviations Scores Mean 87 Means:

Which sample means are likely to be closer to each other. 1. The means of three random samples, each with an n of The means of three random samples, each with an n of 5

The larger samples should be closer, on the average, to mu, and therefore closer to each other.

How much closer to mu does the sample mean get when you increase n, the size of the sample? (1) The average squared distance of individual scores is called the variance. You learned to compute it in Chapter 1. The symbol for the mean of a sample is the letter X with a bar over it.We will write that as X-bar or

How much closer to mu does the sample mean get when you increase n, the size of the sample? (2) The average squared distance of sample means from mu is the average squared distance of individual scores from mu divided by n, the size of the sample. Let’s put that in a formula sigma 2 X-bar = sigma 2 = sigma 2 /n

The standard error of the sample mean As you know, the square root of the variance is called the standard deviation. It is the average unsquared distance of individual scores from mu. The average unsquared distance of sample means from mu is the square root of sigma 2 X-bar The square root of sigma 2 X-bar = sigma X-bar. sigma X-bar is called the standard error of the sample mean or, more briefly, the standard error of the mean. Here are the formulae sigma 2 X-bar = sigma 2 /n sigma X-bar = sigma/

The standard error of the mean Let’s translate the formula into English, just to be sure you understand it. Here is the formula again: sigma X-bar = sigma/ In English: The standard error of the sample mean equals the ordinary standard deviation divided by the square root of the sample size.

Another way to say that: The average unsquared distance of sample means from the population mean (mu) equals the average unsquared distance of individual scores from the population mean divided by the square root of the sample size.

Still another way to say the same thing. The standard error of the mean is the standard deviation of the sample means around mu. This sometimes confuses people. If it confuses you, just remember: The standard error of the mean is the averaged unsquared distance of sample means from mu.

Let’s check and make sure that the formula is correct. Let’s see that the standard error equals the ordinary standard deviation divided by the square root of n. To do that, let’s start with a tiny population: N=5 Here are all the scores in a population: 1,3,5,7,9. The scores in this population form a perfectly rectangular distribution. Mu = 5.00

Computing sigma SS=(1-5) 2 +(3-5) 2 +(5-5) 2 + (7-5) 2 + (9-5) 2 =40 sigma 2 =SS/N=40/5=8.00 sigma = 2.83

If we did compute a standard deviation of sample means from mu, it should give the same result as the formula Let’s see if it does. We can only do all the computations if we have a very small population and an even tinier sample. Let’s use the population of 5 scores we just looked at (sigma = 2.83). We’ll use samples with n = 2. If the formula is right, the average unsquared distance of sample means, n=2, should be 2.83/ = 2.83/1.414 = Is that right? To find out, let’s compute the standard error of the mean from the differences between the means of all possible samples (n=2) from mu (the mean from the population of scores 1,3,5,7,9).

The standard error = the standard deviation divided by the square root of n, the sample size The formula works. And it works every time. By the way the mean of the samples (125/25=5.00 = mu) is the mean of the population. And that works every time too.

Let’s see what sigma X-bar can tell us We know that the mean of SAT/GRE scores = 500 and sigma = 100 So 68.26% of individuals will score between 400 and 600 and 95.44% will score between 300 and 700 REMEMBER THAT SAMPLE MEANS FALL CLOSER TO MU, ON THE AVERAGE, THAN DO INDIVIDUAL SCORES.

What happens when we take random samples with n=4? The standard error of the mean is sigma divided by the square root of the sample size = 100/ =100/2= These sample means will form a lovely normal curve around the population mean (mu=500) with a standard deviation equal to the standard error of the mean = % of the sample means (n=4) will be within 1.00 standard error of the mean from mu and 95.44% will be within 2.00 standard errors of the mean from mu So, 68.26% of the sample means (n=4) will be between 450 and 550 and 95.44% will fall between 400 and 600

Let’s make the samples larger Take random samples of SAT scores, with 400 people in each sample, the standard error of the mean is sigma divided by the square root of 400 = 100/ = 100/20=5.00. These sample means will form a lovely normal curve around the population mean (mu=500) with a standard deviation equal to the standard error of the mean = % of the sample means will be within 1.00 standard error of the mean from mu and 95.44% will be within 2.00 standard errors of the mean from mu. So, 68.26% of the sample means (n=400) will be between 495 and 505 and 95.44% will fall between 490 and 510.

You try it with random samples of verbal SAT scores, with 2500 people in each sample. In what interval can we expect that 68.26% of the sample means will fall? In what interval can we expect 95.44% of the sample means to fall?

With n= 2500, the standard error of the mean is sigma divided by the square root of 2500 = 100/50=2.00. So on the verbal part of the SAT, the average (unsquared) distance of samples (n=2500) is 2.00 points 68.26% of the sample means will be within 1.00 standard error of the mean from mu and 95.44% will be within 2.00 standard errors of the mean from mu % of the sample means (n=2500) will be between 498 and 502 and 95.44% will fall between 496 and 504

A slightly tougher question Using SAT scores, with n=2500: Into what interval should 95% of the sample means fall?

A slightly tougher question 95% of the sample means should fall within standard errors of the mean from mu. Given that sigma X-bar =2.00, you multiply * sigma X-bar = x 2.00 = 3.92

Thus: 95% of the sample means should fall in an interval that goes 3.92 points in both directions around mu 500 – 3.92 = = So 95% of sample means (n=2500) should fall between and

The Central Limit Theorem

What happens as n increases? The sample means get closer to each other and to mu. Their average squared distance from mu equals the variance divided by the size of the sample. Therefore, their average unsquared distance from mu equals the standard deviation divided by the square root of the size of the sample. The sample means fall into a more and more perfect normal curve. These facts are called “The Central Limit Theorem” and can be proven mathematically.

CONFIDENCE INTERVALS

We want to define two intervals around mu: One interval into which 95% of the sample means will fall. Another interval into which 99% of the sample means will fall.

95% of sample means will fall in a symmetrical interval around mu that goes from standard errors below mu to standard errors above mu A way to write that fact in statistical language is: CI.95 : mu sigma X-bar or CI.95 : mu sigma X-bar < X-bar < mu sigma X-bar

As I said, 95% of sample means will fall in a symmetrical interval around mu that goes from standard errors below mu to standard errors above mu Take samples of SAT/GRE scores (n=400) Standard error of the mean is sigma divided by the square root of n=100/ = 100/20.00= standard errors of the mean with such samples = (5.00)= 9.80 So 95% of the sample means with n=400 can be expected to fall in the interval = and = CI.95 : mu sigma X-bar = or CI.95 : < X-bar <

99% of sample means will fall within standard errors from mu Take the same samples of SAT/GRE scores (n=400) The standard error of the mean is sigma divided by the square root of n=100/20.00= standard errors of the mean with such samples = (5.00)= So 99% of the sample means can be expected to fall in the interval = and = CI.99 : mu sigma X-bar = or CI.99 : < the sample mean <

You do one. What is the 95% confidence interval for samples of 25 randomly selected IQ scores? To do the problem, first compute the standard error for samples of 25 IQ scores IQ: mu =100, sigma = 15

Compute sigma X-bar First compute the standard error for samples of 25 IQ scores IQ: mu =100, sigma = 15 Standard error for samples of size 25 is 15 divided by the square root of 25 = 15/5.00 =3.00

IQ scores – Interval into which 95% of samples n=25 should fall, sigma = % of the sample means should fall within standard errors of mu = (3.00) = 5.88 points = and = So, 95% of sample means (n=25) for IQ scores should fall into the range from to

How do we express that as a 95% confidence interval? 95% of the sample means should fall within standard errors of mu = (3.00) = 5.88 points = and = To express that as a confidence interval, we can write it in either of two ways CI.95 : mu sigma X-bar = or CI.95 : < X-bar <