Chapter 21: More About Tests “The wise man proportions his belief to the evidence.” -David Hume 1748.

Slides:



Advertisements
Similar presentations
Statistics.  Statistically significant– When the P-value falls below the alpha level, we say that the tests is “statistically significant” at the alpha.
Advertisements

Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 21 More About Tests.
Testing Hypotheses About Proportions Chapter 20. Hypotheses Hypotheses are working models that we adopt temporarily. Our starting hypothesis is called.
Copyright © 2010 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
© 2013 Pearson Education, Inc. Active Learning Lecture Slides For use with Classroom Response Systems Introductory Statistics: Exploring the World through.
Chapter 9 Hypothesis Testing.
BCOR 1020 Business Statistics
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 21 More About Tests.
Warm-up Day of 8.1 and 8.2 Quiz and Types of Errors Notes.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 9 Hypothesis Testing.
Overview of Statistical Hypothesis Testing: The z-Test
Chapter 20: Testing Hypotheses about Proportions
Introduction to Hypothesis Testing for μ Research Problem: Infant Touch Intervention Designed to increase child growth/weight Weight at age 2: Known population:
Chapter 8 Hypothesis testing 1. ▪Along with estimation, hypothesis testing is one of the major fields of statistical inference ▪In estimation, we: –don’t.
Testing Hypotheses About Proportions
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 20 Testing Hypotheses About Proportions.
Section 9.1 Introduction to Statistical Tests 9.1 / 1 Hypothesis testing is used to make decisions concerning the value of a parameter.
More About Tests and Intervals Chapter 21. Zero In on the Null Null hypotheses have special requirements. To perform a hypothesis test, the null must.
+ Chapter 9 Summary. + Section 9.1 Significance Tests: The Basics After this section, you should be able to… STATE correct hypotheses for a significance.
Chapter 8 Introduction to Hypothesis Testing
Significance Tests: THE BASICS Could it happen by chance alone?
Copyright © 2009 Pearson Education, Inc. Chapter 21 More About Tests.
Chapter 11 Testing Hypotheses about Proportions © 2010 Pearson Education 1.
Chapter 20 Testing hypotheses about proportions
Hypotheses tests for means
Lecture 16 Dustin Lueker.  Charlie claims that the average commute of his coworkers is 15 miles. Stu believes it is greater than that so he decides to.
CHAPTER 17: Tests of Significance: The Basics
Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 20 Testing Hypotheses About Proportions.
Copyright © 2012 Pearson Education. Chapter 13 Testing Hypotheses.
1 Chapter 10: Introduction to Inference. 2 Inference Inference is the statistical process by which we use information collected from a sample to infer.
Statistical Hypotheses & Hypothesis Testing. Statistical Hypotheses There are two types of statistical hypotheses. Null Hypothesis The null hypothesis,
CHAPTER 9 Testing a Claim
Significance Test A claim is made. Is the claim true? Is the claim false?
Copyright © 2010 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
Lecture 16 Section 8.1 Objectives: Testing Statistical Hypotheses − Stating hypotheses statements − Type I and II errors − Conducting a hypothesis test.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 8 Hypothesis Testing.
Introduction to the Practice of Statistics Fifth Edition Chapter 6: Introduction to Inference Copyright © 2005 by W. H. Freeman and Company David S. Moore.
Economics 173 Business Statistics Lecture 4 Fall, 2001 Professor J. Petry
Chapter 20 Testing Hypothesis about proportions
Lecture 18 Dustin Lueker.  A way of statistically testing a hypothesis by comparing the data to values predicted by the hypothesis ◦ Data that fall far.
Chapter 21: More About Test & Intervals
1-1 Copyright © 2015, 2010, 2007 Pearson Education, Inc. Chapter 20, Slide 1 Chapter 20 More about Tests and Intervals.
Ch 10 – Intro To Inference 10.1: Estimating with Confidence 10.2 Tests of Significance 10.3 Making Sense of Statistical Significance 10.4 Inference as.
Lecture 17 Dustin Lueker.  A way of statistically testing a hypothesis by comparing the data to values predicted by the hypothesis ◦ Data that fall far.
CHAPTER 9 Testing a Claim
Lecture PowerPoint Slides Basic Practice of Statistics 7 th Edition.
Slide 21-1 Copyright © 2004 Pearson Education, Inc.
Chapter 21: More About Tests
Math 4030 – 9a Introduction to Hypothesis Testing
AP Statistics Chapter 11 Notes. Significance Test & Hypothesis Significance test: a formal procedure for comparing observed data with a hypothesis whose.
AP Statistics Chapter 21 Notes
Understanding Basic Statistics Fourth Edition By Brase and Brase Prepared by: Lynn Smith Gloucester County College Chapter Nine Hypothesis Testing.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Slide
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 9 Testing a Claim 9.2 Tests About a Population.
Uncertainty and confidence Although the sample mean,, is a unique number for any particular sample, if you pick a different sample you will probably get.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 9 Testing a Claim 9.1 Significance Tests:
CHAPTER 15: Tests of Significance The Basics ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Slide 20-1 Copyright © 2004 Pearson Education, Inc.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
Statistics 20 Testing Hypothesis and Proportions.
Copyright © 2010 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
Section Testing a Proportion
Chapter 21 More About Tests.
More about Tests and Intervals
More About Tests and Intervals
Chapter Nine Part 1 (Sections 9.1 & 9.2) Hypothesis Testing
Presentation transcript:

Chapter 21: More About Tests “The wise man proportions his belief to the evidence.” -David Hume 1748

The Null Hypothesis The null must be a statement about the value of a parameter from a model The value for the parameter in the null hypothesis is found within the context of the problem Use this value to compute the probability that the observed sample statistic would occur The appropriate null arises from the context of the problem Think about the WHY of the situation

Another One-Proportion z-Test Null – the therapeutic touch practitioners are just guessing, so they’ll succeed about half the time. A one-sided test seems appropriate Parameter: the proportion of successful identifications

Another One-Proportion z-Test Check the conditions: Independence Randomization 10% condition Success/failure Independence: the hand choice was randomly selected, so the trials should be independent Randomization: the experiment was randomized by flipping a coin 10% condition: the experiment observes some of what could be an infinite number of trials Success/failure:

Another One-Proportion z-Test State the null model Name the test Because the conditions are satisfied, it is appropriate to model the sampling distribution of the proportion with the model We can perform a one-proportion z-test

Another One-Proportion z-Test Find the standard deviation of the sampling model using the hypothesized proportion,

Another One-Proportion z-Test Sketch of Normal model Find the z-score Find the P- value Observed proportion

Another One-Proportion z-Test Conclusion Link the P-value to your decision about the null hypothesis State your conclusion in context If possible, state a course of action If the true proportion of successful detections of a human energy field is 50%, then an observed proportion of 46.7% successes or more would occur at random about 80% of the time. That is not a rare event, so we do not reject the null hypothesis There is insufficient evidence to conclude that the practitioners are performing better than they would have by guessing.

P-values A P-value is a conditional probability A P-value is the probability of the observed statistic given that the null hypothesis is true The P-value is not the probability that the null hypothesis is true A small P-value tells us that our data are rare given the null hypothesis

Alpha Levels Alpha level An arbitrarily set threshold for our P-value Also called the significance level Must be selected prior to looking at the data If our P-value falls below that point, we’ll reject the null hypothesis The result is called statistically significant When we reject the null hypothesis, we say that the test is “significant at that level” Common alpha levels:.10,.05,.01

Therapeutic Touch Revisited The P-value was.7929 This is well above any reasonable alpha level Therefore, we cannot reject the null hypothesis. Conclusion: “we fail to reject the null hypothesis.” There is insufficient evidence to conclude that the practitioners are performing better than if they were just guessing

Absolutes: Are You Uncomfortable? Reject/fail to reject decision when we use an alpha level is absolute If your P-value falls just slightly above the alpha level, you do not reject the null hypothesis. However, if your P-value falls just slightly below, you do reject the null hypothesis Perhaps it is better to report the P-value as an indicator of the strength of the evidence when making a decision

“Statistically Significant” We mean that the test value has a P-value lower than our alpha level For large samples, even small deviations from the null hypothesis can be statistically significant When the sample is not large enough, even very large differences may not be statistically significant Report the magnitude of the difference between the statistic and the null hypothesis when reporting the P- value

Critical Values Again Critical values can be used as a shortcut for the hypothesis tests Check your z-score against the critical values Any z-score larger in magnitude than a particular critical value has to be less likely, so it will have a P-value smaller than the corresponding probability α1-sided2-sided

TT Revisited Again A 90% confidence interval would give We could not reject because 50% is a plausible value for the practitioners’ true success Any value outside the confidence interval would make a null hypothesis that we would reject; we’d feel more strongly about values far outside the interval

Confidence Intervals & Hypothesis Tests Confidence intervals and hypothesis tests have the same assumptions and conditions Because confidence intervals are naturally two-sided, they correspond to two-sided tests A confidence interval with a confidence level of C% corresponds to a two-sided hypothesis test with an  level of 100 – C% A confidence interval with a confidence of C% corresponds to a on-sided hypothesis test with an  level of ½ (100 – C%)

“Click It or Ticket” If there is evidence that fewer than 80% of drivers are buckling up, campaign will continue  Check conditions Independence: Drivers are not likely to influence each others’ seatbelt habits Randomization: we can assume that the drivers are representative of the driving public 10%: Police stopped fewer than 10% of drivers Success/Failure: there were 101 successes and 33 failures; both are greater than 10. The sample is large enough *Use a one-proportion z-interval

“Click It or Ticket” To test the one-tailed hypothesis at the 5% level of significance, construct a 90% confidence interval Determine the standard error of the sample proportion and the margin of error

“Click It or Ticket” – Conclusion We can be 90% confident that between 69% and 81% of all drivers wear their seatbelts. Because the hypothesized rate of 80% is within this interval, we cannot reject the null hypothesis. There is insufficient evidence to conclude that fewer than 80% of all drivers are wearing seatbelts.

Making Errors When we perform a hypothesis test, we can make mistakes in two ways: 1. The null hypothesis is true, but we reject it. 2. The null hypothesis is false, but we fail to reject it. The Truth H O TrueH O False My Decision Reject H O Type I ErrorPower My Decision Retain H O OKType II Error

Type I Errors Type I errors occur when the null hypothesis is true but we’ve had the bad luck to draw an unusual sample. To reject H O, the P-value must fall below . When you choose level , you’re setting the probability of a Type I error.

Type II Errors When H O is false, and we fail to reject it, we have made a Type II error (  ). There is no single value for . We can compute the probability  for any parameter value in H A. Think about effect: how big a difference would matter?

Type I vs. Type II We can reduce  for all values in the alternative, by increasing . If we make it easier to reject the null hypothesis, we’re more likely to reject it whether it’s true or not However, we would make more Type I errors The only way to reduce both types of errors is to collect more data. (Larger sample size)

Power Our ability to detect a false hypothesis is called the power of a test. When the null hypothesis is actually false, we want to know the likelihood that our test is strong enough to reject it. The power of a test is the probability that it correctly rejects a false hypothesis.

Power  is the probability that a test fails to reject a false hypothesis, so the power of a test is The value of power depends on how far the truth lies from the null hypothesis value. The distance between the null hypothesis value, p O, and the truth, p, is the effect size

What Can Go Wrong??? Don’t change the null hypothesis after you look at the data. Don’t base your alternative hypothesis on the data. Don’t make what you want to show into your null hypothesis Don’t interpret the P-value as the probability that H O is true

What Can Go Wrong??? Don’t believe too strongly in arbitrary alpha values Don’t confuse practical and statistical significance Despite all precautions, errors (Type I or II) may occur Always check the conditions