Power of a Hypothesis Test

Slides:



Advertisements
Similar presentations
Power of a test. power The power of a test (against a specific alternative value) Is a tests ability to detect a false hypothesis Is the probability that.
Advertisements

Power of a test. power The power of a test (against a specific alternative value) Is the probability that the test will reject the null hypothesis when.
Sample size and statistical power ดร. อรพิน กฤษณเกรียงไกร ดร. อรพิน กฤษณเกรียงไกรคณะสาธารณสุขศาสตร์มหาวิทยาลัยนเรศวร.
There are two statistical tests for mean: 1) z test – Used for large samples (n ≥ 30) 1) t test – Used for small samples (n < 30)
Our goal is to assess the evidence provided by the data in favor of some claim about the population. Section 6.2Tests of Significance.
+ Chapter 10 Section 10.4 Part 2 – Inference as Decision.
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Power of a test. power The power of a test (against a specific alternative value) Is the probability that the test will reject the null hypothesis when.
Power of a Test Notes: P 183 and on your own paper.
Hypothesis testing is used to make decisions concerning the value of a parameter.
Hypothesis Testing.
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
STEP BY STEP Critical Value Approach to Hypothesis Testing 1- State H o and H 1 2- Choose level of significance, α Choose the sample size, n 3- Determine.
Hypothesis Testing – A Primer. Null and Alternative Hypotheses in Inferential Statistics Null hypothesis: The default position that there is no relationship.
Power of a Hypothesis test. H 0 True H 0 False Reject Fail to reject Type I Correct Type II Power   Suppose H 0 is true – what if we decide to fail.
Errors in Hypothesis Tests. When you perform a hypothesis test you make a decision: When you make one of these decisions, there is a possibility that.
Chapter 9: Power I can make really good decisions. Chapter 9: Power Target Goal: I can make really good decisions. 9.1d h.w: pg 548: 23, 25.
+ The Practice of Statistics, 4 th edition – For AP* STARNES, YATES, MOORE Unit 5: Hypothesis Testing.
Goals… Define what is meant by a Type I error. Define what is meant by a Type II error. Define what is meant by the power of a test. Identify the relationship.
Type I and Type II Errors. For type I and type II errors, we must know the null and alternate hypotheses. H 0 : µ = 40 The mean of the population is 40.
Major Steps. 1.State the hypotheses.  Be sure to state both the null hypothesis and the alternative hypothesis, and identify which is the claim. H0H0.
Power of a test. power The power of a test (against a specific alternative value) Is In practice, we carry out the test in hope of showing that the null.
Power of a Test. Remember: Type I error – Reject the H 0 when you shouldn’t have. Type II error - Fail to reject the H o when you should have.
Chapter 9: Hypothesis Tests for One Population Mean 9.2 Terms, Errors, and Hypotheses.
Hypothesis Testing Involving One Population Chapter 11.
+ Homework 9.1:1-8, 21 & 22 Reading Guide 9.2 Section 9.1 Significance Tests: The Basics.
Chapter Nine Hypothesis Testing.
Making Sense of Statistical Significance Inference as Decision
Chapter 9 Hypothesis Testing.
Warm - Up: Are the SAT Math Scores for Pearce higher than other schools? To Test the population SAT Math average score of 510, you randomly select a.
Type I & Type II Errors And Power
Power of a test.
Statistics for the Social Sciences
Example: Propellant Burn Rate
Power of a test.
Power of a test.
CONCEPTS OF HYPOTHESIS TESTING
Errors in Hypothesis Tests
A Closer Look at Testing
P-value Approach for Test Conclusion
Chapter 9 Hypothesis Testing.
Chapter Nine Part 1 (Sections 9.1 & 9.2) Hypothesis Testing
Chapter 9: Hypothesis Tests Based on a Single Sample
Using Inference to Make Decisions
Introduction to Inference
Chapter 3 Probability Sampling Theory Hypothesis Testing.
Power of a Test.
P-VALUE.
Section 10.3 Making Sense of Statistical Significance
Introduction to Inference
STA 291 Spring 2008 Lecture 18 Dustin Lueker.
Chapter 11: Introduction to Hypothesis Testing Lecture 5c
Exercise - 1 A package-filling process at a Cement company fills bags of cement to an average weight of µ but µ changes from time to time. The standard.
More About Tests Notes from
Power of a test.
Power of a test.
Chapter 7: Statistical Issues in Research planning and Evaluation
Power of a test.
Hypothesis Testing and Confidence Intervals (Part 2): Cohen’s d, Logic of Testing, and Confidence Intervals Lecture 9 Justin Kern April 9, 2018.
CHAPTER 9 Testing a Claim
Chapter 9: Testing a Claim
Power of a test.
The POWER of a hypothesis test
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
Power Problems.
Inference as Decision Section 10.4.
AP STATISTICS LESSON 10 – 4 (DAY 2)
Statistical Power.
Inference about Population Mean
Presentation transcript:

Power of a Hypothesis Test

Power (against a specific alternative value) P(we will correctly reject a false H0) We want to show H0 is false, so high power is important

We correctly reject a false H0! H0 True H0 False Reject Fail to Reject Type I Correct α Power Type II Correct β

What is the probability of committing a Type I error? A researcher selects a random sample of size 49 from a population with standard deviation σ = 35 in order to test at the 1% significance level the hypotheses: H0: μ = 680 Ha: μ > 680 What is the probability of committing a Type I error? α = .01

H0: μ = 680 Ha: μ > 680 For what values of the sample mean would you reject the null hypothesis? x-bar must be in top 1% invNorm(.99, 680, 5) = 691.63 or higher

What is the power of the test? If H0 is false, suppose that μa is really 700. What is the probability of committing a Type II error? What is the power of the test? Fail to reject H0  x-bar must be below 691.63 β = normalcdf(-1E99, 691.63, 700, 5) = .0471 Power = 1 – .0471 = .9529

What is the power of the test? If H0 is false, suppose that μa is really 695. What is the probability of committing a Type II error? What is the power of the test? β = normalcdf(-1E99, 691.63, 695, 5) = .2502 Power = 1 – .2502 = .7498

Fail to Reject H0 Reject H0 α μ0 ma Power = 1 – β β

As n increases, what happens to α, β, and power? Fail to Reject H0 Reject H0 a m0 b ma

So what do we know? We choose α We can't control β, since it depends on the alternate mean Ideally: have α as small as possible and power close to 1 (we like power > .8) As α increases, power increases… but so has the chance of a type I error! Best way to increase power, without increasing α, is to increase sample size (n)

Identify the decision: A water quality control board reports that water is unsafe for drinking if the mean nitrate concentration exceeds 30 ppm. Water specimens are taken at random from a well. Identify the decision: a) You decide that the water is not safe to drink when it really is safe. Type I Error

Identify the decision: A water quality control board reports that water is unsafe for drinking if the mean nitrate concentration exceeds 30 ppm. Water specimens are taken at random from a well. Identify the decision: a) You decide that the water is not safe to drink when it really is not safe. Correct – Power!

Hamburgers from a popular fast food chain are supposed to contain 300 calories. A consumer group believes the restaurant is making burgers with too many calories. They plan to take a random sample of 30 burgers. Based on past studies, the standard deviation of burger calories at this restaurant is 50. Find the power of this test against the alternative μ = 330 calories.

Reject: invNorm (.95, 300, 9.13) = 315.02 or higher Power = normalcdf(315.02, 1E99, 330, 9.13) Power = 0.9496