A Closer Look at Testing

Slides:



Advertisements
Similar presentations
Power of a test. power The power of a test (against a specific alternative value) Is a tests ability to detect a false hypothesis Is the probability that.
Advertisements

Introduction to Hypothesis Testing
Pitfalls of Hypothesis Testing + Sample Size Calculations.
Power and Effect Size Cal State Northridge  320 Andrew Ainsworth PhD.
More about Tests! Remember, you are not proving or accepting the null hypothesis. Most of the time, the null means no difference or no change from the.
CHAPTER 21 More About Tests: “What Can Go Wrong?”.
Statistical Techniques I EXST7005 Lets go Power and Types of Errors.
+ Chapter 10 Section 10.4 Part 2 – Inference as Decision.
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Hypothesis Testing: Type II Error and Power.
State the null and alternative hypotheses.
Determining Statistical Significance
Power of a Test Notes: P 183 and on your own paper.
Hypothesis Testing.
Chapter 8 Hypothesis Testing. Section 8-1: Steps in Hypothesis Testing – Traditional Method Learning targets – IWBAT understand the definitions used in.
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
Hypothesis Testing: One Sample Cases. Outline: – The logic of hypothesis testing – The Five-Step Model – Hypothesis testing for single sample means (z.
Hypothesis testing Chapter 9. Introduction to Statistical Tests.
Unit 8 Section : z Test for a Mean  Many hypotheses are tested using the generalized statistical formula: Test value = (Observed Value)-(expected.
Inferential Statistics Body of statistical computations relevant to making inferences from findings based on sample observations to some larger population.
Errors in Hypothesis Tests. When you perform a hypothesis test you make a decision: When you make one of these decisions, there is a possibility that.
S-012 Testing statistical hypotheses The CI approach The NHST approach.
Power of a Hypothesis test. H 0 True H 0 False Reject Fail to reject Type I Correct Type II Power   Suppose H 0 is true – what if we decide to fail.
Using Inference to MAKE DECISIONS The Type I and Type II Errors in Hypothesis Testing.
Unit 8 Section 8-3 – Day : P-Value Method for Hypothesis Testing  Instead of giving an α value, some statistical situations might alternatively.
Simple examples of the Bayesian approach For proportions and means.
Hypothesis Testing Errors. Hypothesis Testing Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean.
+ The Practice of Statistics, 4 th edition – For AP* STARNES, YATES, MOORE Unit 5: Hypothesis Testing.
Introduction to hypothesis testing Hypothesis testing is about making decisions Is a hypothesis true or false? Ex. Are women paid less, on average, than.
AP Statistics Chapter 21 Notes
Type I and Type II Errors. For type I and type II errors, we must know the null and alternate hypotheses. H 0 : µ = 40 The mean of the population is 40.
Power of a test. power The power of a test (against a specific alternative value) Is In practice, we carry out the test in hope of showing that the null.
If we fail to reject the null when the null is false what type of error was made? Type II.
Chapter 9: Hypothesis Tests for One Population Mean 9.2 Terms, Errors, and Hypotheses.
The Language of Statistical Decision Making Lecture 2 Section 1.3 Mon, Sep 5, 2005.
Chapter 21 More About Hypothesis Tests Using a Single Sample.
Statistics: Unlocking the Power of Data Lock 5 Section 4.3 Determining Statistical Significance.
The Language of Statistical Decision Making Lecture 2 Section 1.3 Mon, Sep 4, 2006.
Warm Up Check your understanding p. 563
Significance Test for the Difference of Two Proportions
Power of a test.
The Language of Statistical Decision Making
Hypothesis Testing: Hypotheses
More about Tests and Intervals
Unit 6 - Comparing Two Populations or Groups
Chapter Review Problems
Statistical Tests - Power
P-value Approach for Test Conclusion
Chapter 9 Hypothesis Testing
Chapter 9: Hypothesis Testing
Section 12.2: Tests about a Population Proportion
Chapter 9: Hypothesis Tests Based on a Single Sample
Hypothesis Tests for Proportions
The Language of Statistical Decision Making
Statistical Inference for Managers
Power Section 9.7.
More About Tests Notes from
Power of a test.
Power of a Hypothesis Test
Power of a test.
Confidence Intervals.
Sample Mean Compared to a Given Population Mean
Sample Mean Compared to a Given Population Mean
Power of a test.
Power Problems.
Inference as Decision Section 10.4.
Power and Error What is it?.
AP STATISTICS LESSON 10 – 4 (DAY 2)
Statistical Power.
STA 291 Spring 2008 Lecture 17 Dustin Lueker.
Presentation transcript:

A Closer Look at Testing Section 4.4 A Closer Look at Testing

Review The p-value of a hypothesis test is 0.02. Using α = 0.05, we Reject H0 Do not reject H0 Reject Ha Do not reject Ha The p-value is less than α, so we reject H0

A new blood thinning drug is being tested against the current drug in a double-blind experiment. Is there evidence that the mean blood thinness rating is higher for the new drug? Using n for the new drug and o for the old drug, which of the following are the null and alternative hypotheses? A. H0: n > o vs Ha: n = o B. H0: n = o vs Ha: n  o C. H0: n = o vs Ha: n > o H0: vs Ha:

A new blood thinning drug is being tested against the current drug in a double-blind experiment, and the hypotheses are: H0: n = o vs Ha: n > o What does a Type 1 Error mean in this situation? We reject H0 We do not reject H0 We find evidence the new drug is better when it is really not better. We are not able to conclude that the new drug is better even though it really is. We are able to conclude that the new drug is better.

A new blood thinning drug is being tested against the current drug in a double-blind experiment, and the hypotheses are: H0: n = o vs Ha: n > o What does a Type 2 Error mean in this situation? We reject H0 We do not reject H0 We find evidence the new drug is better when it is really not better. We are not able to conclude that the new drug is better even though it really is. We are able to conclude that the new drug is better.

Probability of Type I Error How can we reduce the probability of making a Type I Error (rejecting a true null)? Decrease the significance level Increase the significance level

Probability of Type II Error How can we reduce the probability of making a Type II Error (not rejecting a false null)? Decrease the significance level Increase the significance level

H0: n = o vs Ha: n > o A new blood thinning drug is being tested against the current drug in a double-blind experiment, and the hypotheses are: H0: n = o vs Ha: n > o If the new drug has potentially serious side effects, we should pick a significance level that is: Relatively small (such as 1%) Middle of the road (5%) Relatively large (such as 10%) Since a Type 1 error would be serious, we use a small significance level.

H0: n = o vs Ha: n > o A new blood thinning drug is being tested against the current drug in a double-blind experiment, and the hypotheses are: H0: n = o vs Ha: n > o If the new drug has no real side effects and costs less than the old drug, we might pick a significance level that is: Relatively small (such as 1%) Middle of the road (5%) Relatively large (such as 10%) Since a Type 1 error is not at all serious here, we might use a large significance level.

Probability of Type II Error How can we reduce the probability of making a Type II Error (not rejecting a false null)? Decrease the sample size Increase the sample size