The Language of Statistical Decision Making Lecture 2 Section 1.3 Mon, Sep 4, 2006.

Slides:



Advertisements
Similar presentations
Power of a test. power The power of a test (against a specific alternative value) Is a tests ability to detect a false hypothesis Is the probability that.
Advertisements

Pitfalls of Hypothesis Testing + Sample Size Calculations.
CHAPTER 21 More About Tests: “What Can Go Wrong?”.
+ Chapter 10 Section 10.4 Part 2 – Inference as Decision.
SECTION 8.1 BASIC PRINCIPLES OF HYPOTHESIS TESTING Copyright ©2014 The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
Statistical Significance What is Statistical Significance? What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant?
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Statistical Significance What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant? How Do We Know Whether a Result.
Power. The Four Components to a Statistical Conclusion The number of units (e.g., people) accessible to study The salience of the program relative to.
Power and Effect Size.
Lecture 11 Psyc 300A. Null Hypothesis Testing Null hypothesis: the statistical hypothesis that there is no relationship between the variables you are.
Hypothesis : Statement about a parameter Hypothesis testing : decision making procedure about the hypothesis Null hypothesis : the main hypothesis H 0.
Determining Statistical Significance
Business Statistics - QBM117 Introduction to hypothesis testing.
Hypothesis Testing – Introduction
1 © Lecture note 3 Hypothesis Testing MAKE HYPOTHESIS ©
Tuesday, September 10, 2013 Introduction to hypothesis testing.
1 Virtual COMSATS Inferential Statistics Lecture-17 Ossam Chohan Assistant Professor CIIT Abbottabad.
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
AP STATISTICS LESSON 10 – 4 ( DAY 1 ) INFERENCE AS DECISION.
What’s in the Bag? Lecture 4 Section Wed, Sep 7, 2005.
The use & abuse of tests Statistical significance ≠ practical significance Significance ≠ proof of effect (confounds) Lack of significance ≠ lack of effect.
Hypothesis Testing – A Primer. Null and Alternative Hypotheses in Inferential Statistics Null hypothesis: The default position that there is no relationship.
Inferential Statistics Body of statistical computations relevant to making inferences from findings based on sample observations to some larger population.
Errors in Hypothesis Tests. When you perform a hypothesis test you make a decision: When you make one of these decisions, there is a possibility that.
Correct decisions –The null hypothesis is true and it is accepted –The null hypothesis is false and it is rejected Incorrect decisions –Type I Error The.
+ The Practice of Statistics, 4 th edition – For AP* STARNES, YATES, MOORE Unit 5: Hypothesis Testing.
_ z = X -  XX - Wow! We can use the z-distribution to test a hypothesis.
Lecture 6 inferential statistics  Research hypotheses  Statistical hypotheses  Acceptable risks  ‘Real world model’  Decision rules  Experiment report.
1.  What inferential statistics does best is allow decisions to be made about populations based on the information about samples.  One of the most useful.
Major Steps. 1.State the hypotheses.  Be sure to state both the null hypothesis and the alternative hypothesis, and identify which is the claim. H0H0.
Power of a test. power The power of a test (against a specific alternative value) Is In practice, we carry out the test in hope of showing that the null.
Hypothesis Testing Steps for the Rejection Region Method State H 1 and State H 0 State the Test Statistic and its sampling distribution (normal or t) Determine.
Chapter 9: Hypothesis Tests for One Population Mean 9.2 Terms, Errors, and Hypotheses.
Type I and II Errors Power.  Better Batteries a) What conclusion can you make for the significance level α = 0.05? b) What conclusion can you make for.
The Language of Statistical Decision Making Lecture 2 Section 1.3 Mon, Sep 5, 2005.
Chapter 21 More About Hypothesis Tests Using a Single Sample.
Lesson 2: Section 9.1 (part 2).  Interpret a Type I Error and a Type II Error in context, and give the consequences of each.  Understand the relationship.
Ex St 801 Statistical Methods Part 2 Inference about a Single Population Mean (HYP)
The Language of Statistical Decision Making
STA 291 Spring 2010 Lecture 18 Dustin Lueker.
CHAPTER 9 Testing a Claim
Hypothesis Testing – Introduction
MATH 2311 Section 8.2.
A Closer Look at Testing
Chapter Review Problems
Statistical Tests - Power
P-value Approach for Test Conclusion
CHAPTER 9 Testing a Claim
Chapter 9: Hypothesis Testing
The Language of Statistical Decision Making
Chapter Nine Part 1 (Sections 9.1 & 9.2) Hypothesis Testing
Chapter 9: Hypothesis Tests Based on a Single Sample
The Language of Statistical Decision Making
CHAPTER 9 Testing a Claim
The Language of Statistical Decision Making
Lecture 4 Section Wed, Jan 19, 2005
More About Tests Notes from
Power of a test.
Inference Concepts Hypothesis Testing.
Sample Mean Compared to a Given Population Mean
Sample Mean Compared to a Given Population Mean
CHAPTER 9 Testing a Claim
STA 291 Summer 2008 Lecture 18 Dustin Lueker.
Lecture 3 Section – Mon, Aug 30, 2004
Inference as Decision Section 10.4.
CHAPTER 9 Testing a Claim
Lecture 3 Section – Tue, Sep 5, 2006
CHAPTER 9 Testing a Claim
STAT 1301 Tests of Significance about Averages.
Presentation transcript:

The Language of Statistical Decision Making Lecture 2 Section 1.3 Mon, Sep 4, 2006

Errors Recall the game with Envelopes A and B. Recall the game with Envelopes A and B. Our contestant decided that the other envelope was Envelope A. Our contestant decided that the other envelope was Envelope A. Could he have been wrong? Could he have been wrong? What would be the cause of his error? What would be the cause of his error?

Errors Had our contestant concluded that the sampled envelope was Envelope A, could he have been wrong? Had our contestant concluded that the sampled envelope was Envelope A, could he have been wrong? What would be the cause of his error? What would be the cause of his error?

Possible Errors We might reject H 0 when it is true. We might reject H 0 when it is true. This is a Type I error. This is a Type I error. We might accept H 0 when it is false. We might accept H 0 when it is false. This is a Type II error. This is a Type II error. See Making Intelligent Errors, by Walter Williams. See Making Intelligent Errors, by Walter Williams.Making Intelligent ErrorsMaking Intelligent Errors

Decisions and Errors Correct Type I Error Correct Type II Error State of Nature H 0 trueH 0 false Accept H 0 Reject H 0 Decision

Example Consider a study to determine the effectiveness of a new drug. Consider a study to determine the effectiveness of a new drug. What are the two possible conclusions (hypotheses)? What are the two possible conclusions (hypotheses)? Which should get the benefit of the doubt? Which should get the benefit of the doubt? What are the two possible errors? What are the two possible errors? Which is more serious? Which is more serious?

Example Now consider a study to determine the safety of a new drug. Now consider a study to determine the safety of a new drug. What are the two possible conclusions (hypotheses)? What are the two possible conclusions (hypotheses)? Which should get the benefit of the doubt? Which should get the benefit of the doubt? What are the two possible errors? What are the two possible errors? Which is more serious? Which is more serious?

Significance Level Significance Level – The likelihood of rejecting H 0 when it is true, i.e., the likelihood of committing a Type I error. Significance Level – The likelihood of rejecting H 0 when it is true, i.e., the likelihood of committing a Type I error.  – The likelihood of a Type I error.  – The likelihood of a Type I error.  – The likelihood of a Type II error.  – The likelihood of a Type II error. That is,  is the significance level. That is,  is the significance level. The quantity 1 –  is called the power of the test. The quantity 1 –  is called the power of the test.

Significance Level In the Envelope game, what was our contestant’s criterion for deciding which envelope was Envelope A? In the Envelope game, what was our contestant’s criterion for deciding which envelope was Envelope A? Based on this criterion, how likely was he to make a Type I error (I.e., decide the other envelope was Envelope A when in fact he was holding Envelope A)? Based on this criterion, how likely was he to make a Type I error (I.e., decide the other envelope was Envelope A when in fact he was holding Envelope A)? How likely was he to make a Type II error? How likely was he to make a Type II error?

Significance Level The value of  is determined by our criteria for rejecting the null hypothesis. The value of  is determined by our criteria for rejecting the null hypothesis. If we demand overwhelming evidence against H 0 before rejecting it, then  will be small (and  will be large). If we demand overwhelming evidence against H 0 before rejecting it, then  will be small (and  will be large). If we demand little evidence against it, then  will be large (and  will be small). If we demand little evidence against it, then  will be large (and  will be small).

An Interesting Study Porn can make you blind. Porn can make you blind. Porn can make you blind. Porn can make you blind. What were the hypotheses? What were the hypotheses? Describe a Type I error. Describe a Type I error. Describe a Type II error. Describe a Type II error.