Concept of Power ture=player_detailpage&v=7yeA7a0u S3A.

Slides:



Advertisements
Similar presentations
Introduction to Hypothesis Testing
Advertisements

Inferential Statistics
CHAPTER 14: Confidence Intervals: The Basics
Anthony Greene1 Simple Hypothesis Testing Detecting Statistical Differences In The Simplest Case:  and  are both known I The Logic of Hypothesis Testing:
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
Hypothesis Testing making decisions using sample data.
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Inference Sampling distributions Hypothesis testing.
Thursday, September 12, 2013 Effect Size, Power, and Exam Review.
Topic 6: Introduction to Hypothesis Testing
Using Statistics in Research Psych 231: Research Methods in Psychology.
Statistics for the Social Sciences
Evaluating Hypotheses Chapter 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics.
Cal State Northridge  320 Ainsworth Sampling Distributions and Hypothesis Testing.
Evaluating Hypotheses Chapter 9 Homework: 1-9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics ~
Understanding Statistics in Research
Major Points An example Sampling distribution Hypothesis testing
Stat 217 – Day 15 Statistical Inference (Topics 17 and 18)
PY 427 Statistics 1Fall 2006 Kin Ching Kong, Ph.D Lecture 5 Chicago School of Professional Psychology.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Hypothesis Testing and T-Tests. Hypothesis Tests Related to Differences Copyright © 2009 Pearson Education, Inc. Chapter Tests of Differences One.
Testing Hypotheses I Lesson 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics n Inferential Statistics.
Tuesday, September 10, 2013 Introduction to hypothesis testing.
Chapter 8 Introduction to Hypothesis Testing
1 Today Null and alternative hypotheses 1- and 2-tailed tests Regions of rejection Sampling distributions The Central Limit Theorem Standard errors z-tests.
Hypothesis Testing: One Sample Cases. Outline: – The logic of hypothesis testing – The Five-Step Model – Hypothesis testing for single sample means (z.
Chapter 8 Introduction to Hypothesis Testing
Chapter 9 Power. Decisions A null hypothesis significance test tells us the probability of obtaining our results when the null hypothesis is true p(Results|H.
Chapter 11 Testing Hypotheses about Proportions © 2010 Pearson Education 1.
Chapter 20 Testing hypotheses about proportions
S-012 Testing statistical hypotheses The CI approach The NHST approach.
Chapter 21: More About Test & Intervals
CHAPTER 15: Tests of Significance The Basics ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
CHAPTER 9 Testing a Claim
Hypothesis Testing An understanding of the method of hypothesis testing is essential for understanding how both the natural and social sciences advance.
Lecture PowerPoint Slides Basic Practice of Statistics 7 th Edition.
Stats Lunch: Day 3 The Basis of Hypothesis Testing w/ Parametric Statistics.
Hypothesis Testing Introduction to Statistics Chapter 8 Feb 24-26, 2009 Classes #12-13.
A significance test or hypothesis test is a procedure for comparing our data with a hypothesis whose truth we want to assess. The hypothesis is usually.
AP Statistics Chapter 21 Notes
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 9 Testing a Claim 9.1 Significance Tests:
CHAPTER 15: Tests of Significance The Basics ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Inferential Statistics Psych 231: Research Methods in Psychology.
Reasoning in Psychology Using Statistics Psychology
Chapter 9 Testing A Claim 9.1 SIGNIFICANT TESTS: THE BASICS OUTCOME: I WILL STATE THE NULL AND ALTERNATIVE HYPOTHESES FOR A SIGNIFICANCE TEST ABOUT A POPULATION.
+ Testing a Claim Significance Tests: The Basics.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 9 Testing a Claim 9.1 Significance Tests:
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
Statistics for the Social Sciences
Warm Up Check your understanding P. 586 (You have 5 minutes to complete) I WILL be collecting these.
CHAPTER 9 Testing a Claim
Central Limit Theorem, z-tests, & t-tests
Reasoning in Psychology Using Statistics
More about Tests and Intervals
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
Reasoning in Psychology Using Statistics
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
Psych 231: Research Methods in Psychology
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
Statistical Test A test of significance is a formal procedure for comparing observed data with a claim (also called a hypothesis) whose truth we want to.
CHAPTER 9 Testing a Claim
Presentation transcript:

Concept of Power ture=player_detailpage&v=7yeA7a0u S3A

Power is the probability of rejecting the null hypothesis

What affects power?

3. The inherent variability in the measured response variable. As the variability increases, the power of the test of significance decreases. One way to think of this is that a test of significance is like trying to detect the presence of a “signal,” such as the effect of a treatment, and the inherent variability in the response variable is “noise” that will drown out the signal if it is too great. Researchers can’t completely control the variability in the response variable, but they can sometimes reduce it through especially careful data collecting and conscientiously uniform handling of experimental units or subjects. The design of the study may also reduce unexplained variability, and one primary reason for choosing such a design is that it allows for increased power without necessarily having exorbitantly costly sample sizes.

4.The difference between the hypothesized value of a parameter and its true value. This is sometimes called the “magnitude of the effect” in the case when the parameter of interest is the difference between parameter values (say, means) for two treatment groups. The larger the effect, the more powerful the test is. This is because when the effect is large, the true distribution of the test statistic is far from its hypothesized distribution so the two distributions are distinct, and it’s easy to tell which one an observation came from. The intuitive ideas is simply that it’s easier to detect a large effect than a small one.

Example: You send a friend into your bedroom to look for a book that you really need. He comes back and says “it isn’t there”. What do you conclude? Is the book there or not? There is no way to be sure. So let’s express the answer as a probability. The question you really want to answer is: “If the book really is in the bedroom, what is the chance your friend would have found it”? The answer depends on the answers to these questions: How long did he spend looking? If he looked for a long time, he is more likely to have found the book. How big is the book? It is easier to find a text book than a tiny paper back book. How messy is the bedroom? If the bedroom is a real mess, he was less likely to find the book than if it is super organized. How large is the bedroom? It would be easier to find the book in a smaller room than a larger one. So if he spent a long time looking for a large book in an organized bedroom, there is a high chance that he would have found the book it were there. So you can be quite confident of his conclusion that the book isn’t there. If he spent a short time looking for a small book in a messy bedroom, his conclusion that “the book isn’t there” doesn’t really mean very much.

Analogy with sample size and power So how is this related to computing the power of a completed experiment? The question about finding the book, is similar to asking about the power of a completed experiment. Power is the answer to this question: If an effect (of a specified size) really occurs, what is the chance that an experiment of a certain size will find a “statistically significant” result? The time searching the bedroom is analogous to sample size. If you collect more data you have a higher power to find an effect. The size of the book is analogous to the effect size you are looking for. You always have more power to find a big effect than a small one. The messiness of the bedroom is analogous to the standard deviation of your data. You have less power to find an effect if the data are very scattered. If you use a large sample size looking for a large effect using a system with a small standard deviation, there is a high chance that you would have obtained a “statistically significant effect” if it existed. So you can be quite confident of a conclusion of “no statistically significant effect”. But if you use a small sample size looking for a small effect using a system with a large standard deviation, then the find of “no statistically significant effect” really isn’t very helpful.

Conclusion 1.The larger the sample size, the higher the power of the test. 2.The larger the significance level,, the higher the power of the test. 3.The smaller the standard deviation, the larger the power. 4.The larger the size of the discrepancy between the hypothesized value and the true value of the population characteristic, the higher the power.