POWER CALCULATIONS David Gardner School of Veterinary Medicine

Slides:



Advertisements
Similar presentations
Chapter 13 and 14. Error  Type 1: False positive. The effect was not really present, but our statistics lead us to believe that it is.  Type 2: False.
Advertisements

Business 205. Review Sampling Continuous Random Variables Central Limit Theorem Z-test.
Chapter Seventeen HYPOTHESIS TESTING
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
DATA ANALYSIS I MKT525. Plan of analysis What decision must be made? What are research objectives? What do you have to know to reach those objectives?
Cal State Northridge  320 Ainsworth Sampling Distributions and Hypothesis Testing.
Chapter 6 Hypotheses texts. Central Limit Theorem Hypotheses and statistics are dependent upon this theorem.
Hypothesis Testing: Type II Error and Power.
Chapter 9 Hypothesis Testing.
Hypothesis Testing Is It Significant?. Questions What is a statistical hypothesis? What is the null hypothesis? Why is it important for statistical tests?
Choosing Statistical Procedures
Jeopardy Hypothesis Testing T-test Basics T for Indep. Samples Z-scores Probability $100 $200$200 $300 $500 $400 $300 $400 $300 $400 $500 $400.
Chapter 8 Introduction to Hypothesis Testing
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
Copyright © 2012 by Nelson Education Limited. Chapter 7 Hypothesis Testing I: The One-Sample Case 7-1.
Individual values of X Frequency How many individuals   Distribution of a population.
Chapter 10: Analyzing Experimental Data Inferential statistics are used to determine whether the independent variable had an effect on the dependent variance.
Statistical Hypotheses & Hypothesis Testing. Statistical Hypotheses There are two types of statistical hypotheses. Null Hypothesis The null hypothesis,
Statistics in Biology. Histogram Shows continuous data – Data within a particular range.
Statistical Power The power of a test is the probability of detecting a difference or relationship if such a difference or relationship really exists.
Chapter 9 Introduction to the t Statistic. 9.1 Review Hypothesis Testing with z-Scores Sample mean (M) estimates (& approximates) population mean (μ)
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Statistical Testing of Differences CHAPTER fifteen.
Chi Squared Test. Why Chi Squared? To test to see if, when we collect data, is the variation we see due to chance or due to something else?
Using Inference to MAKE DECISIONS The Type I and Type II Errors in Hypothesis Testing.
Stats Lunch: Day 3 The Basis of Hypothesis Testing w/ Parametric Statistics.
Inen 460 Lecture 2. Estimation (ch. 6,7) and Hypothesis Testing (ch.8) Two Important Aspects of Statistical Inference Point Estimation – Estimate an unknown.
© Copyright McGraw-Hill 2004
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
Results: How to interpret and report statistical findings Today’s agenda: 1)A bit about statistical inference, as it is commonly described in scientific.
CHAPTER 1 EVERYTHING YOU EVER WANTED TO KNOW ABOUT STATISTCS.
Chapter 13 Understanding research results: statistical inference.
Hypothesis Tests. An Hypothesis is a guess about a situation that can be tested, and the test outcome can be either true or false. –The Null Hypothesis.
Chapter 7: Hypothesis Testing. Learning Objectives Describe the process of hypothesis testing Correctly state hypotheses Distinguish between one-tailed.
Critical Appraisal Course for Emergency Medicine Trainees Module 2 Statistics.
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 11: Between-Subjects Designs 1.
Lecture Notes and Electronic Presentations, © 2013 Dr. Kelly Significance and Sample Size Refresher Harrison W. Kelly III, Ph.D. Lecture # 3.
More on Inference.
Chapter 9 Hypothesis Testing.
Chapter 5 STATISTICAL INFERENCE: ESTIMATION AND HYPOTHESES TESTING
The ability to find a difference when one really exists.
Statistics made simple Dr. Jennifer Capers
Hypothesis Testing Is It Significant?.
SEMINAR ON ONE WAY ANOVA
Power Analysis and Meta-analysis
Inference and Tests of Hypotheses
Understanding Results
Hypothesis Testing and Confidence Intervals (Part 1): Using the Standard Normal Lecture 8 Justin Kern October 10 and 12, 2017.
Hypothesis Testing Review
© LOUIS COHEN, LAWRENCE MANION AND KEITH MORRISON
Hypothesis Testing Is It Significant?.
Hypothesis Testing: Hypotheses
Hypothesis Testing Summer 2017 Summer Institutes.
Statistical Analysis of Data
Setting significance levels at the correct level
More on Inference.
P-value Approach for Test Conclusion
Chapter 6 Making Sense of Statistical Significance: Decision Errors, Effect Size and Statistical Power Part 1: Sept. 18, 2014.
Analysis of Variance (ANOVA)
What I learned in statistics
Hypothesis Testing and Comparing Two Proportions
Chapter 12 Power Analysis.
Standard Deviation & Standard Error
Facts from figures Having obtained the results of an investigation, a scientist is faced with the prospect of trying to interpret them. In some cases the.
Chapter 9: Testing a Claim
Chapter 9: Significance Testing
Calculating t X -  t = s x X1 – X2 t = s x1 – x2 s d One sample test
Type I and Type II Errors
Statistical Power.
Rest of lecture 4 (Chapter 5: pg ) Statistical Inferences
CHI SQUARE (χ2) Dangerous Curves Ahead!.
Presentation transcript:

POWER CALCULATIONS David Gardner School of Veterinary Medicine University of Nottingham

POWER CALCULATIONS What are they? Why do them? Examples

POWER CALCULATIONS What are they? Why so them? Examples

POWER CALCULATIONS Conventional power analysis addresses the question: for a given null hypothesis (H0) or alternative hypothesis (H1) and at a given sample size and variation... ...what is the probability of rejecting H0 when H1 is actually true (and H0 is false). This probability is called statistical power. The inverse i.e. (1 – power) = gives the related quantity, b, the probability of rejecting H0 when H0 is true (and H1 is false)..i.e. Type II error.

Factors influencing POWER Sample size Power increases as sample size increases

Factors influencing POWER Effect size A hypothesis test has greater chance of detecting real difference if effect is large rather than small, therefore can have less n

Factors influencing POWER Increasing sample size..... Variability More power with less variation, less power with highly variable responses Figure 18.1 in ‘at a glance’

Sample size...considerations If study n is small we may have inadequate power to detect an important effect, therefore nothing seen – was this due to low n or that there was actually nothing going on...was the whole study a waste of time... ...on the other hand. A large study is time-consuming, expensive, unethical (loads of patients/animals etc...).... A balance has to be struck... how many patients/samples to give best chance of seeing something if that something is genuinely there...?

Sample size...need to know So how do? if number of tests (always the case) then focus on most important or do a range and choose largest sample size. Need to; Specify power of test (usually 80% as minimum) Choose significance level (usually 5%, or if want to be really sure as outcome is critical then choose 1%) Know variability, the std deviation and its square, the variance or RMS (residual mean square) An estimate of effect size (i.e. What difference between means would be considered important)

Sample size...need to know So how do? Power, easy to do Significance level, easy to do Variability, do dummy test, pilot study, use other peoples data An estimate of effect size, as in 3. What would be considered important in your opinion and in other peoples opinion

Sample size...your go! Try doing a sample size calc on the data given...... Prospective on data, i.e. How many subjects need for next study.... 2) Retrospective study, i.e. Were conclusions valid?

Retrospective example...leptin 2 groups T-test C vs. Obese N=6/group gender Effect size 2.3 – 1.3 = 1.0 SEM = 0.3,0.5 Variance = 1.5/0.5 10 df Power ? 40-50% N=12 per group