Power and sample size.

Slides:



Advertisements
Similar presentations
Introduction to Hypothesis Testing
Advertisements

Chapter 10 Introduction to Inference
Statistical vs Clinical or Practical Significance
Statistical vs Clinical Significance
Power of a test. power The power of a test (against a specific alternative value) Is a tests ability to detect a false hypothesis Is the probability that.
HYPOTHESIS TESTING. Purpose The purpose of hypothesis testing is to help the researcher or administrator in reaching a decision concerning a population.
Chapter 10: The t Test For Two Independent Samples
June 14. In Chapter 9: 9.1 Null and Alternative Hypotheses 9.2 Test Statistic 9.3 P-Value 9.4 Significance Level 9.5 One-Sample z Test 9.6 Power and Sample.
Introduction to Hypothesis Testing
Chapter 9 Introduction to the t-statistic
Type I & Type II errors Brian Yuen 18 June 2013.
Pitfalls of Hypothesis Testing + Sample Size Calculations.
Objective: To test claims about inferences for two proportions, under specific conditions Chapter 22.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Introduction to Hypothesis Testing Chapter 8. Applying what we know: inferential statistics z-scores + probability distribution of sample means HYPOTHESIS.
Decision Errors and Power
Statistical Issues in Research Planning and Evaluation
Lecture 3: Null Hypothesis Significance Testing Continued Laura McAvinue School of Psychology Trinity College Dublin.
Estimation of Sample Size
SAMPLE SIZE ESTIMATION
EPIDEMIOLOGY AND BIOSTATISTICS DEPT Esimating Population Value with Hypothesis Testing.
ProportionMisc.Grab BagRatiosIntro.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Statistics for the Social Sciences
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Sample Size Determination Ziad Taib March 7, 2014.
Sample size calculation
AM Recitation 2/10/11.
Testing Hypotheses I Lesson 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics n Inferential Statistics.
Jeopardy Hypothesis Testing T-test Basics T for Indep. Samples Z-scores Probability $100 $200$200 $300 $500 $400 $300 $400 $300 $400 $500 $400.
Tuesday, September 10, 2013 Introduction to hypothesis testing.
Comparing Means From Two Sets of Data
Sample size determination Nick Barrowman, PhD Senior Statistician Clinical Research Unit, CHEO Research Institute March 29, 2010.
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
Statistical Power and Sample Size Calculations Drug Development Statistics & Data Management July 2014 Cathryn Lewis Professor of Genetic Epidemiology.
Concept of Power ture=player_detailpage&v=7yeA7a0u S3A.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Hypothesis Testing Hypothesis Testing Topic 11. Hypothesis Testing Another way of looking at statistical inference in which we want to ask a question.
Biostatistics Class 6 Hypothesis Testing: One-Sample Inference 2/29/2000.
PowerPoint presentation to accompany Research Design Explained 6th edition ; ©2007 Mark Mitchell & Janina Jolley Chapter 10 The Simple Experiment.
Introduction to sample size and power calculations Afshin Ostovar Bushehr University of Medical Sciences.
Jeopardy Hypothesis Testing t-test Basics t for Indep. Samples Related Samples t— Didn’t cover— Skip for now Ancient History $100 $200$200 $300 $500 $400.
Chapter 9 Introduction to the t Statistic. 9.1 Review Hypothesis Testing with z-Scores Sample mean (M) estimates (& approximates) population mean (μ)
Chapter 20 Testing Hypothesis about proportions
Statistical Inference for the Mean Objectives: (Chapter 9, DeCoursey) -To understand the terms: Null Hypothesis, Rejection Region, and Type I and II errors.
© Copyright McGraw-Hill 2004
T Test for Two Independent Samples. t test for two independent samples Basic Assumptions Independent samples are not paired with other observations Null.
Major Steps. 1.State the hypotheses.  Be sure to state both the null hypothesis and the alternative hypothesis, and identify which is the claim. H0H0.
Chapter 13 Understanding research results: statistical inference.
Chapter 7: Hypothesis Testing. Learning Objectives Describe the process of hypothesis testing Correctly state hypotheses Distinguish between one-tailed.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Inferential Statistics Psych 231: Research Methods in Psychology.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 21 More About Tests and Intervals.
INTRODUCTION TO TESTING OF HYPOTHESIS INTRODUCTION TO TESTING OF HYPOTHESIS SHWETA MOGRE.
Sample size calculation
Chapter 9 Hypothesis Testing.
Power and Effect Size.
Statistics for the Social Sciences
Sample Size Estimation
More about Tests and Intervals
Chapter 9: Hypothesis Tests Based on a Single Sample
Chapter 7: Statistical Issues in Research planning and Evaluation
SAMPLE SIZE AND POWER CALCULATION
Psych 231: Research Methods in Psychology
Reasoning in Psychology Using Statistics
1 Chapter 8: Introduction to Hypothesis Testing. 2 Hypothesis Testing The general goal of a hypothesis test is to rule out chance (sampling error) as.
Type I and Type II Errors
Statistical Power.
Presentation transcript:

Power and sample size

Objectives Explain why sample size is important Explain what makes up a sample size calculation Demonstrate sample size calculations Explain the level of understanding that you need for the FCEM Hope that you retain some/any of this information once you leave the room

FCEM – what do you need? Any comparative or diagnostic study needs a power calculation The number of study participants must reach this number If it doesn’t ask yourself why not incorrect assumptions? untoward events?

Altman “...a trial should be big enough to have a high chance of detecting, as statistically significant, a worthwhile effect if it exists and thus be reasonably sure that no benefit exists if it is not found..”

Why is sample size important? Need to get an answer Need to get the right answer Need to be sure we get the right answer Avoid exposing too many participants than is necessary to get the answer

Study process

Hypotheses Research looks to answer a hypothesis Hypotheses are (statistically) easier to “prove” if they start from a null hypothesis: “there is no difference between treatment A and treatment B in treating X” “there is no difference between test C and test D in diagnosing Y”

Answers Four ways to get an answer: Correct answer for the correct reason Correct answer for the wrong reason Incorrect answer for the correct reason Incorrect answer for the wrong reason

 Truth table Truth Null Hypothesis  Type I error Type II error There is a difference There is no difference Null Hypothesis Rejected i.e. a difference was found   Type I error Accepted i.e. no difference was found Type II error

 Truth table Truth Null Hypothesis  Type I error Type II error There is a difference There is no difference Null Hypothesis Rejected i.e. a difference was found   Type I error Accepted i.e. no difference was found Type II error

Generic sample size equation n ~ 2(z1-α/2 + z1-β)2 σ2 Δ2

Sample size n ~ 2(z1-α/2 + z1-β)2 σ2 Δ2 n is the sample size α is the significance level - often set at 0.05 so we accept a 5% chance of making a type I error 1-β is the power – often set at 0.8 so we accept an 80% chance of avoiding a type II error Δ is the effect size σ is the variance within the population

Factors affecting sample size The precision and variance of measures within any sample Magnitude of a clinically significant difference How certain we want to be of avoiding a type I error The type of statistical test we are performing

Precision and variance

Clinically significant difference Very small differences require very precise estimates of the true population values But is it clinically important? At great effort we could demonstrate a 2mmHg difference in blood pressure between two drugs

Standardised difference Based upon the ratio of the difference of interest to the standard deviation of those observations Calculated in a different way depending on whether the data is continuous or categorical

Continuous data Standardised difference = difference between the means population standard deviation So if we were assessing an antihypertensive and wanted a 10mm difference between the drugs and the population standard deviation was 20mm then the standardised difference would be 0.5

Categorical data P1 is the baseline mortality P2 is the “new” mortality we expect P is 0.5(P1 + P2 )

Standardised difference and power

Gore and Altman nomogram

Gore and Altman nomogram 0.01 0.05

Diagnostic studies - sensitivity TP = true positive rate, FN = false negative rate, SN = sensitivity, P = prevalence

Diagnostic studies - specificity FP = false positive rate, TN = true negative rate SP = specificity, P = prevalence

Questions?

FCEM – what do you need? Any comparative or diagnostic study needs a power calculation The number of study participants must reach this number If it doesn’t ask yourself why not incorrect assumptions? untoward events?