Testing for Equivalence or Noninferiority chapter 21.

Slides:



Advertisements
Similar presentations
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Advertisements

INFERENCE: SIGNIFICANCE TESTS ABOUT HYPOTHESES Chapter 9.
Objectives (BPS chapter 15)
Significance Tests About
EPIDEMIOLOGY AND BIOSTATISTICS DEPT Esimating Population Value with Hypothesis Testing.
MARE 250 Dr. Jason Turner Hypothesis Testing II. To ASSUME is to make an… Four assumptions for t-test hypothesis testing:
Lecture 2: Thu, Jan 16 Hypothesis Testing – Introduction (Ch 11)
1 Equivalence and Bioequivalence: Frequentist and Bayesian views on sample size Mike Campbell ScHARR CHEBS FOCUS fortnight 1/04/03.
Hypothesis Tests for Means The context “Statistical significance” Hypothesis tests and confidence intervals The steps Hypothesis Test statistic Distribution.
© 2013 Pearson Education, Inc. Active Learning Lecture Slides For use with Classroom Response Systems Introductory Statistics: Exploring the World through.
Chapter 9 Hypothesis Testing.
Tests of significance: The basics BPS chapter 15 © 2006 W.H. Freeman and Company.
Chapter 5For Explaining Psychological Statistics, 4th ed. by B. Cohen 1 Suppose we wish to know whether children who grow up in homes without access to.
Example 10.1 Experimenting with a New Pizza Style at the Pepperoni Pizza Restaurant Concepts in Hypothesis Testing.
Chapter Ten Introduction to Hypothesis Testing. Copyright © Houghton Mifflin Company. All rights reserved.Chapter New Statistical Notation The.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 9 Hypothesis Testing.
Overview of Statistical Hypothesis Testing: The z-Test
Tuesday, September 10, 2013 Introduction to hypothesis testing.
Marshall University School of Medicine Department of Biochemistry and Microbiology BMS 617 Lecture 6 – Multiple comparisons, non-normality, outliers Marshall.
Section 9.1 Introduction to Statistical Tests 9.1 / 1 Hypothesis testing is used to make decisions concerning the value of a parameter.
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University ECON 4550 Econometrics Memorial University of Newfoundland.
Tests of significance: The basics BPS chapter 15 © 2006 W.H. Freeman and Company.
14. Introduction to inference
Introduction To Biological Research. Step-by-step analysis of biological data The statistical analysis of a biological experiment may be broken down into.
Chapter 8 Introduction to Hypothesis Testing
Section 9.2 Testing the Mean  9.2 / 1. Testing the Mean  When  is Known Let x be the appropriate random variable. Obtain a simple random sample (of.
6.1 - One Sample One Sample  Mean μ, Variance σ 2, Proportion π Two Samples Two Samples  Means, Variances, Proportions μ 1 vs. μ 2.
Significance Tests: THE BASICS Could it happen by chance alone?
Introduction to inference Tests of significance IPS chapter 6.2 © 2006 W.H. Freeman and Company.
10.2 Tests of Significance Use confidence intervals when the goal is to estimate the population parameter If the goal is to.
Hypothesis Testing Hypothesis Testing Topic 11. Hypothesis Testing Another way of looking at statistical inference in which we want to ask a question.
Chapter 20 Testing hypotheses about proportions
Statistical Hypotheses & Hypothesis Testing. Statistical Hypotheses There are two types of statistical hypotheses. Null Hypothesis The null hypothesis,
S-012 Testing statistical hypotheses The CI approach The NHST approach.
10.1: Confidence Intervals Falls under the topic of “Inference.” Inference means we are attempting to answer the question, “How good is our answer?” Mathematically:
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 8 Hypothesis Testing.
1 Chapter 8 Introduction to Hypothesis Testing. 2 Name of the game… Hypothesis testing Statistical method that uses sample data to evaluate a hypothesis.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Ch11: Comparing 2 Samples 11.1: INTRO: This chapter deals with analyzing continuous measurements. Later, some experimental design ideas will be introduced.
Hypothesis Testing An understanding of the method of hypothesis testing is essential for understanding how both the natural and social sciences advance.
Chapter 8 Parameter Estimates and Hypothesis Testing.
Stats Lunch: Day 3 The Basis of Hypothesis Testing w/ Parametric Statistics.
Hypothesis Testing Errors. Hypothesis Testing Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean.
Introduction to inference Tests of significance IPS chapter 6.2 © 2006 W.H. Freeman and Company.
AP Statistics Unit 5 Addie Lunn, Taylor Lyon, Caroline Resetar.
Principles of statistical testing
P-values and statistical inference Dr. Omar Aljadaan.
Hypothesis Testing Introduction to Statistics Chapter 8 Feb 24-26, 2009 Classes #12-13.
Understanding Basic Statistics Fourth Edition By Brase and Brase Prepared by: Lynn Smith Gloucester County College Chapter Nine Hypothesis Testing.
Tests of significance: The basics BPS chapter 14 © 2006 W.H. Freeman and Company.
Psych 230 Psychological Measurement and Statistics Pedro Wolf October 21, 2009.
+ Unit 6: Comparing Two Populations or Groups Section 10.2 Comparing Two Means.
Marshall University School of Medicine Department of Biochemistry and Microbiology BMS 617 Lecture 7 – Non-normality and outliers.
Hypothesis Testing. Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean μ = 120 and variance σ.
Chapter 7: Hypothesis Testing. Learning Objectives Describe the process of hypothesis testing Correctly state hypotheses Distinguish between one-tailed.
Copyright © 2009 Pearson Education, Inc. 9.2 Hypothesis Tests for Population Means LEARNING GOAL Understand and interpret one- and two-tailed hypothesis.
Tests of Significance -how to put them in writing.
Uncertainty and confidence If you picked different samples from a population, you would probably get different sample means ( x ̅ ) and virtually none.
© 2010 Pearson Prentice Hall. All rights reserved Chapter Hypothesis Tests Regarding a Parameter 10.
Chapter 9 Hypothesis Testing Understanding Basic Statistics Fifth Edition By Brase and Brase Prepared by Jon Booze.
Chapter 10: The t Test For Two Independent Samples.
Chapter Nine Hypothesis Testing.
14. Introduction to inference
Chapter 12 Tests with Qualitative Data
Hypothesis Testing: Hypotheses
Tests of significance: The basics
The Practice of Statistics in the Life Sciences Fourth Edition
Hypothesis Tests for a Standard Deviation
Volume 46, Issue 5, Pages (May 2007)
1 Chapter 8: Introduction to Hypothesis Testing. 2 Hypothesis Testing The general goal of a hypothesis test is to rule out chance (sampling error) as.
Presentation transcript:

Testing for Equivalence or Noninferiority chapter 21

An Example Compare the treatment effects of two drugs ( peak plasma concentration) Statistically Null hypothesis: x-y=0 Alternative hypothesis: X-Y=!0 Set a significant level (0.05) P value and CI Clinically or scientifically a generic drug tends to be prove it works just the same as a standard or reference drug. How? Equivalence zone/margin; equivalence testing

Equivalent Zone Ratio of Peak Concentrations The zone of equivalence is defined using scientific criteria with range 80 to 125% from report of Food and Drug Administration (FDA). As shown in this figure, the zone does not appear symmetrical around the 100 %; whereas it is symmetrical in a practical sense due to both symmetrical reciprocals (1/0.8=1.25;1/1.25=0.8) (%) 80% 125%

Mean within the Equivalence Zone A B C Ratio of Peak Concentrations (%) mean Figure shows data from three drugs where the mean of ratio of peak concentrations is within the zone of equivalence, but cannot prove equivalence. From FDA, two drugs are defined to be bioequivalent, when CI within the equivalence zone. As seen in this graph, the data demonstrate drugs B and C are equivalent to the standard drug; whereas the result is inconclusive for drug A.

Mean outside the Equivalence Zone D E F Ratio of Peak Concentrations (%) mean Figure shows data from three drugs where the mean ratio of peak concentrations is in the not equivalence one, but cannot prove the drugs are not equivalent. According to FDA’s criteria, as seen in this graph, drug F is not equivalent to standard drug, and for D and E, the data are inconclusive.

Usual Statistical Hypothesis Testing Is Not Helpful Statistically in this case Null hypothesis: ratio=100% ( CI includes 100%) Alternative hypothesis: ratio=!100% (100% sits outside of CI) A,B and D drugs meet null hypothesis, while C,E and F reject it. However, as we had known, B and C drugs are equivalent to a standard drug, and F is not equivalent.

Hypothesis Testing to Equivalence..significantly>80%..significantly<125% AND Two null hypotheses with one-tail test respectively Alternatives: the mean value of the ratio is greater than 0.80 the mean value of the ratio is less than 1.25 Applying the idea of statistical hypothesis testing to equivalence testing Two drugs are proven equivalent when both of alternatives are met.

Noninferiority Trials To prove that a new treatment is not worse than the standard treatment All parts of CI must be to the right of the lower border of the equivalence zone. Before testing, make 100% sure the works of the standard drug

Gaussian or Not? Chapter 24

The Gaussian Distribution Is an Unreachable Ideal Ideal data includes extremes: very low negative numbers super-high positive values Real data cannot meet those extremes, such as blood pressure and weight. Why do many tests rely on the it? Simulated data have shown statistical tests based on the Gaussian distribution is useful and robust, especially for the equal sample size. The data for test is required to enough close to the Gaussian distribution rather than equal it.

Distribution of 12 sample size from a Gaussian distribution with mean of and SD of 0.40 via randomly simulation. Distribution of 130 sample size from a Gaussian distribution with mean of and SD of 0.41 via randomly simulation. What a Gaussian distribution really looks like

Testing for Normality D'Agostino's K-squared test: Combinated the skewness and kurtosis, and both are equivalent to zero under an ideal Gaussian distribution. Others, positive or negative. Other tests: Shapiro-Wilk test Kolmogorov-Smirnov test Darling-Anderson test

The Interpreting of Results of Test Hypothesis: (null hypotheses, alternative hypotheses ) P value: Answer to what is the probability of obtaining a sample that deviates from a Gaussian distribution as much as (more/ less than ) this sample does. High P value and low P value Note: When null hypothesis is accepted, it does not demonstrate the sample is Gaussian distribution, only say this sample is consistent with Gaussian distribution. With the increasing of sample size, the evidence would be stronger.

What to do when data fail into a normality test Choices for a small P value (1) Transform your data (2) Outliers (3) Follow your statistical conclusion (4) Switch to non-parametric tests (will be shown in chapter 41) (before switch, should be careful, especially for the small size of sample)

Does it make sense to ask whether a particular data set is Gaussian?(No) Normality test is to demonstrate whether the data is consistent with normal distribution rather than whether the data is Gaussian. Should a normality test be run as part of every experiment?(not necessarily) Solution: a particular study without comparisons or scientific questions and plenty of data points, according to this kind of data obtained, it will be more convinced to see whether its distribution is consistent with normal distribution via normality test?