Clinical Trials with Two Endpoints. EXAMPLES HIV Vaccine Trial: Outcome 1: Incidence of HIV infection Outcome 2: Reaching Viral Set-point Cardiovascular:

Slides:



Advertisements
Similar presentations
STA305 Spring 2014 This started with excerpts from STA2101f13
Advertisements

CHAPTER 25: One-Way Analysis of Variance Comparing Several Means
CHAPTER 25: One-Way Analysis of Variance: Comparing Several Means ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner.
Estimation  Samples are collected to estimate characteristics of the population of particular interest. Parameter – numerical characteristic of the population.
Hypothesis: It is an assumption of population parameter ( mean, proportion, variance) There are two types of hypothesis : 1) Simple hypothesis :A statistical.
Hypothesis Testing A hypothesis is a claim or statement about a property of a population (in our case, about the mean or a proportion of the population)
Chap 9: Testing Hypotheses & Assessing Goodness of Fit Section 9.1: INTRODUCTION In section 8.2, we fitted a Poisson dist’n to counts. This chapter will.
Chap 8: Estimation of parameters & Fitting of Probability Distributions Section 6.1: INTRODUCTION Unknown parameter(s) values must be estimated before.
Likelihood ratio tests
EPIDEMIOLOGY AND BIOSTATISTICS DEPT Esimating Population Value with Hypothesis Testing.
Maximum likelihood (ML) and likelihood ratio (LR) test
Hypothesis testing Some general concepts: Null hypothesisH 0 A statement we “wish” to refute Alternative hypotesisH 1 The whole or part of the complement.
Maximum likelihood (ML) and likelihood ratio (LR) test
Chapter 11 Survival Analysis Part 2. 2 Survival Analysis and Regression Combine lots of information Combine lots of information Look at several variables.
Inferences About Process Quality
7-1 Introduction The field of statistical inference consists of those methods used to make decisions or to draw conclusions about a population. These.
Sample Size Determination
Hypothesis tests for slopes in multiple linear regression model Using the general linear test and sequential sums of squares.
The Neymann-Pearson Lemma Suppose that the data x 1, …, x n has joint density function f(x 1, …, x n ;  ) where  is either  1 or  2. Let g(x 1, …,
1 Chapter 9 Inferences from Two Samples In this chapter we will deal with two samples from two populations. The general goal is to compare the parameters.
Categorical Data Prof. Andy Field.
Ch 10 Comparing Two Proportions Target Goal: I can determine the significance of a two sample proportion. 10.1b h.w: pg 623: 15, 17, 21, 23.
Copyright © Cengage Learning. All rights reserved. 8 Tests of Hypotheses Based on a Single Sample.
Power and Sample Size Determination Anwar Ahmad. Learning Objectives Provide examples demonstrating how the margin of error, effect size and variability.
Two Sample Tests Nutan S. Mishra Department of Mathematics and Statistics University of South Alabama.
Statistical Decision Theory
Random Sampling, Point Estimation and Maximum Likelihood.
Chapter 9 Hypothesis Testing and Estimation for Two Population Parameters.
Section 9.2 Testing the Mean  9.2 / 1. Testing the Mean  When  is Known Let x be the appropriate random variable. Obtain a simple random sample (of.
1 Objective Compare of two matched-paired means using two samples from each population. Hypothesis Tests and Confidence Intervals of two dependent means.
Mid-Term Review Final Review Statistical for Business (1)(2)
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
1 Section 8.5 Testing a claim about a mean (σ unknown) Objective For a population with mean µ (with σ unknown), use a sample to test a claim about the.
01/20151 EPI 5344: Survival Analysis in Epidemiology Maximum Likelihood Estimation: An Introduction March 10, 2015 Dr. N. Birkett, School of Epidemiology,
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
The Practice of Statistics Third Edition Chapter 13: Comparing Two Population Parameters Copyright © 2008 by W. H. Freeman & Company Daniel S. Yates.
Chapter 10: Comparing Two Populations or Groups
Chapter 9 Inferences from Two Samples
Chapter 7 Point Estimation
1 Section 9-4 Two Means: Matched Pairs In this section we deal with dependent samples. In other words, there is some relationship between the two samples.
April 4 Logistic Regression –Lee Chapter 9 –Cody and Smith 9:F.
1 Chapter 9 Inferences from Two Samples 9.2 Inferences About Two Proportions 9.3 Inferences About Two Means (Independent) 9.4 Inferences About Two Means.
Maximum Likelihood Estimation Methods of Economic Investigation Lecture 17.
What Does the Likelihood Principle Say About Statistical Process Control? Gemai Chen, University of Calgary Canada July 10, 2006.
Analysis of Variance 1 Dr. Mohammed Alahmed Ph.D. in BioStatistics (011)
Two-Sample Hypothesis Testing. Suppose you want to know if two populations have the same mean or, equivalently, if the difference between the population.
1 Objective Compare of two population variances using two samples from each population. Hypothesis Tests and Confidence Intervals of two variances use.
Statistical Decision Theory Bayes’ theorem: For discrete events For probability density functions.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Reasoning in Psychology Using Statistics Psychology
Lecture 3: Statistics Review I Date: 9/3/02  Distributions  Likelihood  Hypothesis tests.
1 Inferences about a Mean Vector Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking.
1 Chihiro HIROTSU Meisei (明星) University Estimating the dose response pattern via multiple decision processes.
1. Homework due Wed 2. Project Proposal due Friday
Chapter 5 Statistical Inference Estimation and Testing Hypotheses.
1 Definitions In statistics, a hypothesis is a claim or statement about a property of a population. A hypothesis test is a standard procedure for testing.
M.Sc. in Economics Econometrics Module I Topic 4: Maximum Likelihood Estimation Carol Newman.
+ Section 10.1 Comparing Two Proportions After this section, you should be able to… DETERMINE whether the conditions for performing inference are met.
Lecture 23: Quantitative Traits III Date: 11/12/02  Single locus backcross regression  Single locus backcross likelihood  F2 – regression, likelihood,
1 Section 8.5 Testing a claim about a mean (σ unknown) Objective For a population with mean µ (with σ unknown), use a sample to test a claim about the.
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University.
BIOL 582 Lecture Set 2 Inferential Statistics, Hypotheses, and Resampling.
Chapter 7: Hypothesis Testing. Learning Objectives Describe the process of hypothesis testing Correctly state hypotheses Distinguish between one-tailed.
Testing for Equivalence or Noninferiority chapter 21.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Chapter 8 Section 8.5 Testing µ1 - µ2 and p1 - p2 Independent Samples Hypothesis Testing Mr. zboril | Milford PEP.
Comparing Populations
EM for Inference in MV Data
EM for Inference in MV Data
Incorporating the sample correlation between two test statistics to adjust the critical points for the control of type-1 error Dror Rom and Jaclyn McTague.
Presentation transcript:

Clinical Trials with Two Endpoints

EXAMPLES HIV Vaccine Trial: Outcome 1: Incidence of HIV infection Outcome 2: Reaching Viral Set-point Cardiovascular: Stroke Heart Attack Cognitive: Evaluation of Memory Occurrence of Dementia Insomnia: Time Till Sleep Length of Continuous Sleep Diet: Pounds lost MmHg BP Lowered

Difficulty: Want an overall test that rejects the null only 5% of the time. Somehow, combine two endpoints. There are better ways than Bonferroni that can consider when Modest effects are seen in each outcome. Dealing with the difficulty: Combine Endpoints into a Composite Endpoint. Here, you condense results into a single outcome. May complication interpretation of statistic (Burden of Illness Scores, total time awake at night, lost 10 lbs or lowered BP ) Combine Tests. Perform a statistical test on each endpoint separately, and then consider results from both tests together. Combine P-values.

Two Outcomes: H 0 : Θ 1 =0, Θ 2 =0 H A : Θ 1 ≥0, Θ 2 ≥0 (with one strict inequality) How do you test this hypothesis? ONE-SIDED TESTS Why? Believe treatment can only be beneficial Only care if treatment can be beneficial One Outcome: H o : Θ=0 H A : Θ > 0 Reject when Z 1 > α 0.05

EXAMPLE of a STUDY with TWO OUTCOMES: DIET: Outcome 1: Weight Loss Outcome 2: Blood Pressure Lower W i = Starting Weight – Final Weight BP i =Starting SBP – Final SBP

Option 1: Simes Test Reject H 0 when max(Z 1,Z 2 ) > k x or min(Z 1,Z 2 ) > k n

Option 2: Fisher’s Test Reject H 0 when (Z 1 Z 2 ) > k

Option 3: Linear Combination of Z Statistics Reject H 0 when Z 1 + Z 2 > k

Options 4 - 6: Weighted Versions of Statistics Reject H 0 when w 1 Z 1 + w 2 Z 2 > k When w 1 is large, rejection is primarily based on Z 1

Ideal Test? Most Powerful? Only one alternative ( θ 1, θ 2 ) Reject H o when Z 1 θ 1 +Z 2 θ 2 >k H A : E(Z 1 ) = θ 1 E(Z 2 ) = θ 2

Ideal Test? Most Powerful? Only one alternative ( θ 1, θ 2 ) Reject H o when Z 1 θ 1 +Z 2 θ 2 >k H A : E(Z 1 ) = θ 1 E(Z 2 ) = θ 2

Ideal Test? Most Powerful? ( θ 1, θ 2 ) Reject H o when Z 1 θ 1 +Z 2 θ 2 >k (Z 1,Z 2 ) Z 1 θ 1 +Z 2 θ 2

Best test statistic under known alternative: Z 1 θ 1 + Z 2 θ 2 Unknown (θ 1,θ 2 )? Estimate the parameters from the data: When there are no restrictions on the Parameter space However, by believing our treatment can only be beneficial, we implicitly State θ 1, θ 2 ≥ 0 Z 2 > 0 otherwise Z 1 > 0 otherwise

Rejection Region for

Likelihood Ratio Test Switch notation, return to variation of original example 1) Assume subjects are paired. 2) Let X i1,X i2 be the difference in weight and blood pressure change for Pair i. TREATMENT WORK ≈ μ 1 ≡ E(X 1 ) > 0 and/or μ 2 ≡ E(X 2 ) > 0 Density: Just need to find the μ that maximizes the denominator. And then can Use 2*log(λ) as the likelihood ratio test. LR

Likelihood Ratio Test (Continued) x 1 > 0 otherwise x 2 > 0 otherwise MLE’s (assuming X 1 and X 2 are independent) log …(skipping the algebra) Always use LRT? --It is very difficult to maximize μ when X i1 and X i2 are not independent Use LRT for POC HIV Vaccine Trial? --The Z statistics for incidence of viral infection and reaching viral set-point are independent.

Properties of Likelihood Ratio Test Combining Most Powerful Rejection Regions:

Properties of Likelihood Ratio Test Combining Most Powerful Rejection Regions:

Properties of Likelihood Ratio Test Combining Most Powerful Rejection Regions:

R α (Θ) = The rejection region that gives the most powerful α-level test under the alternative hypothesis, Θ = (θ 1,θ 2 ). p α (Θ) = The power of the most powerful α-level test under the alternative hypothesis, Θ = (θ 1,θ 2 ),. Uniformly Most Powerful Invariant Test (UMPI) Notation: If we can write the rejection region as the union of R α (Θ) such that p α (Θ) is the same for equivalent Θ’s, we will say that test has composition invariance. When does composition invariance imply that the test is Uniformly Most Powerful Invariant? THE END Question