On estimating treatment effects under noncompliance in randomized clinical trials Heejung Bang.

Slides:



Advertisements
Similar presentations
Designing an impact evaluation: Randomization, statistical power, and some more fun…
Advertisements

Systematic Review of Literature Part XIX Analyzing and Presenting Results.
Analysis & Expressing Resultd in Clinical Trials Dr. Khalili.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Treatment Switching in the VenUS IV trial Methods to manage treatment non-compliance in RCTs with time-to-event outcomes Caroline Fairhurst York Trials.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
COURSE: JUST 3900 INTRODUCTORY STATISTICS FOR CRIMINAL JUSTICE Instructor: Dr. John J. Kerbs, Associate Professor Joint Ph.D. in Social Work and Sociology.
Sensitivity Analysis for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Common Problems in Writing Statistical Plan of Clinical Trial Protocol Liying XU CCTER CUHK.
BS704 Class 7 Hypothesis Testing Procedures
Chapter 9 Flashcards. measurement method that uses uniform procedures to collect, score, interpret, and report numerical results; usually has norms and.
Sample size calculations
Sample Size Determination Ziad Taib March 7, 2014.
Association vs. Causation
Random Sampling, Point Estimation and Maximum Likelihood.
Experimental Design All experiments have independent variables, dependent variables, and experimental units. Independent variable. An independent.
Consumer behavior studies1 CONSUMER BEHAVIOR STUDIES STATISTICAL ISSUES Ralph B. D’Agostino, Sr. Boston University Harvard Clinical Research Institute.
Understanding real research 4. Randomised controlled trials.
Estimating Causal Effects from Large Data Sets Using Propensity Scores Hal V. Barron, MD TICR 5/06.
RCTs and instrumental variables Anna Vignoles University of Cambridge.
What is a non-inferiority trial, and what particular challenges do such trials present? Andrew Nunn MRC Clinical Trials Unit 20th February 2012.
Chapter 5 Parameter estimation. What is sample inference? Distinguish between managerial & financial accounting. Understand how managers can use accounting.
How to Read Scientific Journal Articles
Issues concerning the interpretation of statistical significance tests.
Compliance Original Study Design Randomised Surgical care Medical care.
SAMPLING DISTRIBUTION OF MEANS & PROPORTIONS. SAMPLING AND SAMPLING VARIATION Sample Knowledge of students No. of red blood cells in a person Length of.
SAMPLING DISTRIBUTION OF MEANS & PROPORTIONS. SAMPLING AND SAMPLING VARIATION Sample Knowledge of students No. of red blood cells in a person Length of.
Jump to first page Inferring Sample Findings to the Population and Testing for Differences.
Chapter 9: Introduction to the t statistic. The t Statistic The t statistic allows researchers to use sample data to test hypotheses about an unknown.
1 Econometrics (NA1031) Chap 7 Using Indicator Variables.
Experimental Evaluations Methods of Economic Investigation Lecture 4.
NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN RESEARCH STATISTICS.
1 Basics of Inferential Statistics Mark A. Weaver, PhD Family Health International Office of AIDS Research, NIH ICSSC, FHI Lucknow, India, March 2010.
Fundamentals of Data Analysis Lecture 10 Correlation and regression.
©The McGraw-Hill Companies, Inc. 2008McGraw-Hill/Irwin Estimation and Confidence Intervals Chapter 9.
Journal Club Curriculum-Study designs. Objectives  Distinguish between the main types of research designs  Randomized control trials  Cohort studies.
Looking for statistical twins
Inference for a Single Population Proportion (p)
Experimental Research
Statistical Core Didactic
Ian Shrier MD, PhD, Dip Sport Med (FACSM)
3. The X and Y samples are independent of one another.
Unit 5: Hypothesis Testing
Inference and Tests of Hypotheses
Chapter 9: Inferences Involving One Population
Confidence Intervals and p-values
CHAPTER 6 Statistical Inference & Hypothesis Testing
Randomized Trials: A Brief Overview
Sample Size Estimation
Challenges of statistical analysis in surgical trials
EXPERIMENTAL STUDIES.
Tests of significance: The basics
Inferential statistics,
Chapter Eight: Quantitative Methods
S1316 analysis details Garnet Anderson Katie Arnold
Common Problems in Writing Statistical Plan of Clinical Trial Protocol
Comparing Populations
Significance Tests: The Basics
Scientific Method Steps
Significance Tests: The Basics
Sampling and Power Slides by Jishnu Das.
Statistical Data Analysis
What are their purposes? What kinds?
Statistical significance using p-value
Interpreting Epidemiologic Results.
Last Update 12th May 2011 SESSION 41 & 42 Hypothesis Testing.
Objectives 6.1 Estimating with confidence Statistical confidence
Objectives 6.1 Estimating with confidence Statistical confidence
Use of Piecewise Weighted Log-Rank Test for Trials with Delayed Effect
MGS 3100 Business Analysis Regression Feb 18, 2016
Presentation transcript:

On estimating treatment effects under noncompliance in randomized clinical trials Heejung Bang

Background Randomized clinical trial (RCT) Groups must be alike in important aspects and differ only in the treatment assigned. Comparable treatment groups are achieved through randomization In most trials, “noncompliance” is extremely difficult to avoid. ---reasons: voluntary refusal, failure to comply, treatment switch, and administrative error

Noncompliance & Intent-to-treat (ITT) With or without protocol deviations, the ITT approach has long served as a standard procedure, preserving the integrity of randomization. Although the estimate of treatment effect is known to be attenuated under imperfect compliance, the ITT method ignoring post-randomization compliance is strongly advocated because randomization eliminates selection bias. The approach of comparing policies of “intentions” or the effect of “treatment assignment”. --- a more pragmatic statement as a measure of effectiveness rather than efficacy.

What are other estimators/principles to consider? As treated (AT) Per protocol (PP) Instrumental variables (IV) Here, we intend to compare these 4 estimators under different compliance scenarios in several RCT settings.

AT Rarely accepted not only for statistical inference but also for decision making. Well known to give a biased test and inflated type I error even under the null hypothesis. It can be severely confounded with other nonrandomized prognostic characteristics. However, it may give some idea about the maximum (or optimal) treatment efficacy if noncompliance is indeed a random phenomenon.

PP It addresses what happened to patients who completed the entire treatment protocol as planned. This also suffers selection bias and the assessment of bias is difficult. FDA generally requires that analyses based on PP in addition to ITT be conducted for approval of drug, expecting the results to be logically consistent.

IV It aims to establish “causal” interpretation. Methods making use of IV frequently appear in econometrics literature. The origin of the IV is traced back to Wald (1940). The IV estimand was introduced to structural equation modeling by Durbin (1954). This idea was implicit in the study of RCT with imperfect compliance (Sommer & Zeger, 1991)

Notation Zi (treatment indicator) =1 (active treatment) & =0 (control) where i=1,2,...,N subjects. “Counterfactual” outcome Yi(Zi) for the i-th subject --- a pair of Yi (1) and Yi (0) are never observed simultaneously. Treatment effect=μ1- μ0=τ, where E{Yi(1)}=μ1 & E{Yi(0)}=μ0. Likewise, it is also assumed that there is counterfactual (binary) dose at each treatment level, Di(Zi).

Observed Data We only get to see the actually received dose di and observed response yi (i=1,2,...,N), where di=Zi*Di(1)+ (1-Zi)*Di(0) & yi=di*Yi(1)+ (1-di)*Yi(0).

4 estimators

More on IV IV estimator is the ratio of average ITT effect of Z on y and ITT effect of Z on d. Underlying idea: any effect of Z on y must be via the effect of Z on d. It estimates “complier average causal effect (CACE)” as the average causal effect for the subpopulation of compliers (Little & Rubin 2000) ---E{Y(1)-Y(0)|C=1} where C=compliance status. More assumptions are required.

Noncompliance Scenarios 1. Ignorable (i.e., random) noncompliance 2. Nonignorable, symmetric noncompliance: For example, a study of exercise encouragement for lung disease: healthy subjects (with high lung function score Yi(0)) are more likely to exercise regularly, whereas weak subjects (with low Yi(0)) do not exercise even if encouraged.

(conti’) 3. Nonignorable, asymmetric noncompliance: same as Scenario #2 but only one of the 2 noncompliance patterns is observed. Remark: implementation of asymmetric nature is important because exact symmetry may not be achieved.

Clinical Trial Scenarios Case 1: Noncompliance can occur in either treatment arm. e.g., “encouragement” design such as a program for smoking cessation and a physician's encouragement for influenza vaccine or exercise. Case 2: Participants in the active treatment may not comply, while the ones in the control arm have no choice but to comply e.g., a new, very expensive or rare intervention

(conti’) Case 3: Partial compliance is permitted in either arm. This is the case when the study treatment is readily available and easily skipped. e.g., vitamin or multiple pills.

Simulation Settings: Case 1 Yi(0) ~ N(μ0,1) and Yi(1)~N(μ1,1) for i=1,…,1000, where μ0= μ1=1 (i.e., τ=0) under the null & μ0=1, μ1=3 (i.e., τ=2) under the alternative. Z=1 or 0 with equal probability. Initially, we set Di(0)=0 & Di(1)=1, i.e., complete compliance.

(conti’) Under the “ignorable” noncompliance, a randomly selected 20% of the subjects do not comply. For the “nonignorable” symmetric noncompliance, 1) if Yi(0)> μ0+0.5, we set Di(0)= Di(1)=1 (named “upper condition”) 2) if Yi(0)< μ - 0.5, we set Di(0)= Di(1)=0 (named “lower condition”).

Simulation Settings: Case 2 Same as Case 1 but Di(0)=1 is not allowed.

Simulation Settings: Case 3 Among untreated, - 50% of subjects comply as directed - 30% take 1/3 amount of the active regimen from some external sources - 10% take 2/3 - the remaining 10% are able to take an equal amount of a full dose. Among treated, - 50% of subjects take a whole recommended dose - 30% do not take the regimen at all - 10% take only 1/3 - the other 10% missed 1/3 of a dose.

Dose-Outcome Model The treatment effect is assumed to be proportional to the dose taken. Specifically,

Table 1. Results for Case 1 Simulation results are summarized by the mean of treatment effect estimates and sample standard error (SSE), average confidence interval (CI) and empirical coverage probability (CP, %). 500 simulations. Warning: ITT estimates the effect of randomization so some results for ITT may not be directly comparable to results for other estimators.

Table 2: Results for Case 2

Table 3. Results for Case 3

Two more analyses Additive model Sensitivity analysis

Table 4: Results under the additive model (compare with Case 1 results) Yi(1)-Yi(0)=τ, i.e., a constant additive effect within each individual. This assumption often appears in Econometrics research. The condition under which IV always works!

Sensitivity analysis for dose-outcome model (compare with Case 3 results) New model: IV: 1.99->2.11 AT: 2.00->1.86 PP: 2.00->1.91 Unbiasedness of the IV also relies on linearity between dose and treatment effect.

Conclusions Most of our current knowledge is under the “random noncompliance” setting. PP and AT estimators are severely biased (esp., overestimation). ITT and IV estimators carry desirable properties as we assume but not always (esp., under nonignorable noncompliance). IV is always unbiased under constant treatment effect.

Future Extensions Extensions to binary and survival outcomes are straightforward, we find no reason for different results to be reached. “Global average treatment effects” or “principal effects” (based on principal stratification) may be of greater public health interest and better suited for more complex study designs (Robins & Greenland 1996; Frangakis & Rubin 2002) Well-behaved estimators (beyond the standard ITT and IV) along with their analytic properties, especially under our informative asymmetric noncompliance or even more complicated scenarios, would be important contributions.

Reference Bang H. & Davis C.E. On estimating treatment effects under noncompliance in randomized clinical trials: are intent-to-treat or instrumental variables analyses perfect solutions? Statistics in Medicine. 2007.