Statistical considerations for the Nipah virus treatment study

Slides:



Advertisements
Similar presentations
Phase II/III Design: Case Study
Advertisements

Randomized Controlled Trial
天 津 医 科 大 学天 津 医 科 大 学 Clinical trail. 天 津 医 科 大 学天 津 医 科 大 学 1.Historical Background 1537: Treatment of battle wounds: 1741: Treatment of Scurvy 1948:
1 Statistical and Practical Aspects of a Non-Stop Drug Development Strategy Karen L. Kesler and Ronald W. Helms Rho, Inc. Contact:
ODAC May 3, Subgroup Analyses in Clinical Trials Stephen L George, PhD Department of Biostatistics and Bioinformatics Duke University Medical Center.
Common Problems in Writing Statistical Plan of Clinical Trial Protocol Liying XU CCTER CUHK.
Clinical Trials Hanyan Yang
RANDOMIZED CLINICAL TRIALS. What is a randomized clinical trial?  Scientific investigations: examine and evaluate the safety and efficacy of new drugs.
Adverse Events, Unanticipated Problems, Protocol Deviations & other Safety Information Which Form 4 to Use?
Clinical Trials. What is a clinical trial? Clinical trials are research studies involving people Used to find better ways to prevent, detect, and treat.
What is a Clinical Trial (alpha version) John M. Harris Jr., MD President Medical Directions, Inc.
BIOE 301 Lecture Seventeen. Guest Speaker Jay Brollier World Camp Malawi.
Study Design. Study Designs Descriptive Studies Record events, observations or activities,documentaries No comparison group or intervention Describe.
Background to Adaptive Design Nigel Stallard Professor of Medical Statistics Director of Health Sciences Research Institute Warwick Medical School
An agency of the European Union Presented by: Paolo Tomasi Data Safety Monitoring Boards / Data Monitoring Committees in paediatric studies Paolo Tomasi,
1 An Interim Monitoring Approach for a Small Sample Size Incidence Density Problem By: Shane Rosanbalm Co-author: Dennis Wallace.
THE ROLE OF DSMB’s in CLINICAL RESEARCH Data and Safety Monitoring Monitoring.
1 Statistics in Drug Development Mark Rothmann, Ph. D.* Division of Biometrics I Food and Drug Administration * The views expressed here are those of the.
What is a non-inferiority trial, and what particular challenges do such trials present? Andrew Nunn MRC Clinical Trials Unit 20th February 2012.
BIOE 301 Lecture Seventeen. Progression of Heart Disease High Blood Pressure High Cholesterol Levels Atherosclerosis Ischemia Heart Attack Heart Failure.
Medical Statistics as a science
August 20, 2003FDA Antiviral Drugs Advisory Committee Meeting 1 Statistical Considerations for Topical Microbicide Phase 2 and 3 Trial Designs: A Regulatory.
Some Design Issues in Microbicide Trials August 20, 2003 Thomas R. Fleming, Ph.D. Professor and Chair of Biostatistics University of Washington FDA Antiviral.
1 Study Design Issues and Considerations in HUS Trials Yan Wang, Ph.D. Statistical Reviewer Division of Biometrics IV OB/OTS/CDER/FDA April 12, 2007.
Enrollment and Monitoring Procedures for NCI Supported Clinical Trials Barry Anderson, MD, PhD Cancer Therapy Evaluation Program National Cancer Institute.
Adaptive Trial Design Piero Olliaro UNICEF/UNDP/World Bank/WHO Special Programme on Research & Training in Tropical Diseases (TDR) Centre for Tropical.
Session 6: Other Analysis Issues In this session, we consider various analysis issues that occur in practice: Incomplete Data: –Subjects drop-out, do not.
Risks of Standard of Care (Experimental Aspects of Study) Patrick Herbison Continuing Education for IRB Members.
Ebola, study design, and Ethics Nancy E. Kass, ScD Berman Institute of Bioethics and Bloomberg School of Public Health.
1 Chapter 6 SAMPLE SIZE ISSUES Ref: Lachin, Controlled Clinical Trials 2:93-113, 1981.
Adaptive trial designs in HIV vaccine clinical trials Morenike Ukpong Obafemi Awolowo University Ile-Ife, Nigeria.
Chapter 12 Quantitative Questions and Procedures.
Trial Sequential Analysis (TSA)
Welcome Clinical Trials October 11, 2016 Vernon M. Chinchilli, PhD
Is High Placebo Response Really a Problem in Clinical Trials?
The Importance of Adequately Powered Studies
Evidence-based Medicine
FDA’s IDE Decisions and Communications
Statistical Core Didactic
Statistical Approaches to Support Device Innovation- FDA View
Within Trial Decisions: Unblinding and Termination
Clinical Trials Medical Interventions
Donald E. Cutlip, MD Beth Israel Deaconess Medical Center
Watching From Above: The Role of the DSMB
Randomized Trials: A Brief Overview
THE ROLE OF DSMB’s in CLINICAL RESEARCH
Clinical Study Results Publication
AIM HIGH Niacin plus Statin to prevent vascular events
Critical Reading of Clinical Study Results
NHLBI Perspective Yves Rosenberg, M.D, M.P.H.
Strategies for Implementing Flexible Clinical Trials Jerald S. Schindler, Dr.P.H. Cytel Pharmaceutical Research Services 2006 FDA/Industry Statistics Workshop.
Data Monitoring Committees: Current Issues and Challenges Some Discussion Points Jim Neaton University of Minnesota.
Crucial Statistical Caveats for Percutaneous Valve Trials
Clinical Trials.
Sue Todd Department of Mathematics and Statistics
Aiying Chen, Scott Patterson, Fabrice Bailleux and Ehab Bassily
DAY 2 Single-Case Design Drug Intervention Research Tom Kratochwill
Common Problems in Writing Statistical Plan of Clinical Trial Protocol
The DMC’s role in monitoring futility
Statistical considerations for the Nipah virus treatment study
Experimental Studies.
RCT Workshop, Bushehr 2/16/2019.
Candice Preslaski, PharmD, BCPS, BCCCP
Bioengineering and World Health
Evidence Based Practice
Improving the Standards of Reporting of Clinical Trial Data
Research Design Experimental Method.
DAY 2 Single-Case Design Drug Intervention Research Tom Kratochwill
Data Collection and Experimental Design
Finding a Balance of Synergy and Flexibility in Master Protocols
Presentation transcript:

Statistical considerations for the Nipah virus treatment study Lori E Dodd, PhD Clinical Trials Research Section Division of Clinical Research/NIAID

Why randomize in outbreak setting? Evaluating potential efficacy of experimental treatment requires a comparable control group Ensuring a comparable control group is especially tricky in an emerging infectious disease: Risk factors for death not well known Supportive care may differ across sites & outbreaks Randomization will tend to balance risk factors & supportive care differences It is possible treatment may cause harm Randomized control group an efficient way to identify this.

Ebola 2013-2016 treatment studies 8 studies reported evaluations of candidate treatments: Amodiaquine, Convalescent Plasma, Convalescent Whole Blood, Favipiravir (2 studies), Interferon β-1⍺, TKM-13083, ZMappTM Only ZMappTM used a randomized-controlled design All other studies used historical controls What can we learn from comparing the control groups?

Mortality rates vary between 30% and 66%. Potential reasons for variability: Different amounts of virus at time of infection? Different time from onset of symptoms to treatment? Virus variants? Age differences? Gender differences? Genetics? Differences in supportive care? Mortality rates from 6 control groups: Adjustments for cycle threshold, age, and gender do not eliminate the between-study heterogeneity

Favipiravir Study Is this a reasonable estimate of the benefit of favipiravir?

Adjusting for baseline covariates does not resolve this predicament.* Randomization will tend to balance the differences in risk of death of baseline variables. Favipiravir Study This control group would suggest harm.

TKM-13083 Study Harm?

TKM-13083 Concern about TKM does not change even after adjusting for CT, age and gender.

Randomization will not A lead physician on ZMappTM regrets not having a placebo: ZMappTM was perceived to be a “magic serum.” Perception may have influenced patient management. Patients require continual monitoring during ZMappTM infusion. Potential differences in background care??? Balance post-baseline differences! Differences between groups related to treatment assignment AFTER randomization may still bias comparisons. Examples of unintended post-randomization bias: --Patients receiving experimental therapy are monitored more frequently, receiving improved background care, OR --Patients receiving control therapy are monitored more frequently, receiving improved background care Placebo-controlled trials address this potential bias.

Statistical analysis for this RCT Primary Endpoint: 28-day mortality Statistical test: test of lower mortality rate (using Boschloo’s test), two-sided type I error rate of 0.05 Sample size: 100 per arm Highly unlikely that one outbreak will provide sufficient statistical power for conclusive evidence Mortality rate Power for various sample sizes per arm SOC m102.4 50 75 100 80% 64% 40% 58% 71% 56% 72% 89% 96% 70% 49% 57% 75% 86% 50% 30% 53% 83% 20% 76% 87%

Draft statistical analysis plan: Action item Draft statistical analysis plan: who and what?

Randomization Stratified for statistical efficiency Limited to one stratification variable: Presence of neurologic symptoms (yes/no). Double-blinded design requires Process to ensure masking of treatment assignment Randomization via database with blinded treatment codes Pharmacist standardized operating procedure to preserve the blind Reporting of AEs to Data and Safety Monitoring Board who should be unblinded to treatment assignment

Action items Randomization SOP: list generation and database process SOP to ensure double-blinding SOP for reporting results to DSMB

Interim monitoring considerations Early data are unreliable but ethical considerations demand that a trial stops for Definitive early efficacy or Definitive early harm Monitoring too frequently increases chances of a false positive finding Study likely to continue across multiple outbreaks Solution: group sequential monitoring

Definitive early efficacy Truncated O’Brien-Fleming boundary with 5 interim looks: Number total 24 50 100 150 200 One-sided p-value boundary 0.0005 0.009 0.021 Mortality boundaries for first (n=24) interim analysis: Deaths in m102.4 Deaths in SOC 8+ 1 9+ 2 11+ 3 12 Flexibility to evaluate at the end of an outbreak

Definitive early harm Same frequency as for efficacy. Less evidence required to establish harm. p<0.05 for each look Mortality boundaries for first safety analysis (at n=24): Deaths in m102.4 Deaths in SOC 4+ 6+ 1 7+ 2 9+ 3

Conditional Power Method of calculating likelihood of concluding statistical significance given accumulated (but not complete) data Given the accumulated observed data (up to time of analysis), compute the probability of achieving statistical significance assuming the remaining data (up to total of 100/arm) follow assumed alternative: *e.g., 50% reduction in mortality Evaluated during interim analyses and/or accrual pauses (due to end of outbreak) —If conditional power < 20%, continuing study may be futile

Sample size reassessment After 100 participants have been accrued, sample size may be increased if: Conditional power is greater than 50%, or Pooled mortality rate is low

Continuing study across outbreaks Study continues (across outbreaks) without release of results until accrual completed or DSMB recommends early stopping. Procedures/agreements needed to ensure all sites/countries understand the importance of this. Early release of data without a definitive conclusion may make continued study of m102.4 impractical.

Prevail II example Randomized controlled trial comparing ZMappTM to standard-of-care during the 2013-16 Ebola outbreak Powered for a 50% reduction in mortality from 40% to 20% -200 subjects needed By January 2016, epidemic was clearly ending. Should study continue? West African Ebola outbreak was unprecedented. No pattern of regional outbreaks Unclear if and when another outbreak would occur

DSMB presented with the following data The PREVAIL II Writing Group. N Engl J Med 2016;375:1448-1456.

Recommendation DSMB recommended study closure and release of data Results published NEJM in 2016 ZMappTM was promising but results not definitive Ongoing debate about its efficacy Questions for thought: Should DSMB have kept study open? Suppose another outbreak was expected within a year, would DSMB have kept study going?

Action items DSMB charter DSMB approves protocol and monitoring plans Country-/site-wide agreement with monitoring plans Statistical analysis plan to describe interim analyses in detail