Evidence synthesis of competing interventions when there is inconsistency in how effectiveness outcomes are measured across studies Nicola Cooper Centre.

Slides:



Advertisements
Similar presentations
The analysis of survival data in nephrology. Basic concepts and methods of Cox regression Paul C. van Dijk 1-2, Kitty J. Jager 1, Aeilko H. Zwinderman.
Advertisements

The Application of Propensity Score Analysis to Non-randomized Medical Device Clinical Studies: A Regulatory Perspective Lilly Yue, Ph.D.* CDRH, FDA,
What can we learn from data ? A comparison of direct, indirect and observational evidence on treatment efficacy 2 nd Workshop 'Consensus working group.
METHODOLOGY FOR META- ANALYSIS OF TIME TO EVENT TYPE OUTCOMES TO INFORM ECONOMIC EVALUATIONS Nicola Cooper, Alex Sutton, Keith Abrams Department of Health.
Survival Analysis. Key variable = time until some event time from treatment to death time for a fracture to heal time from surgery to relapse.
USE OF EVIDENCE IN DECISION MODELS: An appraisal of health technology assessments in the UK Nicola Cooper Centre for Biostatistics & Genetic Epidemiology,
USE OF EVIDENCE IN DECISION MODELS: An appraisal of health technology assessments in the UK Nicola Cooper Centre for Biostatistics & Genetic Epidemiology,
Nicola Cooper Centre for Biostatistics & Genetic Epidemiology,
Estimating the cost-effectiveness of an intervention in a clinical trial when partial cost information is available: A Bayesian approach Nicola Cooper.
Multiple Regression and Model Building
The Incorporation of Meta-Analysis Results into Evidence-Based Decision Modelling Nicola Cooper, Alex Sutton, Keith Abrams, Paul Lambert, David Jones Department.
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Departments of Medicine and Biostatistics
1 ADDRESSING BETWEEN-STUDY HETEROGENEITY AND INCONSISTENCY IN MIXED TREATMENT COMPARISONS Application to stroke prevention treatments for Atrial Fibrillation.
Introduction Cure models within the framework of flexible parametric survival models T.M-L. Andersson1, S. Eloranta1, P.W. Dickman1, P.C. Lambert1,2 1.
What role should probabilistic sensitivity analysis play in SMC decision making? Andrew Briggs, DPhil University of Oxford.
Modelling Partially & Completely Missing Preference-Based Outcome Measures (PBOMs) Keith Abrams Department of Health Sciences, University of Leicester,
Cox Model With Intermitten and Error-Prone Covariate Observation Yury Gubman PhD thesis in Statistics Supervisors: Prof. David Zucker, Prof. Orly Manor.
Statistical Issues in Contraceptive Trials
ANALYSIS OF REPEATED MEASURES COST DATA WITH ZERO OBSERVATIONS: An Application To The Costs Associated With Inflammatory Polyarthritis Nicola J Cooper,
Introduction to decision modelling Andrew Sutton.
Use of Bayesian Methods for Markov Modelling in Cost Effectiveness Analysis: An application to taxane use in advanced breast cancer Nicola Cooper, Keith.
The Cost-Effectiveness and Value of Information Associated with Biologic Drugs for the Treatment of Psoriatic Arthritis Y Bravo Vergel, N Hawkins, C Asseburg,
Using Weibull Model to Predict the Future: ATAC Trial Anna Osmukhina, PhD Principal Statistician, AstraZeneca 15 April 2010.
Modeling clustered survival data The different approaches.
Decision Analysis as a Basis for Estimating Cost- Effectiveness: The Experience of the National Institute for Health and Clinical Excellence in the UK.
1 ADDRESSING BETWEEN-STUDY HETEROGENEITY AND INCONSISTENCY IN MIXED TREATMENT COMPARISONS Application to stroke prevention treatments for Atrial Fibrillation.
Sample Size Determination Ziad Taib March 7, 2014.
Cox Proportional Hazards Regression Model Mai Zhou Department of Statistics University of Kentucky.
Analysis of Complex Survey Data
USE OF EVIDENCE IN DECISION MODELS: An appraisal of health technology assessments in the UK Nicola Cooper Centre for Biostatistics & Genetic Epidemiology,
Survival Analysis: From Square One to Square Two
Survival analysis Brian Healy, PhD. Previous classes Regression Regression –Linear regression –Multiple regression –Logistic regression.
Essentials of survival analysis How to practice evidence based oncology European School of Oncology July 2004 Antwerp, Belgium Dr. Iztok Hozo Professor.
Dr Laura Bonnett Department of Biostatistics. UNDERSTANDING SURVIVAL ANALYSIS.
1 Introduction to medical survival analysis John Pearson Biostatistics consultant University of Otago Canterbury 7 October 2008.
Bayesian Analysis and Applications of A Cure Rate Model.
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
QUANTITATIVE RESEARCH AND BASIC STATISTICS. TODAYS AGENDA Progress, challenges and support needed Response to TAP Check-in, Warm-up responses and TAP.
HSRP 734: Advanced Statistical Methods July 17, 2008.
Randomized Trial of Preoperative Chemoradiation Versus Surgery Alone in Patients with Locoregional Esophageal Carcinoma, Ursa et al. Statistical Methods:
Lecture 2 Review Probabilities Probability Distributions Normal probability distributions Sampling distributions and estimation.
Pro gradu –thesis Tuija Hevonkorpi.  Basic of survival analysis  Weibull model  Frailty models  Accelerated failure time model  Case study.
Patricia Guyot1,2, Nicky J Welton1, AE Ades1
Uncertainty Management in Rule-based Expert Systems
Introduction Sample Size Calculation for Comparing Strategies in Two-Stage Randomizations with Censored Data Zhiguo Li and Susan Murphy Institute for Social.
A generalized bivariate Bernoulli model with covariate dependence Fan Zhang.
Sampling and estimation Petter Mostad
Chapter 5 Sampling Distributions. The Concept of Sampling Distributions Parameter – numerical descriptive measure of a population. It is usually unknown.
REGRESSION MODEL FITTING & IDENTIFICATION OF PROGNOSTIC FACTORS BISMA FAROOQI.
Sample Size Determination
BIOST 513 Discussion Section - Week 10
The Importance of Adequately Powered Studies
Survival curves We know how to compute survival curves if everyone reaches the endpoint so there is no “censored” data. Survival at t = S(t) = number still.
Impact of censoring on the statistical methods for handling non-proportional hazards in Immuno-Oncology studies Yifan Huang, Luping Zhao, Jiabu Ye, and.
Survival Analysis: From Square One to Square Two Yin Bun Cheung, Ph.D. Paul Yip, Ph.D. Readings.
Simon Thompson University of Cambridge
Meta-analysis of joint longitudinal and event-time outcomes
Anja Schiel, PhD Statistician / Norwegian Medicines Agency
Gerald Dyer, Jr., MPH October 20, 2016
Quantitative Methods in HPELS HPELS 6210
Jeffrey E. Korte, PhD BMTRY 747: Foundations of Epidemiology II
EVENT PROJECTION Minzhao Liu, 2018
Biostatistics Primer: What a Clinician Ought to Know: Hazard Ratios
Cure Survival Data in Oncology Study
Non-parametric methods in statistical testing
Biomarkers as Endpoints
Use of Piecewise Weighted Log-Rank Test for Trials with Delayed Effect
Björn Bornkamp, Georgina Bermann
Gregory Levin, FDA/CDER/OTS/OB/DBIII
Presentation transcript:

Evidence synthesis of competing interventions when there is inconsistency in how effectiveness outcomes are measured across studies Nicola Cooper Centre for Biostatistics and Genetic Epidemiology, Department of Health Sciences, University of Leicester, UK. Acknowledgements: Tony Ades, Guobing Lu, Alex Sutton & Nicky Welton

MULTIPLE EVENT OUTCOMES Often the main clinical outcome differs across trials  Inconsistent reporting (e.g. mean, median)  Change in outcomes used over time Possible to use the available data to inform the estimation of others

EXAMPLE: Anti-viral for influenza Three antiviral treatments for influenza Amantadine Oseltamivir Zanamivir No direct comparisons of the different antiviral treatments All trials compare antiviral to standard care Different outcome measures Time to alleviation of fever Time to alleviation of ALL symptoms Different summary statistics reported Median time to event Mean time to event

Oseltamivir and Zanamivir trials report median time to event of interest Amantadine trials report mean time to event of interest No direct comparison trials of all antivirals & standard care. Important to preserve within-trial randomised treatment comparison of each trial whilst combining all available comparisons between treatments (i.e. maintain randomisation). DATA AVAILABLE

In clinical studies with time to event data as the principal outcome, median time to event usually reported. However, for economic evaluations the statistic of interest is the mean => Area under survival curve (i.e. provides best estimate of expected time to an event ) Often mean time to an event can NOT be determined from observed data alone due to right- censoring (i.e. actual time to an event for some individuals unknown either due to loss of follow-up or event not incurred by end of study) BACKGROUND

PROBLEM: Mean undefined Last observation censored => mean undefined Trt 1 Trt 2

CALCULATING MEAN FROM MEDIAN TIME Simplest approach is to assume an Exponential distribution for time with influenza, thus assuming a constant hazard function over time, Probability of still having influenza at time t, At median time, Mean time to event = 1/ & its corresponding variance = 1/ 2 r, where r = number of events incurred during the study period

THREE STATE MARKOV MODEL 1 = transition rate (hazard) from influenza onset to alleviation of fever 2 = transition rate from alleviation of fever to alleviation of symptoms 1/ 1 = expected time from influenza onset to alleviation of fever 1/ 2 = expected time from alleviation of fever to alleviation of symptoms (1/ 1 + 1/ 2 ) = expected time from influenza onset to alleviation of symptoms 1 2

Assumptions: Equal treatment effects in each period,  jk Baseline hazard during second period same as in first period plus an additional random effect term,  j EVIDENCE SYNTHESIS MODEL ln(  i1 ) =  j +  jk = -ln( 1 ) #  i1, flu to fev alleviated ln(  i2 ) =  j +  j +  jk = -ln( 2 ) #  i2, fev to sym alleviated  i3 =  i1 +  i2 = 1/ 1 + 1/ 2 #  i3, flu to sym alleviated  jk ~ Normal(d k,  2 ) # log hazard ratio  j ~ Normal(g, V g ) # random effect where i = trial arms, j = trials, k = treatments. Prior distributions specified for d k, g,  2, V g

Exp(d k ) is the ratio of hazards of recovery at any time for an individual on treatment k relative to an individual on the standard treatment If exp(d k ) < 1 then treatment k is superior If exp(d k ) > 1 then standard treatment is superior Model fitted in WinBUGS and evaluated using MCMC simulation HAZARD RATIO / RELATIVE HAZARD

CATERPILLAR PLOT OF HAZARD RATIOS Hazard Ratio Improvement in rate of recovery Oseltamivir Amantadine Zanamivir

RANKING TREATMENTS Best 0% Best 33% Best 67% Best 1%

PROPORTION OF INDIVIDUALS IN EACH STATE Influenza All symptoms alleviated Fever alleviated Oseltamivir trials 21 days (8-22%) Zanamivir trials 28 days (7-25%)

WEIBULL MODEL Relaxes assumption of constant hazard (  = shape)  = 1 0 <  < 1  = 2 Exponential

WEIBULL MODEL (cont.) Probability of still having influenza at time t, S(t)=e -(t/  )   >0 (shape)  >0 (scale) At median time, 0.5=e -(t med /  )   t med =  (ln(2)) 1/  If r out of n individuals still had symptoms at X days (i.e. end of trial), the proportion of censored individuals can be expressed as: S(t(X)) =r/n=e -(t/  ) 

AVAILABLE TRIAL DATA Trt 1 Trt t med X r/n

WEIBULL MODEL (cont.) Important to calculate E(S(t(X))|t med ) to take account of the correlation between median time (t med ) to alleviation of illness and proportion of participants (r/n) still ill at X days as they are from the same trial dataset. Mean time to event (i.e. statistic of interest)   (1+1/  )

EVIDENCE SYNTHESIS MODEL Assumptions: Equal treatment effects in each period,  jk Baseline hazard during second period same as in first period plus an additional random effect term,  j ln(  i1 ) =  j +  jk = ln(  i1 ) + ln(  (1+1/  1 )) #  i1, flu to fev alleviated ln(  i2 ) =  j +  j +  jk #  i2, fev to sym alleviated  i3 =  i1 +  i2 =  i3  (1+1/  3 ) #  i3, flu to sym alleviated  jk ~ Normal(d k,  2 ) # log hazard ratio  j ~ Normal(g, V g ) # random effect where i = trial arms, j = trials, k = treatments. Prior distributions specified for d k, g,  2, V g

EVIDENCE SYNTHESIS MODEL (cont.)  and  are the shape and scale parameters of a Weibull distribution respectively Model assumes the shape parameters are the same for time to alleviation of fever,  1, regardless of antiviral treatment & similarly for time to alleviation of symptoms,  3 Due to lack of data, to estimate  1 set equal to 1 (i.e. exponential distribution). Could set constraint to ensure proportion still with fever at X days (i.e. end of trial)  proportion still with symptoms

CATERPILLAR PLOT OF HAZARD RATIOS Improvement in rate of recovery Zanamivir Oseltamivir Amantadine

RANKING TREATMENTS Best 0% Best 1% Best 20% Best 79%

CONCLUSIONS Although amantadine is ranked “best” it does have serious side effects (e.g. gastrointestinal symptoms, central nervous system) which are not taken into account in this analysis This type of model could inform the effectiveness parameters of a cost effectiveness decision model Allows multiple outcomes & indirect comparisons to be modelled within a single framework Appropriate model for nested outcomes (e.g. progression- free survival & overall survival) If non-nested outcomes, then a multivariate meta-analysis model, as developed for surrogate outcomes, more appropriate