Bayesian Health Technology Assessment: An Industry Statistician's Perspective John Stevens AstraZeneca R&D Charnwood Bayesian Statistics Focus Team Leader.

Slides:



Advertisements
Similar presentations
Statistical vs Clinical Significance
Advertisements

Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University.
Assessing Uncertainty when Predicting Extreme Flood Processes.
Design of Experiments Lecture I
Week 11 Review: Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS St. Edward’s University.
When is there Sufficient Evidence? Karl Claxton, Department of Economics and Related Studies and Centre for Health Economics, University of York.
Exploring uncertainty in cost effectiveness analysis NICE International and HITAP copyright © 2013 Francis Ruiz NICE International (acknowledgements to:
1 1 Slide © 2009 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS St. Edward’s University.
1 1 Slide STATISTICS FOR BUSINESS AND ECONOMICS Seventh Edition AndersonSweeneyWilliams Slides Prepared by John Loucks © 1999 ITP/South-Western College.
MPS Research UnitCHEBS Workshop - April Anne Whitehead Medical and Pharmaceutical Statistics Research Unit The University of Reading Sample size.
Optimal Drug Development Programs and Efficient Licensing and Reimbursement Regimens Neil Hawkins Karl Claxton CENTRE FOR HEALTH ECONOMICS.
BAYESIAN POSTERIOR DISTRIBUTIONS FOR PROBABILISTIC SENSITIVITY ANALYSIS Gordon B. Hazen and Min Huang, IEMS Department, Northwestern University, Evanston.
Sample size optimization in BA and BE trials using a Bayesian decision theoretic framework Paul Meyvisch – An Vandebosch BAYES London 13 June 2014.
What role should probabilistic sensitivity analysis play in SMC decision making? Andrew Briggs, DPhil University of Oxford.
Is it time to ban PSA? In support of OFSA… Stirling Bryan, PhD.
Opportunities for Bayesian analysis in evaluation of health-care interventions David Spiegelhalter MRC Biostatistics Unit Cambridge
Sensitivity Analysis for Complex Models Jeremy Oakley & Anthony O’Hagan University of Sheffield, UK.
The Importance of Decision Analytic Modelling in Evaluating Health Care Interventions Mark Sculpher Professor of Health Economics Centre for Health Economics.
Elicitation Some introductory remarks by Tony O’Hagan.
1 A Bayesian Non-Inferiority Approach to Evaluation of Bridging Studies Chin-Fu Hsiao, Jen-Pei Liu Division of Biostatistics and Bioinformatics National.
USE OF LAPLACE APPROXIMATIONS TO SIGNIFICANTLY IMPROVE THE EFFICIENCY
Cost-Effectiveness Analyses in the UK - Lessons from the National Institute for Clinical Excellence Mark Sculpher Professor of Health Economics Centre.
The Cost-Effectiveness and Value of Information Associated with Biologic Drugs for the Treatment of Psoriatic Arthritis Y Bravo Vergel, N Hawkins, C Asseburg,
The Use of Economic Evaluation For Decision Making: Methodological Opportunities and Challenges Mark Sculpher Karl Claxton Centre for Health Economics.
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Statistical inference (Sec. )
1 A heart fills with loving kindness is a likeable person indeed.
Results 2 (cont’d) c) Long term observational data on the duration of effective response Observational data on n=50 has EVSI = £867 d) Collect data on.
Value of Information Some introductory remarks by Tony O’Hagan.
Health care decision making Dr. Giampiero Favato presented at the University Program in Health Economics Ragusa, June 2008.
17/12/2002 CHEBS Launch Seminar CHEBS Activities and Plans Tony O’Hagan Director.
7 November The 2003 CHEBS Seminar 1 The problem with costs Tony O’Hagan CHEBS, University of Sheffield.
Lecture 10 Comparison and Evaluation of Alternative System Designs.
Value of Information for Complex Economic Models Jeremy Oakley Department of Probability and Statistics, University of Sheffield. Paper available from.
Making Cost Effectiveness Analyses more useful: Budget Impact Curves Christopher McCabe PhD Endowed Research Chair in Emergency Medicine Research University.
Trial Based Economic Evaluation: Just Another Piece Of Evidence Claxton K Department of Economics and Centre for Health Economics, University of York,
1Carl-Fredrik Burman, 11 Nov 2008 RSS / MRC / NIHR HTA Futility Meeting Futility stopping Carl-Fredrik Burman, PhD Statistical Science Director AstraZeneca.
Decision Analysis as a Basis for Estimating Cost- Effectiveness: The Experience of the National Institute for Health and Clinical Excellence in the UK.
The National Institute for Clinical Excellence in the UK – Experience and Impact Mark Sculpher Professor of Health Economics Centre for Health Economics.
Stephane Larocque – Consulting Practice Leader, Impact Infrastructure A DECISION MAKING FRAMEWORK FOR SUSTAINABLE INFRASTRUCTURE DEVELOPMENT 1 ST INTERNATIONAL.
Statistical inference: confidence intervals and hypothesis testing.
Knowing what you get for what you pay An introduction to cost effectiveness FETP India.
Economic evaluation of health programmes Department of Epidemiology, Biostatistics and Occupational Health Class no. 17: Economic Evaluation using Decision.
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
1 1 Slide Slides Prepared by JOHN S. LOUCKS St. Edward’s University © 2002 South-Western/Thomson Learning.
1 1 Slide © 2007 Thomson South-Western. All Rights Reserved OPIM 303-Lecture #7 Jose M. Cruz Assistant Professor.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS St. Edward’s University.
1 1 Slide IS 310 – Business Statistics IS 310 Business Statistics CSU Long Beach.
West Virginia University Towards Practical Software Reliability Assessment for IV&V Projects B. Cukic, E. Gunel, H. Singh, V. Cortellessa Department of.
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
Chap. 5 Building Valid, Credible, and Appropriately Detailed Simulation Models.
Department Author Bayesian Sample Size Determination in the Real World John Stevens AstraZeneca R&D Charnwood Tony O’Hagan University of Sheffield.
NIHR Research Design Service London Enabling Better Research Dr Caroline Burgess General Adviser 13 th November 2013.
New Research in Economic Modeling and Simulation Greg Samsa PhD.
Risk Analysis in Capital Budgeting. Nature of Risk Risk exists because of the inability of the decision-maker to make perfect forecasts. the risk associated.
Matching Analyses to Decisions: Can we Ever Make Economic Evaluations Generalisable Across Jurisdictions? Mark Sculpher Mike Drummond Centre for Health.
Building Valid, Credible & Appropriately Detailed Simulation Models
Statistics for Business and Economics Module 1:Probability Theory and Statistical Inference Spring 2010 Lecture 4: Estimating parameters with confidence.
“New methods in generating evidence for everyone: Can we improve evidence synthesis approaches?” Network Meta-Analyses and Economic Evaluations Petros.
Uncertain Judgements: Eliciting experts’ probabilities Anthony O’Hagan et al 2006 Review by Samu Mäntyniemi.
Slides by JOHN LOUCKS St. Edward’s University.
ICS 280 Learning in Graphical Models
Chapter Six Normal Curves and Sampling Probability Distributions
Strategies to incorporate pharmacoeconomics into pharmacotherapy
Health care decision making
An introduction to Bayesian reasoning Learning from experience:
Data Monitoring committees and adaptive decision-making
Chapter 7: Introduction to Sampling Distributions
Building Valid, Credible, and Appropriately Detailed Simulation Models
Professor of Health Economics
Presentation transcript:

Bayesian Health Technology Assessment: An Industry Statistician's Perspective John Stevens AstraZeneca R&D Charnwood Bayesian Statistics Focus Team Leader

Overview Some history Why Bayesian statistics? Summary

Some History “something could be done”

Why is Bayesian statistics appropriate for health technology assessment?

Incremental Cost-Effectiveness Plane cc ee K

Inferences about Cost-Effectiveness Net (Monetary) Benefit,  (K) = K  e -  c > 0 Objective to make inferences : Q(K) = P( K  e -  c > 0 ) –Q(K) is the posterior probability that NB > 0 –Q(K) is the C/E-acceptability curve This is intrinsically Bayesian!

Cost-Effectiveness Acceptability Curve

Why is Bayesian statistics appropriate for health technology assessment? More intuitive and meaningful inferences.

Why is Bayesian statistics appropriate for health technology assessment?

Prior Information A fundamental feature of Bayesian statistics Represents information that is available in addition to observing the data Prior information almost always exists and this should be used to strengthen inferences –Does not mean that inferences are necessarily more favourable –Particularly important where the design objectives of a clinical trial may not relate to the effectiveness measure –Can be structural information as well as numerical information Prior information should always be used for internal planning

Subjectivity Prior information is intrinsically subjective An unscrupulous analyst can concoct any desired result The potential for manipulation is not unique to Bayesian statistics But ….. –nowhere is the discipline of statistics carried out with more discipline than in the pharmaceutical industry, and –nowhere will Bayesian statistics be carried out with greater discipline than in the pharmaceutical industry Synthesis of evidence should follow a formal process for justifying the prior information

Synthesis of Evidence “The elicitation and description of prior information should be given at least as much care and attention as the planning, execution and data scrutiny of the trial itself.” O’Hagan, Stevens and Montmartin (2001)

Incorporates prior information in addition to the trial data. Why is Bayesian statistics appropriate for health technology assessment?

Sensitivity Analysis Economic models are necessary in support of arguments of cost-effectiveness Parameter estimates are typically drawn from a variety of sources Univariate sensitivity analysis is still common Uncertainty and inaccuracy in parameter estimates should be acknowledged Correlations between input parameters should also be acknowledged Bayesian probabilistic sensitivity analysis has advantages to both sponsors and decision makers

Guidance (1) HTBS: Guidance for manufacturers on submission of evidence relating to clinical and cost-effectiveness in Health Technology Assessments 2002 It may be appropriate in some cases to combine the cost-effectiveness evaluation with one or more meta analyses of the clinical data. This may be done most naturally in a Bayesian framework.

Guidance (2) HTBS: Guidance for manufacturers on submission of evidence relating to clinical and cost-effectiveness in Health Technology Assessments 2002 Comprehensive sensitivity analyses should be conducted. For parameters with substantial uncertainty, sensitivity analysis using probability distributions in a Bayesian framework is preferred.

Guidance (3) NICE: Guidance for manufacturers and sponsors 2001 When data are drawn from a variety of sources and used in a modelling framework, probabilistic sensitivity analysis is recommended in order to take account of the uncertainty around data values.

Why is Bayesian statistics appropriate for health technology assessment? Bayesian PSA allows the output uncertainty to be analysed, with a range of diagnostics to identify the most influential model inputs that are driving the output uncertainty.

Why is Bayesian statistics appropriate for health technology assessment?

Answering More Complex Questions Frequentist theory relies on large sample approximations Sample means are not necessarily good estimators of population means when data are skew in relatively small samples Bayesian inferences can be computed exactly in highly complex models

Why is Bayesian statistics appropriate for health technology assessment? The ability to tackle more complex problems.

Summary Bayesian statistics provides: Bayesian PSA allows the output uncertainty to be analysed, with a range of diagnostics to identify the most influential model inputs that are driving the output uncertainty. Win! –More intuitive and meaningful inference –The ability to incorporate prior information –The ability to tackle more complex problems