BAYESIAN POSTERIOR DISTRIBUTIONS FOR PROBABILISTIC SENSITIVITY ANALYSIS Gordon B. Hazen and Min Huang, IEMS Department, Northwestern University, Evanston.

Slides:



Advertisements
Similar presentations
Fuzzy arithmetic is not a conservative way to do risk analysis Scott Ferson and Lev Ginzburg Applied Biomathematics
Advertisements

Bayesian Health Technology Assessment: An Industry Statistician's Perspective John Stevens AstraZeneca R&D Charnwood Bayesian Statistics Focus Team Leader.
Simulation Operations -- Prof. Juran.
MPS Research UnitCHEBS Workshop - April Anne Whitehead Medical and Pharmaceutical Statistics Research Unit The University of Reading Sample size.
1 Parametric Sensitivity Analysis For Cancer Survival Models Using Large- Sample Normal Approximations To The Bayesian Posterior Distribution Gordon B.
Sampling Distributions (§ )
Decision and cost-effectiveness analysis: Understanding sensitivity analysis Advanced Training in Clinical Research Lecture 5 UCSF Department of Epidemiology.
What role should probabilistic sensitivity analysis play in SMC decision making? Andrew Briggs, DPhil University of Oxford.
Sensitivity Analysis for Complex Models Jeremy Oakley & Anthony O’Hagan University of Sheffield, UK.
EQUILIBRIUM POPULATION METHODS FOR MARKOV MODELS OF HEALTH INTERVENTIONS Gordon Hazen, Ph.D., Min Huang. IEMS Department, Northwestern University Intervention.
USE OF LAPLACE APPROXIMATIONS TO SIGNIFICANTLY IMPROVE THE EFFICIENCY
The Cost-Effectiveness and Value of Information Associated with Biologic Drugs for the Treatment of Psoriatic Arthritis Y Bravo Vergel, N Hawkins, C Asseburg,
Results 2 (cont’d) c) Long term observational data on the duration of effective response Observational data on n=50 has EVSI = £867 d) Collect data on.
A RECIPE FOR INCOHERENCE: AVERAGING TIME-TRADEOFF OR STANDARD-GAMBLE UTILITIES ACROSS HEALTH ATTRIBUTES Gordon B. Hazen, IEMS Department, Northwestern.
Value of Information Some introductory remarks by Tony O’Hagan.
A Two Level Monte Carlo Approach To Calculating
1 Transforming the efficiency of Partial EVSI computation Alan Brennan Health Economics and Decision Science (HEDS) Samer Kharroubi Centre for Bayesian.
4-1 Statistical Inference The field of statistical inference consists of those methods used to make decisions or draw conclusions about a population.
T T07-01 Sample Size Effect – Normal Distribution Purpose Allows the analyst to analyze the effect that sample size has on a sampling distribution.
Non-parametric Bayesian value of information analysis Aim: To inform the efficient allocation of research resources Objectives: To use all the available.
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
Value of Information for Complex Economic Models Jeremy Oakley Department of Probability and Statistics, University of Sheffield. Paper available from.
1 Inference About a Population Variance Sometimes we are interested in making inference about the variability of processes. Examples: –Investors use variance.
5-3 Inference on the Means of Two Populations, Variances Unknown
Lecture II-2: Probability Review
1 Assessment of Imprecise Reliability Using Efficient Probabilistic Reanalysis Farizal Efstratios Nikolaidis SAE 2007 World Congress.
Modeling Menstrual Cycle Length in Pre- and Peri-Menopausal Women Michael Elliott Xiaobi Huang Sioban Harlow University of Michigan School of Public Health.
Copyright © Cengage Learning. All rights reserved. 10 Inferences Involving Two Populations.
8.1 Inference for a Single Proportion
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
QBM117 Business Statistics Estimating the population mean , when the population variance  2, is known.
Probabilistic Mechanism Analysis. Outline Uncertainty in mechanisms Why consider uncertainty Basics of uncertainty Probabilistic mechanism analysis Examples.
Incorporating heterogeneity in meta-analyses: A case study Liz Stojanovski University of Newcastle Presentation at IBS Taupo, New Zealand, 2009.
Decision and Cost-Effectiveness Analysis: Understanding Sensitivity Analysis Training in Clinical Research DCEA Lecture 5 UCSF Dept. of Epidemiology &
Validation / citations. Validation u Expert review of model structure u Expert review of basic code implementation u Reproduce original inputs u Correctly.
ECE 8443 – Pattern Recognition LECTURE 07: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Class-Conditional Density The Multivariate Case General.
Approximate letter grade assignments ~ D C B 85 & up A.
- 1 - Bayesian inference of binomial problem Estimating a probability from binomial data –Objective is to estimate unknown proportion (or probability of.
Three Frameworks for Statistical Analysis. Sample Design Forest, N=6 Field, N=4 Count ant nests per quadrat.
FIN 614: Financial Management Larry Schrenk, Instructor.
Not in FPP Bayesian Statistics. The Frequentist paradigm Defines probability as a long-run frequency independent, identical trials Looks at parameters.
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition LECTURE 07: BAYESIAN ESTIMATION (Cont.) Objectives:
Introduction to LDA Jinyang Gao. Outline Bayesian Analysis Dirichlet Distribution Evolution of Topic Model Gibbs Sampling Intuition Analysis of Parameter.
Chapter 7 Point Estimation of Parameters. Learning Objectives Explain the general concepts of estimating Explain important properties of point estimators.
Expectation-Maximization (EM) Algorithm & Monte Carlo Sampling for Inference and Approximation.
1 Optimizing Decisions over the Long-term in the Presence of Uncertain Response Edward Kambour.
6. Population Codes Presented by Rhee, Je-Keun © 2008, SNU Biointelligence Lab,
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
A Cost-Effectiveness Analysis of Maternal Genotyping to Guide Treatment in Postnatal Patients.
Chapter 22 Inferential Data Analysis: Part 2 PowerPoint presentation developed by: Jennifer L. Bellamy & Sarah E. Bledsoe.
A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation Yee W. Teh, David Newman and Max Welling Published on NIPS 2006 Discussion.
Class Six Turn In: Chapter 15: 30, 32, 38, 44, 48, 50 Chapter 17: 28, 38, 44 For Class Seven: Chapter 18: 32, 34, 36 Chapter 19: 26, 34, 44 Quiz 3 Read.
Generalization Performance of Exchange Monte Carlo Method for Normal Mixture Models Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology.
Data Analysis Patrice Koehl Department of Biological Sciences
Introduction Out-of-hospital cardiac arrest (OHCA) is the sudden cessation of the heart in an out of hospital setting. In the United States, the incidence.
ESTIMATION.
University of Palestine
One-Sample Inference for Proportions
Statistical inference: distribution, hypothesis testing
Chapter 8: Inference for Proportions
Monte Carlo Simulation Managing uncertainty in complex environments.
Inference Concerning a Proportion
Defining the null and alternative hypotheses
Sampling Distribution
Sampling Distribution
Mathematical Foundations of BME Reza Shadmehr
LECTURE 09: BAYESIAN LEARNING
Latent Variable Mixture Growth Modeling in Mplus
Chapter 13: Inferences about Comparing Two Populations
Sampling Distributions (§ )
Presentation transcript:

BAYESIAN POSTERIOR DISTRIBUTIONS FOR PROBABILISTIC SENSITIVITY ANALYSIS Gordon B. Hazen and Min Huang, IEMS Department, Northwestern University, Evanston IL Abstract Purpose: In probabilistic sensitivity analyses (PSA), analysts assign probability distributions to uncertain model parameters, and use Monte Carlo simulation to estimate the sensitivity of model results to parameter uncertainty. Bayesian methods provide convenient means to obtain probability distributions on parameters given data. We present large-sample approximate Bayesian posterior distributions for probabilities, rates and relative effect parameters, and discuss how to use these in PSA. Methods: We use Bayesian random effects meta-analysis, extending procedures summarized by Ades, Lu and Claxton (2004). We outline procedures for using the resulting posterior distributions in Monte Carlo simulation. Results and conclusions: We apply these methods to conduct a PSA for a recently published analysis of zidovudine prophylaxis following rapid HIV testing in labor to prevent vertical HIV transmission in pregnant women (Mrus and Tsevat 2004). Zidovudine prophylaxis is cost saving and has net benefit $553 per pregnancy compared to not testing for HIV, assuming a cost of $50,000 per lost QALY (mother and child). We based a PSA on data cited from Mrus and Tsevat on seven studies of vertical HIV transmission, as well as data for 5 other probability parameters. Given this data, the two parameters (log Risk population mean) and (log Risk Ratio population mean) for vertical HIV transmission have approximate bivariate normal posterior with mean/sd equal to  1.39/0.12 and  1.02/0.23, and correlation  Using these and other posterior distributions for all 5 remaining probabilities in a PSA yields zidovudine prophylaxis optimal 95.9% (  0.19%) of the time, and the expected value of perfect information on all 7 relative effects and probabilities equal to $10.65 (  0.87) per pregnancy. These results concur with Mrus and Tsevat’s conclusion that the choice of rapid HIV testing followed by zidovudine prophylaxis is not a close call. Probabilistic Sensitivity Analysis Using the Bayesian Paradigm In decision or cost-effectiveness analyses, observations y 1,…,y n may be available from past studies concerning unknown parameters  that influence future observations, costs and utilities. In order to conduct a probabilistic sensitivity analysis on , one needs to assign a probability distribution to . Bayesian methods provide in principle a straightforward method for this: Use the posterior distribution f(  | y 1,…,y n ) of  given the observations. In practice there may be difficulties in obtaining posterior distribution f(  | y 1,…,y n ) A prior distribution for  must be specified The burden of computing a posterior distribution on  may be excessive. However, both of these difficulties disappear when the number of observations is large. In this case, the prior distribution has little effect on the resulting posterior, and approximate large-sample normal posterior distributions can be inferred without extensive computation. Example 1: The effect of zidovudine prophylaxis on HIV transmission The following data is drawn from the 7 sources referenced by Mrus & Tsevat (2004). p 0 = probability of HIV transmission without zidovudine prophylaxis p 1 = probability of HIV transmission with zidovudine prophylaxis Example 1 (continued): The effect of zidovudine prophylaxis on HIV transmission Example 2: Specificity of rapid HIV testing The following data is drawn from the 3 sources referenced by Mrus & Tsevat (2004). p = specificity of rapid HIV testing Results: Baseline analysis Using the standard value of $50,000/QALY, we found a net benefit of $ per pregnancy for rapid HIV testing followed by zidovudine prophylaxis. This is consistent with the results of Mrus and Tsevat. Results: Probabilistic sensitivity analysis. Based on 40,000 Monte Carlo iterations: Zidovudine prophylaxis optimal 95.9% (±0.19%) of the time. The expected value of perfect information on all 8 relative effects and probabilities is equal to $10.65 (±$0.87) per pregnancy. Conclusion: These numbers indicate that the optimality of zidovudine prophylaxis is insensitive to simultaneous variation in these eight probability and efficacy parameters This is consistent with the conventional sensitivity analyses conducted by Mrus and Tsevat. An Illustrative Probabilistic Sensitivity Analysis We conducted a probabilistic sensitivity analysis of the choice of interventions to reduce vertical HIV transmission in pregnant women, using data from Mrus & Tsevat. p 0 = probability of HIV transmission without zidovudine prophylaxis p 1 = probability of HIV transmission with zidovudine prophylaxis Here pooling is incorrect and leads to misleadingly tight posterior distribution (compare graph at left). Observations from a single controlled study (or several pooled controlled studies) Observations from several heterogeneous studies (no controls) Observations from several heterogeneous controlled studies Reference Mrus, J.M., Tsevat, J. Cost-effectiveness of interventions to reduce vertical HIV transmission from pregnant women who have not received prenatal care. Medical Decision Making, 24 (2004) 1, Ades AE, Lu G, Claxton K. Expected value of sample information calculations in medical decision modeling. Medical Decision Making. 24 (2004) 4, Note that pooling results in a tighter distribution than not pooling. Improperly pooling may lead to misleading overconfidence in a probabilistic sensitivity analysis.