Elicitation Some introductory remarks by Tony O’Hagan.

Slides:



Advertisements
Similar presentations
Elicitation methods Health care demands exceed resource supply Therefore, rationing is inevitable Many ways by which we can ration health care One is economic.
Advertisements

HEA PTP: M207 Health Economics1 Measurement & Valuation of Health What is health? Why do we need to measure it? How can it be measured? Why do we need.
Bayesian tools for analysing and reducing uncertainty Tony OHagan University of Sheffield.
Dr Linda Allin Division of Sport Sciences The value of real life evaluation research for student learning and employability in Sports Development.
Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University.
USE OF EVIDENCE IN DECISION MODELS: An appraisal of health technology assessments in the UK Nicola Cooper Centre for Biostatistics & Genetic Epidemiology,
USE OF EVIDENCE IN DECISION MODELS: An appraisal of health technology assessments in the UK Nicola Cooper Centre for Biostatistics & Genetic Epidemiology,
Benefit Transfer of Non-Market Values – Understanding the concepts John Rolfe Central Queensland University.
Bayesian Health Technology Assessment: An Industry Statistician's Perspective John Stevens AstraZeneca R&D Charnwood Bayesian Statistics Focus Team Leader.
Week 11 Review: Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution.
Exploring uncertainty in cost effectiveness analysis NICE International and HITAP copyright © 2013 Francis Ruiz NICE International (acknowledgements to:
HERU is supported by the Chief Scientist Office of the Scottish Government Health Directorates and the University of Aberdeen. The author accepts full.
What is going on with psychotherapy today? Carolyn R. Fallahi, Ph. D.
BAYESIAN POSTERIOR DISTRIBUTIONS FOR PROBABILISTIC SENSITIVITY ANALYSIS Gordon B. Hazen and Min Huang, IEMS Department, Northwestern University, Evanston.
The uptake of value of information methods Solutions found and challenges to come Alan Brennan Director of Operational Research ScHARR.
Utility Assessment HINF Medical Methodologies Session 4.
Recommendations for Conducting Cost Effectiveness: Elements of the Reference Case Ciaran S. Phibbs, Ph.D. February 25, 2009.
Parameterising Bayesian Networks: A Case Study in Ecological Risk Assessment Carmel A. Pollino Water Studies Centre Monash University Owen Woodberry, Ann.
The Importance of Decision Analytic Modelling in Evaluating Health Care Interventions Mark Sculpher Professor of Health Economics Centre for Health Economics.
CS 589 Information Risk Management 6 February 2007.
Structural uncertainty from an economists’ perspective
The ICH E5 Question and Answer Document Status and Content Robert T. O’Neill, Ph.D. Director, Office of Biostatistics, CDER, FDA Presented at the 4th Kitasato-Harvard.
On the Value of Valuing Recreational Fishing B. Kriström Department of Forest Economics SLU-Umeå, Sweden.
Journal Club Alcohol and Health: Current Evidence March-April 2006.
Results 2 (cont’d) c) Long term observational data on the duration of effective response Observational data on n=50 has EVSI = £867 d) Collect data on.
The relevance of Health Economics Research for the Health Policy Agenda Prof. Guillem López-Casasnovas Depart. de Economía Univ. Pompeu Fabra. Cataluña.
Bayesian Statistics Vague, variable, subjective to boot…
Value of Information Some introductory remarks by Tony O’Hagan.
COST–EFFECTIVENESS ANALYSIS AND COST-UTILITY ANALYSIS
Health care decision making Dr. Giampiero Favato presented at the University Program in Health Economics Ragusa, June 2008.
Design of cost- effectiveness studies Some introductory remarks by Tony O’Hagan.
17/12/2002 CHEBS Launch Seminar CHEBS Activities and Plans Tony O’Hagan Director.
Estimating utilities from individual preference data Some introductory remarks by Tony O’Hagan.
Trial Based Economic Evaluation: Just Another Piece Of Evidence Claxton K Department of Economics and Centre for Health Economics, University of York,
Costs Some introductory remarks by Tony O’Hagan. Welcome! Welcome to the fourth CHEBS dissemination workshop This forms part of our Focus Fortnight on.
1Carl-Fredrik Burman, 11 Nov 2008 RSS / MRC / NIHR HTA Futility Meeting Futility stopping Carl-Fredrik Burman, PhD Statistical Science Director AstraZeneca.
Decision Analysis as a Basis for Estimating Cost- Effectiveness: The Experience of the National Institute for Health and Clinical Excellence in the UK.
QUALITY OF LIFE ASSESSMENT IN PEOPLE LIVING WITH HIV/AIDS Antonieta Medina Lara HIV/AIDS and STI Knowledge Programme Liverpool School of Tropical Medicine.
DISCUSSION Alex Sutton Centre for Biostatistics & Genetic Epidemiology, University of Leicester.
Extending life for people with a terminal illness: a moral right or an expensive death? Empirical and methodological issues Rachel Baker, Helen Mason &
Their contribution to knowledge Morag Heirs. Research Fellow Centre for Reviews and Dissemination University of York PhD student (NIHR funded) Health.
Cost-Effectiveness Problem l You have a $1.5 billion budget to spend on any combination of these programs:
Gaussian process modelling
Value of Information Analysis Roger J. Lewis, MD, PhD Department of Emergency Medicine Harbor-UCLA Medical Center Los Angeles Biomedical Research Institute.
Calibration and Model Discrepancy Tony O’Hagan, MUCM, Sheffield.
Valuing Health Effects of Air Pollution in DevelopingCountries: The Case of Taiwan* JOURNAL OF ENVIRONMENTAL ECONOMICS AND MANAGEMENT 34, 107 ]
Cost-Effectiveness Thresholds Professor of Health Economics
Workshop The science and methodologies behind HTA, diversity and commonality across the EU Achieving more patient centred HTA in different countries.
Group Technical Assistance Webinar August 5, CFPHE RESEARCH METHODS FOR COMPARATIVE EFFECTIVENESS RESEARCH.
Ethical Issues Lecture 14 th. Summary: Understanding Sampling Choice of sampling techniques depends upon the research question(s) and their objectives.
FOCUS GROUP OR INTERVENTION? PUBLIC RESPONSES TO COST EFFECTIVENESS INFORMATION Shoshanna Sofaer, Dr.P.H. School of Public Affairs Baruch College.
Basic Economic Analysis David Epstein, Centre for Health Economics, York.
Validation / citations. Validation u Expert review of model structure u Expert review of basic code implementation u Reproduce original inputs u Correctly.
SOCIOLOGICAL INVESTIGATION
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
IAS Policy and Advocacy priority on Treatment as Prevention Carlos F. Cáceres Multidisciplinary Research on ARV-based Prevention 30 June 2013 Kuala Lumpur.
Mysoltani.ir سایت فیلم روشهای مشارکتی Technology Foresight Foresight is about preparing for the future. It is about deploying resources in the best.
Sample Size Determination in Studies Where Health State Utility Assessments Are Compared Across Groups & Time Barbara H Hanusa 1,2 Christopher R H Hanusa.
City University notes AJ Fischer October Nancy’s Questions Q1Different people present material with different cost perspectives? AWith all such.
Flagship Program on Health Sector Reform and Sustainable Financing.
Gaps to Caps project Why we need a discussion on capability and scenario analysis and why task group C and task group D need to work together when it comes.
Understanding the Research Process
Who is involved in making NICE guidance recommendations and what evidence do they look at? Jane Cowl, Senior Public Involvement Adviser Tommy Wilkinson,
© University of South Wales Royal College of Speech and Language Therapists Outcomes Conference and Hub Launch Belfast, May 1, 2014 Running a tight ship:
Mountain Risks: A Marie Curie Research & Training Network THE MOUNTAIN-RISKS RESEARCH PROJECT: CHALLENGES IN QUANTITATIVE RISK ASSESSMENT P.
Managing with Imperfect Information 1 6/14/2016. Perfect Information 2 1 – Source is WikipediaWikipedia Perfect information refers to the situation in.
City University notes AJ Fischer October Nancy’s Questions Q1Different people present material with different cost perspectives? AWith all such.
Uncertain Judgements: Eliciting experts’ probabilities Anthony O’Hagan et al 2006 Review by Samu Mäntyniemi.
HEALTH ECONOMICS BASICS
An introduction to Bayesian reasoning Learning from experience:
Presentation transcript:

Elicitation Some introductory remarks by Tony O’Hagan

Welcome! Welcome to the third CHEBS dissemination workshop This forms part of our Focus Fortnight on “Elicitation” Our format allows plenty of time for discussion of the issues raised in each talk, so please feel free to join in!

Two strands The talks today address elicitation in two quite different contexts ›Elicitation of expert knowledge in the form of probability distributions of unknown parameters ›Elicitation of people’s preferences for health states, in order to formulate utilities A key objective of this FF is to bring these two strands together, to see what each can learn from the other

Eliciting probabilities Bayesian statistics concerns the updating of beliefs from prior to posterior In principle, specification of prior beliefs is therefore a key component of any analysis In practice it is rarely done seriously ›Given sufficient data, it doesn’t matter much ›It is difficult and time consuming to do properly ›It doesn’t lend itself to nice papers in leading statistics journals

Not necessarily ‘prior’ Eliciting expert opinion probabilistically does not have to be thought of as ‘prior’ to some data Expert information is a crucial input to risk analyses, etc, where there is no prospect of getting more data This is the area where elicitation methodology has been developed most

Elicitation in C-E analysis Elicitation of prior beliefs for Bayesian analysis of clinical trial and other data ›Often, sample sizes are not very large and prior information is appreciable Elicitation of expert knowledge of inputs to economic models ›Needed for sensitivity or value of information analysis Fully Bayesian synthesis of information ›Use posterior distributions for model inputs where possible

Challenges Regulatory context ›Elicitation will need to be robust, defensible Correlations ›How to elicit dependence? ›Or how to structure/model the parameters so that the structure induces the right dependence?

Eliciting preferences What is the ‘effectiveness’ for which ‘we’ are willing to pay? We can only compare costs across the whole health care spectrum, and allocate budgets rationally, if effectiveness is on a common scale Ultimately, we are willing to pay for health improvements that yield ›Longer life and/or ›Better quality of life

QALYs The Quality-Adjusted Life Year seems to be the gold standard ›Health providers’ willingness to pay can be reduced to how much they would pay for one QALY Elicitation then involves asking people how they value different states of health ›This is in order to know how to ‘adjust’ a life year Various challenges seem to arise, both theoretical and practical

Questioning the QALY Is two years of one person’s life worth one year of each of two people’s? If two years of poor health is worth one year of perfect health, are four years of poor health worth two of perfect health? Whose preferences/values? ›Individuals vary wildly ›Systematic differences between sectors of population ›What does society or the health provider think?

Practical challenges Choice of instrument: SG versus TTO Health state is massively multidimensional ›Can’t value every possible combination ›Relevant dimensions depend on medical condition How to quantify uncertainty in valuations Deferred benefits valued differently from immediate benefits ›Does that make sense from a societal perspective?

Some commonalities Different instruments yield different answers ›SG is also used to elicit individual probabilities ›But probabilistic elicitation is more about distributions A multidisciplinary perspective is needed ›There is a lot of psychology involved Questions of whose judgements are needed ›Individual versus community Results are subject to uncertainty ›Always need to extrapolate from limited elicited data Fundamental duality