Evaluating the Value of New Drugs and Devices Copyright ICER 2015.

Slides:



Advertisements
Similar presentations
We show that MP can be used to allocate resources to treatments within and between patient populations, using a policy-relevant example. The outcome is.
Advertisements

1 A New Fiscal Rule Karnit Flug Research department The Bank of Israel May, 2009.
Optimal Drug Development Programs and Efficient Licensing and Reimbursement Regimens Neil Hawkins Karl Claxton CENTRE FOR HEALTH ECONOMICS.
POC INR Testing Rural and Remote Session 2015 CADTH SYMPOSIUM Janice Mann MD Knowledge Mobilization, CADTH.
Subject Selection and Recruitment David Wendler Department of Clinical Bioethics NIH, USA.
A METHODOLOGY FOR MEASURING THE COST- UTILITY OF EARLY CHILDHOOD DEVELOPMENTAL INTERVENTIONS Quality of improved life opportunities (QILO)
CADTH Therapeutic Reviews
Part I: Basic Economics Tools
Departing from the health maximisation approach Social value judgements made by NICE’s advisory committees Koonal K. Shah Office of Health Economics, UK.
Copyright © 2005 Mosby, Inc. All rights reserved. Slide 0.
1Carl-Fredrik Burman, 11 Nov 2008 RSS / MRC / NIHR HTA Futility Meeting Futility stopping Carl-Fredrik Burman, PhD Statistical Science Director AstraZeneca.
Technology and Health Care HCA 701 November 10, 2005.
Major Health Issues The Affordable Healthcare Act.
Health Technology Assessment Program Senate Health Care Committee November 20, 2014 Josh Morse, MPH, Program Director, Health Technology Assessment Daniel.
3rd Baltic Conference on Medicines Economic Evaluation, Reimbursement and Rational Use of Pharmaceuticals Pricing and Reimbursement of Pharmaceuticals.
Introduction ► This slide deck provides a suggested framework for the financial evaluation of an investment project. When evaluating any such project,
Cost-Benefit & Risk Analysis in Public Policy
Assistive Technology Clinical Outcomes Research Management System (AT-CORMS) Tool Utilizing the International Classification of Functioning (ICF) Cognitive.
1 OAC Principles MHSA Prevention and Early Intervention.
The Business Case for Bidirectional Integrated Care: Mental Health and Substance Use Services in Primary Care Settings and Primary Care Services in Specialty.
Outcomes based approach to measuring the impact of new technology Vikas Arya HSCI 740 Spring 2004 May 22,2004.
Comparative Effectiveness in Orthopaedics: Stakeholder Perspectives Kevin J. Bozic, MD, MBA Associate Professor and Vice Chair UCSF Department of Orthopaedic.
What is an Inventory Program for? Dr. Emilio Moceo Ph.D Director of Studies Meet international obligations and expectations Inform international, national,
Exhibit ES-1. Synergistic Strategy: Potential Cumulative Savings Compared with Current Baseline Projection, 2013–2023 Total NHE Federal government State.
CHALLENGES FOR PRAGMATIC TRIALS IN EUROPE Donna A. Messner, PhD.
HSA 171 CAR. 1436/ 7/4  The results of activities of an organization or investment over a given period of time.  Organizational Performance: ◦ A measure.
Leapfrog Hospital Rewards Program™: Implementation Options Catherine Eikel February 6, 2006.
Cost-Effectiveness Thresholds Professor of Health Economics
BACKGROUND Cost-effectiveness of Psychotherapy for Cluster C Personality Disorders and the Value of Information and Implementation Djøra I. Soeteman 1,2,
Instructions: Developing a Presentation for Communicating with Board This PowerPoint template is meant to serve as a starting point for the development.
Mohammad Aljawadi PharmD, PhD Clinical Pharmacy Department King Saud University PHCL 431 Sep, 2015.
© Nuffield Trust 24 October 2015 NHS payment reform: evolving policy and emerging evidence Chief Economist: Anita Charlesworth.
Module 3 Risk Analysis and its Components. Risk Analysis ● WTO SPS agreement puts emphasis on sound science ● Risk analysis = integrated mechanism to.
ASPECTS AFFECTING THE HOSPITAL OPERATION Financial Financial Operational Operational Administrative Administrative Clinical Clinical Safety Safety.
New Analysis of DRE Savings for States & Federal Government September 22, 2008.
A Journey Together: New Maryland Healthcare Landscape Health Montgomery Maryland Health Services Cost Review Commission March 2015.
Themes Emerging from Country and Related Presentations Notes from session 1545 – 1730 Thursday 17 February 2011 Albert Weale.
The future of Medicare fee-for- service Mark E. Miller, Ph.D. Executive Director Medicare Payment Advisory Commission October 16, 2006.
PHARMAC What is PHARMAC? PHARMAC - the Pharmaceutical Management AgencyPHARMAC - the Pharmaceutical Management Agency A New Zealand Government Agency (Crown.
A Journey Together: New Maryland Healthcare Landscape Baltimore County Forum Maryland Health Services Cost Review Commission June 2015.
Evidence Based Practice RCS /9/05. Definitions  Rosenthal and Donald (1996) defined evidence-based medicine as a process of turning clinical problems.
Performance Measurement & Public Reporting: Consumer Perspective and Principles To schedule a presentation of “Performance Measurement & Public Reporting”
Sara Lovell, CPCS Education Coordinator Providence Alaska Medical Center.
Risk Sharing Schemes Dr Rafiq Hasan Director of Market Access
Proposal on Revised Mechanism of Selecting Applications for Approval Presentation by Secretariat of Council for the AIDS Trust Fund in Sharing Session.
Who is involved in making NICE guidance recommendations and what evidence do they look at? Jane Cowl, Senior Public Involvement Adviser Tommy Wilkinson,
The US Preventive Services Task Force: Potential Impact on Medicare Coverage Ned Calonge, MD, MPH Chair, USPSTF.
Integrating Qualitative Research Into Health Technology Assessment in Canada The CADTH Experience Laura Weeks, PhD Scientific Advisor Kristen.
A Tale of Two Ratios: Assessing Value from the Perspectives of Cost-Effectiveness and Affordability Copyright ICER 2016 Dan Ollendorf, PhD Chief Scientific.
Value-Based Drug Pricing Steven D. Pearson, MD, MSc.
Organizations of all types and sizes face a range of risks that can affect the achievement of their objectives. Organization's activities Strategic initiatives.
Real World Evidence in Cancer Care: A Payer’s Perspective CADTH SYMPOSIUM 2016 Scott Gavura, Director, Provincial Drug Reimbursement Programs.
CIS 170 MART Teaching Effectively/cis170mart.com FOR MORE CLASSES VISIT HCA 497 MART Inspiring Minds/hca497mart.com FOR MORE CLASSES.
Aligning Drug Prices and Benefits: What Are Our Options? Copyright ICER 2016 Dan Ollendorf, PhD Chief Scientific Officer Institute for Clinical and Economic.
Medical Necessity Criteria An Overview of Key Components Presented by BHM Healthcare Solutions.
Appraisal and Funding of Cancer Drugs from July 2016 (including the new Cancer Drugs Fund) A new deal for patients, taxpayers and industry Tuesday 5 July.
Strategic Information Systems Planning
Alternative Payment Models in the Quality Payment Program
HEALTH ECONOMICS BASICS
Patient Involvement in the HTA Decision Making Process
Cornerstone Research Group Inc.
Regulated Health Professions Network Evaluation Framework
Discounting Future Benefits and Costs
Germany’s Approach to Prescription Drug Pricing
Medicare Rx Drug Benefit
EUnetHTA Assembly May 2018.
How much is health spending expected to grow?
Germany’s Approach to Prescription Drug Pricing
Presentation Developed for the Academy of Managed Care Pharmacy
LHIN Service Change Planning
Presentation transcript:

Evaluating the Value of New Drugs and Devices Copyright ICER 2015

The ICER Value Framework The “problems” the value framework was intended to address –Poor reliability and consistency of value determinations by payers –Need for a more explicit and transparent way for HTA groups and payers to analyze and judge value Tension between long-term and short-term perspectives The goal –A common language and mental model of the components of value across life science companies, payers, and other stakeholders A distinct advantage for ICER –Public HTA program “laboratories” for the application of a value framework in deliberation and voting Copyright ICER

ICER Value Assessment Policy Development Group NB: All participants provided input into the development of the value assessment framework but none should be assumed to approve of its approach Insurers and Pharmacy Benefit Management Companies –Aetna –Wellpoint –Kaiser Permanente –OmedaRx –Premera –America’s Health Insurance Plans (AHIP) Patient Organizations –FamiliesUSA Physician Specialty Societies –ASCO Manufacturers –Merck –Covidien –Lilly –GSK –Philips –Amgen –National Pharmaceutical Council (NPC) –Biotechnology Industry Organization Copyright ICER

What is the Overall Structure? Copyright ICER

A Value Assessment Flowchart Comparative Clinical Effectiveness Incremental cost per clinical outcomes achieved Other benefits or disadvantages Contextual Considerations “Care Value” Copyright ICER 2015 High Intermediate Low “Care Value”Potential Short-Term Health System Budget Impact Provisional “Health System Value” Mechanisms to Maximize Health System Value Achieved “Health System Value” High Intermediate Low Not evaluated by ICER or voted upon by public panels Discussed during public meetings; included in final ICER reports Discussed and voted upon during public meetings Discussed and voted upon during public meetings Discussed and voted upon during public meetings 5

Comparative Clinical Effectiveness Comparative clinical effectiveness reflects a joint judgment of the magnitude of the comparative net health benefit and the level of certainty in the evidence on net health benefit. ICER reports use ICER’s EBM matrix to describe the scientific staff’s judgment of comparative clinical effectiveness. –Judgments of the magnitude of net health benefit should consider not just average outcomes but potential significant differences in the pattern of patient response to treatment, e.g. significantly greater numbers of patients with long-term response despite overall equivalent mean response –Judgments of the level of uncertainty should take into consideration all aspects of the strength of a body of evidence as described in the ICER matrix guidebook ( content/uploads/2008/03/Rating-Matrix-User-Guide-FINAL-v pdf) Copyright ICER 2015 Comparative Clinical Effectiveness Incremental cost per outcomes achieved Other Benefits or Disadvantages Contextual Considerations Care Value 6

Incremental Cost per Outcomes Achieved –Cost per aggregated health measure (QALY) –ICER uses commonly cited cost/QALY thresholds in its guidance to its public appraisal committees Associated with high care value  <$100,000/QALY Associated with intermediate care value  $ K/QALY Associated with low care value  >$150,000/QALY Copyright ICER 2015 Comparative Clinical Effectiveness Incremental Cost per Outcomes Achieved Other Benefits or Disadvantages Contextual Considerations Care Value 7

Other Benefits or Disadvantages Benefits or disadvantages offered by the intervention to the individual patient, caregivers, the delivery system, other patients, or the public that would not have been considered as part of the evidence on comparative clinical effectiveness. Examples include (but are not limited to) –A public health benefit, e.g. reducing new infections –Treatment outcomes that reduce disparities across various patient groups –More rapid return to work or other positive effects on productivity (if not considered a benefit as part of comparative clinical effectiveness) –New mechanisms of action for treatments of clinical conditions (e.g., mental illness) that have demonstrated low rates of response to currently available treatments The relative importance of other benefits or disadvantages in an overall determination of care value will be judged not by ICER but by one of its independent public appraisal committees Copyright ICER 2015 Comparative Clinical Effectiveness Incremental Cost per Outcomes Achieved Other Benefits or Disadvantages Contextual Considerations Care Value 8

Contextual Considerations Contextual considerations include ethical, legal, or other issues that influence the relative priority of illnesses and interventions. Specific issue to be considered: –Is there a particularly high burden/severity of illness? –Do other acceptable treatments exist? –Are other, equally or more effective treatments nearing introduction into practice? –Would other societal values accord substantially more or less priority to providing access to this treatment for this patient population? The relative importance of contextual considerations in an overall determination of care value will be judged not by ICER but by one of its independent public appraisal committees. Copyright ICER 2015 Comparative Clinical Effectiveness Incremental Cost per Outcomes Achieved Other Benefits or Disadvantages Contextual Considerations Care Value 9

Provisional Health System Value –Provisional health system value represents a judgment integrating consideration of the long-term care value of a new intervention with an analysis of its potential short-term budget impact if utilization is unmanaged. –If the potential budget impact of unmanaged introduction of a new intervention would contribute to an increase in overall health care costs at a trend far greater than growth in the overall national economy, health system value would be threatened. –Therefore, if the provisional health system value of a new intervention is low, manufacturers, insurers, providers, and policymakers should consider mechanisms to achieve improved health system value through changes to price, payment mechanisms, and/or patient eligibility. Copyright ICER 2015 Care Value Potential Health System Budget Impact Provisional Health System Value Mechanisms to Maximize System Value Achieved Health System Value 10

Potential Budget Impact of Unmanaged Utilization Potential Budget Impact: –Estimated net change in total health care costs over an initial 5- year time-frame –Calculations will be based on broad assumptions regarding the unmanaged uptake of new interventions, i.e. without estimating potential payer or provider group actions that might modulate uptake –New interventions will be assigned to one of 4 uptake patterns – very high, high, intermediate, and low – based on consideration of 6 Rx/condition/market criteria Magnitude of improvement in clinical safety and/or effectiveness Patient-level burden of illness Patient preference (ease of administration) Proportion of eligible patients currently being treated Primary care vs. specialty clinician prescribing/use Presence or emergence of competing treatments of equal or superior effectiveness Copyright ICER 2015 Care Value Potential Health System Budget Impact Provisional Health System Value Mechanisms to Maximize System Value Achieved Health System Value 11

Potential Budget Impact of Unmanaged Utilization Unmanaged 5-year uptake patterns –Very high uptake pattern 75% of eligible patients assumed to use the intervention –High uptake pattern 50% of eligible patients assumed to use the intervention –Intermediate uptake pattern 25% of eligible patients assumed to use the intervention –Low uptake pattern 10% of eligible patients assumed to use the intervention Copyright ICER 2015 Care Value Potential Health System Budget Impact Provisional Health System Value Mechanisms to Maximize System Value Achieved Health System Value 12

Potential Budget Impact Threshold: Drugs Theoretical basis of the potential budget impact threshold for new drugs –The amount of net cost increase per individual new drug that would contribute to growth in overall health care spending greater than the anticipated growth in national GDP + 1% Calculating the threshold for individual new drugs –World Bank estimates US GDP growth at an average of 2.75%, so GDP + 1% = 3.75% –National health care expenditures for 2014 were estimated by CMS at $3,080,100,000,000 –Contribution of drug spending in 2014 to total national health care costs = 13.3% ($409,653,300,000 out of total NHE) –If we assume that the net health care cost impact for existing drugs does not change, and allow only new drugs to account for growth in net health costs related to drugs, then all new drugs combined should not contribute to net health care cost growth more than 3.75% over current drug spending ($409,653,300,000): 3.75% x $409,653,300,000 = $15,361,998,750 –$15,361,998,750 is therefore the budget impact threshold for NET costs due to new drugs for –To calculate the budget impact threshold for each individual new drug, we divide the total maximum budget impact for all new drugs by the 2-year running average of the number of new drugs approved in the US. For 2013 and 2014 the average number of new drugs approved was ( ) ÷ 2 = 34 –The average net budget impact threshold for each new drug can then be calculated: Total net budget impact for all drugs of $15,361,998,750 ÷ 34 = $452 million average net budget impact per new drug –If $452 million is the average budget impact threshold, then in order to identify those new drugs whose potential budget impact is significantly higher than the average, ICER will set its potential budget impact threshold at 2x the level of the “average” drug: $452 million x 2 = $904 million NET health care cost increase. –The ICER threshold for NET budget impact of individual new drugs = $904 million. This figure represents net additional costs to the health care system, including cost offsets of switching from other treatments as well as any potential reductions in hospitalizations or changes in other health care costs. Copyright ICER

Summary of Potential Budget Impact Threshold Calculations ItemParameterEstimateSource 1Growth in US GDP, (est.) +1%3.75%World Bank, Total health care spending ($)$3.08 trillionCMS NHE, Contribution of drug spending to total health care spending (%) 13.3%CMS NHE, Altarum Institute, Contribution of drug spending to total health care spending ($) (Row 2 x Row 3) $410 billionCalculation 5 Annual threshold for net health care cost growth for ALL new drugs (Row 1 x Row 4) $15.4 billionCalculation 6 Average annual number of new molecular entity approvals, FDA, Annual threshold for average cost growth per individual new molecular entity (Row 5 ÷ Row 6) $452 millionCalculation 8Annual threshold for estimated potential budget impact for each individual new molecular entity (doubling of Row 7) $904 million Calculation Copyright ICER

Potential Budget Impact Threshold: Devices Theoretical basis of the potential budget impact threshold for new drugs –The amount of net cost increase per individual new device that would contribute to growth in overall health care spending greater than the anticipated growth in national GDP + 1% Calculating the potential budget impact threshold for individual new devices –World Bank estimates US GDP growth at an average of 2.75%, so GDP + 1% = 3.75% –National health care expenditures for 2014 were estimated at ~$3,080,100,000,000 –Contribution of device spending in 2014 to total national health care costs ≈ 6.0% ($184,806,000,000 out of total NHE) –If we assume that the net health care cost impact for existing devices does not change, and allow only new devices to account for growth in net health costs related to devices, then all new devices combined should not contribute to net health care cost growth more than 3.75% over current device spending ($184,806,000,000): 3.75% x $184,806,000,000 = $6,930,225,000 –$6,930,225,000 is therefore the budget impact threshold for NET costs due to new devices for –To calculate the budget impact threshold for an individual new device, we divide the total budget impact cap for all new devices by the 2-year running average of the number of new devices approved in the US. For 2013 and 2014 the average number of new devices approved was ( ) ÷ 2 = 23 –The average net budget impact threshold for each new device can then be calculated: Total net budget impact for all devices of $6,930,225,000 ÷ 23 = $301 million average net budget impact per new device –If $301.3 million is the average budget impact threshold, then in order to identify those new devices whose potential budget impact is significantly higher than the average, ICER will set its potential budget impact threshold at 2x the level of the “average” device: $301 million x 2 = $602 million NET health care cost increase. –The ICER threshold for NET budget impact of individual new devices = $602 million. This figure represents net additional costs to the health care system, including cost offsets of switching from other treatments as well as any potential reductions in hospitalizations or changes in other health care costs. Copyright ICER

Draft report cost/QALY estimate Significant benefits or contextual factors Probable CTAF/CEPAC Care Value votes Potential Budget Impact Probable CTAF/CEPAC Provisional Health System Value votes < $100K/QALY- sig benefitsHigh or Intermediate< $904 millionHigh or Intermediate < $100K/QALY- sig benefitsHigh or Intermediate> $904 millionIntermediate or Low < $100K/QALY+ sig benefitsHigh< $904 millionHigh < $100K/QALY+ sig benefitsHigh> $904 millionHigh, Intermediate or Low $ K/QALY- sig benefitsIntermediate< $904 millionIntermediate $ K/QALY- sig benefitsIntermediate> $904 millionLow or Intermediate $ K/QALY+ sig benefitsIntermediate or High< $904 millionIntermediate or High $ K/QALY+ sig benefitsIntermediate or High> $904 millionLow or Intermediate > $150K/QALY- sig benefitsLow< $904 millionLow > $150K/QALY- sig benefitsLow> $904 millionLow > $150K/QALY+ sig benefitsLow or Intermediate< $904 millionLow or Intermediate > $150K/QALY+ sig benefitsLow or intermediate> $904 millionLow Copyright ICER Connecting care value and provisional health system value: Drugs

Draft report cost/QALY estimate Significant benefits or contextual factors Probable CTAF/CEPAC Care Value votes Potential Budget Impact Probable CTAF/CEPAC Provisional Health System Value votes < $100K/QALY- sig benefitsHigh or Intermediate< $602 millionHigh or Intermediate < $100K/QALY- sig benefitsHigh or Intermediate> $602 millionIntermediate or Low < $100K/QALY+ sig benefitsHigh< $602 millionHigh < $100K/QALY+ sig benefitsHigh> $602 millionHigh, Intermediate or Low $ K/QALY- sig benefitsIntermediate< $602 millionIntermediate $ K/QALY- sig benefitsIntermediate> $602 millionLow or Intermediate $ K/QALY+ sig benefitsIntermediate or High< $602 millionIntermediate or High $ K/QALY+ sig benefitsIntermediate or High> $602 millionLow or Intermediate > $150K/QALY- sig benefitsLow< $602 millionLow > $150K/QALY- sig benefitsLow> $602 millionLow > $150K/QALY+ sig benefitsLow or Intermediate< $602 millionLow or Intermediate > $150K/QALY+ sig benefitsLow or intermediate> $602 millionLow Copyright ICER Connecting care value and provisional health system value: Devices

What if the Provisional Health System Value is Judged “Low”? Copyright ICER 2015 Care Value Potential Health System Budget Impact Provisional Health System Value Mechanisms to Maximize System Value Achieved Health System Value Maximizing health system value is an action step, ideally supported by enhanced early dialogue among manufacturers, payers, and other stakeholders. –Determine the extent to which real-world constraints in uptake will limit the actual budget impact of the new service –Decide if the expected budget impact for this service is manageable in the context of the current health care landscape –Seek savings in other areas to optimize the entire portfolio of services –Change the payment mechanism (longer terms) and/or price (lower) –Prioritize Rx populations to reduce immediate cost impact –Share the costs with government or other funders The policy actions taken will determine the “achieved” health system value 18

From Value Assessment to ICER “Value-Based Price Benchmarks” The ICER value-based price benchmark represents the price at which patients in the population being considered could be treated with reasonable long- term value at the individual patient level and with overall short-term costs to the health care system that would not be so large as to be likely to contribute to faster growth in health care spending than growth in the national economy. Copyright ICER

Draft report cost/QALY estimate and VBPB Sig benefits or contextual factors as per CTAF/CEPAC Probable Care value vote Potential Budget Impact Probable Provisional health system value vote Final VBPB < $100K/QALY Draft VBPB: $ K/QALY (care value price range) limited by $904 million budget impact threshold if applicable - sig bens $100K/QALY with $904M budget impact limit if applicable + sig bens $150K/QALY with $904M budget impact limit if applicable Copyright ICER From Value Assessment to Value-Based Price Benchmark: Drugs

Draft report cost/QALY estimate and draft value-based price benchmark Sig benefits or contextual factors as per CTAF/CEPAC Probable CTAF/CEPAC Care value votes Potential Budget Impact Probable CTAF/CEPAC Provisional Health System Value votes Final ICER value- based price benchmark < $100K/QALY Draft VBPB: $ K/QALY (care value price range) limited by $904 million budget impact threshold if applicable - sig bens $100K/QALY with $904M budget impact limit if applicable + sig bens $150K/QALY with $904M budget impact limit if applicable $ K/QALY Draft VBPB: $ K/QALY (care value price range) limited by $904 million budget impact threshold if applicable - sig bens $100K/QALY with $904M budget impact limit if applicable + sig bens $150K/QALY with $904M budget impact limit if applicable > $150K/QALY Draft VBPB: $ K/QALY (care value price range) limited by $904 million budget impact threshold if applicable - sig bens $100K/QALY with $904M budget impact limit if applicable + sig bens $150K/QALY with $904M budget impact limit if applicable Copyright ICER From Value Assessment to Value-Based Price Benchmark: Drugs

Draft report cost/QALY estimate and draft value-based price benchmark Sig benefits or contextual factors as per CTAF/CEPAC Probable CTAF/CEPAC Care value votes Potential Budget Impact Probable CTAF/CEPAC Provisional Health System Value votes Final ICER value- based price benchmark < $100K/QALY Draft VBPB: $ K/QALY (care value price range) limited by $652M budget impact limit if applicable - sig bens $100K/QALY with $602 budget impact limit if applicable + sig bens $150K/QALY with $602M budget impact limit if applicable $ K/QALY Draft VBPB: $ K/QALY (care value price range) limited by $652M budget impact limit if applicable - sig bens $100K/QALY with $602M budget impact limit if applicable + sig bens $150K/QALY with $602M budget impact limit if applicable > $150K/QALY Draft VBPB: $ K/QALY (care value price range) limited by $652M budget impact limit if applicable - sig bens $100K/QALY with $602M budget impact limit if applicable + sig bens $150K/QALY with $602M budget impact limit if applicable Copyright ICER From Value Assessment to Value-Based Price Benchmark: Devices

The ICER Value Framework Comparative Clinical Effectiveness Incremental cost per clinical outcomes achieved Other benefits or disadvantages Contextual Considerations “Care Value” Copyright ICER 2015 High Intermediate Low “Care Value”Potential Short-term Health System Budget Impact Provisional “Health System Value” Mechanisms to Maximize Health System Value Achieved “Health System Value” High Intermediate Low Not evaluated by ICER or voted upon by public panels Discussed during public meetings; included in final ICER reports Discussed and voted upon during public meetings Discussed and voted upon during public meetings Discussed and voted upon during public meetings 23