AHRQ Quality Indicators 101: Background and Introduction to the AHRQ QIs John Bott, Contractor, Agency for Healthcare Research and Quality April 28th,

Slides:



Advertisements
Similar presentations
Manatt manatt | phelps | phillips New York State Health Information Technology Summit Initiative Overview and Update Rachel Block, Project Director United.
Advertisements

Adverse Patient Safety Events: Costs of Readmissions and Patient Outcomes Following Discharge Didem M. Bernard, Ph.D. William E. Encinosa, Ph.D.
Care Transitions – Critical to Quality and Patient Safety Society of Hospital Medicine Lakshmi K. Halasyamani, MD.
What Types of Websites and Reports Can MONAHRQ Generate? May 2014 Note: This is one of seven slide sets outlining MONAHRQ and its value, available at
What Is MONAHRQ? May 2014 Note: This is one of seven slide sets outlining MONAHRQ and its value, available at
Barbara Rudolph, PhD, MSSW NAHDO Consultant. To enhance the value of statewide APCDs by cataloging measures and reporting practices To develop and disseminate.
Preventable Hospitalizations: Assessing Access and the Performance of Local Safety Net Presented by Yu Fang (Frances) Lee Feb. 9 th, 2007.
Irene Fraser, Ph.D., Director
Advancing Excellence in Health Care Agency for Healthcare Research and Quality Advancing Excellence in Health Care Input Your Data. Output.
Using AHRQ Prevention Quality Indicators to Assess Program Performance in Medicaid Managed Care Sandra K. Mahkorn MD, MPH, MS Chief Medical Officer Wisconsin.
Transparency for Quality Improvement Efforts at the Kentucky Cabinet for Health and Family Services (CHFS) Trudi Matthews, MA Senior Policy Advisor Office.
DATA Role of data in QI and Scholarship Characteristics of “good” data Sources/categories of data Administrative databases – pros &cons New Informatics.
Hospital Inpatient Discharge Data (HIDD) Hospital Inpatient Discharge Data (HIDD) Using Public Health Data New Mexico Data Users Conference November 17,
Present on Admission. Requirements of Deficit Reduction Act 2005 CMS and CDC choose conditions that are: High Cost, High Volume, or both. Assigned to.
Documentation for Acute Care
Research and analysis by Avalere Health Hospitals Demonstrate Commitment to Quality Improvement October 2012.
The AHRQ Quality Indicators Melanie Chansky, MAA, Research Scientist Battelle Memorial Institute December 4, 2008.
AHRQ Quality Indicators Toolkit Tool A.2 Instructions.
AHRQ Quality Indicators Toolkit Tool B.3b The AHRQ Quality Indicators Results and Discussion of Data Analysis.
What Types of Websites and Reports Can MONAHRQ Generate? March 2015 Note: This is one of eight slide sets outlining MONAHRQ and its value, available at.
What Is MONAHRQ? March 2015 Note: This is one of eight slide sets outlining MONAHRQ and its value, available at
William B Munier, MD, MBA, Director Center for Quality Improvement and Patient Safety Agency for Healthcare Research and Quality AHRQ Annual Conference.
1 Using WhyNotTheBest.org to Benchmark and Improve Performance: A Webinar Anne-Marie J. Audet, M.D., Sc.M., S.M. Vice President, Delivery System Reform.
Impact of the MS-DRGs on the AHRQ QIs
Preventable Hospitalization Costs: A County-Level Mapping Tool State Healthcare Quality Improvement Workshop: Tools You Can Use to Make a Difference January.
Agency For Healthcare Quality and Research Quality Indicators NH Health Care QA Commission AHRQ Subcommittee Report July 31, 2009.
1 NATIONAL ADVISORY COUNCIL ON HEALTHCARE RESEARCH AND QUALITY Subcommittee on Quality Measures for Children's Healthcare in Medicaid and CHIP Overview.
Preventable Hospitalization Costs: A County-Level Mapping Tool June 16, 2008 Marybeth Farquhar Agency for Healthcare Research and Quality Melanie Chansky.
CARDIOVASCULAR DISEASE National Healthcare Quality and Disparities Report Chartbook on Effective Treatment.
Agency for Healthcare Research and Quality Advancing Excellence in Health Care A Web-Based Tool for Quality and Utilization Reporting Visit.
Quality Indicators™: Moving Ahead AHRQ Annual Conference 2012 Mamatha Pancholi, MS, Project Officer, Quality Indicators September 11, 2012.
Agency for Healthcare Research and Quality Advancing Excellence in Health Care Improving Administrative Data for Public Reporting Anne Elixhauser.
The 2nd P in P4P: Towards a Hybrid Data Strategy
Preventable Hospitalization Costs and Mapping Tool John Bott Center for Delivery, Organization, and Markets July 21, 2010.
AHRQ Quality Indicators
Putting the Tools to Use: One Hospital’s Experiences Donna Farley, PhD – RAND Ellen Robinson, PT ATC – Harborview Medical Center.
July 31, 2009Prepared by the Maine Health Information Center Overview of All Payer Claims Data Suanne Singer, Senior Consultant Maine Health Information.
Hospital State Division Kristi Martinsen Hospital State Division Director HSD Overview September 2014 Department of Health and Human Services Health Resources.
Arizona Health Care Cost Containment System DRG-Based Inpatient Hospital Payment System Project Overview June 14, 2012.
Advancing Excellence in Health Care 2.0 ETA December 2010 Carol Sniegoski AHRQ Annual Conference September 27, 2010 Preview:
3M Health Information Systems APR-DRGs: A Practical Update.
Day 1: Session I Presenter: Sam Shalaby, General Motors Corporation AHRQ QI User Meeting September 26-27, 2005.
Agency for Healthcare Research and Quality Advancing Excellence in Health Care A Web-Based Tool for Quality and Utilization Reporting Anne.
AHRQ Quality Indicators 2005 AHRQ QI User Meeting September 26, 2005 Marybeth Farquhar, AHRQ.
Not Just Your Grandmother’s Administrative Data Anymore: The Vision Irene Fraser, Ph.D.. Director Center for Delivery, Organization and Markets Presentation.
Collaborating with FADONA to Improve Care Coordination FHA Readmission Collaborative June 4, 2010.
Agency for Healthcare Research and Quality Advancing Excellence in Health Care A Web-Based Tool for Quality and.
AHRQ PSIs and IQIs in National Pay for Reporting September 14, 2009 AHRQ QI Conference Shaheen Halim, Ph.D. Centers for Medicare & Medicaid Services.
AHRQ and the Science of Public Reporting Presentation to National Advisory Council Irene Fraser and Carol Sniegoski July 22, 2011.
AHRQ Quality Indicators NQF Update Marybeth Farquhar, PhD, MSN, RN QI Users Meeting AHRQ 2 nd Annual Conference Rockville, MD September 10, 2008.
Using AHRQ Quality Indicators Denise Remus PhD, RN Senior Research Scientist Agency for Healthcare Research and Quality (AHRQ)
ICD-10 Implementation: Opportunities and Challenges Diane Stollenwerk, MPP NAHDO Conference - October 28, 2015 Input Your Data. Output Your Website.
Hospital Measures Reporting in Ohio Michele Shipp, MD, DrPH AHRQ QUALITY INDICATORS USERS MEETING Wednesday September 9, 2008 AHRQ ANNUAL CONFERENCE 2008.
Agency for Healthcare Research and Quality Advancing Excellence in Health Care A Web-Based Tool for Quality and Utilization Reporting Visit.
BlueCross BlueShield of Illinois a Division of Health Care Service Corporation (HCSC), a Mutual Legal Reserve Company Blue Cross Blue Shield of Illinois.
Iowa Healthcare Collaborative - Past, Present, and Future Use of AHRQ Quality Indicators Lance Roberts 2009 AHRQ Annual Conference September 24,
Development and Testing of the AHRQ QI Toolkit for Hospitals Donna O. Farley, PhD Peter Hussey, PhD RAND Corporation.
Transparency for Quality Improvement Efforts in the Commonwealth of Kentucky Trudi Matthews, MA AHRQ State Health Care Quality Improvement Workshop Phoenix,
Future Validation and Improvement of the AHRQ QI AHRQ Annual Conference September 10, 2008 Bethesda, MD Presented by Kathryn McDonald.
Uses of the NIH Collaboratory Distributed Research Network Jeffrey Brown, PhD for the DRN Team Harvard Pilgrim Health Care Institute and Harvard Medical.
National Quality Strategy Overview March 2016 Each slide includes notes that you can access by selecting “View” and then “Notes Page” in PowerPoint. Please.
Comparative Effectiveness Research (CER) and Patient- Centered Outcomes Research (PCOR) Presentation Developed for the Academy of Managed Care Pharmacy.
Future Validation and Improvement of the AHRQ QI AHRQ Annual Conference September 10, 2008 Bethesda, MD Presented by Kathryn McDonald.
NHQR Efficiency Measurement: Potentially Avoidable Hospitalization Trends & Costs Roxanne M. Andrews, Ph.D. Agency for Healthcare Research and Quality.
AHRQ QI Guide to Comparative Reporting AHRQ Annual Conference September 10, 2008 Bethesda, MD Presented by Sheryl Davies.
Region 15 Regional Healthcare Partnership 4th Public Meeting
Presentation Developed for the Academy of Managed Care Pharmacy
Medicare and Hospitals
Provider Peer Grouping: Project Overview
The AHRQ Quality Indicators Results and Discussion of Data Analysis
Presentation transcript:

AHRQ Quality Indicators 101: Background and Introduction to the AHRQ QIs John Bott, Contractor, Agency for Healthcare Research and Quality April 28th, 2011

AHRQ – Agency within DHHS 2

Overview 1. Origins 2. Current modules 3. Advantages & challenges 4. Recent improvements 5. Uses of the AHRQ QIs 6. Tools: public reporting & quality improvement 7. National Quality Forum Endorsement 8. Additional activities 9. Questions 3

AHRQ QIs & the Healthcare Cost & Utilization Project (HCUP) HCUP: Partnership among States, industry & AHRQ HCUP: Partnership among States, industry & AHRQ Uniform database for cross-State studies; includes clinical, demographic, and resource use information Uniform database for cross-State studies; includes clinical, demographic, and resource use information Represents all inpatient discharge data from 44 participating States — represents approximately 95% of all discharges Represents all inpatient discharge data from 44 participating States — represents approximately 95% of all discharges 4 The AHRQ QIs utilize HCUP in measure development & maintenance So what is HCUP?

AHRQ Quality Indicators (QIs) Developed through contract with UCSF-Stanford Evidence-based Practice Center & UC Davis Developed through contract with UCSF-Stanford Evidence-based Practice Center & UC Davis Use existing hospital discharge data, based on readily available data elements Use existing hospital discharge data, based on readily available data elements Incorporate a range of severity adjustment methods, including APR-DRGs* & co-morbidity groupings Incorporate a range of severity adjustment methods, including APR-DRGs* & co-morbidity groupings Current modules: Prevention, Inpatient, Patient Safety, Pediatric & Neonatal Current modules: Prevention, Inpatient, Patient Safety, Pediatric & Neonatal * 3M All Patient Refined - Diagnosis Related Groups * 3M All Patient Refined - Diagnosis Related Groups 5

Example of indicator evaluation PANEL EVALUATION FURTHER EMPIRICAL ANALYSES REFINED DEF. FURTHER REVIEW? FINAL DEFINITION INITIAL EMPRICAL ANALYSES AND DEFINITION LITERATURE REVIEW USER DATA 6

Structure of AHRQ QIs Measure definitions based on a number of data elements, e.g.: Measure definitions based on a number of data elements, e.g.: – ICD-9-CM* diagnosis & procedure codes – Medicare Diagnostic Related Groups (DRGs), Major Diagnostic Categories (MDC), sex, age, procedure dates, admission type, admission source, discharge disposition, discharge quarter, point of origin, present on admission Numerator: Number of cases with the outcome of interest (e.g., postoperative sepsis, avoidable asthma hospitalization asthma, death) Numerator: Number of cases with the outcome of interest (e.g., postoperative sepsis, avoidable asthma hospitalization asthma, death) Denominator: Population at risk (e.g., pneumonia patients, elective surgical patients, county population from census data) Denominator: Population at risk (e.g., pneumonia patients, elective surgical patients, county population from census data) Observed rate: The numerator / denominator Observed rate: The numerator / denominator Volume counts for selected procedures Volume counts for selected procedures Counts of admissions at an area level for certain types of admissions Counts of admissions at an area level for certain types of admissions * International Classification of Diseases, Ninth Revision, Clinical Modification * International Classification of Diseases, Ninth Revision, Clinical Modification 7

Overview 1. Origins 2. Current Modules 3. Advantages & Challenges 4. Recent Improvements 5. Uses of the AHRQ QIs 6. Tools: public reporting & quality improvement 7. National Quality Forum Endorsement 8. Additional Activities 9. Questions 8

Inpatient QIs Mortality,Utilization,Volume AHRQ Quality Indicators Prevention QIs (Area Level) Avoidable Hospitalizations / Other Avoidable Conditions Patient Safety QIsComplications, Unexpected Death Pediatric QIs NeonatalQIs 9

Overview 1. Origins 2. Current Modules 3. Advantages & Challenges 4. Recent Improvements 5. Uses of the AHRQ QIs 6. Tools: public reporting & quality improvement 7. National Quality Forum Endorsement 8. Additional Activities 9. Questions 10

Advantages Public Access Public Access – All development documentation and details on each indicator available on Web site – Software available to download at no cost Documentation & software at: Documentation & software at: – Standardized indicator definitions – Can be used with any administrative data, e.g. HCUP, MEDPAR*, State data sets, payer data, hospital internal data – Hospitals can replicate results * * Medicare Provider Analysis & Review (Medicare administrative inpatient data) 11

Advantages (cont.) Scope Scope – Over 90 individual measures – Each measure can be stratified by other variables including patient race, age, sex, provider, geographic region – Include priority populations & areas, e.g.: Child health, women’s health (pregnancy & child-birth), diabetes, hypertension, ischemic heart disease, stroke, asthma, patient safety, preventive care Child health, women’s health (pregnancy & child-birth), diabetes, hypertension, ischemic heart disease, stroke, asthma, patient safety, preventive care – Focus on acute care, but crosses over to community & outpatient care delivery settings 12

Advantages (cont.) Harmonization of measures Harmonization of measures Indicator maintenance and updates Indicator maintenance and updates Tools & technical assistance Tools & technical assistance National benchmarks: National benchmarks: – National Healthcare Quality Report – National Healthcare Disparities Report – HCUPnet 13

Current limitations & challenges Outcomes data less actionable than processes Outcomes data less actionable than processes Limited clinical detail Limited clinical detail Risk adjustment challenges Risk adjustment challenges Accuracy hinges on accuracy of documentation & coding Accuracy hinges on accuracy of documentation & coding Data potentially subject to gaming Data potentially subject to gaming Time lag of the data Time lag of the data 14

Overview 1. Origins 2. Current Modules 3. Advantages & Challenges 4. Recent Improvements 5. Uses of the AHRQ QIs 6. Tools: public reporting & quality improvement 7. National Quality Forum Endorsement 8. Additional Activities 9. Questions 15

Recent improvements Composite measures Composite measures – Developed composite measures for the IQIs, PSIs, PQIs & PDIs Risk adjustment based on administrative data Risk adjustment based on administrative data – Additional risk adjustment methods for AHRQ QIs Updated literature reviews Updated literature reviews – Completed IQIs, PDIs & PSIs Reporting template Reporting template – Tested & refined National Quality Forum review & endorsement of a number of the QIs National Quality Forum review & endorsement of a number of the QIs Use of present on admission & point of origin data Use of present on admission & point of origin data 16

Overview 1. Origins 2. Current Modules 3. Advantages & Challenges 4. Recent Improvements 5. Uses of the AHRQ QIs 6. Tools: public reporting & quality improvement 7. National Quality Forum Endorsement 8. Additional Activities 9. Questions 17

General uses of the AHRQ QIs Hospital quality improvement efforts Hospital quality improvement efforts – Individual hospitals & health care systems, such as: Banner Health (a multi-hospital system in AZ) Banner Health (a multi-hospital system in AZ) Norton Healthcare (a multi-hospital system in KY) Norton Healthcare (a multi-hospital system in KY) Baycare Health System (a multi-hospital system in FL) Baycare Health System (a multi-hospital system in FL) Ministry Health Care (a multi-hospital system in WI) Ministry Health Care (a multi-hospital system in WI) – Hospital association member based reports, such as: University Healthsystem Consortium University Healthsystem Consortium Dallas - Fort Worth Hospital Council Dallas - Fort Worth Hospital Council Premier (note: Premier participating in CMS pay for performance demonstration, which includes AHRQ QIs) Premier (note: Premier participating in CMS pay for performance demonstration, which includes AHRQ QIs) 18

General uses of the AHRQ QIs Aggregate reporting: National, state, regional Aggregate reporting: National, state, regional – National Healthcare Quality / Disparities Reports – Commonwealth Fund’s Health Performance Initiative Research Research – Tracking quality of care for populations over time & across areas – Tracking disparities in care over time and across areas – Comparing quality between different types of hospitals or hospital systems (e.g., size, volume, teaching status, ownership, accreditation, critical access status) – Evaluating impact of interventions to reduce costs or improve quality (e.g., resident work hours reform, electronic health information systems, hospital mergers & consolidations) 19

General uses of the AHRQ QIs Value based purchasing / pay for performance (P4P) Value based purchasing / pay for performance (P4P) – CMS - Premier Demo – Anthem of Virginia – The Alliance (Wisconsin) Hospital level public reporting Hospital level public reporting – Currently: Statewide public reporting (upcoming slide) – Upcoming: CMS Hospital Compare, including Veterans Affairs medical centers (upcoming slide) Hospital profiling: Public reporting & P4P Hospital profiling: Public reporting & P4P – Blue Cross / Blue Shield of Illinois 20

Current & future uses of AHRQ QIs in public reports State level National level AHRQ QIs used in public reports FY11 IPPS rule *: reports in 25 states – two-thirds 6 individual AHRQ QIs of U.S. population & 2 AHRQ QI composites slated for Hospital Compare slated for Hospital Compare FY12 IPPS rule *: FY12 IPPS rule *: 2 additional individual 2 additional individual AHRQ QIs to be added to AHRQ QIs to be added to Hospital Compare Hospital Compare * * Inpatient Prospective Payment System rule

Overview 1. Origins 2. Current Modules 3. Advantages & Challenges 4. Recent Improvements 5. Uses of the AHRQ QIs 6. Tools: public reporting & quality improvement 7. National Quality Forum Endorsement 8. Additional Activities 9. Future Vision 10. Questions 22

AHRQ tools for public reporting the AHRQ QIs: Recent & current Reporting templates (or model reports) Reporting templates (or model reports) – Tool for reporting sponsors to use the best evidence on public reports Reporting guidance Reporting guidance – Report on the appropriate uses of the AHRQ QIs based on the evidence to date Quality Indicators Learning Institute Quality Indicators Learning Institute – Web conference series to disseminate technical information of various aspects of public reporting 23

AHRQ tools for public reporting the AHRQ QIs (cont.) MONAHRQ software MONAHRQ software – Software to input hospital administrative claims data & produce a website to publicly report performance in the AHRQ QIs at the hospital & community level - MONAHRQ Web site at: - MONAHRQ Web site at: MONAHRQ Learning Network MONAHRQ Learning Network – Provide information & technical assistance to users & potential users of MONAHRQ 24

AHRQ tools for quality improvement using the AHRQ QIs: Upcoming Quality improvement toolkit under development for hospital use to make improvement related to the AHRQ IQIs & PSIs Quality improvement toolkit under development for hospital use to make improvement related to the AHRQ IQIs & PSIs Some specifics of the toolkit: Some specifics of the toolkit: – Methods to evaluate the data for identifying opportunities for improvement – Strategies for implementing interventions (or evidence-based best practices) – Methods to measure progress Available late Available late

Overview 1. Origins 2. Current Modules 3. Advantages & Challenges 4. Recent Improvements 5. Uses of the AHRQ QIs 6. Tools: public reporting & quality improvement 7. National Quality Forum Endorsement 8. Additional Activities 9. Questions 26

National Quality Forum Endorsement: Overview Currently, NQF endorsement in regard to: 48 of the AHRQ QIs 48 of the AHRQ QIs – Inpatient Quality Indicators (IQIs): 13 – Patient Safety Indicators (PSIs): 10 – Prevention Quality Indicators (PQIs): 14 – Pediatric Quality Indicators (PDIs): 10 – Neonatal Quality Indicators (NQIs): 1 3 AHRQ QI composites 3 AHRQ QI composites – Mortality for selected conditions – Patient safety for selected indicators – Pediatric patient safety for selected indicators 27

Overview 1. Origins 2. Current Modules 3. Advantages & Challenges 4. Recent Improvements 5. Uses of the AHRQ QIs 6. Tools: public reporting & quality improvement 7. National Quality Forum Endorsement 8. Additional Activities 9. Questions 28

Highlights of additional activities AHRQ funded HCUP Partner projects to add more clinical data to statewide administrative databases (e.g. present on admission, lab values) AHRQ funded HCUP Partner projects to add more clinical data to statewide administrative databases (e.g. present on admission, lab values) AHRQ proposed coding changes & clarifications to ICD-9 to enhance accuracy & use of some indicators AHRQ proposed coding changes & clarifications to ICD-9 to enhance accuracy & use of some indicators – Retinopathy of prematurity – Necrotizing enterocolitis – Disruption of postoperative wound – Deep vein thrombosis – Transfusion reaction Working with other measure developers to align specifications of similar measures Working with other measure developers to align specifications of similar measures – The Joint Commission – Centers for Medicare & Medicaid Services – National Perinatal Information Center – Researchers 29

Organisation for Economic Cooperation and Development (OECD) The OECD Health Care Quality Indicators Project includes a patient safety component The OECD Health Care Quality Indicators Project includes a patient safety component The project conducted a pilot with seven countries to translate a number of PSIs to the WHO’s version of ICD 10 The project conducted a pilot with seven countries to translate a number of PSIs to the WHO’s version of ICD 10 A paper on the pilot was recently published in the International Journal of Quality Health Care A paper on the pilot was recently published in the International Journal of Quality Health Care – volume 21, number 4, pages 272 – 278 The pilot has recently expanded The pilot has recently expanded – Currently 18 countries are participating 30

Validation pilot Pilot Objectives: Pilot Objectives: – Gather evidence on the scientific acceptability of the PSIs  Medical record reviews, data analysis, clinical panels, evidence reviews – Consolidate the evidence base – Improve guidance on the interpretation and use of the data – Evaluate potential refinements to the specifications 31

Validation pilot, phases 1 to 4 Phase 1 (Concluded) Phase 1 (Concluded) – Focus on estimating false positive rate for 5 PSIs (# 6, 7, 12, 13, 15) – 6 articles published or soon to be published Phase 2 & 3 (Currently in data analysis) Phase 2 & 3 (Currently in data analysis) – Focus on estimating false positive rate for 2 other PSIs (# 9, 10) – Will also estimate false negative rate (sensitivity) for these 2 PSIs and up to 6 more PSIs (# 5-7, 11, 14, 15) Phase 4 (Ongoing) Phase 4 (Ongoing) – Collaboration with University HealthSystem Consortium on 3 PSIs (# 3, 11, 12) 2 articles published (PSI 11, 12) and 1 in preparation (PSI 3) 2 articles published (PSI 11, 12) and 1 in preparation (PSI 3) – Collaboration with Veterans Health Administration on 10 PSIs (# 3, 5, 6, 8, 9, 11-15) 3 articles published or soon to be published (PSI 6, 11-13, 15) 3 articles published or soon to be published (PSI 6, 11-13, 15) – Collaboration with National Perinatal Information Center on PSI 17 32

Current Measurement Work Measure & Beta Measurement pipeline Measure & Beta Measurement pipeline - Readmission measures - Health care associated infections - Emergency Preparedness measures - Care coordination measure development - Emergency dept. PSI measure development - Emergency dept. PQI measure development - Medicaid Home & Community Based Services population measures Exploration of Measure Enhancement pipeline Exploration of Measure Enhancement pipeline - Integration of lab values - Further integration of present on admission - Assessment of PQIs for pay for performance 33

For more information… Web site: Web site: – QI documentation and software are available – Sign up for AHRQ QI listserv Support Support Support Phone: (888) (voic ) Support Phone: (888) (voic ) Staff: Staff: 34