Clinical Event Classification: Strategies and Practices

Slides:



Advertisements
Similar presentations
Consolidated User Story 1: Chronic Diseases (cancer, occupational health) Chronic Diseases, Outpatient Flow Patient, Provider/Physician, Laboratory, PH.
Advertisements

Allen Jeremias MD MSc, Sanjay Kaul MD, Luis Gruberg MD, Todd K. Rosengart MD, David L. Brown MD Divisions of Cardiovascular Medicine and Cardiothoracic.
Epidemiology and benefit to patients from accurate coding Heather Walker CHKS Consultancy and Marketing Director 4 th May 2012.
Using AHRQ Prevention Quality Indicators to Assess Program Performance in Medicaid Managed Care Sandra K. Mahkorn MD, MPH, MS Chief Medical Officer Wisconsin.
天 津 医 科 大 学天 津 医 科 大 学 Clinical trail. 天 津 医 科 大 学天 津 医 科 大 学 1.Historical Background 1537: Treatment of battle wounds: 1741: Treatment of Scurvy 1948:
Validation of Acute Stroke in Medicare Data against WHI Kamakshi Lakshminarayan, MD, PhD presented by Dale Burwen, MD, MPH WHI Investigators Meeting May.
Some comments on the 3 papers Robert T. O’Neill Ph.D.
Inappropriate clopidogrel adherence explains stent related adverse outcomes Leonardo Tamariz, MD, MPH University of Miami.
Bree Collaborative Cardiology Report: Appropriateness of Percutaneous Cardiac Interventions (PCI) Bree Collaborative Meeting November 30, 2012.
Women’s Health Initiative Scientific Symposium May
Biostatistics ~ Types of Studies. Research classifications Observational vs. Experimental Observational – researcher collects info on attributes or measurements.
Documentation for Acute Care
Kenneth W. Mahaffey Daniel M. Wojdyla Stefan K. James Hugo A. Katus Steen Husted Gabriel Steg Christopher P. Cannon Richard C. Becker Claes Held Nardev.
Diagnostic Assays to Plan Specific Drug Treatment Elizabeth Hammond MD.
1 Lecture 20: Non-experimental studies of interventions Describe the levels of evaluation (structure, process, outcome) and give examples of measures of.
Overview Public Reporting Cardiovascular Data Recommendations.
 Ascertainment of cardiovascular (CV) outcomes via physician review of medical records using a standardized case definition aims to maximize data quality,
Patterns of red blood cell transfusion use and outcomes in patients undergoing percutaneous coronary intervention in contemporary clinical practice: Insights.
Lecture 16 (Oct 28, 2004)1 Lecture 16: Introduction to the randomized trial Introduction to intervention studies The research question: Efficacy vs effectiveness.
Assessing the Concordance of Coded Morbidity and Mortality Data for In-Hospital Trauma-Related Deaths Presenter: Bridget Allison Research Team:Kirsten.
SPORT MEDICINE CENTRE 1 st World Congress on Sports Injury Prevention Oslo, Norway, June 23-25, 2005 Willem H. Meeuwisse, MD, PhD Key Components of Collection.
How to Analyze Therapy in the Medical Literature (part 2)
Monthly Journal article review: Vimmi Kang PGY 2
The Synergy between Percutaneous Coronary Intervention with TAXUS and Cardiac Surgery: The SYNTAX Study One Year Results of the PCI and CABG Registries.
Cost-effectiveness of Screening Tests Mark Hlatky, MD Stanford University.
Health Services Research SIG October 2010 – September 2011 Newly established SIG (no previous WHI focus on health services research or claims data) About.
1 Audit of the Columbia Suicidality Classification Project September 13, 2004 Meeting of Psychopharmacological Drugs Advisory Committee and Pediatric Advisory.
Methodological Issues in Implantable Medical Device(IMDs) Studies Abdallah ABOUIHIA Senior Statistician, Medtronic.
A ssociation of Public Health Observatories Hospital Activity data Roy Maxwell SWPHO & Bristol University Dr Richard Wilson Sandwell PCT.
Clinical Trials for Comparative Effectiveness Research Mark Hlatky MD Mark Hlatky MD Stanford University January 10, 2012.
Clinical Terminology and One Touch Coding for EPIC or Other EHR
UHC, DMO, and AWP UHC REIMBURSEMENT POLICY
Quality of Electronic Emergency Department Data: How Good Are They?
Jakutis G.1, Polevoda V.1, Serpytis R.2, Serpytis P.2,3
Women’s Health Initiative Scientific Symposium May
CLINICAL PROTOCOL DEVELOPMENT
Insights Using Data from California Richard H. White MD
Evaluating The Accuracy Of International Classification Of Diseases 10TH Revision Codes For Venous Thromboembolism (VTE) And Major Bleeding (MB) in.
PCI related in-hospital mortality based on race and gender in the USA
Trends in Use of Pulmonary Rehabilitation Among Older Adults with Chronic Obstructive Pulmonary Disease Anita C. Mercado, Shawn P. Nishi, Wei Zhang, Yong-Fang.
2017 Network Management Updates
Nut and Bolts of Critical Appraisal of Medical Literature
Laura Mauri, MD, MSc Brigham and Women’s Hospital
WHO Collaborating Centre in Calgary, Canada
Evaluating Sepsis Guidelines and Patient Outcomes
Disclaimer This presentation is intended only for use by Tulane University faculty, staff, and students. No copy or use of this presentation should occur.
Rural Chest Pain Quality Improvement
Menachem M Meller,MD, PhD
PMA Analysis of the CREST Trial Approvability of the RX Acculink Carotid Stent System for Revascularization of Carotid Artery Stenosis in Standard Surgical.
The Hidden Cost of Underutilizing PCI for Chronic Total Occlusions
Public Reporting of Cardiovascular Data
Dr. Muhammad Ajmal Zahid Chairman, Department of Psychiatry,
Recurrent Angina: New Tools for an Old Problem
Tim Auton, Astellas September 2014
Please mute yourselves, on phone or computer. Thank you.
The Cardiovascular Inflammation Reduction Trial (CIRT)
Monthly Journal article review: Vimmi Kang PGY 2
The Synergy between Percutaneous Coronary Intervention with TAXUS and Cardiac Surgery: The SYNTAX Study One Year Results of the PCI and CABG Registries.
Candice Preslaski, PharmD, BCPS, BCCCP
Undetectable High Sensitivity Cardiac Troponin T Level in the Emergency Department and Risk of Myocardial Infarction Nadia Bandstein, MD; Rickard Ljung,
Undetectable High Sensitivity Cardiac Troponin T Level in the Emergency Department and Risk of Myocardial Infarction Nadia Bandstein, MD; Rickard Ljung,
Collaboration in CEC: Strategies and Best Practices
Translation Pathway for Coronary Stent Development- Clinical Endpoints
NIH’S Redefinition of Clinical Trials and Using the New Human Subjects Form Chris Sylvester, M.A. Senior Grant Administrator (AO) Grants and Contracts.
The Synergy between Percutaneous Coronary Intervention with TAXUS and Cardiac Surgery: The SYNTAX Study One Year Results of the PCI and CABG Registries.
Encouraging care coordination in FFS Medicare
IMPACT OF PHARMACIST DELIVERED CARE IN THE COMMUNITY PHARMACY SETTING
Comparison of Self-Reported and Medical Record Health Care Utilization measures Concurrent criterion validation of.
Regulatory Perspective of the Use of EHRs in RCTs
Cardiovascular Epidemiology and Epidemiological Modelling
Presentation transcript:

Clinical Event Classification: Strategies and Practices Mark A Hlatky, MD Stanford University School of Medicine September 27, 2018

Outline Is clinical event classification necessary? Experience in WHI study Possible implications What are best practices when it is done? Some take-aways from this meeting

Why classify events? What does a CEC add? Independent, blinded adjudication of events increases credibility of study results Standardized data collection and definitions of key outcome events Satisfying regulatory requirements for new drug approval Cost, time, and complexity to RCTs Should test value added by CEC process

Comparison of CEC and claims Pragmatic clinical trials may use existing data collection processes to simplify studies The Women’s Health Initiative (WHI), a large NIH RCT, linked the trial database to CMS claims Opportunity to evaluate the accuracy of hospital claims data in assessing CV outcomes: MI, CABG, and PCI Circ Cardiovasc Qual Outcomes 2014;7:157-162.

Methods Women ≥65 yo at WHI enrollment WHI MI = best available adjudication (central > local) CMS MI = ICD.9 code of 410.x1 (acute MI, initial admission) Censored at end WHI follow-up, loss of Medicare Part A, or HMO enrollment Training set = not in hormone RCTs Application to hormone RCTs Circ Cardiovasc Qual Outcomes 2014;7:157-162

Definition of MI WHI process Participant reported a possible event Records requested and reviewed by CEC MI Dx by ECG, biomarkers, symptoms MI categorized as “resulting from a procedure” CMS Process 1º = principal reason for admission, 2º = conditions also present ICD9 Codes: 410 = acute MI, 411 = other acute CHD, 412 = old MI, 413 = angina, 414 = other chronic CHD Circ Cardiovasc Qual Outcomes 2014;7:157-162

CMS MI vs. WHI MI in Training Set 37,397 women ≥65 yo w CMS data 1,345 WHI MI cases (172 procedure related) 1,195 CMS MI cases (1º dx) 306 more with acute MI as 2º dx __ WHI MI_ Kappa Yes No CMS (1º) Yes 914 281 0.71 No 431 35,771 CMS (1º, 2º) Yes 1,062 439 0.74 No 283 35,613 Circ Cardiovasc Qual Outcomes 2014;7:157-16

Reasons for CMS Yes/WHI No 281 with CMS MI = 1º MI dx, no WHI MI No event reported to WHI (49%) Inadequate documentation—no records (5%) or key data missing (9%) Adjudicated, but No CHD outcomes (16%) Another CVD outcome (23%) CHD deaths w/o MI (2%) Circ Cardiovasc Qual Outcomes 2014;7:157-16

Reasons for CMS No/WHI Yes 431 with WHI MI, no CMS MI (1º diagnosis) No CMS admission <30 days (15%) CMS 2º dx of MI (32%) WHI MI procedure related (13%) Other CVD 1º dx (39%) Non-CVD 1º dx (15%) Circ Cardiovasc Qual Outcomes 2014;7:157-16

Intention to treat comparison

Inights from comparing CEC with Claims Claims data identified events not reported by WHI participants Agreement between claims and CEC data was very good for MI, and excellent for PCI and CABG (kappa 0.88 to 0.91) Some disagreements due to: No or incomplete records for adjudication Differences in diagnostic criteria applied by CEC adjudicators vs local physicians MIs due to procedures or non-cardiac illness were often missed in claims

Some reflections on best practices CEC is more valuable when study intervention is applied during hospitalization for acute illness or procedures More difficult to identify MI in this setting CEC more important for drugs in development than for comparative effectiveness studies of well-established drugs Regulatory requirements to meet

More reflections on best practices Application of clear, standardized diagnostic criteria for events decreases variation Interobserver variation is more often due to different dx criteria than to variable application of standardized dx criteria Standardizing CEC processes, however, could impede innovation Could test importance of key processes (e.g. meetings vs independent evaluations) CEC might be applied to a random sample to validate process (e.g. claims) for all events