A “bottom up” approach to curating electronic order sets

Slides:



Advertisements
Similar presentations
Improving Office Care for Chest Pain Thomas D. Sequist, MD MPH Associate Professor of Medicine and Health Care Policy Brigham and Women ’ s Hospital, Division.
Advertisements

Medical Engagement and Medication Safety James Williamson Sir Charles Gairdner Hospital.
What IMPACT Means to Physicians November 2014 Physician Champion: William Bradshaw, MD, FACS.
Medical Errors Frances Symons PHE 570. Definition- Medical Error Failure of a planned action to be completed as intended or the use of a wrong plan to.
Computerization of the practice Grzegorz Margas, M.D., Ph.D. Department of Family Medicine Jagiellonian University Medical College.
TIGER Standards & Interoperability Collaborative Informatics and Technology in Nursing.
NURSING INFORMATICS Dr. Ali M. Hadianfard Faculty member of AJUMS
The Impact of Computerized Physician Order Entry Session on Redesigning Work Processes to Improve Patient Safety and Quality AHRQ Conference, Bethesda.
Island Health – Implementation of a fully automated Electronic Health Record and Closed Loop Medication System – lessons learned Jan Walker Regional Leader,
© VANDERBILT UNIVERSITY 2008 Inpatient Clinical Information Systems, Decision Support, and Analysis Russ Waitman, PhD Collaborators: Asli Ozdas, PhD Josh.
Chapter 5. Describe the purpose, use, key attributes, and functions of major types of clinical information systems used in health care. Define the key.
Standard 4: Medication Safety Advice Centre Network Meeting Margaret Duguid Pharmaceutical Advisor February 2013.
Medical Informatics "Medical informatics is the application of computer technology to all fields of medicine - medical care, medical teaching, and medical.
Decision Support for Quality Improvement
Knowledge Driven Care – Realised Through Transformation Dr Simon Wallace Medical Executive Cerner UK.
© VANDERBILT UNIVERSITY 2009 B I O M E D I C A L I N F O R M A T I C S A System to Improve Medication Safety in the Setting of Acute Kidney Injury Intervention.
Increasing Pharmacists reporting of adverse medication incidents Being Ready for new risks and Opportunities Prepared by Tim Garrett Northern Sydney Central.
Summary of Recent Literature 2011 Dr. Alexandra Papaioannou.
Clinical Decision Support Nasriah Zakaria, Ph.D. Assistant Professor Medical informatics and e-learning unit (MIELU) College of Medicine, King Saud university.
Health Management Information Systems Computerized Provider Order Entry (CPOE) Lecture b This material Comp6_Unit4b was developed by Duke University funded.
Medication Use Process Part One, Lecture # 5 PHCL 498 Amar Hijazi, Majed Alameel, Mona AlMehaid.
Component 2: The Culture of Health Care Unit 9: Sociotechnical Aspects: Clinicians and Technology Lecture 1 This material was developed by Oregon Health.
Health Management Information Systems Unit 4 Computerized Provider Order Entry (CPOE) Component 6/Unit41 Health IT Workforce Curriculum Version 1.0/Fall.
Health Management Information Systems
Presented to: AHRQ Attendees AHRQ 2007 Annual Conference September 27, 2007 By Kristine Gleason, RPh Quality Leader, Clinical Quality and Patient Safety.
Using the Electronic Health Record to Encourage Evidence-Based Practice Jonathan S. Einbinder, MD, MPH Partners HealthCare
Beyond ePrescribing Factors Influencing Patient Safety in Medical Group Practices - September 26 th, 2007 AHRQ 2007: Improving Healthcare, Improving Live.
Overview Linkage: Providing Safe and Effective care, Coordinating Care, & The Joint Commission National Patient Safety Goal #8, Reconciling Medications.
Amar K. Das, MD, PhD Associate Professor of Biomedical Data Science, Psychiatry and Health Policy & Clinical Practice Geisel School of Medicine at Dartmouth.
Informatics Technologies for Patient Safety Presented by Moira Jean Healey.
Computerized Physician Order Entry (CPOE), Process, Costs and Benefits Joe Shaffer, MS Alberto Coustasse, DrPH, MD Graduate School of Management, College.
The Holistic Approach to the Design and Meaningful Use of Electronic Health Records: A Nursing Experience Frances Beadle, MSc Health Informatics Nurse.
1 PATIENT SAFETY WORK PRODUCT—Created as part of LPSES - the LMHS Patient Safety Evaluation System Lee Memorial Health System Smart Pump PI Team Smart.
Conference on Medical Thinking University College London June 23, 2006 Medical Thinking: What Should We Do? Edward H. Shortliffe, MD, PhD Department of.
From Hospital to Home: Medical Students Observe Patients in Transition Martha S. Terry, MD Assistant Professor of Clinical Family and Community Medicine.
Prepared by: Iris Abigail B. Navallo, RN MSN-MHPN CNIS 5807.
CONFIDENTIAL AND PROPRIETARY This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole.
Dawn Dowding PhD RN VNSNY Professor of Nursing
Collaborative Initiatives on Improving the Quality of Post-Anesthesia Care by Decreasing Postoperative Nausea and Vomiting in the Post-Anesthesia Care.
Audit Opioid use in palliative patients on general hospital wards
Using Technology to Support Evidence Based Practice
Dawn Drahnak, DNP, RN, CCNS, CCRN, Courtney Boast, BS
1st International Online BioMedical Conference (IOBMC 2015)
Joshua Medow MD, MS Christopher Nickele MD,
Prevention of Medical Errors
Speaker Institution Twitter: #AMIA2017
Electronic Prescribing & Clinical Decision Support Sarah Pontefract
Can Emergency Department Provider Notes Help Achieve More Dynamic
Bret J. Gardner University of Nebraska Medical Center
Steve Tomlin Consultant Pharmacist – Children’s Services
Hong Kang, PhD (Presenter) Zhiguo Yu, PhD Yang Gong, MD, PhD
Component 11/Unit 7 Implementing Clinical Decision Support
Real-time Protection for Open Beacon Network
Decaying Relevance of Clinical Data when Predicting Future Decisions
Special Topics in Vendor-Specific Systems
Daniel R. Masys, M.D. Professor and Chair
Hospitals, Quality and HIT: Important Issues and Intersections
From Evidence to EHR? Building and Championing Order Sets
Dawn Dowding PhD RN VNSNY Professor of Nursing
Tobey Clark, Director*, Burlington USA
Maryland HCW Influenza Vaccination Survey Highlights
Margaret R. Punch, MD Michigan Medicine
Contributing factors Lack of communication Lack of coordination
COMPUTERIZED PHYSICIAN ORDER ENTRY (CPOE)
Clinical Decision Support System (CDSS)
Action Endorsement of CPOE
Patient Safety and Health Informatics
CPOE Medication errors resulting in preventable ADEs most commonly occur at the prescribing stage. Bobb A, et al. The epidemiology of prescribing errors:
A study of two UK hospitals found that 11% of admitted patients experienced adverse events of which 48% of these events were most likely preventable.
Presentation transcript:

A “bottom up” approach to curating electronic order sets S22: Identifying Medication Risk Ron Li, MD Clinical Informatics Fellow Stanford University School of Medicine ronl@stanford.edu

Disclosure I and my spouse/partner have no relevant relationships with commercial interests to disclose. AMIA 2017 | amia.org

Understanding how clinicians deliver care is an important piece of the Learning Health Care System Institute of Medicine. Best Care at Lower Cost. (2012)

Automatically generated ethnographic data

Digital trace data in healthcare

Adverse drug events are responsible for up to 770,000 inpatient injuries and deaths annually, most of which are from prescribing errors. These adverse events affect nearly 5% hospitalized patients in the United States. AHRQ Patient Safety Network. Computerized provider order entry. AHRQ PSNet Patient Safety Primer 2015 (2015). Available at: https://psnet.ahrq.gov/primers/primer/6/.

Clinical Decision Support Clinical decision making Unintended consequences of clinical decision support (CDS) on ordering medications Clinical Decision Support How is medication ordering affected? Clinical decision making Workflow

Errors mediated by automation bias Users tend to over-accept and over-rely on computer output “as a heuristic replacement of vigilant information seeking and processing, which can lead to both errors of omission and commission. Error of commission: a CDS generates an incorrect recommendation, prompting clinician to order a medication he otherwise would not have ordered Error of omission: a CDS fails to alert a clinician of a patient’s risk for severe sepsis. The clinician, who is accustomed to relying on the CDS alert, does not do as careful of an assessment and misses the diagnosis. Goddard, K., Roudsari, A. & Wyatt, J. C. Automation bias: a systematic review of frequency, effect mediators, and mitigators. J. Am. Med. Informatics Assoc. 19, 121–127 (2012).

How does automation bias affect the use of the electronic order sets? Electronic order sets are present in more than 80% of inpatient EHRs and are important for standardizing/increasing efficiency of workflow and clinical decision making. Does automation bias cause order sets to also promote incorrect mediation ordering?

Order sets are currently curated based on the ad hoc insights of a small group of people: expert opinion, anecdotal experiences, guidelines, incident reports. This “top down” approach may result in a inaccurate and biased understanding of how order sets are affecting clinician ordering behavior, resulting in sub-optimally curated order sets. Aim: to develop a “bottom up” approach using EHR audit trail data to systematically capture ordering errors from order sets

Methods All inpatient medication orders from order sets at Stanford Hospital were identified from 2008-2017. Frequency of medication prescribing errors (in the form of near misses) estimated by frequency of orders discontinued within 30 minutes of ordering (“dw30m”)1. Medication prescribing error rate calculated for each order 1) when part of any order set and 2) when part of a specific order-order set pair. Medication error rates are compared to the error rates for when the medication was ordered not from an order set (relative risk). Koppel, R. et al. Identifying and Quantifying Medication Errors : Evaluation of Rapidly Discontinued Medication Orders Submitted to a Computerized Physician Order Entry System. J. Am. Med. Informatics Assoc. 15, 461–465 (2008).

Inpatient medication orders at Stanford Hospital (2008-2017) All data from 2008-2017 With at least one dw30m order # patient encounters 195,588 89,354 # orders 10,578,855 335,084 # times order set was used 745,621 41,329 # orders from order sets 3,395,541 67,560

Medication error rates per medication when ordered from order set After excluding medications with the bottom 25th percentile ordering frequencies, there were 519 unique medications with at least one order discontinued within 30 minutes. Medication # times dw30m from orderset Total # times ordered from orderset Dw30m rate Ondansetron 4mg Inj 3480 251,825 1.4% Fentanyl 50 mcg Inj 1960 120,156 1.6% Enoxaparin 40mg SC 937 28,606 3.3% Cefazolin 2g IV PGBK 315 7,616 4.1% Morphine 2mg IV Inj 288 12,653 2.3%

Min 0.2% Median 2.6% Max 29% IQR 3%

Error rates tend to be lower with order sets, but higher for a subset of medications Relative Risk < 1 Relative Risk >1 Min 0.06 Median 0.81 Max 23.1 IQR 0.77

Total # times pair was ordered Identifying the medication-order set pairs most prone to prescribing errors After excluding order sets and medication-order set pairs with the bottom 25th percentile ordering frequencies, there were 2678 unique medication-order set pairs with at least one order discontinued within 30 minutes Medication Order set # times dw30m Total # times pair was ordered Dw30m rate Ondansetron 4mg Inj Anesthesia PACU 1,066 71,471 1.5% Fentanyl 50 mcg Inj Neurosurgery ICU 95 7494 1.3% Enoxaparin 40mg SC Medicine General Admit 512 11,967 4.3% Cefazolin 2g IV PGBK Pre-admission/Pre-op 245 9,026 2.7% Morphine 2mg IV Inj 96 5924 1.6%

Min 0.05% Median 2.0% Max 42.5% IQR 2%

Relative Risk < 1 Relative Risk >1 Min 0.1 Median 0.67 Max 46.9 IQR 0.8

Data driven order set curation Medication Order set # times ordered # times dw30m Dw30m rate Hydromorphone 2 mg/ml inj Bone marrow and aspirate 40 17 43% Amiodarone infusion periph ICU cardiac surg postop 34 14 42% Cefoxitin 1 gram IV Surg general admit 43 40% Cefazolin 1 gram inj GU general admit 188 73 39% Calcium chloride 8 g/1000 ml NS IV infusion Continuous renal replacement therapy(CRRT) 1162 425 37%

Data-driven order set curation Medication Order set # times ordered # times dw30m Relative risk of dw30m Hydromorphone 2 mg/ml inj Bone marrow and aspirate 40 17 46.96 Ondansetron 4 mg/2 ml inj Ane ECT PACU orders 679 121 9.22 Influenza vaccine Med alcohol withdrawal 248 28 8.93 Aztreonam 2 gram/100ml IVB Med cystic fibrosis admit 57 4 8.70 Hydrocodone-acetaminophen 5-325 mg PO Nursing triage pain management protocol 12 8.66

Discussion Medication prescribing errors from order sets are relatively uncommon, but are high (as high as 29%) for a subset of medications. Most medications have lower prescribing error rates when ordered from an order set, but a subset of medications are more likely to be prescribed in error when from order sets. These data can be used to target medications and order sets for further investigation during the order set review process. Limitations: results are unadjusted for differences between order set/non-order set medication orders and are from a single institution

Acknowledgements Jonathan Chen, MD PhD Christopher Sharp, MD Jason Wang Connie Taylor, RN Stanford Clinical Informatics Fellowship Stanford Department of Medicine Stanford Division of Biomedical Informatics Research Stanford Research IT

AMIA is the professional home for more than 5,400 informatics professionals, representing frontline clinicians, researchers, public health experts and educators who bring meaning to data, manage information and generate new knowledge across the research and healthcare enterprise. AMIA 2017 | amia.org

Email me at: ronl@stanford.edu Thank you! Email me at: ronl@stanford.edu