Amanda L. Do, MPH1,2, Ruby Y. Wan, MS1,2, Robert W

Slides:



Advertisements
Similar presentations
Building the Health Information Technology (HIT) Workforce for Rural Communities Susan H. Fenton, PhD, RHIA, FAHIMA Asst. Professor, School of Biomedical.
Advertisements

Health Insurance Portability Accountability Act of 1996 HIPAA for Researchers: IRB Related Issues HSC USC IRB.
Implementation of Privacy Board Reviews at PCMC Mary Thomason, Intermountain Healthcare Privacy Board Chair.
Chapter 15 Application of Computer Simulation and Modeling.
Dr. Julian Lo Consulting Director ITIL v3 Expert
University of Pittsburgh Department of Biomedical Informatics Healthcare institutions have established local clinical data research repositories to enable.
Theresa Tsosie-Robledo MS RN-BC February 15, 2012
August 12, Meaningful Use *** UDOH Informatics Brown Bag Robert T Rolfs, MD, MPH.
Adam Wilcox, PhD Associate Professor of Biomedical Informatics.
Information for Providers West Virginia Mental Health Planning Council This information was developed to raise awareness of Psychiatric Advance Directives.
Who’s the Boss? Faculty Advisor or Principal Investigator Supervision versus Student Investigator or Study Coordinator Responsibilities Gwenn Snow, MS,
Consent2Share Linking Cohort Discovery to Consent David R Nelson MD Assistant Vice President for Research Professor of Medicine Director, Clinical and.
ACCELERATING CLINICAL AND TRANSLATIONAL RESEARCH A simple, flexible tool for inexpensively building secure data capture systems Andy.
Challenges with creating a Clinical and Translational Research Support Center in the University of Louisville Department of Medicine Robert Kelley PhD,
The analyses upon which this publication is based were performed under Contract Number HHSM C sponsored by the Center for Medicare and Medicaid.
This material was developed by Duke University, funded by the Department of Health and Human Services, Office of the National Coordinator for Health Information.
Chapter 6 – Data Handling and EPR. Electronic Health Record Systems: Government Initiatives and Public/Private Partnerships EHR is systematic collection.
NIH Mentored Career Development Awards (K Series) Part 5 Thomas Mitchell, MPH Department of Epidemiology & Biostatistics University of California San Francisco.
Biomedical Informatics Program Douglas S. Bell, MD, PhD Leader, Biomedical Informatics Program Access to UCLA Clinical Data for Research.
CALIFORNIA DEPARTMENT OF EDUCATION Tom Torlakson, State Superintendent of Public Instruction Special Education Self Review (SESR) Activity Three: Corrective.
Larry Wolf, chair Marc Probst, co-chair Certification / Adoption Workgroup March 6, 2014.
The HMO Research Network (HMORN) is a well established alliance of 18 research departments in the United States and Israel. Since 1994, the HMORN has conducted.
Integrating a Federated Healthcare Data Query Platform With Electronic IRB Information Systems Shan He IPHIE 2010.
Research Navigation at MMC Wendy Y. Craig, Ph.D. Research Navigator MMCRI-Center for Outcomes Research & Evaluation.
Improving specialty access with budget restrictions and limited staffing has been one of the major challenges while implementing.
Research Orientation to SCCA. What is the SCCA? The SCCA brings together the outstanding adult and pediatric oncology patient care services of three world-
VICTR Data Management CRC Research Skills Workshop Michael Assink April 6 th, 2012.
Research Tools Brought to you by the Clinical and Translational Science Institute Presented by: Terri Shkuda Systems Analyst Research Informatics The Penn.
Informatics Tools and Services Biomedical Informatics Core Tim Aro.
Uses of the NIH Collaboratory Distributed Research Network Jeffrey Brown, PhD for the DRN Team Harvard Pilgrim Health Care Institute and Harvard Medical.
Increasing Diabetic Foot Exam Compliance through Documentation Mohammed Zare, MD, MS 1 ; Jennifer S. Lahue 2 ; Michelle R. Klawans, MPH 1, Kelley Carroll,
Oral Hygiene Assessment & Clinical Care Protocol Freyja Bell 1 & Ruth Elder 2 Speech & Language Therapists Good oral care is integral to general health.
SLAs with Software Provider. Scope “…declare the rights and responsibilities between EGI.eu and the Software Provider for a particular component.” Which.
FOR MORE CLASSES VISIT HCS 483 Entire Course (2 Set) FOR MORE CLASSES VISIT This Tutorial contains 2 Papers for each.
Shubhangi Arora1; Eden Haverfield2; Gabriele Richard2; Susanne B
IRB Open House: Implementation of Single IRB Review
EHR Coding and Reimbursement
REDCap General Overview
Introduction Review and proper registration of Human Gene Transfer protocols is very complex. A protocol goes through rigorous review by multiple Committees.
Draft Primary Care Strategy
Phenotyping youth depression
Stephanie Oppenheimer, MS SUCCESS Center Erica Ellington, CRA, CHRC
METHODS SECTION OF A RESEARCH PROPOSAL
DATA COLLECTION METHODS IN NURSING RESEARCH
THURSDAY TARGETED TRAINING: Reporting Regulations and Requirements
The Problem of Multiple Hats: Providing efficient and safe team-based care with providers who are not always in the clinic. Frank Babb, MD David RM Trotter,
Leigh E. Tenkku, PhD, MPH Department of Family and Community Medicine
Douglas Wixted1, Meredith L
the National Diabetes Prevention Program in the Community
TRI Resources for Researchers
FIGURE 1. CLINICAL PATHWAY MODEL PROGRAM FACILITATORS AND BARRIERS
Workday Financials Role Mapping Guide For Business Operations
Role Mapping Guide for Business Operations
HCS 483 Education for Service-- snaptutorial.com.
Clinical and Translational Science Institute
Research Data Services Summary
Institutional Effectiveness USF System Office of Decision Support
Enhancement of study programs in Public Health Law, Health
Clinical and Translational Science Awards Program
I lead the initiative to design this document and the via a webinar to the community of users when CMS upgraded the version of Business Objects that was.
Candice Preslaski, PharmD, BCPS, BCCCP
The Center for Nursing Research Ochsner Health System December 2015
Finding Patient Data for Research
Multijurisdictional FAQs (Workshop Stream 3)
Celebrating Success and Making a Plan for Sustainability
From Innovation to Commercialization Access to Data
ONC Update for HITSP Board
IRB protocol no PI: Dr. David F. Chhieng
Dan Geschwind, MD, PhD Director, Institute for Precision Health
Wojciech Glinkowski The prevalence of deforming dorsopathies (scoliosis, kyphosis and lordosis) in the population children and adolescents in Poland.
Presentation transcript:

Reasons for Rework in Clinical Data Provisioning: A Root-Cause Analysis Amanda L. Do, MPH1,2, Ruby Y. Wan, MS1,2, Robert W. Follett1,2, Marianne Zachariah1,2, and Douglas S. Bell MD, PhD1,2 1Department of Medicine, UCLA David Geffen School of Medicine, Los Angeles, CA 2UCLA Clinical & Translational Science Institute, Los Angeles, CA Accelerating Discoveries Toward Better Health Secondary use of electronic health record (EHR) data in clinical research has become more prevalent with the deployment of large-scale EHR systems. Challenges frequently arise in repurposing clinical data for research, and many investigators are unable to relate their needs to the existing clinical data. To address these challenges, the UCLA Clinical & Translational Science Institute’s (CTSI) Informatics Program (IP) has implemented, and continues to refine, a data provisioning service model. The model includes consulting and programming services to assist investigators in defining EHR data requests that address their research questions. However, investigators sometimes find that a dataset does not meet their needs only after it has been provided, which costs the IP additional time and resources to remedy. The IP seeks to understand the reasons for this kind of rework in an effort to identify and rectify their root causes. IP hopes to use the findings from this analysis to further enhance the service model and minimize future rework. IP acts as the storefront for provisioning healthcare-related datasets for research projects at UCLA: Provide initial consultation (orient the investigators to the request process and ask them to fill out the data request form) Data request form: standardized template with two components 1) definition of patient selection criteria and 2) selection of demographics and other output variables e.g. diagnoses, lab results, etc. Review, analyze and optimize data request to ensure institutional approvals (IRB and Compliance) and technical feasibility (data requested is attainable from the existing EHR) Explore data sources, program and test data extraction code, quality check data Data source: UCLA’s Integrated Clinical and Research Data Repository (xDR), a clinical data warehouse of UCLA’s CareConnect (Epic) EHR data, linked with data from older legacy systems and other sources (e.g. Transplant Registry) Communicate with the investigators when clarification is needed Deliver data through secure, compliant methods Data requests were considered complete once all template variables were queried, exported, and delivered to the investigators. Study Data 165 data requests completed between March 2014 and February 2017 Reviewing Rework Requests Two IP data consultants reviewed all completed data requests and associated materials: Data request form filled out by the investigator and confirmed by IP staff Consulting and programming notes Project management system records (REDCap and JIRA) Email correspondence with the investigator or amongst IP staff Institutional Review Board (IRB) applications, approval notices, and other related study materials Additional files sent by the investigator e.g. study protocols, recruitment materials Defining Rework and Assigning Rework Reasons Rework was defined as any instance in which the original query needed to be revisited and modified after the original dataset was extracted and delivered. Based on previous work and experience, IP consultants classified reasons for rework into 6 categories (Table 1). Each request was then assigned any one or combination of the 6 reasons by IP consultants and programmers. Calculating Rework Cost Total hours logged by consultants and programmers for each rework request were obtained from project management system records Consultants and programmers confirmed, out of the total number of hours, the time spent on each rework reason. Requests could have more than 1 rework reason. Cost was then calculated for each request based on IP’s current hourly service rates Introduction Results Distribution of Rework Out of 165 data requests completed between March 2014 and February 2017, 39 requests (23.6%) required rework. 16 out of the 39 rework requests (41.0%) had only 1 cause for rework. The remaining 23 requests (59.0%) had more than 1 rework reason: 14 requests with two reasons, 3 with three or four reasons, 2 requests with five reasons, and 1 request with all six possible rework reasons. By year, there were 6 rework requests in 2014, 22 in 2015 and 11 in 2016. Hours and Cost Spent on Rework Total time spent on rework: 795 hours Total cost of rework (based on current hourly rates): $102,000 Adjustment of patient selection criteria was the greatest cause for rework, accounting for ~446 hours and a cost of ~$57,800 (Figure 1, Figure 2) Total time spent on original rework requests (prior to any rework): 1,268 hours Total cost of original rework requests (prior to any rework): ~$149,400 Average cost of original rework request (prior to any rework): ~$3,800 Average cost per any request (with or without rework): ~$2,600 Overall, most investigators were able to use the data provisioned through the UCLA CTSI IP service model without needing to request revisions. Nonetheless, substantial resources ($102K) were still spent on rework, costing the equivalent of 68% of the original data extraction expense. Adjustment of patient selection criteria and additional data variables have imposed the most significant strains on IP resources, accounting for ~80% of all rework. The root causes of rework could be insufficient preparation on the part of the investigators in defining the study scope and planning data analysis or lack of careful upfront analysis of the research plan by IP. However, the requests that ended up needing rework may have been inherently more complex, e.g. patient populations harder to define, as evidenced by the higher average cost ($3,800) compared to that ($2,600) of all requests, regardless of rework. To reduce the occurrence of rework, IP has continually worked to improve the service model to ensure patient selection criteria and output variables will adequately answer the investigators’ research questions. This includes fine-tuning the data request form to make it more comprehensive, e.g. addition of descriptive footnotes. IP has also implemented a more rigorous scientific review during initial consultations. The project described was supported by the National Center for Advancing Translational Science through UCLA CTSI Grant UL1TR001881. Data Provisioning Service Model Methods Figure 1: Total Hours of Rework, by Reason Figure 2: Cost of Rework, by Reason Discussion & Conclusion Table 1: Rework Reasons and Counts Acknowledgments