Use of Simulation-based Surgical Education and Training within the Context of the Core Competencies, Milestones, Patient Safety, and the New ACGME Accreditation.

Slides:

Advertisements

Similar presentations

Beta Test Results of a New System Assessing Laparoscopic Competence Lee L. Swanstrom, MD, Portland, OR Nathaniel J. Soper, MD, Chicago, IL Gerald M. Fried,

Advertisements

M4 Interest Group Nabil Issa, MD- Director, Surgery Subinternship Northwestern University Feinberg School of Medicine.

Impact of a Structured Skills Lab Curriculum on Operative Judgment Deb DaRosa, David Rogers, Reed Williams, Linnea Hauge, Ken Murayama, Alex Nagle, Keith.

5/5/14 Evaluation of Tube Thoracostomy Teaching Models: An Argument for Developing Low-Fidelity Simulators Azmath Mohammed, MD; Christina Jenkins, MD;

PRESENTED BY: Michael T. Flannery, M.D., F.A.C.P. Professor of Medicine GME Internal Review Director.

Skills coaches as part of the educational team: A randomized controlled trial Skills coaches as part of the educational team: A randomized controlled trial.

US Navy Orthopaedic Physician Assistant Fellowship LT Michael A. Mitchell, PA-C, MPAS Fellowship Program Director.

JS Tsang, QMH Joint Hospital Grand Round 26 th April 2014.

Stanford Vascular Surgery Simulation-based Endovascular Skills Assessment: The Future of Credentialing? Maureen M. Tedesco, Jimmy J. Pak, E. John Harris,

The Objective Structured Assessment of Technical Skills (OSATS) Helen M. MacRae, M.D., FRCSC, D.H. Gales Director Technical Skills Centre, University of.

Preliminary Feedback from ACGME CLER Site Visit August 19-21, 2014

SURGICAL EDUCATION WEEK APDS-ASE JOINT PROGRAM March 22, 2012 ACS EFFORTS TO ADVANCE RESIDENCY EDUCATION AND TRAINING IN SURGERY: 2012 UPDATE Ajit K. Sachdeva,

Do More With Less: A Surgery Directed Institutional Model for Resident Central Line Training David Leshikar, M.D. Jonathan Pierce, M.D. Edgardo Salcedo,

Improved Patient Safety By Comprehensive Simulation-Based Training in Cardiac Surgery AHRQ 2012 Annual Conference September 10, 2012 Richard H. Feins,

Resident Teaching at CWRU: Mandates, Opportunities, and Challenges Dan Wolpaw, M.D. Professor of Medicine Director, Undergraduate Clinical Education Programs.

Matt Mauro MD ABR Trustee APDR  Approval of ABMS and ACGME  Program requirements  Accredited programs  Certifying examinations  MOC program.

The Otorhinolaryngology Hand-Off: Pursuing Excellence in Patient Care and Safety Mark A. Zacharek, MD, FACS, FAAOA Associate Professor Associate Residency.

Core Competency Assessment in Emergency Medicine from Design to Implementation National Hispanic Medical Conference Christian Arbelaez, MD, MPH Associate.

Laparoscopic Skills Laboratories: Current Assessment and a Call for Resident Training Standards James R. Korndorffer, Jr., MD, Dimitris Stefanidis, MD,

On the Road Again: Surgical Simulation is Rural Practice D.R.Antonenko, MD.PhD. Professor of Surgery Director of Surgical Simulation Center University.

Fund of Knowledge: Basic research methodology Pre-test mean: 56% ± 8% Post-test mean: 65% ± 6% N=11, p value

Redefining Simulator Proficiency Using Automaticity Theory Dimitris Stefanidis, MD, PhD, Mark W Scerbo, PhD James R Korndorffer Jr, MD, Daniel J Scott,

Intersection of Surgical Outcomes and Medical Education The RRC Perspective APDS Panel Session IV Surgical Education Week March 21,2012 San Diego, CA James.

Performance on Brief Practice Exam Identifies residents at Risk for Poor ABSITE and ABS Qualifying Exam Performance Michael Corneille MD, Ross Willis PhD,

Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.

Simulation-Based Assessment Emily M. Hayden, MD, MHPE Associate Director for Curricular Integration Gilbert Program in Medical Simulation Harvard Medical.

Training for Tomorrow: The Simulated Interprofessional Rounding Experience at MUSC Donna Kern, MD Associate Dean for Curriculum- Clinical Sciences, COM.

Does success on the American Board of Surgery Qualifying Examination guarantee Certifying Examination success? Thomas W. Biester MS, Jonathan D. Rubright.

Simulation and Medical Performance Peter G. Schulam, M.D., Ph.D. Associate Professor Department of Urology Eric Savitsky, M.D. Associate Professor Department.

Can a Brief On-line Education Tool Improve Surgical Resident Operative Dictations? A Prospective Evaluation Alicia Kieninger, MD, Yi Wei Zhang, MD, Anna.

Advanced Distributed Learning & Medical Skills Proficiency Carla Pugh, MD, PhD Assistant Professor of Surgery and Associate Director of the Center for.

Proficiency of surgical faculty and residents with ethical dilemmas: Is modeling enough? Kamela K. Scott, PhD David J. Chesire, PhD J. Bracken Burns, Jr,

Randomized double-blinded trial investigating the impact of a curriculum focused on error recognition on laparoscopic suturing training J Bingener, T Boyd,

Feasibility and Value of a Procedural Workshop for Surgery Residents Based on Phase-II of the APDS/ ACS National Skills Curriculum Dimitrios Stefanidis.

Implementation of Full Patient Simulation Training in Surgical Residency Gladys L. Fernandez, MD Baystate Medical Center Tufts University School of Medicine.

BOOT CAMP: Educational Outcomes After Four Successive Years of Preparatory Simulation-based Training at Onset of Internship Gladys L Fernandez MD, Richard.

Simulators for Objective Differentiation of Force-Based Laparoscopic Skills: Towards a Salient Haptic Skills Trainer Dane E. Smith, Joseph Singapogu, Timothy.

Summary of Retreat & Next Steps Who? Invitations to 155 Faculty & 17 Students Attended by 93 Faculty & 11 Students representing 18 Departments Facilitated.

Trimming the Fat: Optimizing Overall Educational Value by Defining Factors Associated with Overall Educational Value and Service to Education Ratio Caroline.

Matthew Schill, BS, Debbie Tiemann, RN, Mary Klingensmith, MD, L. Michael Brunt, MD Department of Surgery and Institute for Minimally Invasive Surgery.

Robert Sweet, MD Task Deconstruction and Metrics Robert M. Sweet, MD Assistant Professor Urologic Surgery and General Surgery Clinical Director of Simulation.

Proficiency-Based Training for Phacoemulsification Princeton Lee Research Fellow RCSI & ICO Alcon Education Night 27/02/2009.

High Quality Residency Education and Patient Safety are Directly Related David T. Harrington, MD Program Director, General Surgical Residency Program Associate.

Neal E. Seymour, MD Baystate Medical Center Tufts University School of Medicine Baystate Simulation Center—Goldberg Surgical Skills Lab 2010 APDS Annual.

Comparing Performance on the Virtual Laparoscopic and Robotic Simulators Among Medical Students Pursuing Surgical versus Non-surgical Residencies Amanda.

Applying Advances Rosalyn P. Scott, MD, MSHA Professor of Surgery Wright State University Boonshoft School of Medicine.

Using Simulation to Teach Obstetrics to Second Year Medical Students Catherine Pokropek, MD; David Cameron, MD; Judith Venuti, PhD; Dotun Ogunyemi, MD.

Department of Surgery Development of PGY-1 Surgery Preparatory Course Curricula: Identification of Key Curricular Components Mara B. Antonoff MD Jonathan.

Essentials of Procedural Skills: Early Preclinical Introduction to Common Emergency Medicine Procedures Xiao C. Zhang †, MD, MS; Armon Ayandeh ‡, MSc,

Introduction Motivation Ultrasound-guided (USG) needle interventions, such as central venous catheterization (CVC), require simultaneous sonography and.

Use of Simulation-Based Surgical Education and Training Within the Context of the Core Competencies, Milestones, Patient Safety, and the New ACGME Accreditation.

Defining Grades in the Surgery Clerkship Jeremy M. Lipman, MD MetroHealth Medical Center Case Western Reserve University School of Medicine.

1 Utilization of Operating Room Simulation and Debriefing to Enhance Surgical Resident Participation in the Surgical Timeout Checklist Edward Dominguez.

NEW DIRECTIONS IN SURGICAL EDUCATION AND TRAINING Ajit K. Sachdeva, MD, FRCSC, FACS Director, Division of Education American College of Surgeons Challenges.

A New Model for Assessing Teaching Quality Improvement to Family Medicine Residents Does It Work? Fred Tudiver, Ivy Click, Jeri Ann Basden Department of.

An Effective Method for Teaching Patient-centered Communication Skills to Second-year Medical Students Rachel Bramson, M.D., M.S. Michelle Jeter, Angela.

Introduction of a Comprehensive Training Curriculum in Laparoscopic Surgery for Medical Students: A Randomized Trial. N Gawad, EM Bonrath, NJ Dedy, B Zevin,

Design and Evaluation of a Virtual Reality Simulation Module for Training Advanced Temporal Bone Surgery Sudanthi Wijewickrema Department of Surgery (Otolaryngology)

Education in Urology. The American Perspective

Clinical Learning Environment Review GMEC January 8, 2013

Oh, Kenny J. , Esposito, Andrew

Operating Room Team Training With Simulation Program

Quantitative Evaluation of Surgical Skills Learned in Simulation

M4 Interest Group Nabil Issa, MD- Director, Surgery Subinternship Northwestern University Feinberg School of Medicine.

Maxine A. Papadakis, M.D. Professor of Medicine UCSF

M4 Interest Group Nabil Issa, MD- Director, Surgery Subinternship Northwestern University Feinberg School of Medicine.

How to assess specialist in abroad

The Program Evaluation Committee

Disclosures Dr. Auguste is paid editor for Springer publishing

Presentation transcript:

Use of Simulation-based Surgical Education and Training within the Context of the Core Competencies, Milestones, Patient Safety, and the New ACGME Accreditation System: Daniel J. Scott, MD, FACS Frank H. Kidd, Jr., MD, Distinguished Professorship in Surgery Vice Chairman and Surgery Residency Program Director Director, Southwestern Center for Minimally Invasive Surgery Frank H. Kidd, Jr., MD, Distinguished Professorship in Surgery Vice Chairman and Surgery Residency Program Director Director, Southwestern Center for Minimally Invasive Surgery University of Texas Southwestern Medical Center at Dallas GENERAL SURGERY

Patient safety –Institute of Medicine: To Err Is Human. National Academy of Science, Sept ,000 deaths per year due to medical error “Error in the performance of an operation” cited as one of many causes New procedures –Advanced laparoscopy –Endovascular –Endolumenal “Orphan” procedures –e.g. open CBDE, PUD Why is Skill Acquisition an Issue?

Cost –$53 million annually to train residents in the OR 1 OR time limitations Inadequate case volumes 80-hour work week constraints 16-hour R1 duty hour limit Why is Skill Acquisition an Issue? 1 Bridges, et al. Am J Surg 1999;177:28-32.

UT Southwestern 1998

Randomized, blinded, controlled trial 5 hours of videotrainer practice using “Southwestern Stations” Performance measured during laparoscopic cholecystectomy  Training improves operating room performance J Am Coll Surg 2000;191:

Skills Training: Gaining Momentum 2004 ACS/SAGES FLS Program Validated with high-stakes certification 2006 ACS Accredited Education Institutes Standards for Centers of Excellence 2007 ACS/APDS National Skills Curriculum High quality simulation exercises with free access 2008 RRC Mandate Mandatory skills labs in all residency programs 2010 ABS FLS Requirement FLS Certification required to sit for qualifying examination Surgery RRC

Perfect Storm

Immersion

Immersion Autonomy

Immersion Autonomy Teaching

Immersion Autonomy Teaching COMPETENCY

Are Graduating Residents Competent? 2012 American Board of Surgery (ABS) Pass Rates –Written Boards: 81%

Are Graduating Residents Competent? 2012 American Board of Surgery (ABS) Pass Rates –Written Boards: 81% –19% of graduates have knowledge deficiencies

Are Graduating Residents Competent? 2012 American Board of Surgery (ABS) Pass Rates –Written Boards: 81% –19% of graduates have knowledge deficiencies –Oral Boards: 72%

Are Graduating Residents Competent? 2012 American Board of Surgery (ABS) Pass Rates –Written Boards: 81% –19% of graduates have knowledge deficiencies –Oral Boards: 72% –28% of graduates have judgment deficiencies

Are Graduating Residents Competent? 2012 American Board of Surgery (ABS) Pass Rates –Written Boards: 81% –19% of graduates have knowledge deficiencies –Oral Boards: 72% –28% of graduates have judgment deficiencies 28% OF GRADUATES ARE NOT COMPETENT

Are Graduating Residents Competent? >80% of 1000 graduating residents enroll in fellowships –Lifestyle –Financial reward –Job opportunities in urban areas –Narrow field of expertise is appealing

Are Graduating Residents Competent? >80% of 1000 graduating residents enroll in fellowships –Lifestyle –Financial reward –Job opportunities in urban areas –Narrow field of expertise is appealing –Not comfortable with their level of competency

Are Graduating Residents Competent? >80% of 1000 graduating residents enroll in fellowships –Lifestyle –Financial reward –Job opportunities in urban areas –Narrow field of expertise is appealing –Not comfortable with their level of competency –DO THEY NEED MORE TRAINING?

Start Training during Medical School “The American Board of Surgery recommends and endorses that all incoming surgical residents beginning with the 2014 year complete a preparatory course PRIOR to beginning Surgical Training.”

More General Surgery Training after Residency ACS Transition to Practice Program –6 Programs starting in 2013 –“Help with your transition to independent practice in general surgery” –“Increase your competence and confidence in clinical practice”

UT Southwestern6095% xxxxxxxxxxxxxxxx2986% xxxxxxxxxxxxxxxx3184% xxxxxxxxxxxxxxxx2789% xxxxxxxxxxxxxxxx2886% xxxxxxxxxxxxxxxx3485% xxxxxxxxxxxxxxxx2588% xxxxxxxxxxxxxxxx4286% xxxxxxxxxxxxxxxx3281% xxxxxxxxxxxxxxxx4185% xxxxxxxxxxxxxxxx2588% xxxxxxxxxxxxxxxx2986% xxxxxxxxxxxxxxxx3566% xxxxxxxxxxxxxxxx2993% xxxxxxxxxxxxxxxx3884% xxxxxxxxxxxxxxxx4484% xxxxxxxxxxxxxxxx3394% xxxxxxxxxxxxxxxx3574% xxxxxxxxxxxxxxxx5178% xxxxxxxxxxxxxxxx3491% xxxxxxxxxxxxxxxx2588% xxxxxxxxxxxxxxxx2584% UT Southwestern Results 5-year ABS Pass Rates - First Attempt Both Components

General Surgery Residency Program Balance Immersive Experience Structured Education

Technical Skills Curricula General: –Basic Open Knot-tying and Suturing –Intermediate Open Knot-tying and Suturing Trauma/Critical care: –Surgical Airway –Basic Ventilator Management –Advanced Ventilator Management –Ultrasound for Central Line Placement –Ultrasound in the ICU –Ultrasound for Trauma (FAST) –Hemodynamic Monitoring –ATOM: Advanced Trauma Operative Management –Tracheostomy & PEG Tube Insertion Breast: –Percutaneous Breast Biopsy –Ultrasound Guided Breast Biopsy –Mammosite Module Vascular: –Vascular Patch Angioplasty –Vascular Anastomosis –Vascular Access Laparoscopic/Endoscopic: –Lap I Basic Laparoscopic Skills –Lap II Basic & Advanced Laparoscopic Skills (FLS) –Fundamentals of Laparoscopic Surgery (FLS) Ongoing Training –Laparoscopic Common Bile Duct Exploration (LCBDE) –Laparoscopic Cholecystectomy & Appendectomy –Laparoscopic Port Insertion –Laparoscopic Energy Sources –Laparoscopic Inguinal Hernia –Virtual Reality Flexible Endoscopy –Surgeon’s Training Endoscopic Proficiency (STEP) –SAGES Top 21 –SAGES Biliary Grand Rounds Robotic Training: –Comprehensive Console Surgeon Basic Training

Optimizing Skill Acquisition Deliberate practice –Separated from the real environment (OR) –Specifically designed plan for training –Goal oriented motivation for learning Structured training –Protected time allocation –Mandatory participation –Performance and attendance tracking Distributed training –Maximum hours per session –Distributed over days/weeks/months –Superior to massed practice Alleviates fatigue Reinforces mapping/integration Ericsson KA. Acad Med 2004;79:S70-S81. Moulton, et al. Ann Surg 2006;244: Mackay, et al. Surg Endosc 2002;16:

Optimizing Skill Acquisition Proficiency-based training –Avoids the use of arbitrary training endpoints Such as predetermined duration or number of repetitions “One size does not fit all” –Tailors the educational experience to the needs of the learner Practice a little vs. a lot Optimizes efficiency and time requirements Maximizes effectiveness  uniform end product (skill acquisition) Seymour, et al. Ann Surg 2002;236: Brunner, et al. J Surg Research 2004;122: Korndorffer, et al. Arch Surgery 2005;140: Stefanidis, et al. Surgery 2006;140:

Open Skills Curriculum: 12 Tasks Palm Needle Driver Knot-tying, No Tension Knot-tying, Tension Suturing, InterruptedSuturing, Running

R1 (n=37) Proficiency achieved for 100% of the 12 tasks –12.7 hours (range ) –141 repetitions (range ) Cost: $776 Open Skills Curriculum p <0.001 Goova, et al. J Surg Educ 2008;65:309-15

Tie at Depth Suturing at Depth, Interrupted simple Tie on a Pass Suture Ligation (Stick tie) Ties in Continuity Atraumatic Tie Open Intermediate Skills Curriculum: 6 Tasks

PGY1 (n=39) Proficiency reached 3.4 ± 3.8 hours 29 ± 17 repetitions Cost $4 per trainee Open Intermediate Skills Curriculum Mashaud, et al. Surgery (in press)

Proficiency-based Curriculum Intracorporeal Extracorporeal Ligating Loop Pattern Cut Peg Transfer PGY1 (n=37) Cognitive & Skills: Lap I + Lap II (FLS) FLS –7.4 ± 3.2 hours, 67 ± 28 repetitions 78% & 100% FLS exam pass rates after Lap I & II Passing Score = 270 P < Lap I Lap II Goova MT, et al. J Surg Research 2008;144:

PGY2-5 (n=54) FLS Skills –6.2 ± 2.6 hours –103 ± 28 repetitions 63% passing at baseline 100% FLS exam pass rate Intracorporeal Extracorporeal Ligating Loop Pattern Cut Peg Transfer Goova MT, et al, J Am Coll Surg 2008; 207: S90. Passing Score = 270 Proficiency-based Curriculum

Ongoing FLS Training Protocol Task 4 & 5 Testing (1 rep) Re-training if indicated Ongoing FLS training –96% participation rate (all curricular components over 2-year period) Initial Proficiency-based FLS Training PGY1-5 (n=91) Ongoing Proficiency-based FLS Training PGY3-5 (n=33) 6 moRetention I 6 moRetention II 6 moRetention III 6 mo Retention IV PGY4-5 Certification (n=20) 2-Year Analysis Mashaud, et al. Surgery 2010;148:

Task 4: Performance Improvement and Retention (n=33) PGY 3 PGY 4 PGY 5 91% at 23.3 months 98% at 18 months 94% at 12.3 months 83% at 6.3 months Ongoing FLS Training Results Mashaud, et al. Surgery 2010;148:

Task 5: Performance Improvement and Retention (n=33) PGY 5 PGY 3 PGY 4 100% at 23.3 months 96% at 18 months 95% at 12.3 months 85% at 6.3 months Ongoing FLS Training Results Mashaud, et al. Surgery 2010;148:

Passing Score Certification Exam PGY 4-5 (n=20) Ongoing FLS Training 92% Retention at 23.3 months Mashaud, et al. Surgery 2010;148:

Comprehensive Proficiency-based Robotic Training Curriculum Curriculum Design –23 unique skills identified through task deconstruction –Residents, fellows, faculty –General Surgery, Gynecology, Urology Curriculum Components –Online tutorial (MCQ’s, certificate) –½ day interactive session (global ratings) –9 inanimate exercises (objective metrics) Validation (Content, Face, Construct, Reliability) Dulan G, et al. Surgery 2012;152: Dulan G, et al. Surg Endosc 2012;26: Dulan G, et al. Am J Surg 2012;203:

Task 1. Peg Transfer Task 2. Clutch/Camera MovementTask 3. Rubber Band TransferTask 4. Suture (Simple) Task 5. Clutch/Camera Peg Transfer Task 6. Stair Rubber Band TransferTask 7. Running/Cutting Rubber BandTask 8. Pattern Cut Task 9. Suture (Running)

Performance Improvement (n=53) *p<0.05 Arain et al. Surg Endosc 2012;26:

Ensuring Competency: Is FLS Certification Necessary for Practicing Surgeons? Melanie L Hafford MD Kent R VanSickle MD Ross E Willis PhD Todd D Wilson MD Kristine Gugliuzza MD Kimberly M Brown MD Daniel J Scott MD University of Texas Healthcare Safety and Effectiveness Grant Program

Pretest: n=83 –26 (31%) failed manual skills Training –Skills: 2.5 ± 2.3 hrs. –Cognitive: 2.6 ± 2.1 hrs Certification Examination: n=76 –1 (1%) failed manual skills –9 (12%) failed cognitive exam 6 remediated, passed on re-take FLS Certification for Faculty Surgeons Hafford, et al. Surg Endosc Surg Endosc 2013;27: P= <0.001

Conclusions Numerous threats to developing competency exist Simulation plays a pivotal role –Technical skills –Judgment (i.e. decision-making)? Performance benchmarks may facilitate competency assessments in a longitudinal fashion (i.e. milestones)

Thank You!