PRESENTED BY: Michael T. Flannery, M.D., F.A.C.P. Professor of Medicine GME Internal Review Director.

Slides:



Advertisements
Similar presentations
The Challenge and Importance of Evaluating Residents and Fellows Debra Weinstein, M.D. PHS GME Coordinators Retreat March 25, 2011.
Advertisements

Introduction to Competency-Based Residency Education
Clinical Competency Committees (CCC): 3 different perspectives Sharon Dabrow: Pediatrics PD Cuc Mai: Internal Medicine PD Todd Kumm: Radiology PD.
©2013 Accreditation Council for Graduate Medical Education (ACGME) Information Current as of December 2, 2013 The Program Evaluation Committee and the.
Resident Duty Hours UB Office of Graduate Medical Education Donna M. Cummiskey Director, GME Resource Management May 20, 2008.
ACGME Next Accreditation System AAMC Contacts: Carol Aschenbrener, M.D., Sunny Yoder
Program Evaluation Committees (PEC), Annual Evaluations, and the 10 year Self Study and Visit in the Next Accreditation System Cuc Mai MD FACP August.
Department of Graduate Medical Education (GME) Overview of the ACGME Core Competencies.
Surveys: One More Outcomes Measure Jay Shapiro, MD Program Director Anesthesiology.
What it Means to be a Program Director Rita M Patel MD Professor of Anesthesiology & Vice-Chair, Education Department of Anesthesiology Associate Dean.
Program Director’s Guide to Common Program Requirements Cuc Mai MD GME Director of Faculty Development November 2011.
Documents That Provide Basis for Professional Standards and NASP Approval and Practices in ISU SCPY Internship* 1. Ed.S. Internship Handbook 2. Internship/Practicum.
House Staff Orientation Alan J. Smith, PhD, MEd Assistant Dean for GME Director, GME Office ACGME Designated Institutional Official (DIO)
Assigning Milestone Evaluations in Internal Medicine
How Accurate is the ACGME Resident Survey? Comparison Between ACGME and In-House GME Survey Bridget N. Fahy 1, S. Rob Todd 1, Judy L. Paukert 2, Melanie.
Program Director Best Practices: Initial Survey Results University of Utah GME Annual Program Director Retreat Susan Stroud, MD Sonja Van Hala, MD, MPH,
Conducting Your Program’s Annual Review Esther Tucci, CTAGME Pinnacle Health Harrisburg, PA.
NEW COMPETENCY QUESTIONS IN PROGRAM INFORMATION FORM Lois L. Bready, M.D. Associate Dean for GME and DIO UTHSCSA.
Next Accreditation System Safe Care for Current and Future Patients.
ACGME Survey and Program Evaluation Analysis
Quality Improvement Projects for MOC MOC Credit for the Work You Do Every Day * Additional notes added by CPQCC.
ACGME Core Competencies New ACGME Duty Hours Standards ACGME Site Visit Residency Program July 26 Effective July 1, 2011.
Preliminary Feedback from ACGME CLER Site Visit August 19-21, 2014
Annual Data Collected and Reviewed 1. Annual ADS Update - Streamlined ◦ Program Attrition ◦ Program Characteristics – Structure and Resources ◦ Scholarly.
Developing a Nursing Portfolio
Comparison: Traditional vs. Outcome Project Evaluative Processes Craig McClure, MD Educational Outcomes Service Group University of Arizona December 2004.
GME Jeopardy. Compe 10 cies VISA issues ToolboxOversiteAlphabet Soup
Milestones Knowledge regarding the Milestones in the GME community is variable. This presentation will provide a general overview of the Milestones. This.
The ACGME Annual Educational Conference After just one Margarita Be sure you can trust those you ask for help back to your room A long night, a few drinks,
CASE LOGS & CLINICAL PROCEDURE TRACKING M. Njoku, MD UMMC DIO, Chair GMEC GMEC Meeting June 25, 2015.
Developing A Competency-based Curriculum B. Joyce, Ph.D.
Matt Mauro MD ABR Trustee APDR  Approval of ABMS and ACGME  Program requirements  Accredited programs  Certifying examinations  MOC program.
Wendy M. Helkowski, M.D. Program Director University of Pittsburgh Medical Center (UPMC)
Core Competency Assessment in Emergency Medicine from Design to Implementation Christian Arbelaez, MD, MPH Assistant Residency Director Harvard Affiliated.
Core Competency Assessment in Emergency Medicine from Design to Implementation National Hispanic Medical Conference Christian Arbelaez, MD, MPH Associate.
Program Administrator Certification
Kazakhstan Health Technology Transfer and Institutional Reform Project Clinical Teaching Post Graduate Medicine A Workshop Drs. Henry Averns and Lewis.
GUIDELINES FOR CURRICULUM PLANNING Jose Y. Cueto Jr., MD, MHPEd Member Board of Medicine.
Resident Credentialing Project: From Procedures to Portfolios Ruth H. Nawotniak, MS Program Coordinator - Surgery University at Buffalo State University.
The Program Evaluation Committee and its Role Manuel A. Eskildsen, MD, MPH Fellowship Directors Pre-Conference May 14, 2015.
(insert Program Name) Expansion (Insert program director name) Program Director (date)
Welcome to…... The Single Accreditation System: AOA/ACGME Integration At Last! Judith Pauwels, MD AAFP Residency Program Solutions Consultant.
McGaw’s Overview of the Next Accreditation System (NAS)
Program Coordinator Wisdom Emergency Medicine. Program Structure 4 Year Residency 12 Residents/PGY = 48 Residents 1 PD 3 APD 2 PC.
E. Ryan - ARCS Presentation May 8, 2003 Preparing For A Site Visit: Supervising the Collection of Data Association of Residency Coordinators in Surgery.
Milestones Jennifer Gould, MD Program Director, Diagnostic Radiology.
- E-Portfolios are being used to support individual learning at multiple levels in a number of different areas of study - Widely used by medical students.
STACEY T. GRAY, MD PROGRAM DIRECTOR, HARVARD MEDICAL SCHOOL.
ACGME SIX CORE COMPETENCIES Minimum Program Requirements Language Approved by the ACGME, September 28, 1999 “The residency program must require its residents.
Accreditation Council for Graduate Medical Education Milestones are Coming: A Conversation with the Family Medicine Milestones Committee May 2013.
Assessing Specialty Specific Milestones of ‘Off-Service’ Rotators During Emergency Medicine Rotation Lauren Walter, MD, FACEP, FAAEM and Andrew Edwards,
Delivering the Milestones Evaluation: Structuring Feedback & Comments from the CCC Dr. Eric Beachy, MD, Dr. Manju Thothala, MD, Dr. Nicole McGuire, DHSc.
Preparing for the ACGME's Next Accreditation System (NAS) A Prospective View for Family Medicine Residencies Joseph J. Brocato, PhD, University of Minnesota.
Common Program Citations and What a Program Coordinator Can Help Avoid.
ACGME CLER Visit USF and TGH September 22-24, 2014 Results.
Next Accreditation System (NAS) Primer Cuc Mai IM Residency Program Director Annual PD Workshop 2015.
Navigating the Resident Quarterly Development Plan
ANNUAL PROGRAM REVIEW Welcome! We are excited to have you here and about your participation in this project. As you know, the AAIM – ABIM project is investigating.
To Entrust or Not to Entrust
Oversight of Underperforming Programs Through Special Reviews
Committee # VI: Medical Students: Student Services/Learning Environment.
General Competencies Committee September 21, 2007
Are you ready? Preparing for your ACGME Site visit
Site Visits and Clerkship Coordinators – Defining a Best Practice
The Program Evaluation Committee and the Annual Program Evaluation
The Program Evaluation Committee
How to Survive a Self-Study!!
The Program Evaluation Committee
Presentation transcript:

PRESENTED BY: Michael T. Flannery, M.D., F.A.C.P. Professor of Medicine GME Internal Review Director

RESIDENT EVALUATION FORMATIVE EVALUATION Faculty must evaluate resident performance during each rotation and document this evaluation at completion of the assignment. ROTATIONAL – COMPETENCY/LEVEL SPECIFIC

FORMATIVE EVALUATIONS 1.) Competence in patient care 2.) Medical Knowledge 3.) Practice-based learning and improvement 4.) Interpersonal and communication skills 5.) Professionalism 6.) Systems-based practice

FORMATIVE EVALUATIONS 1.) 360 degree evaluation use multiple evaluators (e.g., Faculty, peers, patients, self, and other professional staff). 2.) Document progressive resident performance improvement appropriate to education level (semiannual). 3.) Provide each resident with documented semiannual evaluation of performance with feedback. 4.) The evaluations of resident performance must be accessible for review by the resident.

RESIDENT SEMIANNUAL EVALUATION Resident Name: _______________________________ PGY Year: _____________________________________ Reviewer’s Name circle (PD/APD):________________ Date:_______________ Check off all appropriate areas and note any discussion with the resident REVIEW ITEMS __Review Self Assessment*: __Review Rotational Evaluations*: __Review Ambulatory Preceptor Evaluation* (every 6 months:)

REVIEW LIST (CONTINUED) __Review 360 Evaluations*: __Review Case Logs: __Review Surgical Logs (program vs individual variation): __Review Simulation Activities: __Review and Attach Scholarly Activities: __Review CEX’s*: __Review ITE’s*: Y/N Moonlighting: GME form completed Y/N: Interferes with clinical education Y/N * = Areas that involve main review of ACGME Core Competencies

RESIDENT SEMIANNUAL EVALUATION (CONTINUED) DISCUSSION/ACTION ITEMS __Quality Improvement/Patient Safety: __Reception/Review of Goals/Objectives Prior to Rotations: __Transitions of Care: __Fatigue: __Supervision Policies: __Duty Hours: __Required Conference Attendance: __Interdisciplinary Team Involvement: __Participation on Committees and document (residency, departmental, hospital, graduate medical, etc.): _____________________ ________________________ Resident’s Signature Reviewer’s Signature

RESIDENT SEMIANNUAL EVALUATION (CONTINUED) OTHER REQUIRED FILE INFORMATION __Curriculum Vitae: __USMLE Data: __ACLS Documentation: __Licensing Information: __ECFMG Data (if appropriate)

SUMMATIVE EVALUATION The Program Director must provide a summative evaluation for each resident upon completion of the program. This evaluation must become part of the resident’s permanent record maintained by the institution, and must be accessible for review by the resident in accordance with institution policy.

SUMMATIVE EVALUATION (CONTINUED) 1.) Document the resident’s performance during the final period of education. 2.) Verify that the resident has demonstrated sufficient competence to enter practice without direct supervision.

SUMMATIVE EVALUATION DATE:______ I have reviewed Dr._____________ performance in the final __ months of his residency/fellowship (circle) matriculation and found him/her competent in the six core competencies which are superior/average/below average (circle) in relation to his/her peers. Dr.______________ has successfully completed his/her residency/fellowship and can enter ______________ (insert field of training) practice independently and competently without direct supervision. Program Director_______________________ Resident/Fellow________________________

FACULTY EVALUATION 1.) At least annually, the program must evaluate faculty performance as it relates to the educational program. 2.) This evaluation must include at least annual written confidential evaluations by the residents.

FACULTY EVALUATION (CONTINUED) 3.) These evaluations should include a review of the faculty’s: A.) Clinical teaching abilities B.) Commitment to educational program C.) Clinical knowledge D.)Professionalism E.) Scholarly activities

ANNUAL FACULTY EVALUATION (Attachment to New Innovations Faculty summary which reviews ACGME competencies and resident/fellow comments.) YEAR: Checklist (discussion with commentary): Clinical teaching abilities: Commitment to educational program: Clinical Knowledge: Professionalism: Scholarly activities: Faculty Development attended: Date & Signatures of Program Director and Faculty

PROGRAM EVALUATION & IMPROVEMENT The program must document formal, systematic evaluation of the curriculum at least annually. The program must monitor and track each of the following areas: 1.) Resident performance 2.) Faculty development 3.) Graduate performance, including performance of program graduates on the certification examination 4.) Program quality. Specifically:

PROGRAM EVALUATION & IMPROVEMENT Program Quality Continued A.) Residents and faculty must have the opportunity to evaluate the program confidentially and in writing at least annually. B.) The program must use the results of residents’ assessments of the program together with other program evaluation results to improve the program.

PROGRAM EVALUATION & IMPROVEMENT (CONTINUED) If deficiencies are found, the program should prepare a written plan of action to document initiatives to improve performance in the areas listed in section V.C. 1. the action plan should be reviewed and approved by the teaching faculty and documented in meeting minutes.

USF MORSANI COLLEGE OF MEDICINE ANNUAL PROGRAM REVIEW Program:___________________ Review Date:________________ Attendance: (specific roles) Program Director: Program Coordinator: Faculty Member (s): Residents/Fellows (by PGY year) Other:

USF MORSANI COLLEGE OF MEDICINE ANNUAL PROGRAM REVIEW DATA REVIEWED: Prior Year Annual Program Review and status of any issues identified Current Goals/Objectives reviewed – and modified as needed (every three years minimum) ACGME Annual Resident Survey (Current Year vs. Prior Year) Faculty/Resident Annual Surveys of the Program Post-graduate Surveys

USF MORSANI COLLEGE OF MEDICINE ANNUAL PROGRAM REVIEW RESIDENT/FELLOW PERFORMANCE/EVALUATIONS: Review of evaluations POST-GRADUATE PERFORMANCE: Review of graduates performance on certification exam Three year rolling pass rate and how many took the examination [> 80%] PROGRAM QUALITY: With measures (program and faculty evaluations) Improvements to be implemented

USF MORSANI COLLEGE OF MEDICINE ANNUAL PROGRAM REVIEW FACULTY DEVELOPMENT: Describe needs/activities Annual Feedback from New Innovations data Any specific GME and program-directed activity CURRENT DEFICIENCIES/CITATIONS: Add action on prior deficiencies/citations Note: Minimum of one annual meeting required (but more necessary i.e., due to abnormal resident survey, for instance)

NAS (Next Accreditation System) CURRENT EVALUATION: (ADS) update ACGME resident survey Case Log Clinical experience data Data on graduates’ performance on certifying board examination.

NAS (Next Accreditation System) NEW EVALUATION ELEMENTS: Educational Milestone data from semiannual resident evaluations (phase one specialties submit reports in 12/13 and 6/14) Faculty survey (scheduled for implementation in 2012/2013) Scholarly activity report form that replaces the detailed faculty curricula vitae presently used (only PD will need full CV)

ACGME EVALUATION REQUIREMENTS What you will receive via Talk w/slides Evaluation form templates 1. Resident Semiannual Evaluation 2.Summative Evaluation 3.Annual Faculty Evaluation 4.USF Morsani College of Medicine Annual Program Review Links Common Program Requirements (CPR) nPR pdf nPR pdf Next Accreditation System FAQ’s: