1. The ACGME Annual Educational Conference After just one Margarita Be sure you can trust those you ask for help back to your room A long night, a few drinks, all you want to do is go to sleep, then this starts…

2. http://med.stanford.edu/gme/GME_Community.html Millstones

3. What Should a CCC Do First? Understand their specialty Milestones ( Posted on acgme.org) Decide how to assess the Milestones – Program Evaluation Strategy If necessary, identify new evaluation tools from program director associations, societies, colleges

4. NAS and Milestones and YOU The program coordinator will play a crucial role in developing, implementing and collecting data on x and reporting of milestone evaluation tools to the CCC

5. Managing it all…

6. U - R - IT! U nderstanding RRC program requirements R equirements applied to evaluation methods/process I mplementing new evaluation system 2+2=4 (2+2)*4=16 T racking completion and accuracy (outliers) for data aggregation

7. Implementing Assessment Tools to validate Milestones Evaluation systems – Milestone-based/EPAs (Entrustable Professional Activities) – Rotation-specific – Patient handovers – Define evaluator groups (faculty, staff, patients) – Set up and timing of delivery systems

8. 4. Tracking and Reporting… Start with the end in mind: – CCC biannual reporting windows to ACGME November 1- December 31 / May 1 - June 15 Back track and set calendar events for: – Periodic monitoring of evaluation completion – Running aggregate reports and reviewing milestone evaluation data – Reviewing case logs, learning portfolios, duty hours

9. Pulling the Data Together Clinical Competency Committee End-of- Rotation Evaluations Safety Incident Reports Case Logs Patient/ Family Evaluations Clinical Skills Assessment Nursing and Staff / Techs Evaluations Progress on Milestones Sim Lab Sim Lab In-service training exams Quality Improvement Activities

10. A milestone from General Surgery

11. Pulling the Data Together Clinical Competency Committee End-of- Rotation Evaluations Safety Incident Reports Case Logs Patient/ Family Evaluations Clinical Skills Assessment Nursing and Staff / Techs Evaluations Progress on Milestones Sim Lab Sim Lab In-service training exams Quality Improvement Activities

12. A milestone from General Surgery

13. Managing it all: How will I pull this off?

14. The Toolbox

15. Creating a Resident Performance Profile Goals to support your CCC Resident performance data that is: Comprehensive Consolidated / Aggregated Easy for CCC to identify strengths, areas for improvement, opportunities for advancement

16. Creating a Resident Performance Profile Step 1 – Defining what to track

17. More tools…

18. Leveraging Resident Management System (RMS)Tools, if Available RMSs – becoming more feature rich Curriculum – Goals and Objectives and learning outcomes by rotation – Teaching and Assessment methodologies Evaluation tool development – Sharing between programs and institutions

19. He was so lonely he needed his comfort blanket

20. Links to other sessions’ slides I attended… Katie’s Presentation Slides http://www.acgme.org/acgmeweb/Portals/0/PDFs/2014AEC-Presentations/BR11.pdf http://www.acgme.org/acgmeweb/Portals/0/PDFs/2014AEC-Presentations/BR11.pdf https://quickstart.quickmobile.com/cms/resources/render/3698/1/122 ***** https://quickstart.quickmobile.com/cms/resources/render/3698/1/122 https://quickstart.quickmobile.com/cms/resources/render/3698/1/187 **** https://quickstart.quickmobile.com/cms/resources/render/3698/1/187 https://quickstart.quickmobile.com/cms/resources/render/3698/1/215 https://quickstart.quickmobile.com/cms/resources/render/3698/1/216 https://quickstart.quickmobile.com/cms/resources/render/3698/1/119 https://quickstart.quickmobile.com/cms/resources/render/3698/1/217 hthttps://quickstart.quickmobile.com/cms/resources/render/3698/1/131 hthttps://quickstart.quickmobile.com/cms/resources/render/3698/1/131 https://quickstart.quickmobile.com/cms/resources/render/3698/1/184 https://quickstart.quickmobile.com/cms/resources/render/3698/1/247 https://quickstart.quickmobile.com/cms/resources/render/3698/1/248 https://quickstart.quickmobile.com/cms/resources/render/3698/1/53 https://quickstart.quickmobile.com/cms/resources/render/3698/1/54 http://med.stanford.edu/gme/GME_Community.html ****** http://med.stanford.edu/gme/GME_Community.html