1. ERIC KATZ, MD PROGRAM DIRECTOR VICE-CHAIR FOR EDUCATION Graduate Assessment of Programs GLORIA KUHN, DO, PHD VICE-CHAIR FOR ACADEMIC AFFAIRS WAYNE STATE/DETROIT RECIEVING

2. Are the residents prepared for the real world? How do we know? How can we figure out where our programs need to improve?

3. ACGME Outcomes Project – Phase 3  Requires programs to use outside sources to prove quality of education.  Requires comparison with a national standard  Dead line for Phase 3, external evaluation, is here

4. Post-Graduate Assessment  Goals: 1. Evaluation of the program by asking employers how our grads are doing. 2. Evaluation of the program by asking our grads how well they were prepared. 3. Evaluation of specific elements of training that may predict graduate performance. (i.e. what should we be teaching)

5. Post-Graduate Assessment Methodology Survey the graduate Survey the graduate’s primary employer Survey the program

6. Obstacles Protect the anonymity of the graduate Protect the rights of the graduate Protect the anonymity of the program

7. Steps 1. PROGRAM DIRECTOR gets a link by email to fill out the PD survey March or April, 2011 2. PROGRAM COORDINATOR gets an email stating the PD wants them to enter resident emails, employer emails and send consents to survey coordinator March or April, 2011 3. Surveys sent to RESIDENTS and EMPLOYERS April, 2011

8. Step 1 – PD Survey – Defines your program

9. Step 2 Once the PD completes their survey, it is up to the coordinators  Communication between PD and coordinators matters! Consent forms (available on sharepoint) to be completed prior to graduation and sent to the address on the coordinator link.  Residents can opt out  Hopefully many of you already have these signed

10. Step 2 – Coordinators – Contact Information

11. Sending the forms in

12. Step 3 – Graduates get surveyed

13. Step 3- Employers get surveyed at the same time

14. How it will work – your reports You will receive your own program’s results Each program will receive national statistics and comparisons within similar programs Programs will NOT see individual survey results Programs will NOT see other program results CORD/EMARC will NOT see individual program results

15. The Beta Test The system works Some Unexpected Problems:  Delays in survey completion  Coordinators unaware of project Some expected problems  Spam-blockers  Email addresses incorrect  Delay/Response rate (not yet known) Louisville Maimonides Maricopa Penn State Synergy Medical Wayne State

16. What can you do for March, 2011? PLEASE – (if you haven’t already) get the consent off sharepoint and have your 2010 grads sign them. Get your grads email address and their new boss’s email address.

17. What can You Do? Communicate with your PD about the project Have a check list to ensure that each step is completed Get the consent forms signed OR Figure out an alternative plan for obtaining external evaluation of your program

18. Phase 3 of outcomes THE GOAL!

19. Now is the Time Implement this project Phase 3, external evaluation is here It will be easier to do this as a society than individually

20. This is the result of dozens of CORD/EMARC members working for over three years. It has had many fits and starts, but we hope this version is feasible for the group as a whole.

21. Questions?