Pediatric Resident Minimum Milestone Expectations by Level of Training Su-Ting Li, MD, MPH; Daniel Tancredi, PhD; Alan Schwartz, PhD; Ann Burke, MD; Ann.

Slides:

Advertisements

Similar presentations

Steve Craig, MD & Danny Takanishi, MD and Members of the TY Milestones Working Group.

Advertisements

MILESTONES, EPAS, NAS…AND OTHER ACGME JARGON Committee on Graduate Medical Education September 24, 2012 Sara LP Ross, MD.

Bethany Geldmaker PNP, PhD Tracy Jebo MPH Continuous Quality Improvement (CQI): Part 3.

Assigning Milestone Evaluations in Internal Medicine

 Residents report using different modes of communication with LEP patients depending on the clinical encounter.  Variation in professional interpreter.

Milestone Project Update

Edward H. Shortliffe, MD, PhD Professor of Biomedical Informatics, Arizona State University Adjunct Professor of Biomedical Informatics, Columbia University.

Residency Review Committee for Emergency Medicine Report to CORD Art Sanders, MD, Chairman October 2004.

Next Accreditation System Safe Care for Current and Future Patients.

SAHM FELLOWSHIP DIRECTORS ANNUAL LUNCHEON March 19, 2015.

 Nancy Piro, PhD – No conflicts of interest to disclose  Kim Walker, PhD - No conflicts of interest to disclose.

Resident Orientation Medical School Residency & Fellowship Examination & Certification Professional Development & MOC Outcomes: Healthy Children.

Competency Tools to Measure Resident Progress

Preliminary Feedback from ACGME CLER Site Visit August 19-21, 2014

Accreditation Council for Graduate Medical Education © 2014 Accreditation Council for Graduate Medical Education Competency-based Medical Education (CBME)

Wendy M. Helkowski, M.D. Program Director University of Pittsburgh Medical Center (UPMC)

Pediatric Milestones and Evaluations A. White, MD February 7 th, 2014.

Community Pediatrics: Sources of Guidance and Advice for Residents Emily C. Dowling, MHS Candidate Anne E Dyson Community Pediatric Training Initiative.

MPPDA 2014 Presidential Address Russ Kolarik, MD MPPDA National Meeting April 10, 2014.

Provider knowledge of California confidentiality laws: Associations with self-confidence and training Kapphahn C, MD, MPH 1, Rao S, MS, MPH 2, Jesser C,

Impact of the “Asthma Toolbox” for Improving Documentation of Pediatric Asthma Management in an Urban Community Health Center Presenter: Delaney Gracy,

The Program Evaluation Committee and its Role Manuel A. Eskildsen, MD, MPH Fellowship Directors Pre-Conference May 14, 2015.

Adult Drug Courts: The Effect of Structural Differences on Program Retention Rates Natasha Williams, Ph.D., J.D., MPH Post Doctoral Fellow, Morgan State.

Psychology Workforce Development for Primary Care Cynthia D. Belar, PhD, ABPP Executive Director, APA Education Directorate Collaborative.

Assessment of Emergency Medicine Residents’ Bedside Communication Skills: A Survey of Emergency Department Patients Amanda Keller York College of PA Biology.

Is The ACGME Resident/Fellow Survey a Valid Tool to Assess General Surgery Residency Programs Compliance with Work Hours Regulations? Robert P. Sticca,

Developing an Assessment System B. Joyce, PhD 2006.

Quality of Care in Physician Groups Do Larger Integrated Systems Deliver Higher Quality Care? Ateev Mehrotra MD MPH RAND Pittsburgh & University of Pittsburgh.

Clinical Competency Committees What Faculty need to know Academic Affairs Committee ACEP,JMTF, CORD 1.

Can Faculty Development Enhance the Effectiveness of Individualized Learning Plans in Pediatric Residency Training? Ann E. Burke, MD Assistant Professor,

Use of Pharmacoeconomics & Outcomes Research Information in Health Care Decisions – SURVEY Results Peter K Wong, PhD, MS, MBA, RPh Steve Marx, PharmD,

Milestones Jennifer Gould, MD Program Director, Diagnostic Radiology.

Knowledge and experiences about health literacy needs and assessment among fourth year nursing students in Thailand Sinsakchon Aunprom-me, MPH, Ph.D. (Target.

What is a Planned Curriculum?

The Intersection of Surgical Outcomes and Medical Education: The Resident Perspective Caroline E. Reinke, MD MSPH Division of Surgery Education Hospital.

Barriers to Independence Among TANF Recipients: Comparing Caseworker Records & Client Surveys Correne Saunders Pamela C. Ovwigho Catherine E. Born Paper.

Trimming the Fat: Optimizing Overall Educational Value by Defining Factors Associated with Overall Educational Value and Service to Education Ratio Caroline.

Student Learning Outcomes (Pharmacy) Susan S. S. Ho School of Pharmacy Faculty of Medicine The Chinese University of Hong Kong 9 September 2007.

F UNCTIONAL L IMITATIONS IN C ANCER S URVIVORS A MONG E LDERLY M EDICARE B ENEFICIARIES Prachi P. Chavan, MD, MPH Epidemiology PhD Student Xinhua Yu MD.

Robin E. Remsburg, PhD, APRN, BC Beth Han, PhD, MD, MPH National Center for Health Statistics U.S. DEPARTMENT OF HEALTH AND HUMAN SERVICES Centers for.

Fellow Orientation Medical School Residency & Fellowship

ACGME SIX CORE COMPETENCIES Minimum Program Requirements Language Approved by the ACGME, September 28, 1999 “The residency program must require its residents.

Not Just “MK-1” How learning the skills of EBM relates to the pediatric milestones Martha S Wright, MD, MEd Rainbow Babies and Children’s Hospital.

Meeting the ACGME Milestones through Group Prenatal Care INTRODUCTION Mila D'Cunha MD. MSc., Anastasia Kolasa-Lenarz MD. MPH., Karolina Lis MD., Kimberly.

Jennifer Kesselheim, MD Nothing to disclose Discussion of off-label drug use: not applicable 56 th ASH Annual Meeting Disclosure Statement.

The use of OSCE to assess Patient Care, Professionalism and Interpersonal Communication Milestones in EM residents Miriam Kulkarni, MD, Harsh Sule, MD,

TEMPLATE AND PRINTING BY: GRMERC Consortium Members: Grand Valley State University, Michigan State University, Saint Mary’s.

Patricia Kokotailo, Sarah Pitts, Sheryl Ryan, Karen Soren, Maria Trent

Objectives Methods Introduction Results Conclusions To measure the self-reported competency of all EM residents with Level 1 milestones as they enter residency.

Daniel J. Schumacher, MD, MEd Mary Pat Frintner, MSPH Presented at: Association of Pediatric Program Directors Spring Meeting April 1, 2016 New Orleans,

Miles to Go Before We Sleep: Behavioral Science Educators’ Role in Milestone Feedback and Evaluation Katherine Buck, Ph.D., LMFT Director of Behavioral.

ASH Training Directors’ Workshop “Milestones in Graduate Medical Education” Dec Lee Berkowitz, MD UNC – Chapel Hill.

Teaching Maternity Care in Family Medicine Residencies: What Factors Predict Graduate Continuation of Obstetrics? A 2013 CERA Program Directors Survey.

Continuity Patient Panel Reassignment in Primary Care Residencies: A Report from the I 3 Collaborative Chuck Carter, MD, FAAFP Mark Robinson, MD Michele.

Global Maternal and Child Health in Rural Malawi : A Resident-Centerd Evaluation Of A New ACGME-Approved Rotation Christina Miller, MD; Sumedh Mankar,

Entrustable Professional Activities (EPAs) for the Assessment of Early Medical Students H. Carrie Chen MD MSEd1, Margaret McNamara MD1, Arianne Teherani.

Entrustable Professional Activities

Disparities in process and outcome measures among adults with persistent asthma David M. Mosen, PhD, MPH; Michael Schatz, MD, MS; Rachel Gold, PhD; Winston.

EPAs as a Tool for Resident Evaluation

EPAs as Curriculum Tools

This presentation includes the audio recording from the “Review of the Internal Medicine Subspecialty Reporting Milestones” webinar held on September 11,

This presentation includes the audio recording from the “Review of the Internal Medicine Subspecialty Reporting Milestones” webinar held on September 9,

The Next Accreditation System: A Strategy for Implementing New Reporting Standards Using a Hematology/Oncology Model Frances Collichio, MD, Karen Kayoumi,

CLICK TO GO BACK TO KIOSK MENU

To Entrust or Not to Entrust

Physician Adoption of Adolescent Tdap Recommendations

Gerald H. Sterling, Ph.D. Senior Associate Dean, Education

An Introduction to the ACGME

The Clinical Competency Committee

The Program Evaluation Committee

Presentation transcript:

Pediatric Resident Minimum Milestone Expectations by Level of Training Su-Ting Li, MD, MPH; Daniel Tancredi, PhD; Alan Schwartz, PhD; Ann Burke, MD; Ann Guillot, MD; Susan Guralnick, MD; John Mahan, MD; R. Franklin Trimm, MD; Kimberly Gifford, MD

We have nothing to disclose.

Background  ACGME requires biannual reporting of milestones on all pediatric residents  Milestone expectation of performance at each level of training is unknown

Specific Aims  Determine program director expectation of milestone level: – Before a resident is “ready to supervise” – Before a resident is “ready to graduate”

Methods  Cross-sectional survey of pediatric program directors in June 2015  Program demographics  Does your program have minimum milestone expectations before your residents are ready to supervise?  Does your program have minimum milestone expectations for graduating residents?

Methods  For each of the 21 subcompetencies, please indicate the MINIMUM milestone level you expect in your program (or, if your program has not established minimum milestone level, you are considering): – Before your residents are READY TO SUPERVISE IF you would allow a resident to supervise even if they are at milestone 1 for this subcompetency, please mark NO MINIMUM LEVEL. – GRADUATING pediatric residents (ie., would provide UNSATISFACTORY evaluation to American Board of Pediatrics (ABP) if minimum milestone level not met). IF you would allow a resident to graduate even if they are at milestone 1 for this subcompetency, please mark NO MINIMUM LEVEL.

Analysis  Descriptive statistics – Mean, standard deviation for continuous variables – Percentages for categorical variables  Mixed effects logistic regression to determine: – Subcompetencies for which PDs reported: Having no minimum milestone rating before a resident was ready to supervise, or ready to graduate – Clustered by program – Adjusted for program size, program region

Results  57% (113/199) response rate  Program demographics (size, location) similar between respondents and non-respondents  Most (80%; 76/95) did NOT have minimum milestone expectations before residents are ready to supervise  Most (84%; 80/95) did NOT have minimum milestone expectations before residents were ready to graduate

Before a resident is “ready to supervise”:  Majority of PDs expect > Milestone 2 for all subcompetencies  Majority of PDs expect > Milestone 2.5 for: – PBLI4: incorporate feedback – Most patient care subcompetencies PC3: transfer of care PC4: diagnostic/therapeutic decisions PC5: develop management plans – Most professionalism subcompetencies PROF1: humanism PROF2: professionalization PROF3: professional conduct PROF4: help-seeking PROF5: trustworthiness

Before a resident is “ready to supervise”:  Mixed effects logistic regression, PDs were more likely NOT to have minimum milestone expectations before a resident was ready to supervise for: – SBP2: Advocacy OR: 59.66; 95% CI: > – PROF6: Accept ambiguity OR: 19.35; 95% CI: – PBLI3: Quality improvement OR: 19.30; 95% CI: – PBLI2: Identify learning activities OR: 13.94; 95% CI:

Before a resident is “ready to graduate”:  Majority of PDs expect > Milestone 3 in all subcompetencies – Except for: Help-seeking (PROF4) – where >3.5 was expected Advocacy (SBP2) – where >2.5 was expected  PDs had minimum milestone expectations for all subcompetencies prior to graduation – Mixed effects logistic regression adjusting for program size and region

Limitations  Moderate overall response rate  Large drop-off in response – 113/199 (57%) – Program demographics – 95/199 (48%) - Minimum milestone expectations in program – 54/199 (27%) – Program director minimum milestone expectations by level of training  Only second year of milestones reporting – PDs and CCC members still developing experience with milestone determinations and implications – Limited experience with post-graduation outcomes by which to assess validity of how milestone scores are correlated with post- graduation performance

Implications for Medical Education  Most programs do not have set minimum milestones for progression from one level of training to the next  PDs recognize relative importance of different subcompetencies in – allowing a resident to supervise vs. – allowing a resident to graduate and practice without supervision  PDs may have a shared mental model of expectations of residents prior to being “ready to supervise” which include ability to incorporate feedback and performance on professionalism and patient care competencies  Help-seeking behavior may be key to entrustment decisions before a resident is “ready for unsupervised practice”

Thank you!  Program directors who participated in the study