A Step Ahead Assessing the Baseline Competency of Incoming Interns Andrea Wendling, M.D. Phillip Baty, M.D. Grand Rapids Family Practice Residency Program.

Slides:

Advertisements

Similar presentations

Clinical Reasoning and Written Communication Educational Strategies Assessment Challenges.

Advertisements

Feedback & Evaluation: Quick Tips for Clinical Preceptors (Part 1) Shirley Schlessinger, MD, FACP Associate Dean for Graduate Medical Education University.

The Challenge and Importance of Evaluating Residents and Fellows Debra Weinstein, M.D. PHS GME Coordinators Retreat March 25, 2011.

Objectives Explain the purpose of the RIME feedback method.

Introduction to Competency-Based Residency Education

PATRICK DUFF, M.D.. OVERVIEW Small group teaching One-on-one teaching Providing feedback.

Clinical Reasoning Deficits Dr. Traci O’Connor Dr. Lisa Tekell.

Using the IDEA Student Ratings System: An Introduction University of Saint Thomas Fall

Mentoring Conversations: Reflective Writing Exercises for Interns

UCD School of Medicine “Criterion Based” vs. “Norm-Based” Evaluation David L Gaspar MD October 18, 2008.

AGS Annual Meeting May 2005 Converting the Geriatric Functional Assessment Standardized Patient Instructor …into an OSCE Karen E. Hall, M.D., Ph.D. Clinical.

Obstetrics And Gynecology Curriculum

Charting. The Patient and Family The average person has contact with twice in their lifetime Is it an emergency or not?

Teaching learning methods

Acute Ischemic Stroke Management: 2004 Emergency Medicine Perspectives.

Professional Growth= Teacher Growth

Developing A Competency-based Curriculum B. Joyce, Ph.D.

New Faculty Orientation Teaching in the Clinical Setting Tatum Langford Korin, EdD September 19, 2006.

Let’s Take a Journey… Measuring Success Along the Way.

Core Competency Assessment in Emergency Medicine from Design to Implementation Christian Arbelaez, MD, MPH Assistant Residency Director Harvard Affiliated.

Foundation Modules (FOM 011, 013, 014) FOM Team.

Assessment Tools. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions.

Mentor Workshop: Assessing Learners Facilitated by a Practice Education Facilitator.

Nursing Process Unit III NURS 2210 Nancy Pares, RN, MSN Metro Community College.

Kazakhstan Health Technology Transfer and Institutional Reform Project Clinical Teaching Post Graduate Medicine A Workshop Drs. Henry Averns and Lewis.

Implementing Active Learning Strategies in a Large Class Setting Travis White, Pharm.D., Assistant Professor Kristy Lucas, Pharm.D., Professor Pharmacy.

The Teaching Physician: How to Become a More Effective Medical Educator The Teaching Center UNC Department of Pediatrics The Teaching Center.

The New ACGME Competencies for Internal Medicine.

Professional Practices: Assessment Melody Kipp, PhD, LMHC Life & Work Soulutions, Inc.

Modified Essay Question Yousef Abdullah Al Turki MBBS,DPHC,ABFM Associate Professor and Consultant Family Medicine College of Medicine, King Saud University.

Training for Tomorrow: The Simulated Interprofessional Rounding Experience at MUSC Donna Kern, MD Associate Dean for Curriculum- Clinical Sciences, COM.

AAMC Conference Nov, 2011 Pre-Clerkship Clinical Skills Courses Review of the Literature.

Writing Narratives Based on ACGME Competencies. Narratives What Are They?  Written Evaluation of Student Performance Formative  Mid-Course Evaluation.

Meaningful Evaluation: Framework, Process, Impact Inis Jane Bardella, M.D., FAAFP Associate Dean for Faculty Development and Global Health Initiatives.

Cultural Competency and the Inclusive Classroom Professional Development Session Kalyn Estep.

Teachers Mentoring Teachers: The Gift of Peer Feedback Katherine M. Hyland, PhD Gerald Hsu, MD University of California, San Francisco Academy of Medical.

Evaluation & Assessment: Preparing Preservice Music Teachers for the New Educational Paradigm Phillip Hash Calvin College Grand Rapids, Michigan

“R.I.M.E.” MODEL – A SYNTHETIC EVALUATION CONCEPT R eporter I nterpreter M anager- E ducator Pangaro LN. A new vocabulary and other innovations for improving.

Assessment Tools.

What is “Competency” in the New Millennium? Shirley Schlessinger, MD, FACP Associate Dean for Graduate Medical Education University of Mississippi Medical.

©2003 Community Faculty Development Center Teaching Culture and Community in Primary Care: Giving Feedback.

The University of British Columbia Faculty of Medicine Department of Family Practice Post Graduate Program.

- E-Portfolios are being used to support individual learning at multiple levels in a number of different areas of study - Widely used by medical students.

Terry Deane Donna Breger-Stanton Irma Walker-Adame Sharon Gorman Lauri Paolinetti.

MEDICAL STUDENT TRANSITION COURSE Professionalism in the Clinical Environment ANTHONY A. MEYER, MD, PHD CHAIRMAN, DEPARTMENT OF SURGERY UNIVERSITY OF NORTH.

Assessment tools MiniCEX, DOPS AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.

Assessing Learners The Teaching Center Department of Pediatrics UNC School of Medicine The Teaching Center.

Time Efficient Clinical Teaching Tali Ziv, MD KLIC-UCSF Internal Medicine Site Director Assistant Chief of Medicine, Kaiser, Oakland.

Time Efficient Clinical Teaching

Using Simulated Encounters with Standardized Patients to Teach and Evaluate Difficult Discussions Rebecca Stetzer, MD Kathleen M Young, PhD, MPH Albany.

Program Directors Survey How are we evaluating our fellows? Ann Zimrin, MD University of Maryland Greenebaum Cancer Center.

The use of OSCE to assess Patient Care, Professionalism and Interpersonal Communication Milestones in EM residents Miriam Kulkarni, MD, Harsh Sule, MD,

A Procedural Competency Evaluation Process: Systematic and Consistent Lance Fuchs, MD FAAFP Vidush Athyal, MD FAAFP Dennis Andrade, MD Kaiser Permanente.

Scott Renshaw, MD Department of Family Medicine Third Year Clerkship.

Goal Directed Learning: Early Assessment and Individualized Education Plans for Family Medicine Interns Glenda F Stockwell, PhD, Beth A Fox, MD, Reid Blackwelder,

Capturing the Patient Experience at the Point Of Care UW Department of Family Medicine Wingra Clinic Terri Carufel-Wert RN, BSN, MHA, Kirsten Rindfleisch.

Drew Keister, MD Kira Zwygart, MD.  Define the audience  The USF primary care clerkship background & structure  The USF-LVH partnership  Addition.

Approaching Milestones Documentation: Tricks, Tips, and Examples Describing What We Want in a Family Physician: From Competencies to Milestones Allen F.

Evaluating Interns in a New Residency Program – Using a July OSCE Paul Gordon, MD, MPH Tejal Parikh, MD Vic Weaver, MD Julia Hardeman, MD.

Raj Woolever, MD Deborah Taylor, PhD Central Maine Medical Center Family Medicine Residency 2010 FMEC Northeast Region Meeting October 3o, 2010.

If it Ain’t Broke, Don’t Fix it: How does a Junior Faculty Member Know When and How to Update a Clerkship? Katherine P. Land, MPH Marisyl D. de la Cruz,

University of Texas at Houston Family Medicine Residency Program

Video Enhanced Observation

Introduction to Evaluation

Exercise Stress Testing Training in FM Residencies

Using an ‘Oral Board’ exam to assess for EPA 10 in

Committee # 4: Educational Program For The MD

Lauren Douglas Program Assistant Urology Program

Process of Clinical Teaching

Presentation transcript:

A Step Ahead Assessing the Baseline Competency of Incoming Interns Andrea Wendling, M.D. Phillip Baty, M.D. Grand Rapids Family Practice Residency Program Michigan State University College of Human Medicine

A Step Ahead Assessing the Baseline Competency of incoming Interns Outline: Background Description of the Intern Clinical Judgment Evaluation Testing our system Using the information Discussion

Goals of Evaluation System Essential question: Can this intern safely take call? Understand baseline abilities and expectations Identify issues early

Defining Competencies Define competency  Recognize a patient is acutely ill  Understand help is needed  Communicate acuteness of situation appropriately

Designing the Intern Clinical Judgment Evaluation Use aspects of established testing systems Design stressful patient situations Test to be certain we were measuring our goals

Testing Room Observation Room Workstation

Chest pain

Chest Pain

Call for Help

Chest Pain- Summary Slide

Summary Reports

Testing our System To test our system, we compared three things:  Summary impressions from ICJE  Faculty prediction survey  End of year summary

Results ICJE  Kappa 0.80 Faculty prediction  Kappa 0.54

Diagnosis +Diagnosis - Test +132 Test -115 Sensitivity0.93 Specificity0.88 PPV0.87 NPV0.94 LR +7.9 LR ICJE vs. Program Director

Diagnosis +Diagnosis - Test +81 Test -617 Sensitivity0.57 Specificity0.94 PPV0.89 NPV0..73 LR LR -0.4 Faculty vs. Program Director

Results Resident feedback  Overwhelmingly positive  View it as a teaching experience

Using the information Personalized plans developed  Faculty, PGYIII and or Chief resident  Focus on self-reflection issues  Mentoring

Using the Information FMS continually changing  More resident supervision Plan on continuing due to  Additional information  Timely information  Cost

Other options Tried Comparing to OSCE  Mechanics vs. thought process  Timeliness Comparing to IM H and P  Mechanics vs. thought process Comparing to ERAS  No idea of resident ability to self- reflect

A Step Ahead Assessing the Baseline Competency of Incoming Interns Summary Handouts Question and Answer Session