Competency Based Medical Education Coming Soon to A University Near You! Dr. Janice Chisholm October 21, 2015.

Slides:



Advertisements
Similar presentations
Performance Assessment
Advertisements

Educational Supervision & Find Your Way Around in the E-portfolio Dr Jane Mamelok RCGP WPBA Clinical Lead.
The Challenge and Importance of Evaluating Residents and Fellows Debra Weinstein, M.D. PHS GME Coordinators Retreat March 25, 2011.
Competencies, Milestones & EPAs: What Does It All Mean?
The Milestone Project For Neurosurgical Resident Coordinators.
Workplace-based Assessment. Overview Types of assessment Assessment for learning Assessment of learning Purpose of WBA Benefits of WBA Miller’s Pyramid.
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal.
Overview: Competency-Based Education & Evaluation
Constructing a test. Aims To consider issues of: Writing assessments Blueprinting.
Assessment of Clinical Competence in Health Professionals Education
Observing Learning Helen Bacon and Jan Ridgway Inclusion Support Services.
Dr. Dalal AL-Matrouk KBA Farwaniya Hospital
Comparison: Traditional vs. Outcome Project Evaluative Processes Craig McClure, MD Educational Outcomes Service Group University of Arizona December 2004.
Unit Assessment Plan Weber State University’s Teacher Preparation Program.
Purpose Program The purpose of this presentation is to clarify the process for conducting Student Learning Outcomes Assessment at the Program Level. At.
Triple C Competency-based Curriculum A Brief Overview Copyright © 2011 The College of Family Physicians of Canada.
Triple C Competency-based Curriculum: Implications for Family Medicine Residency Programs.
Fundamentals of Assessment Todd L. Green, Ph.D. Associate Professor Pharmacology, Physiology & Toxicology PIES Seminar
Assessment Tools. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions.
Work based assessment Challenges and opportunities.
Queen’s University CBME Workshop #1 Family Medicine’s Journey 2009-present Dr. Karen Schultz Program Director February 2015.
Individualized Learning and Assessment Daniel M Clinchot, MD Vice Dean for Education March 6, 2014.
Triple C Competency-based Curriculum A Brief Overview for Residents Copyright © 2013 The College of Family Physicians of Canada.
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal College.
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal College.
Development of Entrustable Professional Activities (EPAs) for Public Health and Preventive Medicine (PHPM) PHPC CPD Event - May 24, 2015 Kieran Moore MD,
Direct Observation of Clinical Skills During Patient Care NEW INSIGHTS – REYNOLDS MEETING 2012 Direct Observation Team: J. Kogan, L. Conforti, W. Iobst,
Assessment Tools.
Considerations for Curricular Development & Change Donna Mannello, DC Logan University.
What is a Planned Curriculum?
Workplace based assessment for the nMRCGP. nMRCGP Integrated assessment package comprising:  Applied knowledge test (AKT)  Clinical skills assessment.
Training the Trainers Assessing the Learner Progress By Dr Malik Zaben IMET
What is the difference between milestones and evaluations? Why do so many struggle with this?
Not Just “MK-1” How learning the skills of EBM relates to the pediatric milestones Martha S Wright, MD, MEd Rainbow Babies and Children’s Hospital.
Reliability in assessment Cees van der Vleuten Maastricht University Certificate Course on Assessment 6 May 2015.
Patricia Kokotailo, Sarah Pitts, Sheryl Ryan, Karen Soren, Maria Trent
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal College.
Click to edit Master subtitle style Competence by Design (CBD) Foundations of Assessment.
Henry M. Sondheimer, MD Association of American Medical Colleges 7 August 2013 A Common Taxonomy of Competency Domains for the Health Professions and Competencies.
CBME – AMEE 2013 IMELF of these is not like the other 2… Which one ? Why ?
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal College.
Approaching Milestones Documentation: Tricks, Tips, and Examples Describing What We Want in a Family Physician: From Competencies to Milestones Allen F.
CBME and CanMEDS 2015 Susan Glover Takahashi, MA, PhD Laura Leigh Murgaski, MScCH Lisa St. Amant Jesse Montgomery Kim O’Hearn.
Copyright © 2005 Avicenna The Great Cultural InstituteAvicenna The Great Cultural Institute 1 Student Assessment.
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal College.
FAIMER Assessing Teaching Excellence John Norcini, Ph.D.
Is Your Program Competency-based? Could it Be? Jason R. Frank MD MA(Ed) FRCPC Vice-Chair, Dept. of EM, UOttawa Director, Specialty Education Royal College.
Conference on Practice Improvement December 3-5, 2015
Transformation of Medical Education in Canada
Update on CBME/CBD All PDs & FM Site Directors
MAINPORT ePortfolio (Residency Prototype 1)
EPAs as Curriculum Tools
Clinical Assessment Dr. H
Competence Committees
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal.
BPEA Advisory Committee
CBD – What you need to know
MAINPORT ePortfolio (Residency Prototype 1)
Assessment 101 Zubair Amin MD MHPE.
To Entrust or Not to Entrust
Assessment of Clinical Competencies
Farhan Bhanji Associate Director, Assessment May 30th 2016
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal.
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal.
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal.
Work Based Assessments
Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal.
Workplace-based Assessment
ELENTRA How to Guide Dr. Daniel Dubois, MD, FRCPC, CE
Presentation transcript:

Competency Based Medical Education Coming Soon to A University Near You! Dr. Janice Chisholm October 21, 2015

Disclosure I have no actual or potential conflict of interest in relation to this presentation.

Objectives Discuss the rationale to changes in medical education Describe competency based medical education Recognize the importance of programmatic assessment in medical education

What is different now? Technology Rate of new medical knowledge Millenial learners Duty hour restrictions Accountability Emphasis on patient safety Ethics of practicing on patients

How do we adjust? Work with the strengths of the millenial learner Deliberate and planned curriculum Maximize active learning More assessment!

Competency and Time “Competency requires experience, experience requires time, but time alone does not produce competence” Holcombe E and Batalden P. Academic Medicine. Sept 2015 Competency – the thing(s) they need to do Competent – can do all of the things Competence – does all of the things consistently, adapting to contextual and situational needs Caverzagie,K. Making Milestones Matter, 2011 APDM

FMEC PGME 2012 Recommendations #4 Introduce competency based curicula into post graduate programs # 6 Implement effective assessment systems #7 Develop, support and recognize clinical teachers

Competency Based Medical Education “competency-based education is an approach to preparing physicians for practice that is fundamentally oriented to graduate outcome abilities and organized around competencies derived from an analysis of societal and patient needs. It deemphasizes time-based training and promises greater accountability; flexibility, and learner- centeredness” The International CBME Collaborators, 2009

More simply…. Educational programs designed to ensure that learners attain pre-specified levels of competence in a given field. Emphasis is on achievement of specified performance objectives Traditional medical education is based on time & rotations Competency based education focuses on outcomes

100% CBME??? Pure CBME Time independent Rotations are irrelevant Hybrid CBME Predetermined time Rotations are a resource

Entrustable Professional Activities “A core unit of professional work that can be identified as a task to be entrusted to a trainee once sufficient competence has been reached”

EPAs – Stage specific Transition to Discipline Establishing peripheral vascular access for uncomplicated adult patients Foundations Providing anesthesia for ASA 1 or 2 adult patients undergoing scheduled, uncomplicated, non-subspecialty surgery Core Managing patients presenting with a complex, anticipated difficult airway, including appropriate extubation plans Transition to Practice Managing all aspects of care for patients and organizational aspects related to the management of the operating room case load for an elective day list

Milestones Abilities expected of a resident at a defined stage of training

Royal College Implementation Plan 2017 Implementation Anesthesiology Forensic Pathology Gastroenterology Internal Medicine Surgical Foundations Urology

I passed!

Implications for Assessment in CBME Multifaceted assessment is essential Use various assessment methods Assessment has to be: more continuous and frequent authentic, robust and work-based And include narrative Direct observation is essential Regular feedback is essential

Assessment in CBME Goal: Collect enough information to promote a resident NOT data to fail a resident Supervisors Collect data Coach learners Competence committees Make decisions about competence

Assessments: Valid and Reliable? Validity Need multiple types of assessments Need standardized and non-standardized Reliability Need multiple assessments in a variety of contexts and assessors (large sample size) No one method is better than another Subjective assessments can be both reliable/reproducible

Method Reliability as a Function of Time Testing Time in Hours MCQ 1 Cae Based Short Essay 2 PMP 1 Oral Exam 3 Long Case 4 OSCE 5 Mini CEX 6 Practice Video Assess- ment 7 InCognito SPs Norcini et al, Wass et al, Ram et al, Stalenhoef-Halling et al, Van der Vleuten, Gorter, Swanson, Norcini et al, 1999 Slide adapted from Dr. Cees Van der Vleuten, Cudmore Lecture 2015

Continuum of Stakes Slide adapted from Dr. Cees Van der Vleuten, Cudmore Lecture 2015

Overall Assessment Portfolios Competence Committee Residents must PROVE competence, we can not assume competence

“It’s worse than we thought – there’s going to be random testing for competence”

Coaching vs. Feedback Assessment/ evaluation/ feedback: tells you where you stand, how you measure up, what’s expected of you It’s often intimidating, emotional Often evokes fear Coaching: enables you to learn and improve and helps you play at a higher level It’s learner-centered, outcome-oriented, supports success It guides progression from one competency level to the next Heen, Stone 2014

Change is coming… Identify key champions Develop a change management plan Faculty development More assessment Portfolio management

In Summary…. Medical education is changing Focus on outcomes Need to demonstrate competency as opposed to assuming competency Assessment, assessment assessment! Coaching and feedback are essential!

Questions?