Program Evaluation in the Queen’s PGME Transition Designing Competency At Queen’s Workshop February Denise Stockley, PhD Provost’s Office (Teaching and Learning Portfolio) and Faculty of Health Sciences Elaine Van Melle PhD, Education Scientist, RCPSC

Outline 1.Program Evaluation Overview 2.3 year plan 3.Getting started...

Program Evaluation Team Internal Queen’s University Program Evaluation LeadDenise Stockley External Royal College Program Evaluator Consultant Elaine Van Melle Internal Faculty of Health Science Academic LeadDamon Dagnone

CBME Program Evaluation is Guided By: 1.How do we prepare programs for the adoption of CBME? 2.Are we implementing CBME as intended? 3.What strategies are required to sustain the adoption of CBME across the institution? 4.How has (or is) CBME contributing to changes in behaviours (e.g., relationships, actions, activities, policies or practices) across all levels of the institution?

Conceptual Framework - Concerns-Based Adoption Model

Three Year Project Year 1 - Building the Foundation Year 2 - Implementing the Change Year 3 - Ensuring Sustainability

Program Evaluation Year 1 Building the Foundation Collection of baseline data Distribute the Stages of Concern Questionnaire Create an Innovation Configuration Map

Innovation Configuration Map Specific descriptions of what CBME looks like in practice Program Leadership Faculty (as teachers, as assessors) Residents On a continuum... Ideal Transitioning Preparing Business as Usual

Core Components of CBME – First Step What does this figure tell you about CBME? How would you (or would you?) use it?

Core Components of CBME – First Step What does this figure tell you about CBME? How would you (or would you?) use it? CBME... Has a strong theoretical foundation Is made up of many components Components need to work together

For More Information: For more information or to engage in the process, contact: Denise Stockley –