Workplace based assessment Dr Nav Chana

Assessment is not simple… Medical competence is content and case specific Medical competence is content and case specific Constructs are not stable and independent Constructs are not stable and independent Attribution is a problem Attribution is a problem

Lessons learned Need to build up a whole picture Need to build up a whole picture No single method is a panacea No single method is a panacea Content important, format less so Content important, format less so Less structure, more sampling Less structure, more sampling Focus on a programme of assessment, not individual methods Focus on a programme of assessment, not individual methods Van der Vleuten C & Schuwirth L Assessing professional competence from methods to programmes. Medical Education ;

Miller’s pyramid of competence Knows Shows how Knows how Does

Workplace assessment Workplace assessment: the assessment of actual working practices undertaken in the working environment

Utility Validity Validity Reliability Reliability Educational impact Educational impact Acceptability Acceptability Cost effectiveness Cost effectiveness Van der Vleuten C. The assessment of professional competence. Adv Health Sci Educ 1996;1: 41-47

Validity The extent to which a test measures what it was designed to measure The extent to which a test measures what it was designed to measure

Validity Indirect Indirect Direct Direct

Reliability The accuracy with which the test measures the skill or attainment it is designed to measure The accuracy with which the test measures the skill or attainment it is designed to measure

Why workplace assessment? High validity High validity AuthenticityAuthenticity Reconnects assessment with learning Reconnects assessment with learning High educational impact High educational impact

Key features Competency-based Competency-based Developmental Developmental Evidential Evidential Locally assessed Locally assessed Triangulated Triangulated

Evidence needed ! Notion of multiple sampling Notion of multiple sampling From multiple perspectives From multiple perspectives Tool-box of “approved” methods Tool-box of “approved” methods

Needs pulling together That’s the role for the educational supervisor! That’s the role for the educational supervisor! Triangulation of evidence from other sources Triangulation of evidence from other sources

The medical record…