How to make the most of wpba. (workshop) Andrew Whitehouse Jan 25 2011.

Slides:



Advertisements
Similar presentations
Workplace assessment Dr. Kieran Walsh, Editor, BMJ Learning. 2.
Advertisements

The ARCP- For Core trainees Dr Kate Lovett – Head of School of Psychiatry- Southwest Peninsula Deanery March 2013.
Joint Royal Colleges of Physicians Training Board (JRCPTB) Changes to specialty trainee assessment and review August 2014 Guidance for Supervisors.
School of Surgery Induction Day ISCP Session. Overview ISCP aims and benefits Roles and responsibilities ISCP website Learning Agreements Syllabus Assessment.
Assessment of Professionals M. Schürch. How do you assess performance? How do you currently assess the performance of your residents? What standards do.
Introduction to the eportfolio and the nMRCGP HEKSS, KSS Deanery GP Specialty School 2013 Dr Susan Bodgener Associate Dean for Assessment.
General Practice Introduction to the eportfolio and the MRCGP KSS Deanery 2014 Dr Susan Bodgener Associate Dean for Assessment KSS Deanery.
Faculty Development WORKPLACE- BASED ASSESSMENT.
Workplace-based Assessment. Overview Types of assessment Assessment for learning Assessment of learning Purpose of WBA Benefits of WBA Miller’s Pyramid.
The 2009 Learning Portfolio and Assessment Framework for DFT.
Objective vs. subjective in assessment Jaime Correia de Sousa, MD, MPH Horizonte Family Health Unit Matosinhos Health Centre - Portugal Health Sciences.
Promoting Excellence in Family Medicine nMRCGP Workplace-based Assessment March 2007.
An overview of Assessment. Aim of the presentation Define and conceptualise assessment Consider the purposes of assessment Describe the key elements of.
. Workplace-Based Assessment: a true reflection of competency ? Trevor Gibbs.
An overview of Assessment. Aim of the presentation Define and conceptualise assessment Consider the purposes of assessment Describe the key elements of.
Clinical Assessment: at the heart of healthcare education Trevor Gibbs.
Constructing a test. Aims To consider issues of: Writing assessments Blueprinting.
1 Tools of clinical assessment. 2 Presentation outline Introduction Introduction Our daily practice Our daily practice Types of assessment tools Types.
Assessment of Clinical Competence in Health Professionals Education
Workplace-based Assessment
Clinical Assessment: at the heart of healthcare education.
INTEGRATED ASSESSMENT. Integrated Assessment is: Assessing a number of Outcomes together Assessing a number of Assessment Criteria together Assessing.
Assessment of Communication Skills in Medical Education
Assessment Tools. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions.
The e-portfolio - how it will work and how it will improve training James Barrett JRCPTB Clinical lead for e-portfolio.
Training for Public Health Trainers.  Prof. John Collins’ report ‘Foundation for Excellence’ highlighted many positive aspects of the Curriculum but.
‘Do we need exams?’ Wendy Reid Medical Director HEE Past – Vice President RCOG.
MMC – workplace based assessments Dr Lisa Joels Postgraduate Organiser Singleton Hospital 6 th August 08.
Bob Woodwards SAC Chair, Oral and Maxillofacial Surgery.
Verification: Quality Assurance in Assessment Verification is the main quality assurance process associated with assessment systems and practice - whether.
The Royal College of Pathologists – the overall assessment system Dr. Trevor Gray Director of Examinations and Assessment.
The ST3 Year Nick Pendleton.
Belling the Cat – Exams!!! Fedir Abi. Fees Yet to be confirmed. Its not free, you will have to pay.
R 3 P Colloquium American Board of Pediatrics Jan. 31 – Feb. 2, 2007 The Past, Present and Future Assessments of Clinical Competence A Canadian Perspective.
Feedback on Work-Place Based Assessment (WPBA) Barnsley 24 May 2011.
Understanding Meaning and Importance of Competency Based Assessment
Providing ‘value’ in clinical supervision How an ounce of prevention is worth a pound of cure Tracey Tay Staff Anaesthetist HNE Health Clinical Lead NSW.
Modernising Medical Careers for GPs Education Supervision and Review of Progression.
Student assessment AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.
GP Workplace Based Assessment
Developing an Assessment System B. Joyce, PhD 2006.
The intangible part of being a Consultant ABCD National Diabetes Consultant Mentorship Programme Dr B M Singh.
Teaching One To One Dr Alastair McGowan Sept
Assessment Tools.
WBAs: the Northern Ireland School of Surgery Experience Richard Mayes 1 Robert Gilliland 1, 2 Jeffrey Campbell 1, 2 Helen Holscher 3 Department of Surgery,
Guide to the ESR By Carol and Barry. Why is the ESR important? An Educational Supervisors Review (ESR) is conducted every six calendar months for all.
Assessing Your Learner Lawrence R. Schiller, MD, FACG Digestive Health Associates of Texas Baylor University Medical Center, Dallas.
General Practice Introduction to the eportfolio and the MRCGP HEKSS 2015 Dr Susan Bodgener Associate Dean for Assessment, HEKSS.
Assessment Design. Four Professional Learning Modules 1.Unpacking the AC achievement standards 2.Validity and reliability of assessments 3. Confirming.
NMRCGP Please remember the final format is not set and this presentation was in March 2007.
Planning your three years Dr Morooj Mohammad GP/ Commissioning Fellow.
Workplace based assessment for the nMRCGP. nMRCGP Integrated assessment package comprising:  Applied knowledge test (AKT)  Clinical skills assessment.
December 13 th, 2007 Winnie Wade Director of Education RCP Education Department How assessments contribute to successful training in Geriatric Medicine.
Planning the next 3 years Dr Nisha Ehamparanathan GP / Clinical Skills Lecturer.
Assessing Competence in a Clinical Setting GRACE Session 12.
INTRODUCTION TO ASSESSMENT METHODS USED IN MEDICAL EDUCATION AND THEIR RATIONALE.
Workplace-Based Assessment Making it More Effective Jonathan Beard Professor of Surgical Education University of Sheffield, UK.
Student’s Assessment Dr. A. M. Kadri Associate Professor, PSM dept. PDU Govt. Medical College, Rajkot.
Introduction to the eportfolio and the MRCGP HEEKSS 2015 Dr Susan Bodgener Associate Dean of Assessment, HEEKSS.
Making assessment meaningful and useful…….. Andrew Whitehouse January 25th 2011.
Introduction to the eportfolio and the MRCGP On behalf of HEE KSS GP School.
“PRACTICE BASED ASSESSMENTS” An update for 2017/18
The Big Picture – curricula, the Gold Guide and the assessment system
FACULTY OF PHARMACEUTICAL MEDICINE
Clinical Assessment Dr. H
Trainee induction guidance
Work Place Based Assessment
Changes in Training and Assessment
ASSESSMENTs DURING TRAINING.
ePortfolio developments for IMT
Presentation transcript:

How to make the most of wpba. (workshop) Andrew Whitehouse Jan

This workshop Aim; to revisit workplace assessment of doctors to clarify purpose, to help us improve it. Objectives;  Agree definitions  Decide on what counts as wpba, now, and potentially.  Identify best practice in formative assessment.  Identify best practice in summative assessment.  Find ways to maximise performance assessment.

Introductions Who are you? Why did you come? What do you know about assessment? What do you want to get from this?

The key terms needed for this workshop Summative assessment Formative assessment Competence assessment Performance assessment

Some principles to consider…. Assessment has 2 main functions  Summative  Formative Society needs to be assured that doctors are safe, and care about patients. Summative assessment is its check on this. Summative assessment also drives learning. The best teaching is “needs based”. Formative assessment, well done, uses this.

DOES SHOWS HOW KNOWS HOW KNOWS BEHAVIOUR COGNITIVE ASSESSMENTS PERFORMANCE “in vivo” eg MSF ( professional), supervision of work by multiple observers (clinical) Clinical audit/complaints etc COMPETENCE “in vitro” eg OSCE, simulation, miniCEX, DOPS CLINICAL TEST exam, grey cases FACTUAL TEST MCQ

Principles for assessment (high stakes, summative) Validity.  Content  Face  Concurrent  Predictive etc Reliability Fairness Practicality

What counts as wpba in new curricula? (eg Foundation 2005/2010, CMT 2009) miniCEX DOPS CbD ACAT MSF Patient survey

What workplace assessments does GMC list? (2010) (a) systematic observation of clinical practice (b) direct observational procedure (wpbas) (c) Video (d) judgements of multiple assessors (e) consulting with simulated patients (f) case record review, including OPD letters (g) case-based discussions(wpba) (h) oral presentations (i) 360º peer assessment(wpba) (j) patient feedback surveys (k) audit projects (l) critical incident review.

Tasks; Re GMC list of workplace assessments  Decide which are formative, which summative  Decide which assess competence, which assess performance  For the performance group, propose ways to measure, link to curriculum outcomes, record, embed into NHS assessment practice, generally improve their use…………(consider validity, reliability, fairness, practicality!)

What workplace assessments does GMC list? (2010) P=performanceC=competence (a) systematic observation of clinical practiceP (b) direct observational procedure (wpbas)C (c) VideoC (d) judgements of multiple assessorsP (e) consulting with simulated patientsC (f) case record review, including OPD lettersP (g) case-based discussions(wpba)P/C (h) oral presentationsP/C (i) 360º peer assessment(wpba)P (j) patient feedback surveysP (k) audit projectsP/C (l) critical incident review.P