School of Clinical Medicine School of Clinical Medicine UNIVERSITY OF CAMBRIDGE UK Council problems with OSCE assessment Jonathan Silverman 2012.

Slides:

Advertisements

Similar presentations

Assessment of Initial Clinical Competence for NP Regulation: The Development of an Objective Structured Clinical Examination Marie Napolitano RN, PhD,

Advertisements

C21: Modernising Medical Education in Cardiff Annual Curriculum Away Day Friday 16 th September 2011, All Nations Centre Assessment and Feedback Phil Smith,

Why study Communications skills? This slide presentation is based on Introductory talks given by Dr Jonathan Silverman from Cambridge The controls at the.

Promoting Behaviour Change – An Introduction

OSCEs Kieran Walsh OSCE Means “objective structured clinical examination” Assesses competence Developed in light of traditional assessment methods.

Domain Based Communication Skills Assessment Pilot For EU Doctors Annie M Cushing 1, Jean S Ker 2, Paul Kinnersley 3, Anthony N Warrens 1, Olwyn M R Westwood.

PRIOR LEARNING ASSESSMENT RESEARCH PROJECT IN NURSING Mount Royal College, Calgary, Alberta Purpose of the Research: To assess the impact of.

MBBS, MPH, MCPS, MRCGP (UK), FRIPH (UK), FHAE (UK) OSCE PREPARATION GUIDELINES Ass. Prof. Dr. Abdul Sattar KHAN Family & Community Medicine Department.

Assessment of Professionals M. Schürch. How do you assess performance? How do you currently assess the performance of your residents? What standards do.

S tructured O bjective C linical E xamination SOC E.

Division of medical and dental education -update on OSCEs Rhoda MacKenzie.

School of Clinical Medicine School of Clinical Medicine UNIVERSITY OF CAMBRIDGE Teaching clinical communication - an amazing effort Yet why do we still.

NYU School of Medicine CAN PROFESSIONALISM BE TAUGHT? FINALLY THERE IS EVIDENCE Department of Surgery New York University School of Medicine April 29,

Promoting Excellence in Family Medicine nMRCGP Workplace-based Assessment March 2007.

The Selection Interview. Objectives  Understanding the role of an Interview  Recruiting the applicant to the Organization  Measuring applicant KSAs.

An overview of Assessment. Aim of the presentation Define and conceptualise assessment Consider the purposes of assessment Describe the key elements of.

An overview of Assessment. Aim of the presentation Define and conceptualise assessment Consider the purposes of assessment Describe the key elements of.

1 Tools of clinical assessment. 2 Presentation outline Introduction Introduction Our daily practice Our daily practice Types of assessment tools Types.

Clinical assessment in the Health Sciences David Taylor School of Medical Education University of Liverpool.

Assessment of Clinical Competence in Health Professionals Education

Standard setting Determining the pass mark - OSCEs.

CHAPTER 9 External Selection II.

Training the OSCE Examiners

Cambridge International A and AS Levels.

Assessment of Communication Skills in Medical Education

Assessment Tools. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions.

Scientific Research on Veterinary Education T.J. Parkinson.

Bob Woodwards SAC Chair, Oral and Maxillofacial Surgery.

PLAN AND ORGANISE ASSESSMENT. By the end of this session, you will have an understanding of what is assessment, competency based assessment, assessment.

Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.

R 3 P Colloquium American Board of Pediatrics Jan. 31 – Feb. 2, 2007 The Past, Present and Future Assessments of Clinical Competence A Canadian Perspective.

Learner Assessment Win May. What is Assessment? Process of gathering and discussing information from multiple sources to gain deep understanding of what.

Student assessment AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.

Preparing your Registrar for the CSA Facts the Registrar needs to know How the CSA is marked Avoiding common mistakes on the day How to help your Registrar.

International Diabetes Federation (IDF) East Mediterranean and Middle East Region (EMME) Workshop on Professional Educational Methodology in Diabetes

Assessment Tools.

OSCE Objective Structured Clinical Examination For Fourth Class Students In Internal Medicine Department By: Mohammad Maroof “Aram” MD, Associated Professor.

Qualifications Update: Sociology Qualifications Update: Sociology.

~ Test Construction and Validation ~

OSHA Long Term Care Worker Protection Train the Trainer Program Part 7: Evaluation Tools/Post-Test.

Copyright Medschool academy 2007 Common Interview Questions 12 th Jan 2008.

Assessing Learners The Teaching Center Department of Pediatrics UNC School of Medicine The Teaching Center.

OSCE Dr. Shama Mashhood. 2 Objectives At the end of the session, participants will be able to: Enumerate the reasons for use of OSCE Explain the process.

Workplace based assessment for the nMRCGP. nMRCGP Integrated assessment package comprising:  Applied knowledge test (AKT)  Clinical skills assessment.

Training the Trainers Assessing the Learner Progress By Dr Malik Zaben IMET

December 13 th, 2007 Winnie Wade Director of Education RCP Education Department How assessments contribute to successful training in Geriatric Medicine.

IGCSE CAMBRIDGE EXAMINATIONS KESSIAH MAKHWATHA 9TOM.

MRCGP The Clinical Skills Assessment January 2013.

INTRODUCTION TO ASSESSMENT METHODS USED IN MEDICAL EDUCATION AND THEIR RATIONALE.

TUESDAY 10/05/2016 Professional English in Use, Medicine The Overseas Doctor.

Dr. Shruti Mohanty, FAIMER 2008,GSMC, KIMS, Narketpally

Presented by Dr Safeera Hussainy OSCEology A primer on performance-based teaching, learning & assessment in pharmacy.

Learning to Look: A Picture of Health UB Department of Family Medicine UB Anderson Gallery Ginny Lohr, MFA, MA, BSN, RN Richard Pretorius, MD, MPH Denise.

S tructured O bjective C linical E xamination P ractical.

CUMULATIVE OSCE IN QATAR A Pilot Project for the Middle East Dr. Kyle John Wilby, BSP, ACPR, PharmD Assistant Professor of Clinical Pharmacy and Practice.

EFOG – HOW TO PREPARE FOR IT? Rules and regulations

ST1 Induction Day The MAC Thursday

MRCGP The Clinical Skills Assessment January 2013.

Objective vs Subjective

FACULTY OF PHARMACEUTICAL MEDICINE

European integration of medical education

Clinical Assessment Dr. H

Father Muller Medical College & Hospital, Mangalore, Karnataka.

Approach to OSCES.

Сурган хүмүүжүүлэх уншлага

The Mid Tudors A2 Evaluation and enquiry questions

The Mid Tudors AS Evaluation and enquiry questions

Weighted as 40% of final clerkship grade.

Oral Exams & Interviews

Megan Smoot 4th Quarter Project 5/1/19

Presentation transcript:

School of Clinical Medicine School of Clinical Medicine UNIVERSITY OF CAMBRIDGE UK Council problems with OSCE assessment Jonathan Silverman 2012

School of Clinical Medicine School of Clinical Medicine UNIVERSITY OF CAMBRIDGE Integrated but with what? Timing of stations compromises validity? Sacrificed validity for reliability? Reliable? Valid? Are you disadvantaging the thoughtful shy student? Is it a glorified knowledge test? Standard setting and how easy to get it wrong? Are the stations apples and pears? Has integration compromised the exam? Examiner training effective? What is the educational impact of all this? You can never get it right

School of Clinical Medicine School of Clinical Medicine UNIVERSITY OF CAMBRIDGE Utility function U = Utility R = Reliability V = Validity E = Educational impact A = Acceptability C = Cost W = Weight U = w r R x w v V x w e E x w a A x w c C

School of Clinical Medicine School of Clinical Medicine UNIVERSITY OF CAMBRIDGE Domain based marking The problem of atomised communication The concept of professional judgement and flexibility and contextualisation Internalised grids Why this might not work in communication The problem of too few domains

School of Clinical Medicine School of Clinical Medicine UNIVERSITY OF CAMBRIDGE Process Marking in information gathering stations: 7 overall scores Initiating the Session Problem Identification Problem Exploration Patient’s Perspective Non-verbal Communication Developing Rapport Providing Structure

Individual areas for guidance: overall areas marked only

School of Clinical Medicine School of Clinical Medicine UNIVERSITY OF CAMBRIDGE Content marking

Plus structured oral - 5 minutes