Objective vs Subjective

Slides:



Advertisements
Similar presentations
Assessing Student Performance
Advertisements

Assessment of Initial Clinical Competence for NP Regulation: The Development of an Objective Structured Clinical Examination Marie Napolitano RN, PhD,
Use of Examination Technique to Improve Your Grades
L2 program design Content, structure, evaluation.
Assessment of Professionals M. Schürch. How do you assess performance? How do you currently assess the performance of your residents? What standards do.
S tructured O bjective C linical E xamination SOC E.
Introduction to Measurement and Evaluation
EDUC S18 Scarfe 1005 Nov. 2 nd, ASSESSMENT.
Supreeya Wongtra-ngan WHY???  MOTIVATION  GIVE FEEDBACK  TO GRADE  QA.
Objective vs. subjective in assessment Jaime Correia de Sousa, MD, MPH Horizonte Family Health Unit Matosinhos Health Centre - Portugal Health Sciences.
The Objective Structured Assessment of Technical Skills (OSATS) Helen M. MacRae, M.D., FRCSC, D.H. Gales Director Technical Skills Centre, University of.
An overview of Assessment. Aim of the presentation Define and conceptualise assessment Consider the purposes of assessment Describe the key elements of.
Grading in Health and Physical Education Evaluating Student Achievement.
Updates for Medicine & Surgery Exams in Year 5 Curriculum Retreat 2007 Comparing Outcomes from New and Old Curricula 8 September 2007 Paul B. S. Lai HBP.
BASIC TERMINOLOGY n Test n Measurement n Evaluation.
EVALUATION OF DR.MOHAMMED AL NAAMI, FRCSC, FACS, M Ed. Using O bjective S tructured C linical E xamination (OSCE)
Assessment of clinical skills Joseph Cacciottolo Josanne Vassallo UNIVERSITY OF MALTA ANNUAL CONFERENCE - OSLO - MAY 2007.
Mechanical Engineering 1 Graduate Programs Degree Programs –Master of Engineering or M.E. (thesis option) –Master of Science or M.S. (non-thesis option)
Barbara J Pettitt, MD Emory University Dept. of Surgery Atlanta GA April 24, 2015.
Assessment Tools. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions.
Establishing Content Validity of a Novel Written Examination to Assess Medical Students on the Surgery Clerkship A Berlin MD, A Reinert BA, A Swan-Sein.
Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.
Student assessment AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.
OSCE Objective Structured Clinical Examination
Basic|victoria basic assessment & support in intensive care course feedback 2009 Intensive Care Unit.
Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.
Hofstra North Shore-LIJ School of Medicine Curriculum Committee Presentation October 22, 2012.
School of Clinical Medicine School of Clinical Medicine UNIVERSITY OF CAMBRIDGE UK Council problems with OSCE assessment Jonathan Silverman 2012.
Final FRCA SOE Course Evaluation Course 1 : June 1 st – 2 nd 2015.
GCSE Music Cove School Music Department. Why GCSE Music? Do you perform better with course work than examinations? Are you creative? Do you enjoy practical.
Building Exams Dennis Duncan University of Georgia.
Internal Medicine Clerkship General Features Clerkship Length – 12 weeks 4 weeks General Medicine Inpatient 4 weeks Inpatient OR Ambulatory Service 4 weeks.
Assessing Learners The Teaching Center Department of Pediatrics UNC School of Medicine The Teaching Center.
OSCE Dr. Shama Mashhood. 2 Objectives At the end of the session, participants will be able to: Enumerate the reasons for use of OSCE Explain the process.
N ational Q ualifications F ramework N Q F Quality Center National Accreditation Committee.
Training the Trainers Assessing the Learner Progress By Dr Malik Zaben IMET
Scoring Rubrics: Validity and Reliability Barbara M. Moskal Colorado School of Mines.
RELIABILITY BY DONNA MARGARET. WHAT IS RELIABILITY?  Does this test consistently measure what it’s supposed to measure?  The more similar the scores,
Recent Exam Connections to Study Techniques Biology.
TUESDAY 10/05/2016 Professional English in Use, Medicine The Overseas Doctor.
Defining Grades in the Surgery Clerkship Jeremy M. Lipman, MD MetroHealth Medical Center Case Western Reserve University School of Medicine.
MONDAYTUESDAYWEDNESDAYTHURSDAYFRIDAY REVIEW DAY Normal 1st-5th (No 6 th ) 7 th exam 1 st exam Shortened 2 nd -4 th Normal 5 th 6 th exam (No 7 th ) 5 th.
S tructured O bjective C linical E xamination P ractical.
Objective Structured Clinical examination (OSCE)
Medical student evaluations:
Feels Like a ” Real” Patient Interaction
Jane E. Corboy, MD Gerald Adams, EdD
CHAPTER 3: Practical Measurement Concepts
Education system of the Czech Republic
Evaluating Learners Jennifer L. Middleton, MD, MPH, FAAFP
FACULTY OF PHARMACEUTICAL MEDICINE
Test Validity.
Dr. Nina O’Brien Department of Management
ASSESSMENT OF STUDENT LEARNING
Clinical Assessment Dr. H
مركز مطالعات و توسعه آموزش دانشگاه علوم پزشكي كرمان
Scoring: Measures of Central Tendency
Father Muller Medical College & Hospital, Mangalore, Karnataka.
USI College of Business Faculty Evaluation System
Competency, Milestones, and Credentialing: Evaluations and Simulation
Reece A, Davis L, Todd P, Bellman M, Newell SJ
TESTS AND EXAMS TCOP 2014 FACULTY OF ECONOMICS & FINANCE
Approach to OSCES.
Weighted as 40% of final clerkship grade.
Can you bleep the doctor please?
2011 CEPP Retreat Data Report
Oral Exams & Interviews
EDUC 2130 Quiz #10 W. Huitt.
SCATTERPLOTS.
Reliability and validity
Presentation transcript:

Objective vs Subjective M3 OSCE

OSCE Objective Structured Clinical Examination

Written Tests: What do you know? Shelf exams Step exams

OSCE: What can you do with what you know? Knowledge Reasoning Communication Technical Skills

Our M3 OSCE 2 hours 8 clinical stations Educational Inspirational Evaluative

Chicken Wing Suturing Close a laceration 3 interrupted sutures Two-handed surgeon’s knot

Objective Grading

Subjective Grading

Which is better? Some studies say Subjective is better Some studies say Subjective is the same What does “better” mean? Fairness? Consistency? Predictive of Written Test Scores? Predictive of “better” doctors?

Does the Objective Matter?

Types of Stations

12 Month Review

1st vs 2nd Six Months

Subjective Scored Higher, particularly in the 1st half of the year

Unresolved Issues Are we measuring different things? Different faculty grade differently Validation of checklists Which is more reliable? Subjective vs Objective is complicated