An Alternative Certification Examination “ACE”, to assess the domains of professional practice.  Morris M1*, Gillis AE2, Smoothey CO3, Hennessy M1, Conlon.

Slides:



Advertisements
Similar presentations
Assessment of Initial Clinical Competence for NP Regulation: The Development of an Objective Structured Clinical Examination Marie Napolitano RN, PhD,
Advertisements

Health Sciences and Practice & Medicine Dentistry and Veterinary Medicine Higher Education Academy Subject Centres Wendy Hardyman, Mark Stacey, Alison.
Where to from here in Assessment in Medical Education? Dr Heather Alexander 5 November 2010.
Evaluating two feedback mechanisms for MCQ exams David Hope, Kyle Gibson & Helen Cameron August 2013.
Assessing verbal communication skills of medical students J Voges E Jordaan * L Koen DJH Niehaus Department of Psychiatry, University of Stellenbosch and.
Retooling Health Assessment: It Takes More Than a Hammer Cheryl Wilson MSN, ARNP, ANP-BC.
Magia G. Krause Ph.D. Candidate School of Information University of Michigan Society of American Archivists Annual Meeting August 14, 2009 Undergraduates.
Objective vs. subjective in assessment Jaime Correia de Sousa, MD, MPH Horizonte Family Health Unit Matosinhos Health Centre - Portugal Health Sciences.
COURSE PREVIEW Course Name Course Director: Course Coordinator:
Becoming a doctor : in a nutshell. Qualifications Entry to medical school… Good GCSE’s Three A Levels Entry requirements vary between medical schools.
Promoting Excellence in Family Medicine nMRCGP Workplace-based Assessment March 2007.
The use of simulation to teach medical students how to recognise and manage a sick child – A cluster randomised trial Results 61 students participated.
. Workplace-Based Assessment: a true reflection of competency ? Trevor Gibbs.
LEVELS OF CLINICAL COMPETENCE [Cox, 1982] Raja C. Bandaranayake.
Clinical assessment in the Health Sciences David Taylor School of Medical Education University of Liverpool.
Professor Joseph J Y Sung Faculty of Medicine Ensuring Clinical Competence.
Assessment of clinical skills Joseph Cacciottolo Josanne Vassallo UNIVERSITY OF MALTA ANNUAL CONFERENCE - OSLO - MAY 2007.
Accreditation of civil engineering degrees in the UK
Master in General Practice  ICHO  Curriculum Practical training Seminars/Peer review & selfstudy  Masterthesis  Selection of the practice trainers.
Assessment of communication skills of undergraduate medical students J Voges E Jordaan * L Koen DJH Niehaus Servier Student Training Centre Department.
Overview Fall  14 th year  Students receive up to $250,000 in college scholarships based on their research endeavors  14 national Intel semi-finalists,
Fundamentals of Assessment Todd L. Green, Ph.D. Associate Professor Pharmacology, Physiology & Toxicology PIES Seminar
Establishing Content Validity of a Novel Written Examination to Assess Medical Students on the Surgery Clerkship A Berlin MD, A Reinert BA, A Swan-Sein.
Kazakhstan Health Technology Transfer and Institutional Reform Project Clinical Teaching Post Graduate Medicine A Workshop Drs. Henry Averns and Lewis.
American Chemical Society The Role of Undergraduate Research in the Certified Chemistry Major Thomas Wenzel Department of Chemistry Bates College Lewiston,
R 3 P Colloquium American Board of Pediatrics Jan. 31 – Feb. 2, 2007 The Past, Present and Future Assessments of Clinical Competence A Canadian Perspective.
WELCOME! to OBSTETRICS andGYNECOLOGY (and GUM). O&G block 8 weeks Obstetrics and Gynaecology Workplace learning.
Student assessment AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.
Division of Population Health Sciences Royal College of Surgeons in Ireland Coláiste Ríoga na Máinleá in Éirinn Connected health: collaborative opportunities.
Medical Students’ Self-Ratings of Interprofessionalism Knowledge & Performance Before & After Simulation-Based Education David B. Trinkle, MD; David W.
The Catholic University of America Cindy Grandjean, Mary Paterson And Terry Walsh June, 2008 QSEN Annual Meeting Charlotte, NC.
BMH CLINICAL GUIDELINES IN EUROPE. OUTLINE Background to the project Objectives The AGREE Instrument: validation process and results Outcomes.
Building Bridges Qualitative Assessment of a Clinical Faculty Exchange between a Naturopathic and an Allopathic Medical Training Program Bastyr University.
Reliability and Validity of the Intensive Care Delirium Screening Checklist in Turkish Gulsah Kose, Abdullah Bolu, Leyla Ozdemir, Cengizhan Acikel, Sevgi.
Domain Scoring Guide groupNon-Scoring Guide group ICC(95% C.I.)p-valueICC(95% C.I.)p-value Domain (-0.303~0.995) (-0.806~0.966)0.512 Domain.
Assessment tools MiniCEX, DOPS AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.
Assessing Learners The Teaching Center Department of Pediatrics UNC School of Medicine The Teaching Center.
Linking the learning to the National Standards for Safer Better Healthcare Joan Heffernan Inspector Manager Regulation – Healthcare Health Information.
Workplace based assessment for the nMRCGP. nMRCGP Integrated assessment package comprising:  Applied knowledge test (AKT)  Clinical skills assessment.
Supervised practice for medical radiation practice 8 October 2014 Webinar Helen Tierney Policy Officer Medical Radiation Practice Board of Australia 1.
MRCGP The Clinical Skills Assessment January 2013.
The use of OSCE to assess Patient Care, Professionalism and Interpersonal Communication Milestones in EM residents Miriam Kulkarni, MD, Harsh Sule, MD,
Non-Medical Prescribing Practice Based Learning and Assessment.
Learning to Look: A Picture of Health UB Department of Family Medicine UB Anderson Gallery Ginny Lohr, MFA, MA, BSN, RN Richard Pretorius, MD, MPH Denise.
DEVELOPING AND TESTING THE STANDARD OF PRACTICE AND EVALUATION OF CRITICAL-CARE-NURSING TOOL (SPECT) FOR GRADUATES OF CRITICAL CARE NURSE EDUCATION PROGRAMS.
OBJECTIVE INTRODUCTION Emergency Medicine Milestones: Longitudinal Interrater Agreement EM milestones were developed by EM experts for the Accreditation.
School of Health Sciences Welcome Students! Healthcare Delivery & Information Management HI 125 Instructor: Alisa Hayes, MSA, RHIA, CCRC.
Valerie Smith, Kathryn Muldoon, Linda Biesty School of Nursing & Midwifery Trinity College Dublin Student Midwives’ attitudes towards the Objective Structured.
Comparison of graduates from the longitudinal integrated and rotation based clerkships Performance in family medicine residency: W. Woloschuk, D Myhre.
Introduction Implementation of asthma guidelines at national level requires a collaborative approach between healthcare professionals. Health service providers.
Genetic Technologist Registration and the AHCS
“PRACTICE BASED ASSESSMENTS” An update for 2017/18
TECHNOLOGY ENHANCED REMOTE ASSESSMENT Deans Award for Innovation 2016
Introduction Developed in collaboration with: Lead Advisor
Designing Effective Accommodation Plans in Clinical Placement & Internship Settings
MRCGP The Clinical Skills Assessment January 2013.
Inter-Professional Teamwork in Medical Education: Diabetes Care as a Case Study  Patrick Henn1, Rossana Salerno-Kennedy1, Siun O’Flynn,1 Jennifer Buckley2,
Empathy in Medical Care Jessica Ogle (D
Bolton Community Practice
Clinical Assessment Dr. H
Workplace Based Assessment
Physicians Associate A CASE FOR CHANGE ? Bolton Community Practice
Workforce Planning Framework
“Development and implementation of a module to improve socio-cultural sensitivity among medical graduates” Dr. Sushanta Kumar Mishra, MD Professor & Head,
CLICK TO GO BACK TO KIOSK MENU
An Alternative Certification Examination 'ACE' to assess the domains of professional practice.
Mapping the ACRL Framework and Nursing Professional
FACULTY – MEDICAL DEPARTMENT LOG BOOK Radiodiagnosis M.D. / D. M.R.D.
OSCE Interest group 3rd April 2009 Barry Ricketts
Physicians Associate A CASE FOR CHANGE ? Bolton Community Practice
Presentation transcript:

An Alternative Certification Examination “ACE”, to assess the domains of professional practice.  Morris M1*, Gillis AE2, Smoothey CO3, Hennessy M1, Conlon KC1, 2, Ridgway PF1, 2  1Education Division, School of Medicine, University of Dublin, Trinity College. Dublin 2 2 Department of Surgery, University of Dublin, Trinity College, Tallaght Hospital Campus, Dublin 24 3 School of Electrical, Electronic and Mechanical Engineering, University ,Belfield, Dublin 4. BACKGROUND RESULTS Metric Value 95% Confidence Interval Cronbachs Alpha 0.907 [0.766, 1] Krippendorrf's Alpha 0.824 [0.824, 1] Cohen's Kappa 0.823 [0.571,1] Medical graduates are required to be competent in many domains of professional practice when joining the healthcare workforce 1 (Fig 1). Current undergraduate examination methods robustly assess up to five of these eight required skills. The authors previously assessed the feasibility of utilising a post graduate surgical examination format “PAME“ in an undergraduate setting with promising results 2. This study sought to further evaluate the alternative certification examination "ACE“ format in assessing all eight of the required domains of professional practice in surgical cases. Table 1 : Inter-rater reliability between examiners The "ACE" assessed all eight domains. The correlation of grades between independent examiners in the "ACE" was strong at 0.907 (CI 0.766, 1) Cronbachs Alpha (Table 1). The inclusion of a patient safety measure in the pass criteria resulted in 27 (18.9%) students failing to meet the pass criteria. The "ACE" format was reported as an acceptable examination methodology by students and examiners. CONCLUSIONS The “ACE” format is standardised and integrative. The “ACE” format has strong inter-rater reliability. The “ ACE” format assesses all eight domains of professional practice and considers patient safety in pass criteria. The “ACE” format shows potential as an alternative to OSCE and Long Case assessment formats. Fig 1: Domains of Professional Practice – Irish Medical Council 2012 1. METHODOLOGY 143 final year medical students were contacted in February 2013. 137 students agreed to participate - 95.8% of the class. "ACE" format consisted of 4 sequential patient encounters (Fig 2) Students were observed by two independent examiners. “ACE” assessed all eight domains of professional practice Examiners and students evaluated the “ACE” using a Likert scale and free text comments. Students received structured oral and written feedback on all 4 encounters within 1 week of the examination. REFERENCES Irish Medical Council. Professional Competence Document. 2014. Dublin. Ireland 2. Morris M, Bennett M, Hennessy M, Conlon KC, Ridgway PF. An alternative  certification examination “ACE”: Can post graduate methods be used to assess clinical skills in medical under graduates? British Journal of Medicine & Medical Research. 2013; 3 (4):1806-1817. Encounter 1 Focused History- (6 minutes) Focused Examination (6 minutes) Encounter 2 Ordering and Interpretation of investigations results (5 minutes ) Encounter 3 Diagnosis and Management (6minutes) Standardised Structured Oral Examination Encounter 4 Review of case in consultation with Team (6 minutes) Fig 2: ACE Format Contact: Marie on morrism4@tcd.ie Awas gained Ethical Approval was gained from TCD Health Sciences Research Ethics Committee.