Does success on the American Board of Surgery Qualifying Examination guarantee Certifying Examination success? Thomas W. Biester MS, Jonathan D. Rubright.

Slides:

Advertisements

Similar presentations

The Physician-PA Team Improving Access to Patient Care.

Advertisements

“Scoring an Oral Simulation Exam” Elizabeth A. Witt, Ph.D. American Board of Emergency Medicine Presented at the 2005 CLEAR Annual Conference September.

Standard 22D Evaluations HT Accredited Curriculum.

Evaluating the Reliability and Validity of the Family Conference OSCE Across Multiple Training Sites Jeffrey G. Chipman MD, Constance C. Schmitz PhD, Travis.

The ERAS Application Can Predict ACGME Competency-Based Surgical Resident Performance Amy M. Tolan MD *, Amy H. Kaji MD PhD *, Chi Quach †, O.Joe Hines.

Where Have All The Doctors Gone? A Public Health Crisis William H. Harvey, Ph.D. Emeritus Professor of Biology- Advisor/Consultant Earlham College.

Resident Orientation Medical School Residency & Fellowship Examination & Certification Professional Development & MOC Outcomes: Healthy Children.

Why CPH Certification? Certified In Public Health (CPH)

The Objective Structured Assessment of Technical Skills (OSATS) Helen M. MacRae, M.D., FRCSC, D.H. Gales Director Technical Skills Centre, University of.

Trauma Emergency Surgery Joseph Galante, MD FACS General Surgery Program Director.

Comparison: Traditional vs. Outcome Project Evaluative Processes Craig McClure, MD Educational Outcomes Service Group University of Arizona December 2004.

Marshall (Mark) Smith, MD, PhD

American Board of Surgery Examinations: Can We Identify Surgery Residency Applicants Who Will Pass the Examinations on the First Attempt? John L. Shellito,

Daniel Farkas, Kamal Nagpal, Ernesto Curras, Ajay Shah, John Cosgrove

The Emotional Intelligence Profile of Surgical Residents: A Descriptive Study AR Jensen, MD, AS Wright, MD, A Lance, MBA, K O’Brien, MA, C Pratt, MS, DJ.

Barbara J Pettitt, MD Emory University Dept. of Surgery Atlanta GA April 24, 2015.

 Alterman DM, Jones TM, Daley BJ, Goldman MH Department of Surgery.

Emergency Medicine Training in the USA Gloria Kuhn, DO, Ph.D.

American Board of Surgery Update Association of Residency Coordinators in Surgery Boston – March 25, 2011 Barbara Jalbert-Gerkens.

Professional and Political Organizations for Physician Assistants Group 7 Hayley Cohen, Rosanna Reda, Adaeze Agbar, Salma Gene, Qurratulaen Khawaja, Sofia.

Establishing Content Validity of a Novel Written Examination to Assess Medical Students on the Surgery Clerkship A Berlin MD, A Reinert BA, A Swan-Sein.

The ABS in 2006: A Year of (More) Change Association of Residency Coordinators in Surgery March 21, 2006.

GUIDELINES FOR CURRICULUM PLANNING Jose Y. Cueto Jr., MD, MHPEd Member Board of Medicine.

Intersection of Surgical Outcomes and Medical Education The RRC Perspective APDS Panel Session IV Surgical Education Week March 21,2012 San Diego, CA James.

Unit 4 Correlation and proxy measure. Proxy measure Likert scale is a form of self-report data. But what if sometimes you have no direct access to the.

Performance on Brief Practice Exam Identifies residents at Risk for Poor ABSITE and ABS Qualifying Exam Performance Michael Corneille MD, Ross Willis PhD,

MPPDA 2014 Presidential Address Russ Kolarik, MD MPPDA National Meeting April 10, 2014.

A rich history of commitment to Medical Education in Northwest Ohio.

Resident Credentialing Project: From Procedures to Portfolios Ruth H. Nawotniak, MS Program Coordinator - Surgery University at Buffalo State University.

So…Do you want to be a doctor??? Seema Salwan Sharma, M.D. Washington Township Medical Foundation.

Validation of a Toolkit to Assess the Communication Climate in Health Care Organizations Matthew Wynia, MD, MPH, 1 Megan Johnson, MA, 1 Thomas P McCoy,

MAINTENANCE OF CERTIFICATION Part IV Practice Performance and Improvement David L. Gillespie MD, FACS Professor of Surgery University of Rochester School.

Can a Brief On-line Education Tool Improve Surgical Resident Operative Dictations? A Prospective Evaluation Alicia Kieninger, MD, Yi Wei Zhang, MD, Anna.

ABPS’s Position on LSBME Proposed Rule on Board Certification.

Subspecialty Recognition in Medicine The Process The Process Step 1 Approval by the American Board of Medical Specialties (ABMS) Requires sponsorship by.

Employing Empirical Data in Judgmental Processes Wayne J. Camara National Conference on Student Assessment, San Diego, CA June 23, 2015.

Human Resource Management Lecture 09

Missing Data in NSQIP Albumin Peter Doris SQAN. Clarification Albumen –Egg white Albumin –A water soluble protein.

Developing an Assessment System B. Joyce, PhD 2006.

METHODS Setting Wichita State University Physician Assistant Program Study population WSU PA graduating class of 2003 and 2004 (n=84) Study design Retrospective.

1 Addressing the Term “Foreign Equivalent” in OPTN/UNOS Bylaws Membership and Professional Standards Committee Fall 2015.

Weekly Assigned Reading and Exams Improve ABS Exam Pass Rates

Trimming the Fat: Optimizing Overall Educational Value by Defining Factors Associated with Overall Educational Value and Service to Education Ratio Caroline.

Measuring Non-technical Aspects of Surgical Clinician Development in an Otolaryngology Residency Training Program Jennifer J. Shin, M.D. S.M. Michael J.

Transitional Care Curriculum for Medical Interns Linda DeCherrie, MD Mount Sinai School of Medicine Department of Geriatrics and Palliative Medicine Department.

High Quality Residency Education and Patient Safety are Directly Related David T. Harrington, MD Program Director, General Surgical Residency Program Associate.

Female Pelvic Medicine: The Present and the Future Roger Dmochowski MD, FACS Dept of Urology Vanderbilt University Medical Center Nashville, TN.

Fellow Orientation Medical School Residency & Fellowship

Edgar Guzman MD., MS. Vijay K. Maker MD., FRCSc., FACS. University of Illinois Metropolitan Group Hospitals Chicago.

Comparing Performance on the Virtual Laparoscopic and Robotic Simulators Among Medical Students Pursuing Surgical versus Non-surgical Residencies Amanda.

Are We There Yet: Optimal Duration for Direct Supervision of Surgical Interns Joseph M. Galante, MD, Jonathan Pierce, MD, Soman Sen, MD, Ahmed Mahmoud,

Students and Applicants in Higher Education The need for wider information.

Background Methods Objectives Results Conclusions USMLE Scores Predict Success in ABEM Initial Certification Ashley Pinawin 1, Nikhil Goyal 1, Elie Harmouche.

What is new? The American Board of Surgery Mark A. Malangoni MD, FACS Associate Executive Director.

Pediatric Resident Minimum Milestone Expectations by Level of Training Su-Ting Li, MD, MPH; Daniel Tancredi, PhD; Alan Schwartz, PhD; Ann Burke, MD; Ann.

Introduction References Objectives Conclusions Results Faculty provision of performance feedback is critical for residents to improve their clinical skills.

Are national assessment systems associated with improved quality of care? John Norcini, Ph.D.

Scott L Massey PhD PA-C Slippery Rock University USA

Oh, Kenny J. , Esposito, Andrew

Figure 2 Medical Laboratory Technician (MLT) Examination Scores and Failure Rate. A. Mean (SD) scaled scores plotted by quarter in which the American Society.

Matching into a Surgical Residency

Maintenance of Certification

By Dr. Prabhjot Gill Steps to Become a Medical Doctor.

The Greater Miami Valley EMS Council

CLICK TO GO BACK TO KIOSK MENU

Interim Analysis of a Prospective Multi-Institutional Study of Surgery Resident Experience with Flexibility in Surgical Training Darren R. Cullinan,

A Bright Future: Cardiothoracic Surgery Training in Transition

In type A aortic dissection repair, an effective team approach and relational coordination are more important for patients' outcomes than surgeon volume

Susan D. Moffatt-Bruce, MD, PhD, Patrick Ross, MD, PhD, Thomas E

An Introduction to the ACGME

Presentation transcript:

Does success on the American Board of Surgery Qualifying Examination guarantee Certifying Examination success? Thomas W. Biester MS, Jonathan D. Rubright MS, Andrew T. Jones PhD, Mark A. Malangoni MD, FACS The American Board of Surgery, Philadelphia, PA

Board Certification Matters Important benchmark to achieve following completion of residency (Nahrwold DL, Surg, 1999) Associated with better outcomes in patient care (Wenthofer E, Med Educ 2009; Reid RO, Arch Intern Med, 2010) Often required to obtain or maintain hospital privileges

Mission of the American Board of Surgery Serves as an agent for protection of the public and for quality surgical care Certifies surgeons who have met education and training standards Sets standards for maintenance of certification

Process of Obtaining Board Certification Appropriate undergraduate medical education Successfully complete an ACGME- approved surgery residency program Obtain favorable summary evaluation from the program director Pass the ABS Qualifying Examination (QE) Pass the ABS Certifying Examination (CE)

Oral Exams “Bridge the gap” between the cognitive domain and behavioral evaluation of performance in practice 15/24 ABMS boards have an oral exam

Purposes Determine whether there is a correlation between passing the QE and passing the CE Ascertain whether there is a discrete QE score that would predict passing the CE

Design Examinees who passed the ABS QE from QE equated scores matched to 1 st CE pass/fail decisions Contingency table analysis Phi coefficient and point bi-serial for correlation ROC curve constructed p < 0.01

Results 4,385 examinees who passed the QE Mean QE score = (range, 58-99) 92.3% passed the QE on the 1 st attempt 82.8% passed the CE on the 1 st attempt

Relationship between 1 st QE outcome and 1 st CE CE fail CE pass Total QE pass 639 (16%) 3407 (84%) 4046 (92%) QE fail 115 (34%) 224 (66%) 339 (8%) Total 754 (17%) 3631 (83%) 4385 Φ = 0.13, p < 0.001

1 st QE scaled scores and CE pass/fail decisions Scale Score Fail Pass Total (67%) 2 (33%) (41%) 53 (59%) (30%) 169 (70%) (26%) 820 (74%) (17%) 1196 (83%) (7%) 1391 (93%) 1501 Total 754 (17%) 3631 (83%) 4385 CE QE r pb = 0.229, p < 0.001

1 st QE scaled scores and successful certification ( ) Scale Score Not certified Certified Total (96%) 1 (4%) (54%) 22 (46%) (33%) 133 (68%) (17%) 442 (83%) (5%)1054 (95%) (2%)1487 (98%) 1525 Total 313 (6%)4776 (94%) 5089 r pb = 0.339, p < 0.001

Summary The correlation between the 1 st QE score and CE pass/fail rate is low Failure on the 1 st QE doubles the risk of CE failure Excellent correlation between 1 st QE score and eventual board certification

Conclusions These exams measure different aptitudes (knowledge vs. application) QE scores and CE results correlate well only at the extremes There is no discrete QE score that predicts passing the CE on the 1 st attempt

Thank you