“Hawks vs Dove” Phenomenon in Faculty Attending Evaluations of

Slides:



Advertisements
Similar presentations
Using and Teaching Stata in Emergency Medicine Research Rotation Muhammad Waseem, MD Research Director Emergency Medicine Lincoln Medical & Mental Health.
Advertisements

1 Teaching a statistical program in emergency medicine research rotations: Command- driven or click-driven? Muhammad Waseem, MD Research Director Emergency.
American Board of Surgery Examinations: Can We Identify Surgery Residency Applicants Who Will Pass the Examinations on the First Attempt? John L. Shellito,
 Alterman DM, Jones TM, Daley BJ, Goldman MH Department of Surgery.
Molly M. Gathright, MD 1 ; Shane Sparks, MD 1 ; Carol R. Thrush, EdD 2 ; Brynn Mays MLS 3 ; Lewis Krain, MD 1 1 UAMS Department of Psychiatry, 2 UAMS Office.
Differences in the Quality of the Patient- Physician Relationship Among Terminally Ill African American and White Patients: Impact on Advance Care Planning.
Self-assessment Accuracy: the influence of gender and year in medical school self assessment Elhadi H. Aburawi, Sami Shaban, Margaret El Zubeir, Khalifa.
Scatter Diagrams scatter plot scatter diagram A scatter plot is a graph that may be used to represent the relationship between two variables. Also referred.
A survey of our OB/GYN residents identified fellows as a source of valued and effective teaching more often than either senior residents or faculty members.
Business in Medicine and its Effect on Resident Education Jennifer Litwin D.O. HO4, Randy Wobser M.D. Creighton University Medical Center Omaha, NE Introduction.
Center for Institutional Effectiveness LaMont Rouse, Ph.D. Fall 2015.
Capability of Emergency Medical System on first response team for stop bleeding from road traffic accident patients Prat Intarasaksit.
Evaluating Resident Transitions of Care in the Emergency Department Nicole Zadzilka MD, Deborah Pierce DO, MS, and Gina Domingo MD Albert Einstein Medical.
Cultural Competency Training in Emergency Medicine Oren J Mechanic MD, MPH, Nicole M Dubosh MD, Carlo L Rosen MD, Alden M Landry MD MPH INTRODUCTION OBJECTIVES.
Assessing Specialty Specific Milestones of ‘Off-Service’ Rotators During Emergency Medicine Rotation Lauren Walter, MD, FACEP, FAAEM and Andrew Edwards,
Project VIABLE - Direct Behavior Rating: Evaluating Behaviors with Positive and Negative Definitions Rose Jaffery 1, Albee T. Ongusco 3, Amy M. Briesch.
Procedure Logging - What's old is new again Theodore Gaeta, DO, MPH Michael Cabezon, MD Annette Visconti, MD New York Methodist Hospital Introduction METHODS.
Introduction Methods Objectives Results Conclusions Figures/Graphs Implementation of clinical innovations are often evaluated at the operational and patient.
Identification and Instruction of Core ECG Interpretation Skills Necessary for Emergency Medicine Residency Readiness. Shannon Lovett, MD; Dan Holt, BS;
OBJECTIVE INTRODUCTION Emergency Medicine Milestones: Longitudinal Interrater Agreement EM milestones were developed by EM experts for the Accreditation.
Introduction References Objectives Conclusions Results Faculty provision of performance feedback is critical for residents to improve their clinical skills.
Incorporation of Images on Presentation Slides Positively Impacts Continuing Medical Education Conference Speaker Evaluations Ian Ferguson, BA 1, Andrew.
References Results Conclusions Figures/Graphs The Impact of Interdisciplinary Education on Skills and Attitudes of Emergency Medicine & General Surgery.
Emergency Department Admission Refusals Requiring Readmission at an Academic Medical Center David R. Kumar MD, Adam E. Nevel MD/MBA, John P. Riordan MD.
Multisource Feedback in a Simulation-Based Milestone Assessment of Emergency Medicine Residents Jeffrey Siegelman MD, Sidhant Nagrani MD, Anna Gajewski.
National University Of Rwanda Faculty Assessment: Focus Group Discussions Inis Jane Bardella, MD, FAAFP L. Miriam Dickinson, PhD Mark Hotchkiss Doug Fernald,
Seizure Incidence Associated with Bupropion Dosing Errors Reported to a Local Poison Center William Eggleston, PharmD 1 and Ross W. Sullivan, MD 1,2 1.
Robert Lipton, Ph.D., MPH and Nina Joyce, MPH
Sofija Zagarins1, PhD, Garry Welch1, PhD, Jane Garb2, MS
Impact of Daily PE: Year 7 and Longitudinal Findings
Decrease The Future Rate Of Dislocation?
Blake R. Barker, MD, Shannon A
How Do Female and Male Faculty Members Construct Job Satisfaction?
Donald E. Cutlip, MD Beth Israel Deaconess Medical Center
Insulin Detemir versus Glyburide in Women with
Risk of post-operative stroke in patients with known extra-cranial carotid artery disease undergoing Non-Cardiac Surgery Heart and Vascular.
The Hurricane Sandy Experience
Acute Assessment of Mild Traumatic Brain Injury with the King-Devick Test in an Emergency Department Sample Objectives Results The MTBI and trauma control.
Comparison of Live Tissue vs. Mannequin Cricothyroidotomy
The Association between External Ear Size and Medical Student Performance: A Purely Hypothetical Study John Star Student, B.S. and Jane Doe Mentor, M.D.,
Michael Jong, MD1, Bryan G. Kane, MD1,3, Nicole C
CLICK TO GO BACK TO KIOSK MENU
CLICK TO GO BACK TO KIOSK MENU
CLICK TO GO BACK TO KIOSK MENU
National Trends in Emergency Medicine Residency ECG Curriculum and Interpretation Practices Céline Pascheles, MD, Leslie Bilello MD, Jenna Singleton MD,
CLICK TO GO BACK TO KIOSK MENU
Teaching Medical Students Oral Presentations Skills
CLICK TO GO BACK TO KIOSK MENU
The Patient Experience Curriculum:
CLICK TO GO BACK TO KIOSK MENU Material & Methods (Click)
CLICK TO GO BACK TO KIOSK MENU
CLICK TO GO BACK TO KIOSK MENU CLICK TO GO BACK TO KIOSK MENU
CLICK TO GO BACK TO KIOSK MENU Correlation Coefficient
CLICK TO GO BACK TO KIOSK MENU
Using an ‘Oral Board’ exam to assess for EPA 10 in
Measuring Change in Two-Wave Studies
CLICK TO GO BACK TO KIOSK MENU
CLICK TO GO BACK TO KIOSK MENU
TITLE Authors We appreciate the support of the:
CLICK TO GO BACK TO KIOSK MENU
CLICK TO GO BACK TO KIOSK MENU
CLICK TO GO BACK TO KIOSK MENU
Experience Introducing Physician Assistant Students
Gender Bias in Nursing Assessments of Emergency Medicine Residents
Christopher S. Kiefer MD, Erica B. Shaver MD,
Department of Emergency Medicine
Talk It Out: A Novel Use of Training Groups with EM Residents
Correlation with Final Rank List Survey Comments from Faculty:
Images in Emergency Medicine
T. Tzellos1,2; H. Yang3; F. Mu3; B. Calimlim4; J. Signorovitch3
Presentation transcript:

“Hawks vs Dove” Phenomenon in Faculty Attending Evaluations of Emergency Medicine Residents Nicole M. Dubosh MD, Layla Abubshait MD, Celine Pascheles MD, Carlo Rosen MD, Nitsan Mendelson BSc, Edward Ullman MD CLICK TO GO BACK TO KIOSK MENU Harvard Affiliated Emergency Medicine Residency, Department of Emergency Medicine Beth Israel Deaconess Medical Center, Boston, MA Official hospital of the Boston Red Sox INTRODUCTION METHODS, continued RESULTS Evaluators whose medical knowledge rating was outside of the interquartile range (25th-75th percentile) were defined as hawks or doves, respectively. A multivariate generalized estimating equations analysis was performed to comparing the above variables. Models were adjusted for resident post-graduate year. “Hawk vs dove” phenomenon refers to the stringency of evaluators i.e. hawks evaluate learners more stringently whereas doves evaluate more leniently compared to peers. While this concept has been discussed in the medical education literature, its presence in EM resident evaluations is unclear.   Figure 1: Number of “Strengths” and “Suggestions for Improvement” Words by Grading Group OBJECTIVE RESULTS The objectives of this study were to: Determine if hawks and doves differ in the amount of written feedback provided on EM resident evaluations. Determine if gender or seniority correlates with an evaluator being a hawk or a dove. 4965 evaluations by 52 faculty attendings were included. 13 (25%) were hawks and 13 (25%) were doves. Hawks provided fewer “strengths” word comments (B-coefficient -0.310, p=0.001) and more “suggestions for improvement” words (B- coefficient 0.533, p=0.000) compared to their peers. Doves provided more “strengths” words (B coefficient 0.278, p=0.080) and fewer “suggestions for improvement” words B-coefficient 0.504, p=0.020). Figure 1. 73% of all faculty evaluators were male, with 92% of hawks being male and 69% of doves being male (p=0.190). There was no significant difference in faculty seniority between the hawks and doves (p=0.962).   METHODS Retrospective study of EM resident shift evaluations by EM faculty at a single academic, urban medical center in a three-year residency program. EM faculty attending evaluations of EM residents from 2013-2016 were included. Ratings of residents’ medical knowledge, number of words in the “strengths” and “suggestions for improvement” comment boxes, attending gender, and senior versus junior faculty (greater or less than 5 years post-training) were extracted from the database.   CONCLUSION . Hawks provided more “suggestions for improvement” comments. Male faculty were more likely to be hawks, however, this was not statistically significant. Further faculty development on written evaluation feedback may reduce variability by gender and provide learners with a more accurate assessment of their progress.