NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.

Slides:

Advertisements

Similar presentations

Resident Educator Development

Advertisements

Being an effective team player

“Scoring an Oral Simulation Exam” Elizabeth A. Witt, Ph.D. American Board of Emergency Medicine Presented at the 2005 CLEAR Annual Conference September.

Division of Physical Therapy, University of North Carolina Chapel Hill A. Rosenberg PT, DrPH; D. Meyer PT; C. Eicher SPT; A. Fay SPT; E. Gaskins DPT; K.

Advocacy Training in Persons with TBI and their Families Tom Bergquist Mayo Clinic and Jeff Nachbar Minnesota Brain Injury Alliance ©2011 MFMER | slide-1.

Joan E. St. Onge, M.D. UMMSM At Holy Cross Hospital Internal Medicine Residency Faculty Development January 23, 2013 The Evaluation Toolkit.

The three experiences our grounded with two core learning outcomes and are built upon as the student moves through the leadership continuum. Foundation.

Use of Mock Code Simulation in the Development of Competence, Communication and Confidence in Actual Code Situations among Staff in the Michigan Congenital.

Improving Communication in the Emergency Department: The 5 Cs Model of Consultation Educational Soundbites CORD Academic Assembly 2011 San Diego, CA Chad.

Strategies & Solutions  By acting as a team, students can expand their potential for knowledge.  Students can learn to come up with and solve new problems.

Between the Lions Preschool Literacy Project Evaluation Results

Clinical Leadership Skills Acquisition in Nurse Residents

Leadership and Management Training for physicians Maria V. Gibson, MD, PhD Trident / MUSC Family Medicine Residency Program Background Practice Problem.

Assessing Shoulder Dystocia Simulations for Quality

Paramedic Care: Principles & Practice Volume 1: Introduction to Paramedicine CHAPTER Fourth Edition ©2013 Pearson Education, Inc. Paramedic Care: Principles.

Assessing Teamwork in the Trauma Bay: Introduction of a Modified NOTECHS Scale for Trauma Supported by a grant from the American College of Surgeons and.

Training and development Education Evaluation: Benefits to Trust and its Learners Learning Beyond Registration Education Quality Team May 2014 Training.

Crisis Resource Management (CRM) Concepts starting in aviation as Crew Resource Management Majority of plane crashes caused by communication errors.

Seth D. Goldstein, MD 1, Brenessa Lindeman, MD 1, Jorie Colbert-Getz, PhD 3, Trisha Arbella 1, Robert Dudas, MD 2, Anne Lidor, MD, MPH 1, Bethany Sacks,

Portfolio Assessment in Clerkship Michelle Gibson - Geriatrics (thanks to Chris Frank and Melissa Andrew too)

Division of Emergency Medicine Cincinnati Children’s Hospital

T tests comparing two means t tests comparing two means.

Collaborative Learning in Medicine over Internet2 Patricia Youngblood, PhD, Associate Director for Evaluation SUMMIT (Stanford University Medical Media.

Topic 4 Being an effective team player. LEARNING OBJECTIVE understand the importance of teamwork in health care know how to be an effective team player.

Using Simulation to teach leadership competencies in delivering safe patient care Claudia Grobbel DNP RN Michelle Costlow MSN RN, Jean Ann Dean MSN RN.

IDEA Student Ratings of Instruction Shelley A. Chapman, PhD Insight Improvement Impact ® University of Alabama Birmingham September 11, 2012.

The use of distance learning technologies to bring simulation- based critical care training to a remote community in northern Canada Timothy Willett, RCPSC;

Assessment of Emergency Medicine Residents’ Bedside Communication Skills: A Survey of Emergency Department Patients Amanda Keller York College of PA Biology.

Virtual Learning Technologies for the Digital Generation.

IN-SITU, MULTIDISCIPLINARY, SIMULATION-BASED Trauma Team TRAINING IMPROVES THE EARLY CARE OF TRAUMA PATIENTS Susan Steinemann, MD, FACS Benjamin Berg,

Campus Quality Survey 1998, 1999, & 2001 Comparison Office of Institutional Research & Planning July 5, 2001.

Mathematics and Science Partnerships: Summary of the Performance Period 2008 Annual Reports U.S. Department of Education.

Medical Students’ Self-Ratings of Interprofessionalism Knowledge & Performance Before & After Simulation-Based Education David B. Trinkle, MD; David W.

Advanced Distributed Learning & Medical Skills Proficiency Carla Pugh, MD, PhD Assistant Professor of Surgery and Associate Director of the Center for.

Maintaining Patient Safety: Improved Communication in Clinical Education Settings Suzanne Marnocha RN, MSN, PhD, CCRN Becki Cleveland RN, MSN Mark Marnocha.

Smarter Balanced Assessment Professional Development Resources Derrick Chau, Ph.D. - Director of Secondary Instruction Oscar Lafarga - Student Testing.

Virtual Patients in a Virtual Clinic in a Virtual Hospital Neil Gesundheit, Patricia Youngblood, Pauline Brutlag, Eleonor Ekorn, Nabil Zary, Uno Fors,

ADMINISTRATIVE OFFICE MANAGEMENT

Knowledge and experiences about health literacy needs and assessment among fourth year nursing students in Thailand Sinsakchon Aunprom-me, MPH, Ph.D. (Target.

An Education Program for Prenatal Patients Aimed Toward Primary Prevention of Domestic Violence Peter Vasilenko, PhD Professor of Obstetrics and Gynecology.

Emily C. Prosser, Valerie L. VanTussi, Jaime R. Barth, & Blaine F. Peden, Ph.D. Psychology Department at the University of Wisconsin-Eau Claire Women’s.

Mathematics and Science Partnerships: Summary of the Performance Period 2008 Annual Reports U.S. Department of Education.

Interdisciplinary Clinical Student Training in Teamwork and Geriatric Assessment: A Student Pharmacist’s Perspective Presented by: Catherine Liu, PharmD.

MEDICAL STUDENT TRANSITION COURSE Professionalism in the Clinical Environment ANTHONY A. MEYER, MD, PHD CHAIRMAN, DEPARTMENT OF SURGERY UNIVERSITY OF NORTH.

ESEA, TAP, and Charter handouts-- 3 per page with notes and cover of one page.

Simulation in an undergraduate nursing programme: How do Students rate their learning? by Nancy McNamara MHSc (hons), BN, RCompN, CATE.

Topics Average Rating PrePost 1. Understanding the Need for Reform Managing Publics Sector Reform Sustaining Reform

Resuscitation Team Concept. Role of the Team Leader The role of the team leader is multifaceted. The team leader Oranizes the group Moniters individual.

Teaching First or Teaching Last Does it matter in simulation based surgical scenarios? Benjamin Zendejas Mummert, MD David A. Cook MD, MHPE David R. Farley,

The use of OSCE to assess Patient Care, Professionalism and Interpersonal Communication Milestones in EM residents Miriam Kulkarni, MD, Harsh Sule, MD,

Simulation Training and Assessment in EMS Sean W Moore MD CM, FRCPC, emergency medicine University of Ottawa, Department of Emergency Medicine Associate.

Assessing Specialty Specific Milestones of ‘Off-Service’ Rotators During Emergency Medicine Rotation Lauren Walter, MD, FACEP, FAAEM and Andrew Edwards,

Clinical Simulation in Family Medicine to address the ACGME Core Competencies Beth Anne Fox, MD, MPH Glenda F. Stockwell, PhD Martin Eason, MD, JD.

The CORD-EM Speaker Evaluation Form for Medical Conference Planners 1 Andrew W Phillips MD MEd, 2 David Diller MD, 3 Sarah R Williams MD, 4 Yoon Soo Park.

References Methods Introduction Results Dicussion The Effect of Resident Physicians on Press Ganey Scores in the Emergency Department The patient’s experience.

Instructional Plan | Slide 1 AET/515 Instructional Plan For Associate’s Degree in Library Skills (Donna Roy)

An Inter-Professional Education Delirium Simulation Pilot Project Heather S. Anderson, MD 1, Daniel L. Swagerty, MD, MPH 1, Mary Meyer, RN, MSN, ARNP-BC.

OBSTETRIC EMERGENCY DRILLS Improve the quality of care for women having obstetric emergencies.

Improvements in asthma knowledge and self-efficacy among daycare staff, parents and health professionals following an interactive workshop Jonathan Ross,

Cohort Study Evaluation Irina Ibraghimova

Self Efficacy of Communication Skills in Difficult Patient Encounters: An Interdisciplinary Collaboration Rachel Bramson, M.D., M.S. Kimberly L. van Walsum,

Evaluation of new medical school curricula: identifying and treating

PROFESSIONALISM & SUPERVISION

Louanne Friend, PhD; Catherine Skinner, MD The University of Alabama

CLICK TO GO BACK TO KIOSK MENU

CLICK TO GO BACK TO KIOSK MENU

Redmond Fire & Rescue Community Paramedicine

Christopher S. Kiefer MD, Erica B. Shaver MD,

Virtual Hospitals: a panel presentation

Overview This presentation provides information on how districts compile evaluation ratings for principals, assistant principals (APs), and vice principals.

Presentation transcript:

NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical Media & Information Technology) Phillip M. Harter, MD Residency Program Director Division of Emergency Medicine Stanford University School of Medicine

NMC Online Conference December 2005 Comparison of the Virtual ED & HPS Human Patient Simulator Virtual ED (Emergency Department)

NMC Online Conference December 2005 Virtual ED (Emergency Department)

NMC Online Conference December 2005 Debriefing with instructor Student being assessed Standardized team member

NMC Online Conference December 2005 Study Design: Pretest/Posttest 30 medical students & interns Virtual ED Simulator (n=16) pretest case  4 training cases  posttest case Human Patient Simulator “HPS” (n=14) pretest case  4 training cases  posttest case Is there a significant difference in performance between the two student groups?

NMC Online Conference December 2005 EMCRM Rating Scale of Team Performance (1-5) Knowledge of the environment Anticipation of & planning for potential problems Assumption of leadership role Communication with other team members Distribution of workload/delegation of responsibility Attention allocation Utilization of information Utilization of resources Recognition of limitations/call for help early enough Professional behavior/interpersonal skills Overall team leadership skills (1= not acceptable; 5=excellent)

NMC Online Conference December Communication with other Team Members Average performance (3): Communicates clearly with all team members; speaks clearly, calls team members by name, can be heard easily Below Average (1-2): Cannot be heard easily, doesn’t identify to whom he is speaking, talks ‘down’ to other members, does not close the communication loop Above Average (4-5): Closes the communication loop, thinks/talks out loud so other members can follow his problem solving approach Guidelines for Scoring Team Leadership in the Virtual ED

Comparison of Pre & Post Mean Scores Mean Scores Pretest Sum ScoresPosttest Sum Scores *Significant at p= HPS Group Pretest Sum ScoresPosttest Sum Scores Pretest Sum Scores Posttest Sum Scores Virtual ED Group

NMC Online Conference December 2005 Results Summary Users’ performance rating scores improved between pretest case and posttest case with both the MORPG and the Human Patient Simulator; Analysis of performance data shows no statistically significant differences between the two treatment groups; Reliability of the EMCRM rating scale was high (Cronbach’s alpha =.96); Users liked both types of simulation training.

NMC Online Conference December 2005 The Stanford Research Team