Formative Evaluation of the Implementation of the Medical Education Metrics Standard for Continuing Education MedBiquitous Annual Conference 2011 May 11,

Slides:

Advertisements

Similar presentations

1 SUCCCESSFUL ASME STUDENT SECTIONS: INTEGRATION WITH DEPARTMENT OPERATIONS AND GOALS 2003 Region XI-IV Mechanical Engineering Department Heads Meeting.

Advertisements

One of the most important aspects of any CME activity is evaluation, or outcomes measurement. CME Compliance: Evaluation Measuring the educational outcomes.

Reed Exhibitions Driving Revenue Growth and Creating Operating Efficiencies for Association and Society Events.

Welcome to Game Lets start the Game. An electronic health record (EHR) is a digital version of a patient’s paper chart. EHRs are real-time, patient-centered.

GOVERNMENT TRAINING ORGANISATIONS AND ECONOMIC GROWTH SHAPING UP.

Training Kirkpatrick’s Four Levels of Evaluation Kelly Arthur Richard Gage-Little Dale Munson Evaluation Strategies for Instructional Designers.

Regional Trajectories to the Knowledge Economy: A Dynamic Model IKINET-EURODITE Joint Conference Warsaw, May 2006.

TPEP Teacher and Principal Evaluation Process Bellevue Chamber of Commerce Presentation January 15, 2015 Presented by: Dr. Patty Siegwarth: Bellevue School.

Slide Set I: PARS Overview

Using Smartphone and Open Source Web Technologies to Automate Academic Regularly Scheduled Series Presented at: 2011 Annual Medbiquitous Conference Presented.

Competency Portfolios Connecting Life, Learning and Work “CPCA”

Learning in Disaster Health February 13, 2014 Lois D. Banks, PHF TRAIN Director Erin Bougie, PHF TRAIN Program Assistant.

© American Bar Association Effective Strategic Planning Henry F. White, Jr. Executive Director & Chief Operating Officer American Bar Association 10 th.

Welcome to ElderCARE Technologies Customer Relationship Management Product Overview Thank you for visiting our site! For more information about ElderCARE.

Track B: Sales, Marketing & Business Development Workshop B-2: Customer Service: It’s About More Than Just Answering the Phone.

University of Texas Clinical Safety and Effectiveness Program Third Year Evaluation October 27,2011 Sherry Martin, Chancellor’s Health Fellow in Clinical.

1 Open Library Environment Designing technology for the way libraries really work December 8, 2008 ~ CNI, Washington DC Lynne O’Brien Director, Academic.

Support Lifelong Learning: AAMC & NBME’s New Electronic Portfolio Connector Angelique Johnson Association of American Medical Colleges (AAMC) Leta S. Rose.

Standardizing Learner Surveys Across the Enterprise Francis Kwakwa, MA, Radiological Society of North America Valerie Smothers, MA, MedBiquitous.

Medical Education Metrics 2.0 (MEMS 2.0) Orientation.

Two Years of CME FastTrack: More Than One Hundred Thousand Credits Transferred Via the MedBiquitous Activity Report Standard Stephen Kenney Ben Greenberg.

“Integrating Standards in Practice” 10th Open Forum on Metadata Registries July 9-11, 2007 New York City, NY USA An international conference to share and.

Quality Counts!! GOAL “Provide our customers with the highest levels of quality and service in all aspects of PTO operations”

Leadership Development Institute February 15, 2013.

Evaluation Assists with allocating resources what is working how things can work better.

Build a Better HR Scorecard Colorado SHRM Human Resources Conference 1.

7 th Continual Improvement & Innovation Symposium 2015 CASE STUDY COMPETITION: INNOVATION TEMPLATE [ Name of the Organization ] [ Innovation Title ]

Fusion GPS Externalization Pilot Training 3/1/2011 Lydia M. Naylor Research Lead.

Natacha Fernandez-Ureña, Database Manager Jose Hernandez, Supervising Case Manager Shannon Skinner, Coordinator for Testing & Linkage to Care Dustin Przybilla,

Copyright © 2009 South-Western, a part of Cengage Learning All rights reserved. Power Point Presentation by Dr. Leslie A. Korb Georgian Court University.

Campus Quality Survey 1998, 1999, & 2001 Comparison Office of Institutional Research & Planning July 5, 2001.

The power of information Putting all of us in control of the health and care information we need Dr Susan Hamer National Director of Nursing, Midwifery.

Christian Chace Patent Process Reengineering Team December 8, 2010 Patent Process Reengineering Team and Patent End-To-End Processing Team The Biotechnology.

August 2004League for Innovation: Learning Summit1 Learning Outcomes Assessment in Student Services A Statewide Initiative in Maryland.

© 2004 Center for Creative Leadership 1 Center for Creative Leadership An Overview.

Leveraging Handhelds for Sales and Support Force Automation Andrew Robertson Director of Technology ArcStream Solutions

2008 AHCA/NCAL National Quality Award Program - Step III Overview - Jon Frantsvog Ira Schoenberger Tim Case.

IHE Marketing and Implementation Resources IHE Marketing and Implementation Resources Chris Carr Director of Informatics, Radiological Society of North.

Teacher competencies. Professional competence with ICT Draw on appropriate ICT applications to enhance personal and professional effectiveness  Using.

Carol M. Trivette, Ph.D. Orelena Hawks Puckett Institute Asheville and Morganton, North Carolina Presentation prepared for Helping Extend Learning and.

Department of Information Science and Applications Hsien-Jung Wu 、 Shih-Chieh Huang Asia University, Taiwan An Intelligent E-learning system for Improving.

Assessment Formats Charlotte Kotopoulous Regis University EDEL_450 Assessment of Learning.

Sara Lovell, CPCS Education Coordinator Providence Alaska Medical Center.

TRANSPORTATION RESEARCH BOARD WATER SCIENCE AND TECHNOLOGY BOARD TRANSPORTATION RESEARCH BOARD TRB’s Vision for Transportation Research.

1 Strategic Plan Review. 2 Process Planning and Evaluation Committee will be discussing 2 directions per meeting. October meeting- Finance and Governance.

The Great Lakes Stewardship Initiative What We Know Shapes What We Do.

Summer Institutes 2013 Changing Teacher Practice Changing Student Outcomes.

Dimension 1: Define and Monitor Social Goals Today’s speakers: Margaret Namazzi, Opportunity Bank, Uganda (OBUL) Anton Simanowitz, Director, The Business.

EPort at IUPUI Presentation to the Enrollment Management Committee November 19, 2004 Sharon J. Hamilton.

Formative Evaluation of the Implementation of the Medical Education Metrics Standard for Continuing Education MedBiquitous Annual Conference 2011 May 11,

SHEEO Meeting Presentation by the Council of Chief State School Officers (CCSSO) Chris Minnich, Senior Membership Director July 13, 2011.

National Quality Policy in the Netherlands Cordula Wagner, PhD Emmy Sluijs, PhD Mirjan Geurts, MA.

Information about Foundations of Excellence ® Illustration of Academic & Student Affairs Partnerships.

"BFEFs: developing professionals through mentors, colleagues & community : 3 fellows' experiences." Todd Hill, PhD, R.Psych. Ass’t Prof. / Director of.

An Innovative Approach to Local Quality Management: Joint undergraduate / Foundation programme quality visits to Local Education Providers (LEPs) Dr Jon.

The Education Design Challenge Jonathan St. George MD, Jared Rich MD, John Won MD New Tools for Bridging the Education Gap The 21st century is defined.

Integrated EDI for Microsoft Dynamics® AX AXUG Partner Showcase.

Mgt Project Portfolio Management and the PMO Module 8 - Fundamentals of the Program Management Office Dr. Alan C. Maltz Howe School of Technology.

Adding the Second Story: Building Evaluation Capacity in the Field

Education Tools and How to Access Them

MedBiquitous Standards Implementation Workshop

Please highlight one choice only

Data Standards Provide a Focus for CME Initiatives

Peter Greene, MD Executive Director May 18, 2015

The Heart of Student Success

Please highlight one choice only

Knowledge Connections

2017 IEEE President-Elect Candidate

Slide Set I: PARS Overview

8th Continual Improvement & Innovation Symposium 2016 CASE STUDY COMPETITION: INNOVATION TEMPLATE [ Name of the Organization ] [ Innovation Title ]

Presentation transcript:

Formative Evaluation of the Implementation of the Medical Education Metrics Standard for Continuing Education MedBiquitous Annual Conference 2011 May 11, 2011 Baltimore, Maryland

Presenters and Disclosures Francis Kwakwa, MA Assistant Director, Data Management, Radiological Society of North America Does not have an interest in selling anything to CME professionals Andrew Rabin, BS Chief Technology Officer, CECity Does have an interest in selling a program or service to CME professionals Sean Hayes, PsyD Vice President of AXDEV Group Does have an interest in selling a program or service to CME professionals Valerie Smothers, MA Deputy Director, MedBiquitous Does not have an interest in selling anything to CME professionals 2

Objectives of Today’s Session Increase knowledge about use of Medical Education Metrics Standard (MEMS) in CME Share experience of using MEMS as part of Program and Activity Reporting System Present formative findings collected regarding the experience of those who have implemented MEMS Offer case study findings as to how to assess implementation of new systems 3

MedBiquitous Metrics Working Group Mission To develop XML standards & Web services requirements and descriptions for the exchange of aggregate evaluation data and other key metrics for health professions education. 4

MEMS: Medical Education Metrics Technology standard for core evaluation data Users –Educators want best practices, ability to compare –Funders want to measure reach and efficacy –Accreditors want to measure success of activity and provider

MEMS Data Activity Description –What’s being evaluated Participant Activity Evaluation –What did participants think Participation Metrics –How many people participated Learner Demographics

Program and Activity Reporting System (PARS) 7 Manual data entry Comma delimited upload XML upload

Formative Evaluation Provides immediate feedback to program participants Fosters reflection and self-regulation Provides feedback about the program itself to designers and sponsors Oriented to improving the focus of the program Based upon a dynamic model

Relationship Between Formative and Summative Evaluation Across Life of an Innovation Relative Emphasis Program Life Summative Evaluation Formative Evaluation Worthen 1987

Focus Group MEMS implementers using XML in association with PARS 4 organizations represented Measured –Success and satisfaction –Resources for implementation –Characteristics of implementers –Decision factors 10

Results Implementers felt satisfied, but limited (not many customers implementing) Limited effort and resources required; change management important Implementers all fluent in XML ACCME adoption key; implementers seeking to better support customers, show competitive advantage, make links between different types of data

Case Study Implemented MEMS for PARS upload Experience implementing MedBiquitous standards Integrated new data into user interface and workflow Provided user training

Lessons Learned 16 Standards implementation can bring about efficiencies when integrated into workflow and properly supported Validation tools needed Web services needed to realize full benefits, one click data transfer

Contact Us 17 Valerie will forward questions to the working group