Curriculum Inventory Administrators’ Group February 11, 2015 Terri Cameron

New CI Reports CI in Context CI Website Update  Spring Conference Workshop/Presentation Schedule  Spring Webinar Schedule CI Standardized Vocabulary Revision: Resources CI to ASSET Pre-population Medical School Highlight: Oakland University William Beaumont School of Medicine Other updates from participants Next meeting: Wednesday, March 11, 1 pm ET Agenda

New CI Reports

CI in Context Assessment in US and Canadian Medical Schools: Paul McGuire, University of New Mexico

Charts New LCME QII charts added weekly CI Charts in process Data verification process Reporting tool development Training and Webinars Upcoming Events Registration Slides / Recordings CI Website Update

Central Group on Educational Affairs (CGEA): April 9-12, 2015, Columbus, OH ( Date/Time TBD: Pre-Conference Curriculum Inventory Workshop for Curriculum Deans and Administrators Date/Time TBD: MedAPS Update Northeast Group on Educational Affairs (NEGEA): April 17-18, 2015, Worcester, MA ( Date/Time TBD: Pre-Conference Curriculum Inventory Workshop for Curriculum Deans and Administrators Date/Time TBD: MedAPS Update American Association of Colleges of Osteopathic Medicine (AACOM) and Association of Osteopathic Directors and Medical Educators: April 22-25, 2015, Fort Lauderdale, FL ( Wednesday, April 22/Time TBD: Benchmarking for Medical Education Spring Conference Workshop/Presentation Schedule

Southern Group on Educational Affairs (SGEA): April 24-26, 2015, Charlotte, NC ( Date/Time TBD: Pre-Conference Curriculum Inventory Workshop for Curriculum Deans and Administrators Date/Time TBD: MedAPS Update Western Group on Educational Affairs (WGEA): April 23-26, 2015, San Diego, CA ( Date/Time TBD: Pre-Conference Curriculum Inventory Workshop for Curriculum Deans and Administrators Date/Time TBD: MedAPS Update Canadian Conference on Medical Education (CCME): April 25-28, 2015, Vancouver, CA ( Saturday, April 25, 12:15-4 pm:: Pre-Conference Curriculum Inventory Workshop for Curriculum Deans and Administrators Saturday, April 25, 2:30-4 pm: Curriculum Management Systems for Competency-Based Programs Spring Conference Workshop/Presentation Schedule

MedBiquitous Conference: May 18-19, 2015, Baltimore, MD ( Date/Time TBD: Pre-Conference Curriculum Inventory Workshop for Curriculum Deans and Administrators Date/Time TBD: Implementation of the MedBiquitous Curriculum Inventory Data Exchange Standard Group on Information Resources (GIR) Information Technology in Academic Medicine Conference: June 3-6, 2015, San Diego, CA ( demicmedicinecallforproposals.html) demicmedicinecallforproposals.html Tuesday, June 2 (pm) OR Wednesday, June 3 (am): Pre-Conference Curriculum Inventory Developers Workshop (Terri Cameron) Wednesday, June 3 (pm): MedAPS Update (Terri Cameron and Robby Reynolds) – This will likely be part of a big session with all AAMC presenters Spring Conference Workshop/Presentation Schedule

IAMSE: June 13-16, 2015, San Diego, CA ( annual-iamse-meeting/event-summary- 136ae1edefdf4ec1be5686a1c057bdb6.aspx) annual-iamse-meeting/event-summary- 136ae1edefdf4ec1be5686a1c057bdb6.aspx Monday, June 15, 2:15-3:45 pm: Focus Session: Leading Curriculum Management for Local Needs and the International Curriculum Inventory (Terri Cameron, Colleen Grochowski, Giulia Bonaminio, Susan Masters) Tuesday, June 16, 8-9:30 am: Using the AAMC Curriculum Inventory to Support Curriculum Committees and Faculty (Terri Cameron, Robby Reynolds) Spring Conference Workshop/Presentation Schedule

Curriculum Inventory for Curriculum Deans and Administrators Thursday, April 30, 1-2:30 pm ET This webinar provides an overview of the Curriculum Inventory and detailed information about what curriculum data should be uploaded to the Curriculum Inventory. In addition, key concepts about how the data is organized and the specifics of what should be provided for each data element are discussed. The Curriculum Inventory School Portal, the time table for annual academic year uploads, the Verification Report, and the process of uploading, reviewing, and verifying data are explained. Spring Webinar Series

Three-Part Developer Webinar Series (pre-requisite for Developer Workshop) Part I: Thursday, May 28, 1-2:30 pm ET Part II: Monday, June 1, 1-2:30 pm ET Part III: Tuesday, June 23, 1-2:30 pm ET The three-part Developer Webinar Series is a intended for developers responsible for creating XML files for upload to the Curriculum Inventory. Part I focuses on the MedBiquitous Curriculum Inventory Data Exchange Standard and the AAMC Business Rules for the Curriculum Inventory. Part II explains the Competency Framework and how it works with the Curriculum Inventory Standard to document competency mapping. Part III is a discussion of complex curricular options (Clerkships, Multiple Sites, Small Groups, Selectives, Electives) and Best Practices for documenting them. Registration is required for each Part. Spring Webinar Series

One-Day Hands-on Developer Workshop at O’Hare Airport Hilton Thursday, June 18, 10 am – 4 pm CT No registration fee Breakfast and lunch provided Travel expenses are responsibility of school (Small block of rooms reserved at conference rate at O’Hare Hilton) The one-day Developer-to-Developer Workshop held at O’Hare Airport each year is a hand-on workshop with the goal of creating a successful upload of at least on Sequence Block under the direction and with the assistance of developers who have successfully uploaded to the CI. Travel expenses are the responsibility of the medical school or developer, but there is no registration fee and breakfast and lunch are provided. Registration is required, and the three-part Developer Webinar Series is a pre-requisite to participation in the Workshop. Spring Webinar Series

Curriculum Dean/Administrator Workshops are full-day interactive sessions that provide an additional opportunity to medical school curriculum deans and administrators to learn about the MedAPS Suite of Services, with a focus on the Curriculum Inventory; talk about daily support of curriculum committees and faculty; and share ideas on how to get the most from their local curriculum management systems. While there are planned presentations on curriculum mapping, benchmarking, and support of curriculum committees, each group also has the opportunity to request specific content for the workshop. These workshops are also great opportunities for curriculum staff who are not able to participate in regional GEA meetings or wish to ask questions, request assistance, and/or brainstorm in a small group or one-on-one setting and to allow all participants to network and make contacts for collaboration that are also helpful when there are issues with systems, processes, initiatives, etc. The host school provides a continental breakfast and light lunch for the participants. In addition, the host school can arrange the workshop so that it occurs in proximity to a curriculum committee or faculty meeting, so a separate presentation/discussion can be scheduled for faculty at that institution. If your school would like to host a Curriculum Dean/Administrator Workshop, please contact Curriculum Dean/Administrator Workshops

CI Standardized Vocabulary Revision Live patient : Individual participating in the health care system for the purpose of receiving therapeutic, diagnostic, or preventive procedures. [Mesh “patient”] Virtual reality: A virtual environment which allows the participant to experience a sense of presence in an immersive, computer-generated, three-dimensional, interactive environment [borrowed heavily from MeSH for “virtual reality exposure therapy”] Possible conflicts with: Games, Role play/Dramatization Mobile application: Computer programs or software installed on mobile electronic devices which support a wide range of functions and uses which include television, telephone, video, music, word processing, and Internet service.[MeSH for “mobile applications”] Possible conflicts with Audio, Film/Video, Searchable Electronic Database Radiological images: Recording of images on a sensitized surface (such as photographic film) following examination of any part of the body for diagnostic purposes by means of X-RAYS or GAMMA RAYS [borrowed from MeSH “radiography”]

CI Standardized Vocabulary Revision Ultrasound: The visualization of deep structures of the body by recording the reflections or echoes of ultrasonic pulses directed into the tissues. Use of ultrasound for imaging or diagnostic purposes employs frequencies ranging from 1.6 to 10 megahertz. [MeSH for “ultrasonography”] Animation: A film or video wholly or partially created by photographing drawings, sculptures, or other inanimate things in sequence to create the illusion of motion. Animations are also generated by computers. [MeSH for “animation” as publication type] Does not include: Film/Video

Societal Problems: Previous DCI asked schools to provide specific examples of societal probems: family violence, substance abuse, racial bias, socioeconomic issues, etc., but current DCI asks for examples without requiring specific content. Solution? Keyword with the term 'Societal Problem' Event name, description, and/or objectives will need to specify the issue being presented to provide details for ASSET pre-population and other CI reporting. CI to ASSET Pre-population

Medical School Highlight Oakland University William Beaumont School of Medicine Robin Rivest is the Director of Curriculum Data Management at Oakland University, William Beaumont School of Medicine. Her primary roles include overseeing the data used for mapping the medical education curriculum and assessing the quality of the educational program, as well as ensuring curricular and outcomes data required by accrediting bodies is collected, stored, and presented in the appropriate digital formats. She is also responsible for authoring reports regarding the quality of the curriculum as it pertains to the students and alumni of the School of Medicine.

Curriculum Inventory Administrator’s Group Topics to Share Curriculum data elements System overview Process for data collection Interaction with Course/Clerkship Directors Mapping considerations

Curriculum Data Elements Competencies – PCRS School Objectives Keyword List Course and Clerkship Objectives – Coded for Knowledge, Skills, and Attitudes Established mapping relationships for all levels of objectives

System Overview OASIS is our curriculum software system – Implemented Q1 of 2013 – Uses include curriculum inventory, scheduling (including lottery), course and clerkship evaluations, patient logs, clinical performance evaluations, and reporting for all of the above Moodle – Learning Management System iSEEK - embedded web application that enables students, faculty, and staff to perform “smart” content searches in Moodle

Process for Data Collection Establish data scope, inputs, sources, and roles – All M1 & M2 Courses; All M3 & M4 Clerkships and Sub-Internships; Electives are out-of-scope at this time – Course inputs for setup (name, number, dates, student groups, objectives, access, short name, color coding for calendar) – Event inputs include 29 data fields; we use 21 – Data sources – Moodle, Syllabi, Course and Clerkship Directors (as needed) – Course/Clerkship Directors own and provide the data; Medical Education inputs data into OASIS

Interaction with Course/Clerkship Directors Develop all Course/Clerkship Level Objectives – Start with a verb – Include the common threads, i.e., professionalism – Coded by knowledge, skills, and attitudes – Map up to at least 1 School Objective Ensure the development and consistency of all Event Objectives and keywords – work with other faculty – Start with a verb – Consider no more than 5 per instructional hour – Each one maps to at least 1 Course/Clerkship Level Objective

Interaction with Course/Clerkship Directors - Continued Compare current academic year objectives to previous academic year objectives – note any changes Work with Directors for new or modified objectives to map or re-map, keywords, etc. Create a report called the ‘Course/Clerkship Map’ for their validation of the data prior to the submission for CI Once uploaded to CI, send out various report versions for their final data validation and approval for final submission

Mapping Considerations Perform analysis of horizontal and vertical mapping – School objectives should all map to at least 1 Course/Clerkship objective – Likewise Course/Clerkship objectives should all be mapped to at least 1 session objective – What’s the breakdown of Knowledge, Skills, and Attitudes? Mapping consistency – – Does a common course objective map to the same school objective? – Does the mapping of an objective that hasn’t changed stay the same or can the mapping change?

Other Questions Formative and Summative Assessments Tagging Assessments with Keywords or Objectives Available Learning Assessment Methods from MedBiquitous sometimes limited, i.e. essay assessments – writing reflective papers is scored (reflection is an Instructional Method), writing essays has no option, currently using participation

Other updates from participants

Wednesday, March 11, 1 pm ET (Second Wednesday of each month, 1 pm ET) Registration Link: d950da7caeacafed8be2c3feeb4f4 d950da7caeacafed8be2c3feeb4f4 Please send agenda items to Next meeting: