Curriculum Inventory Administrators’ Group June 10, 2015 Terri Cameron, MA, Director Curriculum Programs Robby Reynolds, MPA, Senior Director Medical Education Online Programs

Audio:  You will hear the audio through your computer speakers. Please make sure your computer speakers are on and the sound is turned up.  If you still have no sound once the webinar starts, please click on the audio broadcast icon ( ) located in the Participants Panel on the right hand side of your screen. Housekeeping  Please use the Q&A panel located on the right hand side of your screen to submit your questions throughout the webinar. Send to All Panelists. If you experience any technical or audio issues during the webinar, please send a message through the Chat panel to AAMC Meetings. Questions :

May / June CI in Context New Webinars: Documenting Clerkships and Electives: Wed, June 24, 1 pm ET Curriculum Mapping: Wed, July 15, 1 pm ET CI Developer Help Desk: Fridays in July, 1 pm ET CI in Action! Three exciting school initiatives: Tufts University (Susan Albright) Texas Tech (Josev Lopez) Dartmouth (Brian Reid) Other updates from participants Next meeting: Wednesday, July 8, 1 pm ET Agenda

CI in Context: May Ensuring Comparability of Educational Experiences during Clinical Clerkships at Multiple Sites Latha Chandran, StonyBrook

CI in Context: June Mapping Competencies to Pre-Clerkship Education Susan Masters, UCSF

Competencies: PUBLISHING, LINKING, VISUALIZING,, SEARCHING THE CURRICULUM THROUGH COMPETENCY MAPPING SUSAN ALBRIGHT DIRECTOR, TECHNOLOGY FOR LEARNING IN THE HEALTH SCIENCES TUFTS TECHNOLOGY SERVICES, TUFTS UNIVERSITY

Mission: Competency-based “Competency-based education is characterized by the development of clearly defined and explicitly published competencies, mapping the curriculum to achieve competencies, and assessment process matched to competencies.” ( Ron Harden, Medical Teacher 2002 #24 Vol. 2 )

Curriculum inventory Tufts staff helped to lead the creation of the curriculum inventory standard TUSK - comprehensive enterprise educational system – implemented the standard Having the XML and all that data was not enough

Specification for the Tool Reuse the data already created/collected for the curriculum inventory Create a human readable tool to view the curriculum Create a tool to map and search and view where competencies are taught ◦which course ◦which session ◦what type of instructional method ◦how much time ◦key words ◦Matches competencies to content View how competencies link to school and national competencies

Separate curricula Separate competencies Separate resources Shared curricula Shared competencies Shared resources Now (disciplinary “silos”) Future (“One Health”) Health education/One Health Ecosystem health Human health Animal health Ecosystem health Human health Animal health

US University of Arizona New York Medical College U. Hawaii Einstein Medical School University of Arizona Tufts (Medical, Dental, Vet, PA program) Africa Uganda DRC Kenya Tanzania Ghana Ethiopia Rwanda Southeast Asia India Vellore Bangalore Thailand Middle East: Saudi Arabia

Elements of TUSK used in mapping 1.Published competencies 2.Competencies linked across the curriculum 3.Content linked to Schedule (time/course) 4.Schedule linked to objectives and competencies 5.Courses linked to academic levels

Competency cascade Session Course Program Institution National associations, specialty societies National School Course Clerkshi p Activity Assessment

National PCRS Competencies

Linking competencies in TUSK modify or add link and unlink tool for linking

Linking Tool:

Linking courses to academic levels

The Schedule – Links to Content and Learning Objectives

The “event” metadata

TUSK Dashboard Link to national, school competencies Create map Search for competencies linked to content

Competency Mapping

Visualizing the Curriculum MAP

National Reference Set PCRS competencies in the Patient Care Domain

Drilling Down National  School Drilling down to School level links

Drilling into course competencies Course Links

Drilling into the “Event”: lecture, small group, assessment etc Event level links

Competency search

Search page versioning Select domain and top level OR Search by keyword

Course level results

Content level results

Event level objectives Session objectives with date/time/course where objective can be found in the schedule

Next steps…

Additional visualizations: Academic Level 2 Courses/hours Running prototypes in tableau 289 hours 95 hours 30 hours 17 hours 33 hours 20 hours 27 hours 22 hours 19 hours micro

Thank you! Questions?

Promoting alignment with MedBiquitous Standards and the AAMC Curriculum Inventory through an internal re-design of PLFSOM's curriculum management system Presented by : Naomi Lacy PhD, Jose Lopez, Jessica Klein, Lizeth Corral, Richard Brower MD May 18, 2015

Challenges with Curriculum Management System Our Curriculum Structure was difficult to represent through our CMS High level of frustration by IT and Academic key personnel Our Curriculum Structure did not map easily to the CI Model Plenty of manual reclassification to solve mismatch of CI data Large amount of personnel time proofing the CI Report

Curriculum Management System iLios v.1 o Acquired application code from UCSF in 2006 o Legacy programming o Highly tailored to our integrated curriculum (not easily replaced) Designing a new CMS to align to Curriculum Inventory System o CHAMP (Curriculum Hub And Management Platform)

Use AAMC Staging Site to proof our Curriculum Verification Report. CI Working group meet weekly to identify CI reporting issues.

MedBiquitous Influences Adopted the following: o Concepts and Vocabularies for: o Instructional Methods o Assessment Method o Resource Types o Mapped sessions ILOs to PCRS (Physicians Competency Reference Set) o Parent-Child structures for: o Courses o Sessions o Learning Materials

Parent-Child Structure

Advantage of Parent-Child courses and sessions o Allows ‘nesting’ of courses and sessions o Allow tracking and selection of the level at which we report o CHAMP allows representation of what we think and do without the constraints of how our SIS (Banner) assigns grades When I was a kid my parents moved a lot…but I always found them --Rodney Dangerfield

Integrated Curricular Elements ICE (parent course) Curricular elements (child course) o CEYE multi-course summative assessment o CBSE formative assessments o Yr2 and Yr3 OSCE summative assessments o Longitudinal Surveys – ‘hidden curriculum monitoring’ re. social determinants of health, empathy o Self-directed learning time Non-curricular elements (child course) o Orientations o Holidays

CMS Development Timeline Go! 7/16

Development Resources CHAMP Steering Committee o VP/CIO (oversees all TTUHSCEP IT functions) o Sr. Director, Academic Technology (TTUHSCEP IT project oversight) o Director of Assessment and Evaluation (accred. data management) o Assoc. Dean for Med Ed o Assist. Dean for Med Ed o Assoc. Director for Pre-Clerkship Curric. (course coordination expert) o Director of Tech. Services (software devel. oversight, database admin.) o Assoc. Director for Acad. Tech. (operational expert, analyst oversight) o Lead Analyst for Academic Technology (testing, manuals, training) o 3 Programmer/Analyst (software development) Members affiliated with other committees o Office of Medical Education o Curriculum and Educational Policy Committee o PLFSOM Curriculum Inventory Working Group o Evaluation and Assessment Committee o YR 1-2 Course/Pre-Clerkship Committee & YR 3-4 Clerkship Committee

Questions?

Curriculum Inventory for Curriculum Deans and Administrators Thursday, April 30, 1-2:30 pm ET (recording posted) Three-Part Developer Webinar Series (pre-requisite for Developer Workshop) Part I: Thursday, May 28, 1-2:30 pm ET Part II: Thursday, June 18, 1-2:30 pm ET Part III: Tuesday, June 23, 1-2:30 pm ET One-Day Hands-on Developer Workshop at O’Hare Airport Hilton Thursday, June 18, 10 am – 4 pm CT (CANCELED) New Webinar: Documenting Clerkships and Electives: Wed, June 24, 1 pm ET Curriculum Dean/Administrator Workshops Scheduled by request Spring Webinar Series

Wednesday, July 8, 1 pm ET (Second Wednesday of each month, 1 pm ET) Registration Link: Please send agenda items to Next meeting: