Curriculum Mapping: Flipped, Automated, and Easy Educause – 9/30/2014 Gerald Thrush, PhD & Scott Helf, DO, MSIT Western University of Health Sciences College of Osteopathic Medicine of the Pacific Terence P. Ma, PhD Albert Einstein College of Medicine

Learning Objectives Examine the context and application of curriculum mapping. Realize how automated curriculum mapping is achieved through a simple technical solution. Apply this understanding at your own institutions.

Presentation Organization Curriculum mapping history and context (Ma) Setting the technical stage (Helf) Community buy-in and demonstration (Helf) Analytics demonstration (Helf)

Presentation Organization Curriculum mapping history and context (Ma) Setting the technical stage (Helf) Community buy-in and demonstration (Helf) Analytics demonstration (Helf)

Curriculum Development Process State of New South Wales, Department of Education and Communities, 2011

Process Cycle TOOL to gather evidence is Curriculum Mapping

Curriculum Structures ALIGNMENT PACING MAPPING Modified from Heath, 2001 Virginia Department of Education

Developers of Curriculum Mapping Pioneered by Fenwick English in late 1970s and early 1980s. Focused and what and when Evolved from concept that: Quantity of instructional time affects student achievement Curricular decisions should be based on accurate information, not opinions Fenwick W. English Association for Supervision and Curriculum Development, 2001

Developers of Curriculum Mapping Broadened by Heidi Hayes Jacobs in late 1990s and 2000s Use calendar to “map” a curriculum into chunks that describe content, skills, and assessments that describe learning in a classroom. Map vertical (grade-to-grade) and horizontal (across courses in a grade) integration Heidi Hayes Jacobs Association for Supervision and Curriculum Development, 2001

Purposes of Curriculum Mapping Allows educators to review the curriculum to check for unnecessary redundancies, inconsistencies, misalignments, weaknesses, and gaps; Documents the relationships between the required components of the curriculum and the intended student learning outcomes; Helps identify opportunities for integration among disciplines; Provides a review of assessment methods; and Identifies what students have learned, allowing educators to focus on building on previous knowledge Education World, 2013

Submission Agree on Data Collection -Ontology -Taxonomy -Vocabulary Analyze & Disseminate -Ontology -Taxonomy -Vocabulary Agree on Data

The Framework Understanding the Buzzwords Desires (institutional) Mission/Goals Objectives What is desired How measured Timeframe Action (learner) Competencies Entrustable Professional Activities (EPAs) Milestones Outcomes Measured result Effective data collection Timeframe

How Do We Know What We Want to Know? Measurable How do you know if the student has achieved the outcome? Cognitive (know) Affective (think or care about) Behavioral (able to do) Meaningful Does it, and why, does it matter if the student has achieved the outcome? Manageable How detailed are you going to get? Map-able When does it occur and how is it related to other expectations?

Tensions in Medical Education Need to teach more Need to teach effectively Need to teach clinically-relevant information Teach in less time Teach for understanding Teach foundations for clinical understanding

The Allopathic Experiment Curriculum Inventory and Reports Project (CIR) is to serve as benchmarking and reporting tool on content, structure, delivery, and assessment of medical school curricula across allopathic medical schools.

The MedBiquitous CI Schema MedBiquitous Curriculum Inventory Schema Objective is to provide a data structure to represent a health professions curriculum in a standard format

From CIR Developer’s Workshop I, AAMC, December 2013

MUST HAVE A COMMON LANGUAGE The Tower of Babel, Pieter Bruegel the Elder, 1563

Common AAMC Selected Terminology Academic Level/Phase “year of curriculum” Sequence Block Course, unit, block, clerkship Event (Instructional or Assessment Session) Lecture, lab, discussion, assessment Expectations Competency, objective, milestone, EPA

Everything Is Linked to an Event and Expectations for the Event MedBiquitous Curriculum Inventory Specifications February, 2013

REVIEW: Events Have Title Duration Description Keywords Expectations Instructional or Assessment Method(s) Resources

Keywords: Ensure Correct Concept Choice Medical Subject Headings (MeSH) Controlled vocabulary from NLM used for indexing, cataloging, and searching biomedical and health-related information and documents. 2014 edition Contains 27,149 descriptors Unified Medical Language System (UMLS) 2013AB Release Contains 8,547,943 English concept names Contains 11,399,743 total concept names from 21 different languages

Basic MedBiquitous Terms AACOM/AODME 2013

Competency Framework Based on EXPECTATIONS From CIR Curriculum Dean’s Workshop, AAMC, December 2013

From CIR Developer’s Workshop II, AAMC, December 2013

National Competency Domains ACGME Core Competencies Physician Competency Reference Set Patient Care Medical Knowledge Knowledge for Practice Practice-Based Learning and Improvement Interpersonal Skills and Communication Interpersonal and Communication Skills Professionalism Systems-Based Practice Interprofessional Collaboration Personal and Professional Development

Presentation Organization Curriculum mapping history and context (Ma) Setting the technical stage (Helf) Community buy-in and demonstration (Helf) Analytics demonstration (Helf)

Architecting vs. Mapping

Curriculum “Mapping”

The Technical Stage

What are we trying to achieve?

Reality …as close as we can get

Em[power]ment

Make it work.

Make less work.

How?

Submit Agree on Data Collect -Ontology -Taxonomy -Vocabulary Analyze & Disseminate -Ontology -Taxonomy -Vocabulary Agree on Data

LMS CMS + Curriculum Calendar =

Presentation Organization Curriculum mapping history and context (Ma) Setting the technical stage (Helf) Community buy-in and demonstration (Helf) Analytics demonstration (Helf)

Stakeholders Students Staff Faculty Administration

Curriculum Mapping Goals 100% posting of the curriculum material Accurate “tagging” of each learner activity Ability to report to stakeholders

Perspectives: We want: Everyone wants: our students to become competent, patient-centered osteopathic physicians Everyone wants: new processes to make the “job” easier. generate longitudinal data for curricular improvement

Were we responsive to our stakeholders?

COMP curriculum calendar http://mydocs.westernu.edu

How can faculty use the calendars?

Faculty can use the search function to find: their documents. other related learning activities e.g. What is taught about carbohydrates during introductory biochemistry lectures? tagging (e.g. MeSH) allows this!!

Entering Learning Activities into the Calendar

Names entered here allow editing of the activity

Autocomplete of MeSH terms Agreement on a common language MeSH Medical Subject Headings

Autocomplete of MeSH terms

ILOs

PLOs

Subject Domains (NBOME)

Saving the Calendar Item

Presentation Organization Curriculum mapping history and context (Ma) Setting the technical stage (Helf) Community buy-in and demonstration (Helf) Analytics demonstration (Helf)

(Real Time) Analysis

Easy Export (And / or Persistent Live Data Connection)

Demonstration

How can you do the same?

Vocabulary Classification Input Output Export Visualize Pivot Standardize Vocabulary Classification Design Interface Input Output Export Map Visualize Pivot Drill Down

Discussion Thank You! Terence “Tere” Ma, PhD: Terence.Ma@einstein.yu.edu Gerald “Jerry” Thrush, PhD: gthrush@westernu.edu Scott Helf, DO, MSIT: shelf@westernu.edu