© University of California San Francisco Medical School The Educator’s Portfolio: Creation and Evaluation Brian Schwartz, MD David M. Irby, PhD Kanade Shinkai, MD, PhD University of California, San Francisco Academy of Medical Educators

© University of California San Francisco Medical School Creative Commons License Attribution-NonCommercial-Share Alike 3.0 Unported You are free: to Share — to copy, distribute and transmit the work to Remix — to adapt the work Under the following conditions: Attribution. You must give the original authors credit (but not in any way that suggests that they endorse you or your use of the work). Noncommercial. You may not use this work for commercial purposes. Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under a license identical to this one. See for full license.

© University of California San Francisco Medical School Agenda for the session Introduction and overview of EP 2.0 (20 min) Create an Executive Summary (30 min) Write Detailed Descriptions (30 min) Evaluate Detailed Descriptions (30 min) General discussion (10 min)

© University of California San Francisco Medical School Purpose of the Educator Portfolio 1.Highlight current, best work and impact –Who are you as an educator? 2.Describe contributions in format for review –Promotions committees –Letter writers –Annual review with supervisor 3.Align with CV in ADVANCE and AME continuation metrics Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School EP 2.0 – how is it different? 1.Quality not quantity! 2.New role; learner assessment 3.Scholarship embedded into all roles 4.2 components of EP 2.0: –Executive Summary (5) –Detailed Description (1-3 from Exec Sum)

© University of California San Francisco Medical School What are Educator’s Roles? TeachingActivities Curriculum Development LearnerAssessment Mentoring & Advising Educ Leadership & Administration Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School Executive Summary List up to 5 of your most significant contributions to education in the following roles: 1.Teaching (mandatory) 2.Curriculum Development, Instructional Design/Tech 3.Educational Leadership 4.Mentoring 5.Learner Assessment Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School Executive Summary List up to 5 of your most significant contributions to education in the following roles: 1.Teaching (mandatory) 2.Curriculum Development, Instructional Design/Tech 3.Educational Leadership 4.Mentoring 5.Learner Assessment Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School Executive Summary List up to 5 of your most significant contributions to education in the following roles: 1.Teaching (mandatory) 2.Curriculum Development, Instructional Design/Tech 3.Curriculum Development, Instructional Design/Tech 4.Mentoring 5.Learner Assessment Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School Executive Summary Identify and describe each significant contribution in one sentence. The first contribution must be teaching. Using no more than two or three additional sentences under each contribution, explain the activity, your contribution, what was achieved and any impact. Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School Executive Summary Example Vanya Douglas, MD Assistant Clinical Professor of Neurology Member of the Academy of Medical Educators Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School

Exercise A Use the Executive Summary template –Describe your 1-5 most important contributions to education at UCSF –Label by educator role (e.g., teaching, mentoring, leadership, etc.) Pair and share Report Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School EP 2.0: Detailed Descriptions 1-3 Detailed Descriptions –Select from Executive Summary –2 pages maximum –Templates for all 5 educator roles You will be using a teaching role for the workshop Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School Template for Detailed Description: Teaching Role Your role Learners and contact Builds on best evidence/practice Goals and learning objectives Methods Results impact Dissemination Reflective critique

© University of California San Francisco Medical School Criteria for Excellence in Teaching

© University of California San Francisco Medical School Exercise B Using the template for the “teaching role”, pick one of your important contributions and begin filling out the template for it Consult with person next to you Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School Development of Criteria Education as Scholarship Boyer Glassick Fincher Documentation standards for Educational Scholarship Kirkpatrick Simpson Criteria for Evaluating Educational Scholarship Gusic Criteria for evaluating roles Advocated for teaching as scholarship, guidelines for evaluation teaching Defined roles and documentation standards Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School Excellence, Scholarly, Scholarship CriteriaTeaching Excellence Scholarly Teaching Scholarship of Teaching Quantity & Quality Builds on the Field Public Peer Review Advances the Field Simpson D, et al. Advancing educators and education by defining the components and evidence associated with educational scholarship. Med Educ. 41:1002–1009, 2007.

© University of California San Francisco Medical School Criteria for Excellence in Teaching

© University of California San Francisco Medical School Exercise C Apply Criteria –Use the evaluation criteria to evaluate the sample teaching activity Discuss –How do the criteria help you judge the faculty member’s work? How could it be strengthened? –How can the criteria help you write your entry? Report out Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School Survey

© University of California San Francisco Medical School Frequently Asked Questions FAQs: ators_Portfolio/FAQs_EP_2015.pdf Templates and instructions: ators_Portfolio/ Purpose and Educ. Roles Executive SummaryDetailed Descriptions Evaluation Criteria

© University of California San Francisco Medical School Summary of Portfolio 2.0 Executive summary of 1-5 significant contributions to teaching and education (in 1 page) 1-3 specific examples of most significant contributions to teaching and education (no more than 2 pages per example)

© University of California San Francisco Medical School Resources These Slides –Will be posted on AME website for reference UCSF Academy of Medical Educators Portfolio – olio/ AAMC Toolbox –Gusic M, Amiel J, Baldwin C, Chandran L, Fincher R, Mavis B, et al. Using the AAMC Toolbox for Evaluating Educators: You be the Judge!. MedEdPORTAL; Available from: