1. The Educator’s Portfolio: Creation and Evaluation
David M. Irby, PhD
Kanade Shinkai, MD, PhD
Brian Schwartz, MD
University of California, San Francisco Academy of Medical Educators

2. Creative Commons License
Attribution-NonCommercial-Share Alike 3.0 Unported
You are free:
to Share — to copy, distribute and transmit the work
to Remix — to adapt the work
Under the following conditions:
Attribution. You must give the original authors credit (but not in any way that suggests that they endorse you or your use of the work).
Noncommercial. You may not use this work for commercial purposes.
Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under a license identical to this one.
See for full license.

3. Agenda for the session Introduction and overview of EP 2.0 (20 min)
Create an Executive Summary (30 min)
Write Detailed Descriptions (30 min)
Evaluate Detailed Descriptions (30 min)
General discussion (10 min)
Academic advancement (60 min)

4. Collection of best work
Educator Portfolio:
Collection of best work
• Describe roles and contributions as an educator
• Sharing
• Advancement
Niebuhr V et al (2013) MedEdPORTAL

5. Shortcomings of the Educator Portfolio
• Format
- multimodal
- lack structure
- supplemental
• Difficult to evaluate
• Publication, grants as currency of promotion
Gusic ME et al (2014) Acad Med

6. Towards a new Educator Portfolio format+
Educator Portfolio
Criteria for excellence in teaching
EP2.0

7. How do we best demonstrate our value as educators?

8. Educator Portfolio 2.0 Detailed Description Executive summary (1 page)
(1-2 pages)
Up to 3 detailed descriptions

9. Component 1: Executive Summary

10. What are Educator’s Roles?
Teaching
Activities
Curriculum Development
Learner
Assessment
Mentoring
& Advising
Educ Leadership
& Administration
Purpose & Roles
Executive Summary
Detailed Descriptions
Evaluation Criteria

11. Detailed Descriptions
Executive Summary
List up to 5 of your most significant contributions to education in the following roles:
Teaching (mandatory)
Curriculum Development, Instructional Design/Tech
Educational Leadership
Mentoring
Learner Assessment
Purpose & Roles
Executive Summary
Detailed Descriptions
Evaluation Criteria

12. Executive Summary
List up to 5 of your most significant contributions to education in the following roles:
Teaching (required for AME application)urriculum
Educational Leadership
Learner Assessment
Sentence #1:
Identify and describe each significant contribution.
Sentence #2-4:
Explain the activity, your contribution, what was achieved and any impact.

13. Executive Summary Example
Vanya Douglas, MD Assistant Clinical Professor of Neurology
Member of the Academy of Medical Educators
Purpose and Educ. Roles
Executive Summary
Detailed Descriptions
Evaluation Criteria

15. Detailed Descriptions
Exercise A (30 minutes)
Use the Executive Summary template
Describe your 1-5 most important contributions to education at UCSF
Label by educator role (e.g., teaching, mentoring, leadership, etc.)
Pair and share
Report
Purpose and Educ. Roles
Executive Summary
Detailed Descriptions
Evaluation Criteria

16. Component 2: Detailed Descriptions

17. EP 2.0: Detailed Descriptions
Select within Executive Summary
2 pages maximum
Templates for all 5 educator roles
Teaching role = mandatory component of application to UCSF AME
Purpose and Educ. Roles
Executive Summary
Detailed Descriptions
Evaluation Criteria

18. Detailed Description (1-2 pages)
Up to 3 detailed descriptions

19. Template for Detailed Description: Teaching Role
Your role
Learners and contact
Builds on best evidence/practice
Goals and learning objectives
Methods
Results impact
Dissemination
Reflective critique

20. Detailed Description Example
Learner Assessment

21. Detailed Description 1. Name activity / activities
Describes work at local & national level

22. Detailed Description 2. Your roles
List specific contributions to projects

23. Detailed Description 3. Learners, amount of contact
List local courses and # students
National work -> no #, no direct contact

24. Detailed Description 4. Builds on best practice/evidence
Scholarly approach: builds on prior work or
literature

25. Detailed Description 5. Goals for assessment
Provides detailed project goals (weblink)
Provides clear learning objectives

26. Detailed Description 6. Methods
Spaced education (Q-stream platform)

27. Detailed Description 7. Results and impact
Course/satisfaction ratings, project success

28. Detailed Description 8. Dissemination
Publications
Presentations

29. Detailed Description 9. Reflective critique
Describes rewards
Describes next steps at local and national levels

30. Detailed Descriptions
Exercise B (30 minutes)
Using the template for the “teaching role”, pick one of your important contributions and begin filling out the template for it
Consult with person next to you
Purpose and Educ. Roles
Executive Summary
Detailed Descriptions
Evaluation Criteria

31. Applying Criteria for Excellence in Teaching is the goal of the Detailed descriptions

32. Development of Criteria
Education as Scholarship
Boyer
Glassick
Fincher
Documentation standards for Educational Scholarship
-2006 Kirkpatrick
Simpson
Criteria for Evaluating Educational Scholarship
Gusic
Criteria for evaluating roles
Defined roles and documentation standards
Advocated for teaching as scholarship, guidelines for evaluation teaching
Purpose and Educ. Roles
Executive Summary
Detailed Descriptions
Evaluation Criteria

33. Excellence, Scholarly, Scholarship
Criteria
Teaching Excellence
Scholarly Teaching
Scholarship of Teaching
Quantity & Quality
Builds on the Field
Public
Peer Review
Advances the Field
Simpson D, et al. Advancing educators and education by defining the components and evidence associated with educational scholarship. Med Educ. 41:1002–1009, 2007.

34. Criteria for Excellence in Teaching

35. Detailed Descriptions
Exercise C (30 minutes)
Apply Criteria
Use the evaluation criteria to evaluate the sample teaching activity
Discuss
How do the criteria help you judge the faculty member’s work? How could it be strengthened?
How can the criteria help you write your entry?
Report out
Purpose and Educ. Roles
Executive Summary
Detailed Descriptions
Evaluation Criteria

36. 2016 EP2.0 launched in CV Advance

37. EP2.0 is integrated into CV (not supplemental material)

38. Summary of Portfolio 2.0
Executive summary of 1-5 significant contributions to teaching and education (in 1 page)
1-3 specific examples of most significant contributions to teaching and education (no more than 2 pages per example)

39. Frequently Asked Questions
FAQs:
Templates and instructions:
Needs updating

40. Resources These Slides UCSF Academy of Medical Educators Portfolio
Will be posted on AME website for reference
UCSF Academy of Medical Educators Portfolio
AAMC Toolbox
Gusic M, Amiel J, Baldwin C, Chandran L, Fincher R, Mavis B, et al. Using the AAMC Toolbox for Evaluating Educators: You be the Judge!. MedEdPORTAL; Available from:

41. Acknowledgements David M. Irby, PhD Helen Loeser, MD, MSc
Brian Schwartz, MD
Maxine Papadakis, MD
Karen Hauer, MD, PhD
Cynthia Ashe
Kathleen Land
UCSF AME EP2.0 Task Force (led by Sharad Jain, MD and Rebecca Jackson, MD)

42. Survey