1 Maximizing Your Educational Potential Educational Innovation and Scholarship: Constance Baldwin, Ph.D., University of Rochester Medical Center Latha Chandran, MD, MPH, MBBS, SUNY/Stonybrook

2 What we will do today Definition of scholarship and its assessment Use of Educator Portfolios in academic institutions Discussion of  Good teaching  Scholarly teaching  Educational scholarship

3 Boyer’s Expanded Definition of Scholarship Discovery: original research to acquire new knowledge, clarify how things work  E.g.: How do residents acquire problem solving skills in clinical situations?  Does faculty use of a direct observ/feedback checklist improve residents’ H&Ps? Integration: seeking connections between disciplines, bridging creatively across research findings  E.g.: Does use of a computerized residency management program result in increased faculty feedback to residents?

4 Boyer’s Expanded Definition of Scholarship Application: building bridges between theory and practice, using knowledge for practical purposes  E.g.: Does the use of an educator portfolio increase chances of promotion among clinician educators? Teaching: communicating knowledge, making new discoveries accessible and meaningful outside a specialized domain  E.g.: Does a curriculum in communication skills enhance patient satisfaction?

5 Glassick’s Six Criteria for Excellence in Scholarship 1.Clear goals: stated purpose, realistic objectives, important questions 2.Adequate preparation: understanding of literature, appropriate skills, needed resources 3.Appropriate methods: methods match goals, effective use and flexible application of methods

6 Glassick’s Six Criteria for Excellence in Scholarship 4.Significant results: goals are achieved, results are important, field is advanced 5.Effective presentation: presentation well organized, forums appropriate, message clear 6.Reflective critique: work critically evaluated, supported with good evidence, evaluation used to improve future studies

7 Why is this important? 315% increase in clinician educators in last twenty years JHU- Clinician Educators were 69% less likely to hold a higher rank than basic scientists Promotions committees unfamiliar with educational scholarship No standardized way to assess scholarship in EPs

8 The Educator Portfolio Key components:  Teaching andLearner Assessment  Curriculum Development  Advising/Mentoring  Educational Leadership and Administration  Other information: Awards, Journal reviewer Key indicators of excellence:  Quality  Impact Developmental and Promotional EPs

9 CV vs EP CV mainly documents educational quantity: if format is modified to report educational activities systematically EP shows quantity, quality and impact: creativity, innovation, evidence-based approach, strong learner outcomes, adoption of models by other programs

10 What we will do today Definition of scholarship and its assessment Use of Educator Portfolios in academic institutions Discussion of  Good teaching  Scholarly teaching  Educational scholarship

11 How is excellent teaching documented? What makes teaching excellent?

12 How is Excellent Teaching Defined? Quantity: Variety, volume, effort Content:  Authenticity  Variety, Richness, and Depth Quality:  Use of best practices and sound planning  Demonstrated excellence through Direct observation (peers or experts) Teaching evaluations by learners Assessments of learners  Longterm outcomes of learners  Outcomes of patients

13 Sound Educational Methods: Authenticity As adult learners, residents want and need:  Real world learning opportunities  Learning with immediate applicability  Chances to apply theory to practice  Skills for life-long learning In world of competency-based education, experiential learning in the practice setting is key to enhancing performance

14 Sound Educational Methods: Variety Create a balance of experiences to suit different learning styles and to use a variety of faculty teaching styles Match methods to content :  Didactic : complex sets of facts and concepts  Interactive : more depth from multiple perspectives  Experiential : skills practiced in authentic settings

15 Sound Educational Methods: Richness and Depth As adult learners, students and residents thrive on:  Self-directed learning with choices  Active learning in practical settings  Interactive enrichment  Flexible learning experiences that are adaptable to individual learner needs  Novelty: new approaches, new types of patients, new settings

16 Sound Educational Methods: Good Planning Learning activities and evaluations based on written goals and specific objectives Efficient use of learners’ time with flexible alternatives Good use of faculty teaching strengths Variety of learning settings Faculty orientation and development Integration of new experience with program as a whole

17 EP: Documenting EP: Documenting Teaching and Learner Assessment  Teaching: Scope and impact Creativity and innovation Evidence-based approach  Quality of Teaching: Direct observations by peers or experts Evaluations by learners Objectives-based assessments of learners Long-term learner outcomes Patient outcomes

18 Small Group Exercise I Use Teaching Activities Grid from the EP Template Enter data into Teaching Activities Grid for a variety of activities Review example of an ESP Scholar’s Teaching Activities Grid Report of one key learning point

19 What is a scholarly approach to education? How will a promotions committee know it when they see it?

20 What is a scholarly approach to teaching? Application of sound principles and systematic planning Use of “best practices” from literature or recognized experts Self-analysis (reflective practice) to improve teaching or educational development

21 Ex. of Scholarly Approach: Learner Assessment Going beyond the conventions of one’s institution Assessing learner needs before teaching Evaluating attainment of learning objectives after teaching Using authoritative sources for new methods

22 Miller’s Triangle: Quality of Learner Assessments [Miller, GE. Acad Med, 65(supp); Sept 1990] Multiple choice exams Case presentations, low fidelity simulations High fidelity simulations, OSCEs Chart audit, portfolio, direct observ, pt outcomes Miller’s Triangle Knows how Shows how Does

23 Ex. of Scholarly Approach: Curriculum Development Structured planning (e.g, use of GNOME model) Evaluation using “best practices ”— (e.g., Kirkpatrick model for program evaluation) Examples demonstrating innovation and educational quality

24 The GNOME: A Linear Model of Curriculum Development G G = Goals N N = Needs O O = Objectives M M = Methods E E = Evaluation

25 Kirkpatrick’s Model of Educational Program Evaluation Evaluation of results Real world outcomes— impact on society Evaluation of behavior Transfer of knowledge, skills, attitudes to workplace Evaluation of learning Acquisition of knowledge, skills, attitudes Evaluation of reaction Learner satisfaction, usefulness, motivation

26 Small Group Exercise II Review Curriculum Development section from a sample EP Discuss how to improve the documentation How would you advise the scholar to use a more scholarly approach in the future? Report on one key learning point

27 What is educational scholarship How is it done? How is it demonstrated?

28 What is educational scholarship? Scholarship goes beyond good teaching and a “scholarly approach” It is educational evaluation or research that fulfills the “3 Ps” criteria : Publication Publication Peer review Peer review platform Providing a platform for others to build upon

29 Comparison of Educational Evaluation and Research Comparison of Educational Evaluation and Research Educational evaluation Looks within a program Studies the effects of educational intervention Purpose: improve program, report to stakeholders Educational research Looks beyond a particular program Asks a question with broader relevance Purpose: generalize findings about educational interventions to other programs Can be quantitative or qualitative

30 Educator Portfolio: Key Content  Teaching and Learner Assessment  Curriculum Development  Mentoring and Advising  Educational Leadership and Administration “Countable” products  Scholarship in all sections: “Countable” products

31 EP: Documentation of Scholarship Scholarly Productivity:  Peer rev publications (print or electronic)  Peer rev/Invited presentations and workshops  Non-peer-rev publications/presentations  Books  Educational Products Grants:  PI or Co-PI  Number and $$$  Geographic impact (national > local)

32 Examples of Scholarship: Curriculum Development Peer reviewed presentations- local, regional, national Peer reviewed publications or product approved by MedEdPORTAL Evidence of impact: e.g., geographic dissemination, positive learner outcomes

33 Strategies for Enhancing Your Educational Efforts 1.Expand your educational vision beyond precepting: Boyer’s model 2.Conduct educational activities systematically and critically: Glassick’s Six Criteria 3.Plan ways to demonstrate educational excellence: evaluations, products, models, presentations, publications 4.Participate in the community of educators (meetings, editorial reviews, workshops, presentations, publications)

34 Summary of Requirements for Educ Career Advancement Documentation of educational productivity (~quantity) Documentation of educational quality (teaching, scholarly approach) Peer review of products and reports Dissemination and adoption of educational products Evidence of national reputation (via presentations, publications, collaborations)

35 How to make educational scholarship a part of your career 1. Always ask questions, and seek answers to the best ones 2.Seek mentors/experts to help guide your scholarly work 3.Build productive collaborations : e.g., look across disciplines at your institution for people in similar roles, or look at other institutions for people in same role; take advantage of ready- made networks in professional organizations 4.Find out what others have done (read the literature, go to meetings, attend workshops, colleagues with questions)

36 How to make educational scholarship a part of your career 5.Develop scholarship around your other responsibilities —multi-purpose your academic effort 6.Plan new teaching activities around current educational program structures to avoid political/scheduling challenges 7.Seek stakeholders to support your effort (look up, down and across) 8. Be the solution, not the problem— find opportunities in challenges faced by your institution

37 9. Pass it forward : share your knowledge and expertise among your peer educators locally and nationally 10. Build your work—and actively document it—around the 3 hallmarks of scholarship :  P ublic dissemination  P eer review  Providing a P latform for others to build on How to make educational scholarship a part of your career