1. Creating Customized Resident Self-Evaluation Assessments in PharmAcademic TM Andrea Weeks, PharmD PGY1 Residency Co-Director and Preceptor Paoli Hospital Clinical Pharmacy Specialist, Infectious Disease Email: weeksa@mlhs.org

2. Disclosures There is no commercial support associated with this educational activity The presenter has no relationship with any commercial company 2

3. To identify key areas in your residency program that you would like to offer residents the opportunity to self-evaluate To explain the steps necessary to build customized resident self-evaluations in PharmAcademic which will meet the needs of your residency program 3 Objectives

4. 2005 Residency Standards American Society of Health-System Pharmacists (ASHP) 2005 Accreditation Standards for PGY1 Pharmacy Residency Programs –Required Residents under Principal 4.1e(2) to practice and document their self-evaluation of their routine performance and achievement of goals and objectives for the residency program 4

5. New 2014 Residency Standards New ASHP 2014 Accreditation Standards for PGY1 Pharmacy Residency Programs –Standard 3.4 Evaluation of the Resident (critical factor) only includes initial resident self- assessment under 3.4d as part of the resident’s development plan –The summative end of rotation Resident self- evaluation is no longer a standard. 5

6. 6 Self-assessments can still be valuable tools for both Residents and Preceptors

7. 2014 Residency Goals and Objectives Competency Area R3: Leadership and Management –Objective R3.1.2: Apply a process of ongoing self- evaluation and personal performance improvement –Objective R3.2.4: Manage one’s own practice effectively 7

8. Summary of Criteria for Residency Objective R3.1.2 Accurately summarizes own strengths and areas for improvement in knowledge, values, qualities, skills and behaviors Effectively uses as self-evaluation process for developing professional direction, goals and plans Effectively engages in self-evaluation of progress on specified goals and plans Effectively uses principles of continuous development planning (reflect, plan, act, evaluate, record/review) 8

9. Summary of Criteria for Residency Objective R3.2.4 Accurately assesses successes and areas for improvement. Makes accurate, criteria-based assessments of one’s own ability to perform practice tasks. Routinely seeks applicable learning opportunities when performance does not meet expectations. Assumes responsibility for personal work quality and improvement. 9

10. 10 How can Preceptors Facilitate Resident Self-Reflection?

11. Preceptors: Review Your Residency Program Rotations Review the activities in your rotations Review the objectives assigned to your rotations Consider previous Resident feedback on various activities What are some behaviors, skills, values or qualities you are looking for in your Residents? Maybe your rotation is one where the Resident may need to seek out more exposure to different patient types in order to get the experience they need 11

12. Examples of Self-Evaluation Questions Rotation Activity-Based Describe your most memorable / interesting patient from this week and what you learned from your interaction with him/her. List any traumas or codes you participated in this week and how you contributed to the health care team and what you could do better next time. Briefly describe how you contributed to the Medication Safety Committee Meeting this month and include your quality improvement/safety ideas. Information on any presentations you have done and how you plan to incorporate feedback into future presentations Please reflect on any feedback you provided a student. What was easy? What was difficult? Provide examples of interventions you made on rounds. Are there interventions that you did not address that should have? 12

13. Examples of Self-Evaluation Questions Rotation Objective-Based Objective R1.1.8: (Applying) Demonstrate responsibility to patients (Choose some criteria from the objective): Gives priority to patient care activities. Assumes responsibility for medication therapy outcomes. Actively pursues all significant existing and potential medication- related problems until satisfactory resolution is obtained. Informs patients how to obtain their medications in a safe, efficient, and cost-effective manner. Determines barriers to patient compliance and makes appropriate adjustments 13

14. 14 Types of Evaluation Scales Answers to your custom Resident self-evaluations can be varied including written text only. You create any type of answer choices or scales.

15. 15 Let’s explore options for creating scheduled customized Resident self- evaluations in PharmAcademic TM is a registered trademark of the McCreadieGroup

16. How to Get Started 16 Need to have access to edit program RPD or Designee

17. PharmAcademic TM Evaluations 17 Once in the edit mode custom evaluations can be created Helpful step by step guides Suggest adding mock resident for practice

18. Custom Evaluations 18 When adding questions you can choose the question type, answers and even a comments box. The alternative is to use a custom evaluation scale here instead of manually entering answer choices.

19. Example of a Weekly Self-Assessment for Residents for a Core Rotation Can add purpose of assessment Directions for assessment Resident focuses on specific tasks Preceptor can assess progress 19

20. Scheduling Custom Evaluations 20 Click here to add an evaluation This drop down box allows you to choose an existing evaluation Schedule the evaluation Preceptors who have access to edit their rotation can build a custom evaluation from here

21. 21 Let’s Practice Together Building a Custom Resident Self-Evaluation Using

22. Read this Cardiology Rotation Activity Description Provide and document therapeutic drug monitoring services for patients receiving digoxin, warfarin, heparin infusions and direct thrombin inhibitors. Resident to select and monitor appropriate drug levels and labs such as PT/INR, PTT (or any other therapeutic parameters), and offer dose modifications to ensure that the patient reaches therapeutic goals. The resident should consider patient compliance and obtainable goals. Follow up on all recommendations with physicians, nurse practitioners, patient and caregivers. 22

23. What Resident Self-Assessment Questions Do You Want? We will build these questions in PharmAcademic We will formulate potential answers that will help us as Preceptors see if our Residents are making progress towards their goals for the rotation and residency. 23

24. References 1.American Society of Health-System Pharmacists, 2005 Accreditation Standard for PGY1 Pharmacy Residency Programs. Available at: http://www.ashp.org/DocLibrary/Residents/ASD-PGY1-Standard.aspx. Accessed March 11, 2016.http://www.ashp.org/DocLibrary/Residents/ASD-PGY1-Standard.aspx. Accessed March 11 2.American Society of Health-System Pharmacists, 2014 Accreditation Standard for PGY1 Pharmacy Residency Programs. Available at: http://www.ashp.org/DocLibrary/Residents/Guidance-PGY1-Standard- 2015.aspx. Accessed March 11, 2016.http://www.ashp.org/DocLibrary/Residents/Guidance-PGY1-Standard- 2015.aspx. Accessed March 11 3.American Society of Health-System Pharmacists, 2014 Accreditation Standard for PGY1 Pharmacy Residency Programs. Available at: http://www.ashp.org/DocLibrary/Accreditation/Regulations- Standards/Newly-Approved-Required-Competency-Areas-Goals-and-Objectives.pdf. Accessed March 12, 2016.http://www.ashp.org/DocLibrary/Accreditation/Regulations- Standards/Newly-Approved-Required-Competency-Areas-Goals-and-Objectives.pdf 4.PharmAcademic™, McCreadie Group, Inc. Copyright 2016. Available at: http://www.mccreadiegroup.com/. Accessed March 13, 2016.http://www.mccreadiegroup.com/ 24

25. 25 Thank you! Please feel free to contact me for more personal assistance Andrea Weeks, PharmD Paoli Hospital Paoli, Pennsylvania 484-565-1144 weeksa@mlhs.org