1. Presented By: The COM Office of Assessment and Evaluation Chanita Hughes Halbert, PhD and Michele Friesinger, MA, CHES

2.  Identify best practices for how to give and interpret constructive feedback  Understand how to pull and interpret evaluation data  Apply how to use constructive feedback to make improvements on your own work

3. Mission Providing the College of Medicine with effective and accurate assessment of student learning and medical education curriculum evaluation. A variety of formative and summative measures in the curriculum are evaluated by selected groups of medical students, faculty members, and content experts in the four domains of knowledge, skills, behaviors and attitudes. In addition, the professionals in the Office of Assessment and Evaluation are committed to providing excellent training, data analysis expertise and responsive customer service to all stakeholders.

4.  Powerful tool  Know the criteria which performance is measured  Examples: E*Value data, learning objectives, career goals, etc.  Combination of positive and negative feedback  Give ideas for improvement  Ways to use it  Inform other faculty about performance  Educate students on their strengths and weaknesses  Improve the curriculum

5.  Cause Uncorrected Mistakes  Strengths of curriculum not being reinforced  Lower potential to facilitate educational competency  Lead to anger, defensiveness, or embarrassment  Body language is ineffective feedback  Avoidance is not an excuse

6.  Provide guidance on strengths AND weaknesses  WHY performance is strong or needs improvement  PRAISE for doing well  Provide INFORMATION  Nonjudgmental

7.  Based on First Hand information or Direct Observation  Descriptive, detailed, and using constructive language  Use specific issues not generalizations  Well-timed  Concentrate on remediable behaviors  Focus on activities, not individuals

8.  What was done right?  What was done wrong?  Possible ways to implement improvements

9.  How do you think things are going?  How do you think the activity went?  What aspects do you think were successful?  What aspects need improvement?  Why the need for improvement?

10. MUSC’s preferred health professional education management system since 2005. College of Medicine UME sends out over 55,000+ student, faculty, and course evaluations every academic year. www.evalue.musc.edu  Log in with Net ID and Password  Choose the program the evaluations are regarding, click continue to login

11. 1. Completing evaluations and feedback online (giving)  Students (Small groups, advisors, Clinical Performance Evaluations)  Peers (Peer Faculty Review)  On the Fly evaluations (Praise or Concern Cards)

12. 2. Looking at evaluations completed about your teaching (receiving)  Lecture evaluations, Clinical educators, small group preceptors, advisors  Dean’s office, Associate Deans, and Chairs review this data yearly.

13. Tool Bars Browser Back Button How to save a favorite in E*Value  Go to the page you would like to save as a favorite (For example About Trainees Filter page)  Click on the down arrow next to the Yellow Star My E*Value button on the left hand tool bar  Click Add to My E*Value  This will add this page as a favorite on the left hand tool bar.

14. Email Link or:  Make sure you are in the program you are wanting to view  Click on the Evaluations icon on the top of the screen  Click on To Be Completed underneath the icons  This will list all the evaluations you have to complete.  Scroll down to the bottom of the screen to find the correct line with the evaluation you are looking for and click on the box next to the word “open”. Now click submit  This will bring you to the evaluation that you need to complete.  Once you have entered all the data please hit the submit button at the bottom of this evaluation.

15. How to complete an On-the-Fly Evaluation  Click on your program the evaluation is administered in  Click on the Evaluations icon on the top of the screen  Click on On-the-Fly underneath the icons  Choose an evaluation from “Select an evaluation type” from the drop down menu.  Choose the name of “who you would like to evaluate”  Choose the Activity and Time Frame in which this praise or concern occurred.  Click Next  The evaluation will then be generated, please complete and submit.

16. Instructors to see the evaluations they completed:  Click on the Evaluations Icon  Click on Educator Reports on the submenu below the icons  Click on Submitted by Me under Completed Evaluations & Compliance  Click on the hyperlinked (underlined) evaluation you would like to view.

17.  Click on the Evaluations Icon  Click on Educator Reports on the submenu below the icons  Click on My Performance under Performance Overview  From this page you can change the time period of what data you would like to see (i.e.1 year, 6 months)  You then can click on each blue activity hyperlink to see this data individually. Make sure if you do this on the data page click the Expanded View link at the top of the page.  Or scroll to the bottom and click the link that says All Activities for the last 12 months.

18.  Look at both data and comments  Comments can interpret the data  Consider both strengths and weakness when making changes, not just weaknesses  Peer Review changes and comments

19.  Brodsky D, Doherty EG. Providing Effective Feedback, NeoReviews, 2010;11(3) e117. [Article Link]Article Link  Ende J. Feedback in clinical medical education. JAMA 1983; 250: 777-781. [Abstract Link]Abstract Link  Irby DM. Teaching and learning in ambulatory care settings: a thematic review of the literature. Acad Med 1995; 70: 898-931.  Milan FB, Parish SJ, Reichgott, MJ. A Model for Educational Feedback Based on Clinical Communication Skills Strategies: Beyond the "Feedback Sandwich", Teaching and Learning in Medicine, 200618:1, pages 42-47. DOI: 10.1207/s15328015tlm1801_ 9.