1. Standardized Patients in Training and Evaluation Judith G. Gearhart, MD

2. Our Objectives n Define simulations n Discuss applications n Observe examples n Examine opportunities for standardized cases to enhance employee performance n Create a case framework n Collaborate

3. Topics of Discussion n Background and terms n Standardized patients in teaching n Standardized patients in evaluation n Developing scenarios and checklists n Resources

4. Background n Nothing new under the sun (1916-1963) n Standardized patients and OSCE used since the 1970s in teaching and evaluation n Incorporated into the USMLE in 2005 Step 2CS Exam

5. Definitions n Standardized Patients (SPs): actors trained to simulate a patient in a clinical presentation and to give trainees feedback on performance

6. Definitions (contd) n Virtual patients: online cases paper cases n Simulators: models manikins

7. Definitions (contd) n OSCE (Objective Structured Clinical Exam): An examination assessing trainee performance in a simulated clinical setting using standardized patients and cases Uses objective checklists to determine whether trainee performs desired competencies

8. Also known as: n CPX (Clinical Performance Exam, Clinical Practice Exam) n PBA (Performance-Based Assessment) n CSA (Clinical Skills Assessment)

9. Definitions (contd) n OSTE Objective Structured Teaching Exam

10. Advantages of SPs n Validity n Availability n Reliability n Controllability n Adaptability n Minimal risk n Feedback n Extension of faculty

11. Uses of SPs Education : n Teach specific skills (interview, history & physical, diagnosis, management, procedures, professional behaviors) n Provide exposure to clinical problems n Teach how to deal with important issues (cross-cultural issues, ethics, delivering bad news)

12. Uses of SPs (contd) n Provide opportunities to meet educational objectives regarding variety and type of clinical problems n Provide cases trainees should, but might not see without planning n Give trainees feedback n Evaluate teaching methods

13. Uses of SPs (contd) Evaluation of trainees n Informal assessment and feedback (ungraded, low-stakes, pass/fail) n Formative or final assessment for grade (with or without feedback) n Assessment to determine progression to next level or licensure (high-stakes)

14. Other uses n Admissions of med trainees or residents n OSTE (Objective Structured Teacher Examination) n Human Resources n Practicing Physicians

15. Human Resources Issues n Hospitality receiving, registration, information giving, telephone etiquette n Confidentiality n Team interaction n Professionalism

16. Things SPs Can Do n Act out scenarios (history, physical, need for counseling or information) n Simulate physical findings n Use checklists developed by faculty to evaluate trainees objectively n Give trainees feedback

17. Physical Findings that Can Be Simulated n Abdominal tenderness n Asterixis n Carotid bruits n Confusion n Dilated pupil n Gait abnormalities n Hyper/hypotension n Jaundice n Sensory losses n Sputum production n Wheezing, asymmetrical BS

18. Prior Development of UMC SP Program n Recruiting, screening, training patients to act out scenarios n Training patients to give feedback n Maintaining the standardized patient pool n Working out remuneration n Use of facilities

19. Development of UMC Standardized Patient Program (contd) Creating scenarios and checklists n Accessing those already available n Scripting from patient/employee encounters youve had n Scripting case for objectives

20. Developing Cases and Checklists First, determine objective for case n teaching, evaluation, or combination n teaching/evaluating what skill?

21. Developing Cases and Checklists (contd) What skill(s)? n Adapt for level of trainee n Adapt for time frame n Put in context of curriculum map or institutional goals

22. Next, create the case (scenario) n Access those already available n Script from patient/employee encounters youve had Developing Cases and Checklists (contd)

23. n Identify minimal competencies/ behaviors/questions n List in appropriate sequence n Be specific n Use language that an SP will understand

24. Examples n Patient asks for directions/clinical information from employee who doesnt know the answer n Employee encounters angry patient n Procedures (venipuncture checklist) n Model/mannequin cases (Sim center)

25. Examples n Admitting medical error n Obtaining informed consent n Delivering bad news n Telephone triage n Patient safety

26. Summary Using Standardized Patients can n increase learning opportunities through structured cases n Using standardized cases can provide another perspective of trainee performance n provide an objective rather than subjective, measure of skills

27. Resources n Bibliography n Web sites n Organizations n Clinical Procedures and Simulation Center n Clinical Skills Center

28. Resources ASPE (Association of Standardized Patient Educators) www.aspeducators.org n Individual or institutional membership fee n Casebank Society for Simulation in Health Care www.ssih.org n Multiple membership, individual, active, retired, student, resident fee n Free without journal