Rater Training for Clinical Skills Verification Module 5 Performance Standards Michael Jibson, M.D., Ph.D. Jeffrey Hunt, M.D. David Kaye, M.D. Richard Summers, M.D.

Pre-test Module 5 1.The Clinical Skills Verification Examination requires that residents demonstrate competency all of the following areas except: a.conduct of the interview b. doctor-patient relationship and rapport development c.case formulation d.case presentation

Pre-test Module 5 2.The Clinical Skills Verification Examination defines competency: a) based on a developmental sequence of skills over the four years of the adult psychiatry residency b) based on the expected competency of PGY2 psychiatry residents c) based on the expected skills of a competent general psychiatrist in the community d) based on the standards of the live patient ABPN examination

Pre-test Module 5 3.Residents must : a) pass all items on the CSV forms in order to pass the assessment b) pass all three sections in order to pass the assessment c) pass the majority of items on the CSV form in order to pass the assessment d) Have a global passing grade on the examination if they have failed one section in order to pass the assessment

Pre-test Module 5 4. Which of the following statements is true about the anchor points on the CSV form? a) the anchor points have been validated using standardized patient interviews b) the anchor points assist in the process of developing inter-rater reliability c) the anchor points assist in the process of developing test validity d) the anchor points are derived from ACGME competencies

CSV Form 3 Major items Physician-patient relationship Conduct of the interview Case presentation 10 Subscores with anchors Must score >5 of 8 on each major item

CSV Form 3 major item scores are global impressions They are informed by subscores They need not be an average of the subscores Subscores may be given different weights depending on the clinical situation

CSV Form Subscore anchors for a score of 5-6 define the minimum expectations in each category Anchors assist with inter-rater reliability Major items, subscores, and anchors have not yet been validated

CSV Standards A score of 5 represents: the minimum acceptable standard for a general psychiatrist practicing in the community

CSV Standards Scoring should NOT: be adjusted to the resident’s level of training require excellent or outstanding performance expect performance at the level of a subspecialist

Videos All videos include actual patients All patients and residents have consented to the use of these videos for educational purposes Your responses will be saved for quality assurance assessment It is possible that these data will eventually be used for a research study, but no IRB proposal has been submitted

Videos The videos have been edited. Rate the residents performance on what you see If the resident presents material in the case presentation, assume it was obtained during the patient interview The videos are found in the accompanying slide set

Post-Test Module 5 1.The Clinical Skills Verification Examination requires that residents demonstrate competency all of the following areas except: a.conduct of the interview b. doctor-patient relationship and rapport development c.case formulation d.case presentation

Post-Test Module 5 1.The Clinical Skills Verification Examination requires that residents demonstrate competency all of the following areas except: c.case formulation The CSV exam requires competency in establishing a Doctor-Patient Relationship, Conduct of interview and Case Presentation.

Post-Test Module 5 2.The Clinical Skills Verification Examination defines competency: a) based on a developmental sequence of skills over the four years of the adult psychiatry residency b) based on the expected competency of PGY2 psychiatry residents c) based on the expected skills of a competent general psychiatrist in the community d) based on the standards of the live patient ABPN examination

Post-Test Module 5 2. The Clinical Skills Verification Examination defines competency: c) based on the expected skills of a competent general psychiatrist in the community

Post-Test Module 5 3.Residents must: b) pass all three sections in order to pass the assessment Residents must demonstrate competence on the global ratings of Doctor-Patient Relationship, Conduct of the interview and Case presentation. They do not have to pass each individual anchor under these categories.

Post-Test Module 5 4. Which of the following statements is true about the anchor points on the CSV form? a) the anchor points have been validated using standardized patient interviews b) the anchor points assist in the process of developing inter-rater reliability c) the anchor points assist in the process of developing test validity d) the anchor points are derived from ACGME competencies

Post-Test Module 5 4. Which of the following statements is true about the anchor points on the CSV form? b) the anchor points assist in the process of developing inter-rater reliability