1. Wayne Siegel, Ph.D., ABPP Cathi Grus, Ph.D Elizabeth Klonoff, Ph.D., ABPP Robert Goldberg, Ph.D., ABPP

2. 1. Explain the historical and often limited methods for assessing trainee competence. 2. Describe considerations in developing valid methods to assess competence and its importance to the training of psychologists and the profession overall. 3. List the benefits and limitations of using standardized patients to assess competence at the doctoral program level. 4. Discuss the benefits and limitations of an “oral competency” method of assessing competence at the internship level.

3.  Introduction Wayne Siegel, Ph.D., ABPP Wayne Siegel, Ph.D., ABPP  20,000 Overview Cathi Grus, Ph.D Cathi Grus, Ph.D  Using Standardized Patients Elizabeth Klonoff, Ph.D., ABPP Elizabeth Klonoff, Ph.D., ABPP  An “Oral Competency” approach Robert Goldberg, Ph.D., ABPP Robert Goldberg, Ph.D., ABPP

4.  Doc Programs Knowledge Knowledge  Grades, projects, dissertation, comps Clinical skills Clinical skills  Practicum – supervisor ratings  Internship and postdoc Supervisor subjective perception of trainee performance. Supervisor subjective perception of trainee performance. Weak behavioral anchors often tied to level of independence Weak behavioral anchors often tied to level of independence

5.  No teeth Lack of uniform agreed upon competencies at all levels including licensure Lack of uniform agreed upon competencies at all levels including licensure Subjective ratings have almost non-existent reliability and validity Subjective ratings have almost non-existent reliability and validity How do we know who is competent? How do we know who is competent?  We know it when we see it (or not)?

6.  Consequences Inefficient and ineffective tool to provide feedback for trainee development Inefficient and ineffective tool to provide feedback for trainee development No clear ability to gate keep at internship and licensure level No clear ability to gate keep at internship and licensure level How “incompetent” does someone have to be to NOT make it through the gate? How “incompetent” does someone have to be to NOT make it through the gate? Contributes to the Match imbalance Contributes to the Match imbalance Poor protection of the public Poor protection of the public Overall impact on the profession of psychology Overall impact on the profession of psychology