1. SELF EVALUATION POORLY CORRELATED WITH RESIDENCY ADMISSION GRADES ON OSCE-BASED TEST Júlio César de Oliveira Maria Patrocínio Tenório Nunes Leonardo Borges de Barros e Silva Cristina Helena Fonseca-Guedes Itamar de Souza Santos Joaquim Edson Vieira UNIVERSITY OF SÃO PAULO SCHOOL OF MEDICINE São Paulo BRAZIL

2. UNIVERSITY OF SÃO PAULO SCHOOL OF MEDICINE São Paulo BRAZIL OSCE Performance as a Residency Admission Test

3. - 600 Graduated Doctors around the country -264 positions as a Resident -21 Residency Training Programs From: 60 different Schools 21 different States Phase 1 - Writing test 3.000 candidates Phase 2 – OSCE Based Test 600 candidates

4. PHASE 2 - OSCE Selection Process Actress patient Candidate Observer

5. OBJECTIVE Correlation between Self Evaluation score and OSCE grade in a Residency Admission Test

6. CASUISTIC and METHODS Self-evaluation questionnaire 314 recently graduated physicians Performance on Objective Structured Clinical Examination – OSCE Correlation between OSCE final grade and self-evaluation of skill levels

7. CASUISTIC and METHODS Self evaluation questionnaire 0 You do not know the procedure 1 You have read about or been told how the procedure is done 2 You have seen another person perform the procedure 3 You have done the procedure with guidance of another person 4 You have done the procedure correctly on your own 5 You have done the procedure correctly so many times that you feel both competent and confident about it

8. STATISTICAL ANALYSIS Pearson Correlations test Self evaluation scores X OSCE grade

9. RESULTS

10. RESULTS

11. RESULTS

12. RESULTS

13. DISCUSSION The OSCE provides a nearer real clinical situation The self-evaluation questionnaire indicates how secure and confident was the candidate about the skill asked in each station It would be expected a good correlation between OSCE grade and self evaluation scores But no correlation was found

14. CONCLUSION Young physicians could not self-evaluate OSCE grades during Residency Admission Test.