1. ContextQualityEvaluation Fitness for Purpose Why and How to Evaluate Doctoral programs A Swiss experience Jacques Lanarès

2. ContextQualityEvaluation Evaluation of Doctoral Programs Context and Intentions Quality approach Evaluation of Programs

3. ContextQualityEvaluation Evaluation of Doctoral Programs Context and Intentions Quality approach Evaluation of Programs

4. ContextQualityEvaluation Inter-university project to Improve the training researchers Increase cross fertilization Help development of doc. prgs

5. ContextQualityEvaluation Framework Specifications and Call Political and pedagogical selection Financed Evaluation required

6. ContextQualityEvaluation Required caracteristics Inter-institutional & Inter- disciplinary Represents a scientific field Create a training environment Training for research

7. ContextQualityEvaluation Evaluation of Doctoral Programs Context and Intentions Quality approach Evaluation of Programs

8. ContextQualityEvaluation A process to regulate « tensions » Teacher’s priorities Student’s Needs Expectations professional Fields

9. ContextQualityEvaluation A process to regulate « tensions » Teacher’s priorities Student’s Needs Expectations professional fields surveys Investigations Professional Bodies investigations previous students

10. ContextQualityEvaluation Authorities StudentsTeachers

11. ContextQualityEvaluation Authorities StudentsTeachers Indicators

12. ContextQualityEvaluation Authorities StudentsTeachers Peers

13. ContextQualityEvaluation Authorities StudentsTeachers Surveys

14. ContextQualityEvaluation Authorities StudentsTeachers

15. ContextQualityEvaluation Quality Culture Fitness for Purpose Responsibility Participation Reflexivity Balance between Autonomy and Accountability

16. ContextQualityEvaluation Fitness for Purpose Project evaluation grid Questions of evaluation

17. ContextQualityEvaluation To try to avoid paternalism Self evaluation Constructive feedback from colleagues

18. ContextQualityEvaluation To Encourage Participation Involvement various “actors” Inter-programs meeting

19. ContextQualityEvaluation Support reflexivity with questions of the canvas / guide

20. ContextQualityEvaluation Evaluation of Doctoral Programs Context and Intentions Quality approach Evaluation of Programs

21. ContextQualityEvaluation Objectives of Evaluation Was the program conform to planning ? To what extent match students expectations ? Is there an added value perceived ? What can we learn ?

22. ContextQualityEvaluation Principles Learning organisation logic Financing not linked to results Involvement of all partners

23. ContextQualityEvaluation Evaluation Process Working out“Gathering”Intermediate Evaluation Final Evaluation Material Final Questionnaire Evaluation by directors Counsellors global report Results Global Vision Final Report T = 0T= 18 monthsT = 24 monthsT = 36 months Questionnaires Canvas Meeting Distribution Treatment Self-evaluation Meeting share practice

24. ContextQualityEvaluation Report Goals Results (part./object./act.) Organisational context “side” effects Global evaluation

25. ContextQualityEvaluation Some results of evaluation No accurate indicator of effect Progress observed in thesis work (acceleration) Better professional integration & relations Increased ability to argue

26. ContextQualityEvaluation What did we learn ? Interest of sharing practices Usefulness to support the reflexive process Drive to learn not so strong…. Evaluation culture has to be developed

27. ContextQualityEvaluation Experience alone does not lead to learning

28. ContextQualityEvaluation What did we learn ? Interest of sharing practices Usefulness to support the reflexive process Drive to learn not so strong…. Evaluation culture has to be developed

29. ContextQualityEvaluation What did we learn ? Interest of sharing practices Usefulness to support the reflexive process Drive to learn not so strong…. Evaluation culture has to be developed

30. ContextQualityEvaluation Evaluation Process Working out“Gathering”Intermediate Evaluation Final Evaluation Material Final Questionnaire Evaluation by directors Counsellors global report Results Global Vision Final Report T = 0T= 18 monthsT = 24 monthsT = 36 months Questionnaires Canvas Meeting Distribution Treatment Self-evaluation Meeting share practice

31. ContextQualityEvaluation What is important is not the dancer It is the dance …