1. Teachers training to develop tests, cases, case-measures for student evaluation Dr. med. Andreas Burger Zentrum für Medizinische Lehre in der Medizinischen Fakultät der Ruhr-Universität Bochum Arkhangelsk 02.02.2012 International Seminar On Quality Control Standards in Higher Medical School

2. The participants of the TEMPUS-IV-Projekt are on the top © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

3. –In Germany we have the Approbationsordnung –At the end of the education we want students who became a medical doctor well educated in scientific and practical medicine –We have to assess the knowledge, the ability and competences –The medical doctor should be enabled for further training and education by himself. What are the goals of medical education? © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

4. –PBL or traditional learning –What kind of curriculum H-Model Z- or N-Model Decisions the faculty has to make © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

5. Curriculum, educational methods and assessment have to build an unity Therfore it is necessary, that the teaching staff is educated in the methods of teaching and testing. © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

6. –Most people of the teaching staff in medical education have no knowledge about andragogics What is the problem to develop tests and paper cases? © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

7. –Foundation of MeDiBo –Founder and Cooperation-Partner of LAMA –Cooperation-Partner of the Internal Education and Development Department of the Ruhr-Univeristät Bochum –Cooperation-Partner of the chamber of medical doctors in NRW How did we solve the problem of teachers training in Bochum? © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

8. –The moduls are certificated by the Chamber of Medical Doctors of NRW LAMA the University –The Modules are recognized by the universities of Baden-Württemberg MeDiBo © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

9. –Offers 8 Modules –During Each Module there is a presence time of 12 hours and 12 hours homework –Total workload is about 24 h (if extended – 1ECTS) MeDiBo © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

10. Start in teaching the teachers staff in 2001/2 First Modules of MeDiBo started in 2006 Participants till now about 1200 (total), 50 got the LAMA-Certificate MeDiBo © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

11. The module of staff qualification in new assessment techniques according to interactive methods. (MeDiBo) The curriculum  the rules of the medical education in Germany, the Ärztliche Approbationsordnung (ÄAppO) and the required assessments.  common and innovative assessment tools  the guidelines of the GMA for assessments  the construction of different forms of assessments by theparticipants themselves at home the participants have to construct an assessment,the form they choose by themselves, of their medical discipline and a blueprint of this assessment. Qualification of the teaching staff © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

12. The evaluation of the module by: –the participants –the Chamber of Medical Doctors –the LAMA The evaluation of the homework is done by teachers MeDiBo © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

13. How to construct cases? Cases are needed for – Problem based learning (PBL) – Assessments (Modified Essay Question Test (MEQ), Multiple Choice Question Test (MCQ), Triple Jump Examination (TJE), Objective Structured Clinical Examination (OSCE)) © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

14. How to construct cases? The ZML (Centre of Medical Education) gives support for the construction of cases: A manual “How to construct cases” A manual “How to construct a module” Accompany the process © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

15. How to construct cases? For Problem Based Learning (PBL) The module with all of its contents is constructed by an interdisciplinary group which is involved during the module One case for one week The case must lead the students to the problems, which they can solve by the contents of the seminars, practical exercise and lectures during the week An interdisciplinary board reviews the case © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

16. How to construct cases? For Problem Based Learning (PBL) Review with regard to – the fitting with contents of learning goals – in order of guidelines – special problems in psychology or communication © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

17. How to construct cases? For Problem based learning (PBL) After the use in PBL there is a review – by the PBL-Tutor (a medical teacher) – by the students Then the P(lan)D(o)C(heck)A(ct)- circle starts again © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

18. How to construct cases? For assessments 6 - 8 cases for one MEQ 20 - 30 cases for integrated, interdisciplinary MCQ For each case it should be possible to develop 5 to 10 questions © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

19. How to construct cases? For assessments Review by the members of different disciplines with regard to –the fitting with the blueprint –in order of guidelines –to develop questions in a logical interdisciplinary follow up © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

20. How to construct cases? For assessments Follow up Review –by the examined students –by medical teachers of the first review © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

21. New philosophy Evaluation of the paper cases and the assessments by the students shows us, that there are a lot of competences among the students. Why shouldn’t we use them? © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012

22. You are not walking alone © Dr. med. Andreas Burger 2012 Teachers training to develop tests, cases, case measures for student evaluation Archangelsk2012