OUTCOMES, METHODS AND EVALUATION OF INDIVIDUAL COURSES, CENTRAL TO THE MA PROGRAM Nebojša Majstorović and Marija Zotović University of Novi Sad, Faculty of Philosophy, Department of Psychology TEMPUS SHESPSS Strengthening Higher Education for Social Policy making and Social Services delivery Curricular Reform TEMPUS RS-TEMPUS-JPCR

Goal of the session  The overall objective is to evaluate learning outcomes of prepared syllabi within MA programs from each University (UBG, UNI and UNS).  Specific objectives of the session: 1. To estimate learning outcomes of selected syllabi in each of 3 MA programs according to the methodology derived from Bloom’s taxonomy, 2. To estimate methods and modes of evaluation, 3. To present findings to all participants of the session, to discuss them and to provide conclusions.

Goal of the session  Working material consists of three MA curriculums with syllabi of different number of courses:  From UBG – syllabi for 7 courses  From UNI – syllabi for 21(27) courses  From UNS – syllabi for 9 courses  Each partner brings and present certain number of syllabi.  How many of them? To evaluate the whole program?

Method of work  Steps: 1. Workshops participants to be divided into three groups – mixed group members with at least one participant to present selected syllabi from his/her home University, 2. To select 1-2 syllabi to analyze or the whole program 3. To evaluate learning outcomes according to Bloom’s taxonomy – Bloom’s Wheel

Method of work - Bloom’s Wheel

Method of work Which descriptors of learning outcomes should be taken into consideration? Proposed methodology from the Morning session!  Learning outcomes to be estimated according to the template applied by UNI group, i.e.,:  Cognitive: 1. Knowledge and understanding 2. Application of knowledge 3. Analysis and synthesis 4. Evaluation  Affective outcomes?

Method of work – UNI template? Learning outcomesUNI Master SW (5 years) KNOWLEDGE & UNDERSTANDING APPLICATION OF KNWLEDGE ANALYSIS AND SYNTHESIS EVALUATION

Theoretical background of UNI template  Revised list of outcomes according to Anderson et al. (2000).

Method of work  Syllabus elements’ alignment template provided in workshop material: 1. More of LEARNING OUTCOMES (?): 1. KNOWLEDGE & UNDERSTANDING 2. APPLICATION OF KNOWLEDGE 3. ANALYSIS AND SYNTHESIS 4. EVALUATION 5. More of affective domain (organization, internalization)? 2. COURSE CONTENTS: (given in the Syllabus, isn’t it?) 3. TEACHING METHODS: 4. ASSESSMENT:

Group work  Quick ‘’making a team’’ process: 1. Forming, (making 3 or more mixed groups and to follow one principle - at least one from the home University for a given MA program syllabus) 2. Storming, (‘’how to’’ discussion should lead to three steps in group work: to learn the method, conduct the program evaluation, discuss and report on findings, all in around 30 minutes of time frame) 3. Norming, (to apply the same evaluation methodology – matrix in all groups) 4. Performing (conducting the learning outcomes evaluation and discussing issues), and 5. Adjourning (reporting on findings and terminating membership).

Next steps  Groups’ reports  15 minutes per group speaker  Discussion - all groups.  Conclusions on critical issues.  Closure.

Next step Coffee break !!!