1. FOLIE 1 The Module Level Indicator an EQF-based Instrument for Equivalence Checks of Vocational and Higher Education Modules Dr. Wolfgang Müskens CvO University of Oldenburg

2. FOLIE 2 Vocational vs. Higher Education in Germany Bachelor (3 or 4 years) Certified senior clerk / Master craftsman „Fachwirt“ / „Meister“ Apprenticeship „Ausbildung“ (up to 3.5 years) age (approx.) 16 25 Master (1 or 2 years) (Technical) Business specialist „Betriebswirt“ higher education Secondary School 19 22 1 -3 years of work experience 1 – 3 years of work experience 30 vocational education Doctorate

3. FOLIE 3 Resolution of KMK* at 28 June 2002 “Knowledge and skills obtained outside higher education can be accredited towards a degree in the context of a – possibly also blanket – classification if they [...] are equivalent in content and level to the part of the degree programme that is to be replaced […].” (KMK, 2002). Legal basis of accreditation of prior vocational learning *) KMK – „Kultusministerkonferenz“: Standing Conference of the Ministers of Education and Cultural Affairs of the Länder in the Federal Republic of Germany

4. FOLIE 4 „Blanket“ Recognition Any holder of a certain qualification (e.g. Master craftsman, Certified senior clerk) gets exemption from equivalent university modules without further examination University (in coorperation with Chambers) check only one-time the equivalence of the vocational qualification and the programme of study at university („equivalence check“) University guarantees recognition for any holder of the vocational qualification Basic principles

5. FOLIE 5 Blanket recognition of non-higher-education qualifications Vocational qualification (e.g. master craftsman) Corresponding units of vocational qualification Bachelor in Business Administration Module (e.g. „Production“ or „Leadership“) Equivalence check Independend experts assess the extent to which the contents of the module are covered by learning outcomes of the vocational qualification whether the level of the learning outcomes and skills to be accredited corresponds to the level of the module Level Module Level Indicator (based on EQF) Content Learning Outcomes

6. FOLIE 6 Vocational vs. higher education Assessment of equivalence Module „Cost and results accounting“ in Bachelor- programme „Business Administration“ Uni OL Subject „ Cost and results accounting in the voc. ed. programme „Certified senior industrial clerk“ equivalent or not? An instrument to compare the levels of modules based on the EQF: Module Level Indicator (MLI) Basis: European Qualifications Framework for LLL (EQF)

7. FOLIE 7 Module Level Indicator Construction EQF for LLL German HE-Qualifications Framework EHEA-Framework Differentiated description of learning units by means of multiple dimensions Interviews with experts Reliable scales (according to classical test theory) Applicable to different modules different programmes of study different instructional designs and kinds of examination Construct validity (against direct ratings on EQF) Sources / basisFeatures Objectives 9 scales (Version 2.1) Possible raters: Lecturers Independent experts Students / alumni 5 to 10 items per scale Items refer to learning outcomes

8. FOLIE 8 Knowledge Module Level Indicator Scope and Actuality (.87) Critical appreciation (.95) Interdisciplinarity (.77) Skills Problem Solving (.62) Relation to Practice (.88) Competence Autonomy (.76) Communication (.81) Awareness of ethical and social issues (.89) Scales of the MLI and their reliability Innovation (.84) () – Internal consitency / Cronbach’s alpha, N=84

9. FOLIE 9 Scales of the MLI - Examples of Items Knowledge Module Level Indicator Scope and Actuality Critical appreciation Interdisciplinarity „The module contains at least some in-depth knowledge on the actual state of research within the domain.“ „The module provides an awareness for the limits of the knowledge acquired.“ „The module contains interdisciplinary topics, requiring knowledge from different domains.“ Skills Problem Solving Skills Relation to Practice „The learning objectives or examination questions require comprehensive cognitive of practical skills.“ „The module provides knowledge with immediate practical usability.“ © Carl-von-Ossietzky-University, Oldenburg, Wolfgang Müskens, 2007

10. FOLIE 10 Example of MLI results: Profile of a learning unit (subject)

11. FOLIE 11 Example of MLI results : Comparison of Senior Insurance Clerk and BA Business Administration module / learning unit MLI total scores yellow – Senior Insurance Clerk (voc.) blue – BA Business Admin. (HE)

12. FOLIE 12 Construct validity of the MLI Simple bivariate correlation between MLI and direct ratings on EQF: r=.80 (N=91)

13. FOLIE 13 Construct validity of the MLI Simple bivariate correlation between MLI and direct ratings on EQF: r=.80 (N=91) Non-linear regression (square model): r 2 =.70

14. FOLIE 14 Contact Arbeitsbereich Weiterbildung und Bildungsmanagement Carl-von-Ossietzky-Universität Oldenburg 26111 Oldenburg Germany http://www.web.uni-oldenburg.de/anrechnung Dr. Wolfgang Müskens wolfgang.mueskens@uni-oldenburg.de