1 Quality Assurance in VET M. Kirsch & Y. Beernaert Quality Assurance and Accreditation in VET Magda Kirsch & Yves Beernaert Bulgaria – September /October trainings

2 Quality Assurance in VET M. Kirsch & Y. Beernaert References –'Copenhagen Process ‘, Quality Assurance in VET, Technical Working Group Progress Report, December 2004 – ,%20Opening%20Ceremony%20Copenhagen%20 process%20and%20European%20co-operation.pdf, ,%20Opening%20Ceremony%20Copenhagen%20 process%20and%20European%20co-operation.pdf –Lise-Lotte Ravnmark, ‘ An European Guide on Self- assessment for VET providers ’, September 2003.

3 Quality Assurance in VET M. Kirsch & Y. Beernaert Rationale Quality assurance and development in Vocational Education and training (VET) is a key instrument in supporting the transition to a knowledge-based society, namely by increasing the effectiveness of VET ‘ outcomes ’ in terms of improving the match between demand and supply, employability, and access to training. Furthermore, its role is crucial in increasing mutual trust in training provision in the European Union, and thereby supporting mobility and lifelong learning.

4 Quality Assurance in VET M. Kirsch & Y. Beernaert Growing importance of QA Definition Assessment is nowadays interpreted more broadly to denote a process of gathering and processing of relevant, sound and reliable data so as to enable the parties concerned to take the necessary decisions in order to improve actions and results.

5 Quality Assurance in VET M. Kirsch & Y. Beernaert Growing importance of QA Detailed Workprogramme E&T 3 strategic objectives: 1. Improving the quality and effectiveness of education and training systems in Europe 2. Facilitating access of all to education and training systems 3. Opening up education and training systems to the wider world

6 Quality Assurance in VET M. Kirsch & Y. Beernaert Growing importance of QA Detailed Workprogramme E&T 1. Improving the quality and effectiveness of education and training systems in Europe 1.1. Improving education and training for teachers and trainers 1.2.Developing skills for the knowledge society 1.3. Ensuring access to ICT for everyone 1.4. Increasing the recruitment to scientific and technical studies 1.5. Making the best of resources

7 Quality Assurance in VET M. Kirsch & Y. Beernaert Common Quality Assurance Framework (CQAF) Developed as an outcome of cooperative work on Quality Assurance between the Commission, the MS, social partners, the EEA – EFTA and the candidate countries, through consensus building and stock taking from the experiences of MS. Designed to support the development and, where necessary, the reform of quality systems in VET, in MS. Provides a common reference system and concrete reference tools to help MS and participating countries to improve, monitor and evaluate their own policies and practices in the field of QA.

8 Quality Assurance in VET M. Kirsch & Y. Beernaert Common Quality Assurance Framework (CQAF) The CQAF consists of four features: –a model, to approach quality assurance and development of VET provision at the appropriate levels in Member States; –a method for assessment and review: the emphasis has been given to self assessment, combined with external evaluation; –a monitoring system: to be identified as appropriate at national or regional level, and possibly combined with voluntary peer review at European level; –a measurement tool: a set of reference indicators aiming at facilitating Member States to monitor and evaluate their own systems at national, regional or local levels.

9 Quality Assurance in VET M. Kirsch & Y. Beernaert Common Quality Assurance Framework (CQAF) The model comprises four interrelated elements: · Planning · Implementation · Evaluation and assessment  Review  These elements constitute the quality cycle (PDCA), and for each one of these, as well as for the methodology, which is a transversal dimension of all of them, core quality criteria have been commonly agreed.

10 Quality Assurance in VET M. Kirsch & Y. Beernaert Common Quality Assurance Framework (CQAF)

11 Quality Assurance in VET M. Kirsch & Y. Beernaert Common Quality Assurance Framework (CQAF) Assessment and review –Self-assessment, combined with periodic external monitoring by an independent and appropriate third party body, has been considered as a relevant method/tool to assess and evaluate quality, and to ensure and develop quality at system and provider levels. –The TWG has devised sample self-assessment guidelines for both levels, as a European guide.

12 Quality Assurance in VET M. Kirsch & Y. Beernaert Common Quality Assurance Framework (CQAF) Monitoring systems –Mechanisms and procedures are to be identified as appropriate at national or regional level, as they are part of the regulation function in governance and can be as diverse as the national systems, sub-systems and institutions themselves. The measurement of quality and its components –Key issue in quality management. –The CQAF proposes a common set of indicators to measure and assess the quality of VET.

13 Quality Assurance in VET M. Kirsch & Y. Beernaert QA -A three-step approach Internal quality control, which results in self-evaluation External visitation, which results in a public report Accreditation

14 Quality Assurance in VET M. Kirsch & Y. Beernaert Why External QA? safeguarding of national educational standards for VET accreditation of programmes and/or institutions; user protection; public provision of independently-verified information (quantitative and qualitative) about programmes or institutions;/centres improvement and enhancement of quality.

15 Quality Assurance in VET M. Kirsch & Y. Beernaert HOW do we carry out external QA ? Step 1: Criteria and procedures In order to ensure clarity of purpose and transparency of procedures, external quality assurance methods should be designed and developed through a process involving key stakeholders, Criteria for decisions: Any formal decisions made as a result of an external quality assurance activity should be based on explicit published criteria that are applied consistently.

16 Quality Assurance in VET M. Kirsch & Y. Beernaert HOW do we carry out external QA ? Step 2: Set up expert commissions in vocational areas Expert commissions are set up to conduct an external assessment by a group of experts, including experts from the vocational area that is being assessed, These expert commission members should be representative in their field, so that decisions taken are acceptable for all parties concerned.

17 Quality Assurance in VET M. Kirsch & Y. Beernaert HOW do we carry out external QA ? Step 3: Preparation of the on-site visit –Is there a need for the qualification or course that will be licensed or accredited. ? –Investigating number of key documents such as: 1) existence of mission, vision of the school 2) a number of data such as teacher qualifications, success rate of the pupils or trainees 3) quality of examinations 4) programme brochures, etc.

18 Quality Assurance in VET M. Kirsch & Y. Beernaert HOW do we carry out external QA ? Step 4: The on-site visit The main purpose of the on-site visit is to check whether the data provided are accurate and whether the buildings and facilities meet the existing requirements. Therefore Interviews with Director, teachers, trainees, admin. staff, employers, parents, management board etc. Visit of the facilities, inspection of materials and equipment.

19 Quality Assurance in VET M. Kirsch & Y. Beernaert HOW do we carry out external QA ? Step 5. The review report –A secretary should be appointed to write the report. He/she needs to prepare the draft report of the external review meeting(s) and the on-site visit. –External review not in view of accreditation: Main part: advice to enhance quality –External review in view of accreditation: Main part: motivation of scores given

20 Quality Assurance in VET M. Kirsch & Y. Beernaert HOW do we carry out external QA ? Step 6. Accreditation –Procedures should be clear –Results of accreditation procedures should be open The Managing Board of NAVET will make decisions on accreditation or licensing on the basis of the reports of expert commissions. Thereupon it will inform the Ministry of Education and Science about the licensed vocational training centres and vocational information and career guidance centres as well as about the accredited institutions within the vocational education and training system;

21 Quality Assurance in VET M. Kirsch & Y. Beernaert HOW do we carry out external QA ? Step 7: Follow-up Quality assurance processes should have a predetermined follow-up procedure which is implemented consistently. External quality assurance of institutions and/or centres should be undertaken on a cyclical basis.

22 Quality Assurance in VET M. Kirsch & Y. Beernaert European standards for external Quality Assurance Agencies 1. Use of external QA procedures for education: The external QA of agencies should take into account the presence and effectiveness of the external QA processes described. 2 Official status: Agencies should be formally recognised by competent public authorities in the country/countries concerned 3 Activities: Agencies should undertake external QA on a regular basis. 4 Resources: Agencies should have adequate and proportional resources, both human and financial, to enable them to organise and run their external QA. 5 Mission statement: Agencies should have clear and explicit goals and objectives for their work, contained in a publicly available statement. 6 Independence: Agencies should be independent to the extent that the conclusions and recommendations made in their reports cannot be influenced by third parties such as institutions, centres, ministries or other stakeholders. 7 External QA criteria and processes used by the agencies: The processes, criteria and procedures used by agencies should be pre- defined and publicly available. 8 Accountability procedures: Agencies should have in place procedures for their own accountability

23 Quality Assurance in VET M. Kirsch & Y. Beernaert Trends in QA in VET Stakeholder involvement in QA procedures –In Sweden specific initiatives to increase quality in VET, for improving cooperation between the school and the local industry. –In Flanders experts from the sectors concerned are involved in as well self-evaluation as external evaluation of Professional Bachelor Programmes –In France development of qualifications in VET as well as QA is largely sector-based –IN BG procedures for evaluation are agreed with social partners and ministries, and accepted at the NAVET`s Executive Council –In many countries students are involved, not only in internal but also external evaluation of schools, colleges.

24 Quality Assurance in VET M. Kirsch & Y. Beernaert Trends in QA in VET Benchmarking –Achievements of schools, colleges, universities are set against against national data on learner achievements and other core performance indicators –Therefore several countries developed measurement tools (success measures) which can be applied to evaluate performance. The common set of measures includes a.o.: learner success rates; employer engagement; staff qualifications; learner satisfaction etc.

25 Quality Assurance in VET M. Kirsch & Y. Beernaert Thank you for your attention!

26 Quality Assurance in VET M. Kirsch & Y. Beernaert Quality Assurance and Accreditation in the Flemish Community of Belgium and the Netherlands A case study