Quality Assurance MENTEP Yves Beernaert, Educonsult By Yves Beernaert, Educonsult 13 April 2015

What is QA / evaluation about? “Research determines what can be done, needs assessment determines what should be done, and evaluation determines how well something are being done and can be jointly improved. “Evaluation uses a systematic method for collecting, analyzing, and using information to work on the relevance, the efficiency, the effectiveness, the impact and the sustainability of a project “

Objectives of QA Assess the quality and relevance of: - activities and processes / meetings / deadlines/ relations implemented - deliverables, outputs or results - dissemination / exploitation / valorisation actions taken by the project - sustainability activities of the project in the post EC funding period; Identify key success and failure factors of the overall project; Propose measures that will improve efficient & effective project delivery In interaction with the PT colleagues dealing with QA self scan activities

Key characteristics of QA ‘Right first time approach’ Support to partners Valuing activities and Prevention rather than control Shared responsibility approach Formative and summative evaluation Based on Deming Cycle: PDCA: Plan, Do, Check, Act / Amend Use of KPI: Key Performance Indicators

Key elements of QA Relevance Objectives of the Erasmus + programme Efficency Input / output; efficient use of time, money Information management system / procedures/ relations Effectiveness extent to which project objectives are reached Impact on target audiences/ beneficiaries/ policies Sustainability Valorisarion, dissemination, exploitation, future Development / implmentaion sustainability strategy

Evaluation tools Attending meetings partner meetings, possibly scientific committee meeting, coordinator’s meeting KPI - Key Performance Indicators - agreed between partners Evaluation questionnaire for each partner meeting Report of analysis A PRE questionnaire (online) : after 6 months A POST questionnaire (online): in final 6 months of project Interviews with all the partners and the coordinator: checklist Report of interviews Analysis of the deliverables and activities Comments in intermediate and final report

Reporting Evaluation report after every partner meeting Annual intermediate reports With integration of PRE or POST questionnaire results Interviews reports Results of analysis of deliverables / activities Sustainability strategy Overall final report at end of the project

Calendar QA activities Educonsult QA plan drafted in the next months PRE and POST questionnaire Proposal of some KPI Evaluation Kick-off meeting: report end of June 2015 Gradual implementation of all other activities up from September 2015 Sending out PRE questionnaire around end of 2015 Interviews with partners: Spring 2016 1st intermediate report: before2015 submission intermediate report by coordinator to Commission 2nd intermediate report: before2016 submission intermediate report by coordinator to Commission Sending out POST questionnaire in final phase MENTEP Final report MENTEP (final quarter of project)

Thanks for your attention Good luck with the MENTEP project Questions?