External Quality Assurance 2017 – New Approach and New Opportunities NCEQE conference “New Approaches in Educational Quality Assessment”, Tbilisi, April 13th, 2017 Dr Achim Hopbach Managing Director, AQ Austria

Relaunch of external quality assurance procedures – key aspects Twofold purpose of external quality assurance (in accordance with ESG Principles) Assure compliance with standards Support the development of HEIs

Relaunch of external quality assurance procedures – key aspects External QA takes into account the internal QA of HEIs Information/results of internal QA as important source for external QA HEI’s QA-activities in the focus Strengthening institutional capacity

Relaunch of external quality assurance procedures – key aspects New roles of SAR and Site-Visit Presentation of Effectiveness of HEI’s QA activities Dialogue of experts on both sides Students and international experts on panels Publication of expert evaluation reports Follow-up

The “new” process - overview HEI NCEQE Submission of SAR Appointment of experts Pre-check Preparatory meeting of experts Site-Visit Expert-Evaluation-Report Comments on the Report Decision by Authorization/ Accreditation Council Publication of Report Follow-up

The “new” process - overview HEI NCEQE Submission of SAR

The Self-Assessment Report The HEI demonstrates and explains why and how the standard are complied with. This needs Evidence (incl. the requested documents) Explanation (Analysis) Reference to own benchmarks The SAR as result of self-evaluation Task for the whole institution

The “new” process - overview HEI NCEQE Submission of SAR Appointment of experts

The Panel of Experts NCEQE runs a “new” register of experts Defined qualifications as entry-requirements Academics, Students, Labor market experts Particular background but assess all 7 standards Mandatory training and professional development

The Panel of Experts NCEQE appoints a chair Students and Labor market experts, also international experts NCEQE appoints a staff member as panel secretary

The “new” process - overview HEI NCEQE Submission of SAR Appointment of experts Pre-check

The “Pre-check” Panel secretary does a pre-check of the SAR Is it complete? Is it legible? Aim: Avoid processes that fail because of lack of information. If any shortcomings are observed the panel secretary will give a deadline to resubmit additional material.

The “new” process - overview HEI NCEQE Submission of SAR Appointment of experts Pre-check Preparatory meeting of experts

The Preparatory Meeting of Experts Expert panel and panel secretary meet electronically approx. 3-4 weeks before the site visit in order to discuss: the first impression of the self assessment report the purpose of the site visit whether additional documentation needs to be requested to be provided at the site visit lines of inquiry for the site visit the programme of the site visit the roles and responsibilities of expert panel members the structure of the expert evaluation report

The “new” process - overview HEI NCEQE Submission of SAR Appointment of experts Pre-check Preparatory meeting of experts Site-Visit

The Site-Visit Key objectives: to explore compliance with the standards to discuss the state of development of the HEI (It’s more than document analysis!) Experience shows that, even if SAR are produced carefully, not all necessary information is clear. Interview sessions during the site visit as important source of information in addition to the self assessment report.

The “new” process - overview HEI NCEQE Submission of SAR Appointment of experts Pre-check Preparatory meeting of experts Site-Visit Expert-Evaluation-Report

The Expert-Evaluation-Report Pupose: Basis of the authorization decision or accreditation decision Source of information for the HEI for its consolidation and further development. Structure: General information on the HEI Overview of the process Brief conclusive report on compliance with standards

The Expert-Evaluation-Report Each standard is discussed in a separate chapter which includes: EVIDENCE: General overview of the situation and a short description of the evidence gathered ANALYSIS: Evaluation of the compliance with the standards ASSESSMENT: Judgement on compliance RECOMMENDATIONS, indicating ways for considering these recommendations GOOD PRACTICES

The “new” process - overview HEI NCEQE Submission of SAR Appointment of experts Pre-check Preparatory meeting of experts Site-Visit Expert-Evaluation-Report Comments on the Report

Comments on the Report HEI might give comments on the factual conditions described in the draft report if it wishes so. Within 10 calendar days HEI submits to the Center the written position which is then sent to the panel of experts, and relevant authorization/accreditation council.

The “new” process - overview HEI NCEQE Submission of SAR Appointment of experts Pre-check Preparatory meeting of experts Site-Visit Expert-Evaluation-Report Comments on the Report Decision by Authorization/ Accreditation Council

Decision by Authorization/Accreditation Council The council decides after an oral hearing, where it presents the case, the HEI might give comments if it wishes so, and the panel gives explanations if requested.

The “new” process - overview HEI NCEQE Submission of SAR Appointment of experts Pre-check Preparatory meeting of experts Site-Visit Expert-Evaluation-Report Comments on the Report Decision by Authorization/ Accreditation Council Publication of Report

Publication of Report Purpose Strengthening public accountability of HEI Supporting trust

The “new” process - overview HEI NCEQE Submission of SAR Appointment of experts Pre-check Preparatory meeting of experts Site-Visit Expert-Evaluation-Report Comments on the Report Decision by Authorization/ Accreditation Council Publication of Report Follow-up

Follow-up Follow-up report by HEI and Site-Visit on standards which are partial compliant Prevents negative decisions Supports ongoing quality enhancement

How to make use of the new opportunities? Shared responsibility of HEIs, NCEQE and stakeholders! Create a common understanding of purpose of external QA Create a common understanding of quality All partners have to accept their roles in QA! Collaboration is key!

Achim Hopbach www.aq.ac.at achim.hopbach@aq.ac.at