1. External Quality Assurance 2017 – New Approach and New Opportunities
NCEQE conference “New Approaches in Educational Quality Assessment”,
Tbilisi, April 13th, 2017
Dr Achim Hopbach
Managing Director, AQ Austria

2. Relaunch of external quality assurance procedures – key aspects
Twofold purpose of external quality assurance (in accordance with ESG Principles)
Assure compliance with standards
Support the development of HEIs

3. Relaunch of external quality assurance procedures – key aspects
External QA takes into account the internal QA of HEIs
Information/results of internal QA as important source for external QA
HEI’s QA-activities in the focus
Strengthening institutional capacity

4. Relaunch of external quality assurance procedures – key aspects
New roles of SAR and Site-Visit
Presentation of Effectiveness of HEI’s QA activities
Dialogue of experts on both sides
Students and international experts on panels
Publication of expert evaluation reports
Follow-up

5. The “new” process - overview
HEI
NCEQE
Submission of SAR
Appointment of experts
Pre-check
Preparatory meeting of experts
Site-Visit
Expert-Evaluation-Report
Comments on the Report
Decision by Authorization/ Accreditation Council
Publication of Report
Follow-up

6. The “new” process - overview
HEI
NCEQE
Submission of SAR

7. The Self-Assessment Report
The HEI demonstrates and explains why and how the standard are complied with.
This needs
Evidence (incl. the requested documents)
Explanation (Analysis)
Reference to own benchmarks
The SAR as result of self-evaluation
Task for the whole institution

8. The “new” process - overview
HEI
NCEQE
Submission of SAR
Appointment of experts

9. The Panel of Experts NCEQE runs a “new” register of experts
Defined qualifications as entry-requirements
Academics, Students, Labor market experts
Particular background but assess all 7 standards
Mandatory training and professional development

10. The Panel of Experts NCEQE appoints a chair
Students and Labor market experts, also international experts
NCEQE appoints a staff member as panel secretary

11. The “new” process - overview
HEI
NCEQE
Submission of SAR
Appointment of experts
Pre-check

12. The “Pre-check” Panel secretary does a pre-check of the SAR
Is it complete?
Is it legible?
Aim: Avoid processes that fail because of lack of information.
If any shortcomings are observed the panel secretary will give a deadline to resubmit additional material.

13. The “new” process - overview
HEI
NCEQE
Submission of SAR
Appointment of experts
Pre-check
Preparatory meeting of experts

14. The Preparatory Meeting of Experts
Expert panel and panel secretary meet electronically approx. 3-4 weeks before the site visit in order to discuss:
the first impression of the self assessment report
the purpose of the site visit
whether additional documentation needs to be requested to be provided at the site visit
lines of inquiry for the site visit
the programme of the site visit
the roles and responsibilities of expert panel members
the structure of the expert evaluation report

15. The “new” process - overview
HEI
NCEQE
Submission of SAR
Appointment of experts
Pre-check
Preparatory meeting of experts
Site-Visit

16. The Site-Visit Key objectives:
to explore compliance with the standards
to discuss the state of development of the HEI
(It’s more than document analysis!)
Experience shows that, even if SAR are produced carefully, not all necessary information is clear.
Interview sessions during the site visit as important source of information in addition to the self assessment report.

17. The “new” process - overview
HEI
NCEQE
Submission of SAR
Appointment of experts
Pre-check
Preparatory meeting of experts
Site-Visit
Expert-Evaluation-Report

18. The Expert-Evaluation-Report
Pupose:
Basis of the authorization decision or accreditation decision
Source of information for the HEI for its consolidation and further development.
Structure:
General information on the HEI
Overview of the process
Brief conclusive report on compliance with standards

19. The Expert-Evaluation-Report
Each standard is discussed in a separate chapter which includes:
EVIDENCE: General overview of the situation and a short description of the evidence gathered
ANALYSIS: Evaluation of the compliance with the standards
ASSESSMENT: Judgement on compliance
RECOMMENDATIONS, indicating ways for considering these recommendations
GOOD PRACTICES

20. The “new” process - overview
HEI
NCEQE
Submission of SAR
Appointment of experts
Pre-check
Preparatory meeting of experts
Site-Visit
Expert-Evaluation-Report
Comments on the Report

21. Comments on the Report
HEI might give comments on the factual conditions described in the draft report if it wishes so.
Within 10 calendar days HEI submits to the Center the written position which is then sent to the panel of experts, and relevant authorization/accreditation council.

22. The “new” process - overview
HEI
NCEQE
Submission of SAR
Appointment of experts
Pre-check
Preparatory meeting of experts
Site-Visit
Expert-Evaluation-Report
Comments on the Report
Decision by Authorization/
Accreditation Council

23. Decision by Authorization/Accreditation Council
The council decides after an oral hearing, where it presents the case, the HEI might give comments if it wishes so, and the panel gives explanations if requested.

24. The “new” process - overview
HEI
NCEQE
Submission of SAR
Appointment of experts
Pre-check
Preparatory meeting of experts
Site-Visit
Expert-Evaluation-Report
Comments on the Report
Decision by Authorization/ Accreditation Council
Publication of Report

25. Publication of Report Purpose
Strengthening public accountability of HEI
Supporting trust

26. The “new” process - overview
HEI
NCEQE
Submission of SAR
Appointment of experts
Pre-check
Preparatory meeting of experts
Site-Visit
Expert-Evaluation-Report
Comments on the Report
Decision by Authorization/ Accreditation Council
Publication of Report
Follow-up

27. Follow-up
Follow-up report by HEI and Site-Visit on standards which are partial compliant
Prevents negative decisions
Supports ongoing quality enhancement

28. How to make use of the new opportunities?
Shared responsibility of HEIs, NCEQE and stakeholders!
Create a common understanding of purpose of external QA
Create a common understanding of quality
All partners have to accept their roles in QA!
Collaboration is key!

29. Achim Hopbach