ECA - Code for the selection of experts Rolf Heusser, Chairman of ECA Oslo, 14 February 2008

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 2 Presentation by Rolf Heusser 1.Codes of good practices for QAAs 2.ECA principles for selection of experts 3.Case study Switzerland 4.Open questions and conclusions

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 3 Codes of good practices for QAAs - Rationale Built upon shared experiences of QAAs Promote international consistency of external QA Guarantee reliable external QA procedures Increase transparency for HEIs and society Basis for external reviews of QAAs Necessary element for MR agreements

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 4 INQAAHE Guidelines of good practices (2007) Standard 8 Criteria QAAs must have specifications on the characteristics, selection and training of reviewers Non conflict of interest mechanism in work of experts; adequate training of experts; evidence based expert reports

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 5 European standards and guidelines (2005) Standard 4 (part II) Standards 6/8 (part III) Care in selection of experts; appropriate training of experts; international experts; participation of students Independency of agency in nomination and appointment of experts; non conflict of interest mechanism

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 6 ECA code of good practice (2004) Standard 15 Reference points The accreditation procedure must guarantee the independence and competence of the expert panels Criteria for selection of experts and for composition of expert panels; independency statements of experts

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 7 ECA – Principles for selection of experts (2005) Agreed procedures for the selection of experts: Based on policies of agency or legislation Selection criteria for experts must be published by the agency Independent and unbiased experts; disclosure of possible conflicts of interest; confidentiality statement Institutions have right to comment on selection of experts Accreditations decisions should be made by the relevant authority and not by the group of experts themselves Experts must be briefed adequately by the agency

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 8 ECA – Principles for composition of expert panels Expert panels have the following mix of expertise: Experience in quality assurance in higher education Appropriate academic qualifications and scientific or professional reputation in relevant area(s) Relevant international experience Knowledge on teaching and learning methods Expertise in development, design, provision and evaluation of higher education programmes Knowledge of the country-specific HE-system

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 9 ECA – Principles for composition of expert panels Specific for institutional accreditation: Expertise in institutional governance and management Leadership experience in research/academic management Commendable: Gender balance in the expert panel Student representatives Representatives from the labour market A significant proportion of experts from outside the country

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 10 ECA Road map to mutual recognition Activities/ToolsDate Inventory of accreditation systems2004 Mutual observations 2005 Code of good practice2004 Principles: selection of experts2005 Principles: accreditation of joint programmes2006 Common publication format/databank2007 In depth comparisons / joint projects 2006 Joint declaration ECA – ENIC/NARIC2006 External review of ECA members2007 Formal agreements of mutual recognition2007 Mutual understanding of accreditation organisations Mutual Recognition of accreditation procedures Mutual Recognition of accreditation results/ decisions

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 11 OAQ – Independency of experts Nomination of experts according to published selection criteria; investigations of agency Appointment of experts by scientific advisory board Majority of experts must work/live abroad HEI can object experts Declaration of independence and confidentiality of panel members

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 12 OAQ – Student participation in expert panels Until 2006: Limited student participation in external QA 2006: training of students ---> student expert pool built up in cooperation with Swiss student union 2007: accreditation guidelines ask for integration of students into all expert panels New law on Swiss higher education: students will become member of Swiss accreditation council (decision making body)

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 13 OAQ – Expert panels for institutional audits 4 international experts + 1 student member Leadership experience, QA experience, academic expertise according to profile of institutions Language of on site visit is free choice of HEI At least one expert of previous audit in the panel (continuity) Same panels for different Swiss universities

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 14 OAQ – Open questions about experts How to recruit renowned and experienced experts? How to verify independence of experts? Optimal balance between international and national experts? How to assure consistency of panel judgements? How to assure clarity of conclusions? Reimbursement of experts?

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 15 Conclusions Various codes of good practices have been established and are successfully implemented by QAA ECA has published commonly agreed principles for the selection of experts ---> can easily be adopted to various types of quality assessments Commonly agreed standards and principles are a necessary element for MR agreements among agencies and contribute to the convergence of the EHEA There are many open questions about selection and work of reviewers ---> continuous exchange among QAA necessary

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003 Heusser / Oslo / 2008 | 16