Panel “Key performance indicators for Serbian higher education“ XXV Conference DEVELOPMENT TRENDS IN HE - TREND 2019: Quality of the Higher Education in Serbia Panel “Key performance indicators for Serbian higher education“ February 11th, 2019 Erasmus+ CBHE Project PESHES QUALITY OF HIGHER EDUCATION: WHY INDICATORS? Prof. Vera Dondur Aleksandar Jović peshes@ius.bg.ac.rs http://peshes.ius.bg.ac.rs/

Strategic goals The strategic goals of higher education according to the Strategy for the Development of Education in Serbia until 2020 are grouped within strategic directions through increasing the quality and conformity of study programs with the needs of the market as well as through increasing the efficiency of the study itself, increasing the availability of different types of study programs and modernizing the existing. Quality assurance adapted to the vision and priorities of each higher education institution will encourage greater diversity and specialization of higher education institutions and will promote greater cooperation by systematically embedding results in strategic decision making, with emphasis on sustained progress. And the important issue that arises in higher education institutions is actually the issue of long-term quality assurance.

Project goals For the purpose of this project we will present the possible road map for development and implementation of performance evaluation system for Serbian higher education institutions and system as whole. The idea is to provide the set of key performance indicators, model for evaluation and ranking of study programs, and institutions. This system could provide the number of benefits for different stakeholders. Measurement of performance and quality is very important for efficient planning, improvement and control, as well as decision making in organizations. Performance measurement results show the effects of strategy and potential organization capabilities. In order to achieve the goals, it is necessary to measure performance.

KPIs It is necessary to provide optimization of the indicators for study programs, institutions and HE, as well as to provide process of tuning of the indicators, definition of limits and scopes as well as to define values and limit for specific indicators. Preliminary sets of meaningful indicators have to be tested against feasibility of data collection and policy acceptance.

Guiding principles for KPIs Key performance indicators should: be relevant be statistically and methodologically rigorous be derived from high quality, objective data sources, and where possible collected at by an independent body, as well as not easily manipulated be as simple, transparent and explicable as possible have an explicit and consistently used definition be collected and analysed cost-effectively inform and encourage policy and practice at both the national and institution level

Purpose of KPIs 1. Primary role should be in monitoring and measuring HE performance ‘to provide an overview of Serbian HE’ to: HEIs, funding bodies/policy-makers, the public and students. 2. Performance based evaluation should be used in universities financing as a simulative, not as a punitive measure 3. The goal should be quality assurance, not a ranking of study programs or HEIs

What should we measure and who should we measure? KPIs process Results Goals Users Informations Internal External Database Generation KPIs Calculation What should we measure and who should we measure?

The question is how to construct meaningful KPIs? Non-profit HE institutions Profit HE institutions Serbia has three types of Higher Education Institutions (HEI): Universities, colleges of professional career studies and colleges of academic studies. Universities are the largest institutions. The status of university is granted if the institution offers academic study programs at all levels of studies, within at least three fields (natural sciences and mathematics, social and humanistic studies, medical science, technical and technological science, and arts). A university is composed of Faculties, Art Academies and sometimes Research institutes. The faculties are higher education institutions which carry out academic study programs and develop scientific, vocational, or artistic work in one or more areas. Faculties and art academies may also carry out vocational study programs. Faculties and art academies conduct legal affairs under the name of the university that they belong to, and under their own name, in accordance with the statute of the university. academic study programms vocational study programms study programms in: Natural sciences and mathematics, Social and humanistic studies, Medical science, Technical and technological science, Arts Institutional Key Performance Indicators

Composite or Aggregated Performance Indicators PESHES team propose composite quantitative performance measures in which a number of different numerical indicators are combined into a single group. Not too many indicators, only few (voice from the EUA at the University of Belgrade 210 Anniversary) clear and selected aims and objectives are necessary

KPIs Current and future challenges Legal framework -KPIs Specific KPIs : arts and humanities Data form sources in public domain Specific KPIs : Natural sciences and mathematics, Medical science, Technical and technological science, The number of Spin-off companies Exploitation of IP Genaration of database QUESTIONNAIRE Specific KPIs : Vocational HE Informations Internal External