INTOSAI WORKING GROUP ON KEY NATIONAL INDICATORS Development of KNIs in Italy. A focus on the last Corte dei conti’s report on the University System Rome, 27 – 29 March 2018

The UN 2030 Agenda has set out 17 Sustainable Development Goals (SDGs) relating to various areas of critical importance for progress and prosperity. Their implementation involves all countries and all political and institutional stakeholders acting in collaborative partnership. The SDGs respond to the need to foster universal peace and freedom, to eradicate poverty in all its forms and dimensions, and to achieve substantial improvements, in terms of personal security, well-being and justice, in the three dimensions of sustainable development: the economic, social and environmental. Rome, 27 – 29 March 2018

The SDGs indicators were developed through a political agreement in the global community to measure progress against its values, priorities and goals. On this basis, a number of SDGs indicators have been utilized in almost all the experiences developed in recent years at both the national and supranational levels. Italy played an important role in all phases of the negotiations that led to adopt the UN 2030 Agenda. It served as the vice-president of the preparatory Committee of the Rio Conference + 20 (held in Rio de Janeiro in 2012), it took part in the SDGs Working Group and took the lead in the European Union context. Rome, 27 – 29 March 2018

The Italian National Institute of Statistics (ISTAT) is fully involved in this context. Even before the UN agenda 2030, it had already developed a set of "Equitable and Sustainable Well-being" - BES indicators, in 12 domains, to monitor progress of national well-being. Although different in number and scope, the BES indicators cover the same areas as the SDGs indicators. Rome, 27 – 29 March 2018

Recently, the BES indicators have also been included in the process of economic planning. In the aftermath of the economic and financial crisis, the Italian authorities recognized that the economic policy needed to go beyond a merely financial approach and take on commitments to define policies in a way that improves specific areas of citizens’ quality of life and is sustainable for future generations. Rome, 27 – 29 March 2018

Therefore, in 2016, the Italian Parliament approved, by a large majority, the introduction of indicators of equitable and sustainable well-being in the budgetary cycle (BES indicators). The reform (Law 163 of 2016) mandated the Government to monitor the trend of the BES indicators in the preceding three years and to predict their movements for the following three years, in a “no policy changes” scenario, as well as in the light of new program decisions. Those indicators needed to be selected by an ad hoc Group, after consultation with the appropriate Parliamentary committees. Rome, 27 – 29 March 2018

However, pending final selection, the Government decided to anticipate, on an experimental basis, the inclusion of a first group of BES indicators in the budget process, starting from the Economic and Financial Document (DEF) for 2017. With this decision, Italy was the first country in the European Union and the G7 to introduce in its documents of macro-economic planning - in addition to Gross Domestic Product (GDP) and other «monetary value» indicators – some indicators of equitable and sustainable well-being, to measure not only economic performance, but also social progress. Rome, 27 – 29 March 2018

The Italian DEF for 2017 identified four indicators that were considered as particularly relevant for the quality of life of individual citizens and for the society as a whole: the average available income, a measure of inequality, the unemployment rate and the greenhouse gas emissions.    For each of these four indicators, the DEF presented the performance of the past three years, the performance that is foreseeable in the existing policy scenario and the one that can be expected in a scenario with new policy decisions. Rome, 27 – 29 March 2018

Also the Budget Law for 2017 was drafted in the light of the objectives of the 2030 Agenda. The Ministry of Environment and the Ministry of Economic Development established short and long-term priorities, related to the diversification of energy sources and the development of infrastructure. Local authorities were involved in this context, for example, the mayors of the metropolitan cities have signed an agreement aiming to achieve some of the goals related to the environment safeguard. Rome, 27 – 29 March 2018

In the academic context, the Italian Alliance for Sustainable Development (ASviS) was established in February 2016, upon the initiative of the Unipolis Foundation and the University of Rome “Tor Vergata” to raise the awareness of the Italian society, economic stakeholders and institutions about the importance of the 2030 Agenda for Sustainable Development, to mobilize them in order to achieve the Sustainable Development Goals (SDGs) and to spread a wider knowledge of current and future expected trends in relation to the SDGs. Rome, 27 – 29 March 2018

VAT Working Group Core Group1 Meeting GG/MM/AAAA This Alliance already brings together over 180 of the most important civil society institutions and networks, such as: associations representing social partners (businesses, trade unions and third sector associations); networks of civil society associations pursuing specific goals (in health, education, employment, environment quality, gender equality, etc.); associations of local administrations; public and private universities and research centers; associations of stakeholders working in the fields of culture and information; foundations and networks of foundations; Italian organizations that are members of international networks dealing with the SDGs. Dee Rome, 27 – 29 March 2018

VAT Working Group Core Group1 Meeting GG/MM/AAAA This presentation focuses on one of the indicators included in the UN 2030 Agenda - the Quality Education (SDG n. 4), which is aimed to ensure inclusive and equitable education and promote lifelong learning opportunities for everybody. In Italy, these objectives are taken into consideration by a specific BES domain, which has a similar scope to SDG indicator n. 4. Dee Rome, 27 – 29 March 2018

Increasing the degree of competences through education and training affects the well-being of individuals and opens up opportunities otherwise precluded. People with higher levels of education have higher standards of living and more opportunities to find a work; they live longer and better because they have healthier lifestyles and are more likely to work in less risky environments. Furthermore, higher levels of education and training correspond to higher levels of access and enjoyment of goods and cultural services, and lead to active participation in the production process in cultural and creative sectors. Rome, 26 – 29 March 2018

The “Education and training” domain basically covers four areas: 1. Formal education. Provided in schools and universities, it is the main pillar of competences that people acquire during lifetime. The educational attainment can be considered as a proxy of the stock of human capital available in a country. 2. Long-life learning. People continue to acquire competences throughout their life, especially at work but also through the activities carried out during their free time. The participation of adults in training activities is a key-factor in improving their competences. Rome, 27 – 29 March 2018

3. Levels of competences. The educational attainment gives an idea of the potential in terms of human capital but it does not tell anything on the real competences of the population; for this reason, it is necessary to measure the competences actually acquired and their impact on the individual well-being. 4. Cultural participation. It represents an important source of "random learning”, in continuity with formal education and training and with a direct and positive effect on the degree of life satisfaction. Rome, 27 – 29 March 2018

To show the relevance of the SDGs related to Quality Education, one can emphasize that the Budget Law for 2017 ha provided for equal access to be ensured by 2030, to all women and men, to affordable, high-quality education, including professional and higher education. With this objective in mind, access to university for students from low-income families will be facilitated by acting on student contributions (+40 million euro in 2017 and +85 million euro as from 2018), and by increasing the State Supplementary Fund for scholarships, which provides financial aid to disadvantaged students (+50 million euro as from 2017), merit-based scholarships (+21 million) and pre-university orientation (+5 million as from 2017). The regional system for the right to education will also be strengthened. Rome, 27 – 29 March 2018

One of the fundamental areas of well-being, in the meaning of “better conditions for individual life”, in connection with sustainable development, is the investment in human capital, and in particular the system of higher studies. Precisely on this issue - the university education and the associated opportunities - the Italian Corte dei conti has recently issued a special report (n. 11/2017), which deserves further examination in the context of this presentation. This report, while considering the new model of governance, the reform of the accounting system and the funding mechanism, highlights the specific interventions related to quality and efficiency of the educational offer and the right to education within the Italian university system. Rome, 27 – 29 March 2018

The Italian university system is based on 61 State universities. As for the educational offer, in the academic year 2015- 2016 there were 4,586 courses, out of which 2,225 for three- year degree, 2,015 for master degree (3 years + 2 years) and 316 for five-year single cycle. In the same academic year, there were 245 courses totally done in English and 65 courses partly done in English. The number of new students in the academic year 2015- 2016 increased after years of continuous decline. They were 276,000 (+2% compared to the previous academic year). The total number of students was 1,671,237 in both the State and private universities (see table n.1). Rome, 27 – 29 March 2018

Total number of students UNIVERSITIES AND NUMBER OF STUDENTS TABLE N. 1 Type Institutions Total number of students State Universities 61 1.504.338 Big 12 713.672 Medium 26 586.356 Small 23 204.310 Private 30 166.899 3 72.661 27 94.238 ITALY 91 1.671.237 Source: Corte dei conti on data of the Ministry for education Rome, 27 – 29 March 2018

The reform introduced by law n The reform introduced by law n. 240 of 2010 is aimed to increase efficiency and effectiveness by recognizing a higher degree of autonomy to universities including when it comes to establish the typologies of study courses (degree and master degree). This triggered a gradual process of rationalization of the educational offer. Rome, 27 – 29 March 2018

Geographical distribution This rationalization is shown by the number of study courses, which decreased after the reform (table n. 2). NUMBER OF COURSES AND GEOGRAPHICAL DISTRIBUTION Geographical distribution Degree Courses 2011/12 2012/13 2013/14 2014/15 2015/16 NORTH Three-year degree 988 984 989 971 968 Master degree 853 851 870 863 875 Single cycle 118 121 119 Total 1.959 1.953 1.980 1.962 CENTER 656 633 613 598 589 552 536 540 535 73 75 79 78 1.281 1.244 1.232 1.211 1.208 SOUTH 707 720 732 698 599 600 596 111 117 116 1.416 1.436 1.450 1.419 ITALY 2.351 2.337 2.334 2.276 2.255 II livello 2.003 1.986 2.010 1.994 2.015 302 310 318 313 316 4.656 4.633 4.662 4.583 4.586 Source: Corte dei conti on data of the Ministry for education Rome, 27 – 29 March 2018

The right to education is anchored in the Italian Constitution The right to education is anchored in the Italian Constitution. The State has exclusive authority to define the so-called “Essential Levels of Performance” (LEP), to be provided by Universities. Legislative decree n. 68 of 2012 sets out an integrated system to guarantee the right to education, which involves a number of subjects, amongst which: - The Regions to regulate and activate actions related to the concrete exercise of the right to education; - The Universities to organize services – including orientation and tutoring – and to promote cultural, sport and leisure activities, as well as exchange between students of Italian and foreign universities. Rome, 27 – 29 March 2018

Number of eligible students Number of recipient tudents The following table (n. 3) shows data regarding the resources available for scholarships in the period 2011-2015, as well as their adequacy compared to actual demands in 2015. TABLE 3 RESOURCES AVAILABLE FOR SCHOLARSHIP (in million euro) Year Regional expenditure Amount FIS Total amount Number of eligible students Number of recipient tudents % of met needs Number of unmet needs 2011 334,4 98,6 433,0 176.353 131.263 74,43 45.090 2012 294,4 162,9 457,3 171.819 114.817 66,82 57.002 2013 313,8 149,2 463,0 171.304 136.621 79,75 34.683 2014 322,6 162,7 485,3 179.284 133.117 74,25 46.167 2015 336,7 162,0 498,7 188.612 139.370 73,89 49.242 Source: Corte dei conti on data of the Ministry for education Rome, 27 – 29 March 2018

The Ministry for Education and Research promotes agreements and memorandums of understanding between various Institutions to contribute towards the success of the education process and to enlarge the types of services provided. Among these services, there are student accommodations, transport facilities, health care and free access to culture and learning documentation. The right to benefit of these services is provided by regions and universities, depending on income conditions. Rome, 27 – 29 March 2018

Scholarships are ensured, within the ceiling of available resources, to students meeting the requirements in terms of academic merit and financial conditions. The amount is established every three years by an inter-ministerial decree. The national data regarding scholarships show an acceptance rate of 80% of applications. At a regional level, there are significant differences: some regions have sufficient resources to provide scholarships (for example, Basilicata, Emilia Romagna, Umbria), some others have resources to meet most of the needs (Lombardy, Piedmont, Tuscany), whilst less than a half regions have inadequate resources compared to the needs. In the period considered (2012-2013, 2013-2014 and 2014-2015), the unmet needs were still high (see table n. 4). Rome, 27 – 29 March 2018

DEGREE OF SATISFACTION OF STUDENTS’ APPLICATIONS FOR SCHOLARSHIP   DEGREE OF SATISFACTION OF STUDENTS’ APPLICATIONS FOR SCHOLARSHIP TABLE 4 RegionS   2015 Regional expenditure Percentage of Supplementary Fund Distribution of Supplementary Fund Number of eligible students Number of grants awarded % of needs satisfaction ABRUZZO 14,9 5,9 20,8 5.366 5.213 97,15 BASILICATA 2,7 1,3 4,1 1.438 100 CALABRIA 8,8 6,6 15,5 8.907 3.534 39,68 CAMPANIA 20,1 2,1 22,2 17.440 8.471 48,57 EMILIA-ROMAGNA 44,8 22,0 66,8 19.265 FRIULI VENEZIA GIULIA 10,0 4,4 14,4 4.329 4.245 98,06 LAZIO 37,5 12,6 50,1 19.338 12.672 65,53 LIGURIA 7,1 3,2 10,3 3.279 LOMBARDIA 41,2 15,4 56,6 18.182 16.482 90,65 MARCHE 12,8 7,5 20,4 5.559 5.418 97,46 MOLISE 1,7 0,8 2,5 1.048 761 72,61 PIEMONTE 21,8 32,0 8.219 6.990 85,05 PUGLIA 26,1 12,7 38,8 15.139 11.423 75,45 SARDEGNA 8,9 6,8 15,7 7.579 4.849 63,98 SICILIA 6,5 19,1 21.666 6.225 28,73 TOSCANA 39,1 21,6 60,8 15.462 14.221 91,97 UMBRIA 9,9 5,3 15,3 3.430 VALLE D'AOSTA 0,2 0,5 142 VENETO 22,4 10,6 33,0 12.824 11.312 88,21 TOTAL 336,7 162,0 498,7 188.612 139.370 73,89 Source: Corte dei conti on data of the Ministry for education Rome, 27 – 29 March 2018

In its report, the Corte dei conti also evaluates the relationship between university and the world of labor. For the analysis, it used data provided by ANVUR - National Agency for the evaluation of the university and research system – and by Almalaurea, an Interuniversity Consortium established in 1994, which counts 75 public and private universities amongst its members. ANVUR carries out independent, impartial and transparent evaluations on universities. Almalaurea carries out annual surveys on the students’ profile and employment status 1, 3 and 5 years after graduation, reporting to the member Universities, the Ministry of Education and Research and ANVUR, with a view to improving the decision-making process and enhancing the study planning, orientation and services. Rome, 27 – 29 March 2018

As shown in the analysis, in Italy a reversal of the trend in youth employment only started in 2015, one year later than the average European data. In particular, the rate of misemployment changed: 8% in 2011, 12,7% in 2014 and 11,9% in 2015. In the period 2007-2014, the gap of misemployment between graduates and bachelors changed from 3,6% to 12,3% in favor of graduates. In addition, as education levels increase, gender inequalities decrease. According to the data provided by Almalaurea, three years after graduation, the employment rate is 66% for three-year graduates (54% of the students continue for two years more to get master degrees), 70% for three plus two-year master graduates and 49% for five-year single cycle graduates (provided for departments of Medicine, Law, Pharmacy, Veterinary Medicine and Architecture). Rome, 27 – 29 March 2018

The data reported in a survey by ISTAT on graduates in the year 2011 shows that, four years after graduation, the employment estimate is: 72,8% for three-year graduates, 80,3% for single cycle graduates and 84,5% for master graduates (three years + two years). The results of these two surveys cannot be compared, as they refer to different periods and apply different methodologies. Anyway, it is interesting that in the data issued by ISTAT, single cycle degrees have a better performance in terms of employment compared to the data reported by ANVUR. More detailed analysis of the survey carried out by ISTAT indicates that the highest levels of employment (more than 93%) are observed among single cycle graduates and for master graduates in Defense and Security, Medicine and Engineering (99,4%, 96,5% and 93,9%). Rome, 27 – 29 March 2018

Access of graduates to the labor market is more difficult for three-year graduates, master graduates and five-year single cycle graduates in the framework of literature disciplines (61,7% for three-year graduates and 73,4% for master graduates and five-year single course graduates), and biology disciplines (58,6% for three-year graduates and 76,5% for master graduates and five-year single cycle graduates). Three-year graduates in psychology (67,6% people employed) are significantly below average. Only one in two (52,8%) of three-year graduates has a fixed-term work or occasional work contracts or paid internships. Temporary work involves 41,9% of single cycle graduates and master graduates. Rome, 27 – 29 March 2018

A job placement service is established in almost all Italian universities (97,9% in the period 2013-2014), except for 4 universities which have not yet activated it (1 university in the North-West, 1 university in the center, and 2 universities in the South of Italy). Single-cycle graduates and master graduates coming from Defense and Security, Medicine and Engineering have higher monthly salaries (more than 1,600 euros per month). Rome, 27 – 29 March 2018

The table also presents the distribution of trainees on the territory. The following table (n. 5) shows an increase in internships, which allow trainees to be introduced in the labor market by gaining targeted professional experience. In addition, the internships can serve as a means of orientation for students. The table also presents the distribution of trainees on the territory. Rome, 27 – 29 March 2018

Total number of studentsi % internship/students TABLE N. 5 INTERNSHIP 2013-2014 Geographical area Three-year degree Master degree Single cycle degree Total of internship Total number of studentsi % internship/students   Internship % Internship/ Students % Internship/Students NORTH 81.280 11,8 25.815 3,7 33.437 4,8 140.532 690.586 20,35 North-Est 39.267 10,0 13.933 3,6 16587 4,2 69.787 391.964 17,80 North- West 42.013 14,1 11.882 4,0 16850 5,6 70.745 298.622 23,69 CENTER 41.282 9,5 11.107 2,6 21184 4,9 73.573 434.927 16,92 SOUTH 35.601 6,3 10.561 1,9 19.304 3,4 65.466 569.400 11,50 South 20.081 5,0 6.274 1,6 4710 1,2 31.065 403.362 7,70 Islands 15.520 9,3 4.287 14594 8,8 34.401 166.038 20,72 TOTAL 158.163 47.483 2,8 73.925 4,4 279.571 1.694.913 16,49 Source: Corte dei conti on data of the Ministry for education Rome, 27 – 29 March 2018

  Post degree internship are, instead, a training service provided to young students who have graduated no more than 18 months (table n. 6). The analysis of post degree internship is particularly interesting and sufficiently reliable. 76,4% of Universities declare to have an ex post evaluation system, 12,4% of Universities declare to have an ex post evaluation system, although not complete, and 11,2% declare not to have any evaluation system. This ex post evaluation is aimed at verifying if such internships have given results in terms of actual employment. Rome, 27 – 29 March 2018

Geographical distribution TABLE 6 POST DEGREE INTERNSHIPS Geographical distribution 2012-13 2013-14 NORTH 14.327 11.903 Noth-Est 8.711 7.633 Notrh- West 5.616 4.270 CENTER 3.223 2.223 SOUTH 3.622 1.560 South 2.691 991 Islands 931 569 Total 21.172 15.686 Source: Corte dei conti on data of the Ministry for education Rome, 27 – 29 March 2018

The data above are very important also for the evaluation of professional training policies during the university education processes. Evaluation of public policies sees our strong support, as known by some colleagues who are members of the Expert Network on Public Policies of the Contact Committee. In the context of the next XXIII INCOSAI (to be held in Moscow in 2019), on “The role of the Supreme Audit Institutions in the achievement of the national priorities and goals, theme II considers the involvement of SAIs in the public policies process to assess the risks associated to public programs and policies, and to verify their contribution towards the achievement of SDGs. Rome, 27 – 29 March 2018

In conclusion, the Italian approach to KNIs goes beyond macro-economic indicators to consider factors and aspects that describe the well-being of citizens and measure progress against set objectives. However, those indicators are only useful if they enter into a dynamic process, where political decisions are taken and submitted to subsequent assessment. Both political decision-makers and SAIs need indicators which are based on objectively measurable elements. Rome, 27 – 29 March 2018

Educational attainment is one area where objective measures can provide significant results by relying on outcomes rather than output. This presentation provided an example: it not only considered the output of the investment on higher education (number of graduates), but also its impact on the labor market (employment rate). Rome, 26 – 29 March 2018

Thank you for your attention