Data reported and data quality in AIR 2017 TÓTH Gábor DG Employment, Social Affairs and Inclusion Evaluation and Impact Assessment Unit ESF Evaluation Partnership meeting, 28 September 2017, Brussels

Purpose Show changes in data quality Report actions to improve quality NB: 72% of the AIRs not approved yet, data are tentative!

What has been done so far? What has improved, what has not? What will be done?

I. What has been done so far? Main achievements and improved analytical tools TWG of 10-11 October and EPM of 19 October 2016 Open Data Platform Main inconsistencies and analytical benchmarks EPM of 15 March 2017 Actions to improve data quality Improve SFC validation rules Focus on OPs with under-reporting or LM vs. ed. attainment gap above 10% ← audit approach

Audit approach: Benchmarks above which feedback is requested from MAs as to the reasons for erroneous or underreporting 5 % for erroneous reporting (audit) 10% for underreporting (based on AIR, at OP and priority level) There may be valid reasons or the problem can be corrected easily! NB: proposed deletion of household situation indicators in omnibus regulation would apply retrospectively and solve completeness issues

Audit approach: Possible use of suspension clause Only as of 2019 based on AIR 2018 (=time to adapt, update or correct retrospectively) if: Explanations by MA not provided No action plan by MA to improve 13/10 data.

II. What has improved, what has not? Active IPs have more than doubled More than half of IPs without achievements Total Positive achievements 2015 2016 OPs 187 112 160 PA 565 193 383 IPs 1401 265 651 Cat. of reg. 1632 301 722 13/10 data

Highlights on main achievements Nr. of participants almost tripled Nr. of participants in million 2015 2016 ESF + YEI 2.7 7.8 ESF 2.2 6.5 YEI 0.5 1.3

Highlights on main achievements Immediate results (ESF + YEI) In thousands 2015 2016 Inactive participants engaged in job searching 36 148 Participants in education or training 93 238 Participants gaining a qualification 161 773 Participants in employment 143 637 Disadvantaged participants engaged in job searching, education or training, gaining a qualification, or in employment 265 438

II. What has improved, what has not? Under-reporting 2015: 6.8% (22 MS) - 2016: 6.4% (27 MS) 0-5% increased by 3. Above 10 increased by 2.

II. What has improved, what has not? Gap between LM and education totals 2015: 18.6% (22 MS) - 2016: 7.0% (27 MS) Marked decrease in average. + 5 MS in 0-5%. -3 MS in above 10% - move to 5-10%.

II. What has improved, what has not? Combined assessment 2015 data Number of OPs Under-reporting Total 0% 0% < UR ≤ 5% 5% < UR ≤ 10% 10% < UR Gap betw. LM and education 18 1 3 6 28 0% < Gap ≤ 5% 12 2 7 49 5%< Gap ≤ 10% 4 10% < Gap 21 25 71 17 5 16 109

II. What has improved, what has not? Combined assessment 2015 data Number of OPs Under-reporting Total 0% 0% < UR ≤ 5% 5% < UR ≤ 10% 10% < UR Gap betw. LM and education 59 (54%)   28 0% < Gap ≤ 5% 49 5%< Gap ≤10% 11 (10%) 7 10% < Gap 39 (36%) 25 71 17 5 16 109

II. What has improved, what has not? Combined assessment 2016 data   Under-reporting Gap bw. LM and ed. totals UR = 0% 0 < UR < 5% 5% ≤ UR < 10% 10% ≤ UR ≤ 100% Total Gap = 0% 22 3 2 30 0< Gap < 5% 48 20 1 7 76 5% ≤ Gap < 10% 13 4 6 23 10% ≤ Gap ≤ 100% 19 27 102 31 156

II. What has improved, what has not? Combined assessment 2016 data   Under-reporting Gap bw. LM and ed. totals UR = 0% 0 < UR < 5% 5% ≤ UR < 10% 10% ≤ UR ≤ 100% Total Gap = 0% 93 (59.6%) 0< Gap < 5% 5% ≤ Gap < 10% 20 (12.8%) 10% ≤ Gap ≤ 100% 43 (27,6%) 156

Improve submitted AIRs III. What will be done? Improve submitted AIRs 20 October: cut-off date for data to be published on the Open Data Platform and the Strategic Report Map risks: identify areas where more efforts are necessary Monitor evolution following regulatory change (exclusion of household indicators)

Questions for discussion What is the state of play in the non-reporting IPs? Will there be non-performing IPs in your MS in the 2018 AIRs? Do you expect an impact on under-reporting with the omnibus change regarding household indicators?