1. Data reported and data quality in AIR 2017
TÓTH Gábor
DG Employment, Social Affairs and Inclusion
Evaluation and Impact Assessment Unit
ESF Evaluation Partnership meeting, 28 September 2017, Brussels

2. Purpose
Show changes in data quality
Report actions to improve quality
NB: 72% of the AIRs not approved yet, data are tentative!

3. What has been done so far?
What has improved, what has not?
What will be done?

4. I. What has been done so far?
Main achievements and improved analytical tools
TWG of October and EPM of 19 October 2016
Open Data Platform
Main inconsistencies and analytical benchmarks
EPM of 15 March 2017
Actions to improve data quality
Improve SFC validation rules
Focus on OPs with under-reporting or LM vs. ed. attainment gap above 10% ← audit approach

5. Audit approach: Benchmarks above which feedback is requested from MAs as to the reasons for erroneous or underreporting
5 % for erroneous reporting (audit)
10% for underreporting (based on AIR, at OP and priority level)
There may be valid reasons or the problem can be corrected easily!
NB: proposed deletion of household situation indicators in omnibus regulation would apply retrospectively and solve completeness issues

6. Audit approach: Possible use of suspension clause
Only as of 2019 based on AIR 2018 (=time to adapt, update or correct retrospectively) if:
Explanations by MA not provided
No action plan by MA to improve
13/10 data.

7. II. What has improved, what has not?
Active IPs have more than doubled
More than half of IPs without achievements
Total
Positive achievements
2015
2016
OPs
187
112
160 PA
565
193
383
IPs
1401
265
651
Cat. of reg.
1632
301
722
13/10 data

8. Highlights on main achievements
Nr. of participants almost tripled
Nr. of participants in million
2015
2016
ESF + YEI
2.7
7.8
ESF
2.2
6.5
YEI
0.5
1.3

9. Highlights on main achievements
Immediate results (ESF + YEI)
In thousands
2015
2016
Inactive participants engaged in job searching 36
148
Participants in education or training 93
238
Participants gaining a qualification
161
773
Participants in employment
143
637
Disadvantaged participants engaged in job searching, education or training, gaining a qualification, or in employment
265
438

10. II. What has improved, what has not?
Under-reporting
2015: 6.8% (22 MS) : 6.4% (27 MS)
0-5% increased by 3.
Above 10 increased by 2.

11. II. What has improved, what has not?
Gap between LM and education totals
2015: 18.6% (22 MS) : 7.0% (27 MS)
Marked decrease in average.
+ 5 MS in 0-5%.
-3 MS in above 10% - move to 5-10%.

12. II. What has improved, what has not?
Combined assessment
2015 data
Number of OPs
Under-reporting
Total 0%
0% < UR ≤ 5%
5% < UR ≤ 10%
10% < UR
Gap betw. LM and education 18 1 3 6 28
0% < Gap ≤ 5% 12 2 7 49
5%< Gap ≤ 10% 4
10% < Gap 21 25 71 17 5 16
109

13. II. What has improved, what has not?
Combined assessment
2015 data
Number of OPs
Under-reporting
Total 0%
0% < UR ≤ 5%
5% < UR ≤ 10%
10% < UR
Gap betw. LM and education
59 (54%) 28
0% < Gap ≤ 5% 49
5%< Gap ≤10%
11 (10%) 7
10% < Gap
39 (36%) 25 71 17 5 16
109

14. II. What has improved, what has not?
Combined assessment
2016 data
Under-reporting
Gap bw. LM and ed. totals
UR = 0%
0 < UR < 5%
5% ≤ UR < 10%
10% ≤ UR ≤ 100%
Total
Gap = 0% 22 3 2 30
0< Gap < 5% 48 20 1 7 76
5% ≤ Gap < 10% 13 4 6 23
10% ≤ Gap ≤ 100% 19 27
102 31
156

15. II. What has improved, what has not?
Combined assessment
2016 data
Under-reporting
Gap bw. LM and ed. totals
UR = 0%
0 < UR < 5%
5% ≤ UR < 10%
10% ≤ UR ≤ 100%
Total
Gap = 0%
93 (59.6%)
0< Gap < 5%
5% ≤ Gap < 10%
20 (12.8%)
10% ≤ Gap ≤ 100%
43 (27,6%)
156

16. Improve submitted AIRs
III. What will be done?
Improve submitted AIRs
20 October: cut-off date for data to be published on the Open Data Platform and the Strategic Report
Map risks: identify areas where more efforts are necessary
Monitor evolution following regulatory change (exclusion of household indicators)

17. Questions for discussion
What is the state of play in the non-reporting IPs?
Will there be non-performing IPs in your MS in the 2018 AIRs?
Do you expect an impact on under-reporting with the omnibus change regarding household indicators?