1. Future Monitoring and Evaluation: Focus on results Antonella Schulte-Braucks Ines Hartwig ESF Evaluation Partnership Brussels 17 November 2011

2. Monitoring & Evaluation - General principles -
Effectiveness as a general principle (Art. 4.9)
Ex ante conditionality on statistics (Annex IV)

3. Monitoring Common output and result indicators:
common definitions,
relate to fully and partially implemented operations, no leaving or carry-over
reporting scheme similar to Annex XXIII
Programme-specific indicators: where appropriate output and result indicators
Monitoring information systems needs to record and store data on indicators broken down by gender on individual participants (Art )
Draft guidance on monitoring & evaluation to be discussed in March 2012
Possibility NOT to hold an ARM (except 2017 & 2019), upon agreement between MS & EC (Art. 45.3)

4. Common indicators Common indicators have been widely discussed with MS
Rules on personal data
(Art. 7 of the data protection directive)
Processing personal data is necessary for compliance
with the legal obligation to which the data controller is subject.
Rules on sensitive data
(Art. 8 of the data protection directive)
Collection of sensitive data is only possible
with the explicit consent
Member States may, for reason of substantial public interest,
lay down exemptions in
addition to those laid down in the directive.
“Documents shall be kept in a form which permits identification
of data subjects for no longer than is necessary for the purposes
for which the data were collected or for which they were processed”
Art draft CSF Regulation
Common indicators
Common indicators have been widely discussed with MS
Indicators cover personal and sensitive data
Data protection rules are respected

5. Common Output Indicators (1)
People
unemployed, including long-term unemployed
long-term unemployed
inactive
inactive, not in education or training
employed, including self-employed
below 25 years
above 54 years
with primary (ISCED 1) or lower secondary education (ISCED 2)
with upper secondary (ISCED 3) or post-secondary education (ISCED 4)
with tertiary education (ISCED 5 to 8)
migrants, people with a foreign background, minorities (including marginalised communities such as the Roma)
disabled
other disadvantaged
Annex XXIII
simplified

6. Common Output Indicators (2)
Entities
number of projects fully or partially implemented by social partners or non-governmental organisations
number of projects targeting public administrations or public services
number of micro, small and medium-sized enterprises supported

7. Common Result Indicators
Immediate
inactive participants newly engaged in job searching upon leaving
participants in education/training upon leaving
participants gaining a qualification upon leaving
participants in employment upon leaving
Longer-term
participants in employment 6 months after leaving
participants in self-employment 6 months after leaving
participants with an improved labour market situation 6 months after leaving
Annual reporting
Only in 2019 & 23, participants sample, e.g. surveys

8. Programme-specific Indicators
DG EMPL will draw up a list of recommended ESF indicators for outputs and results
Managing Authority to decide using them

9. Quantified Target Values
Set for 2022
Targets are set for common indicators and programme-specific ones
Ex ante evaluation shall assess feasibility of targets

10. Annual Implementation Reports (1)
First AIR in 2016 (not in 2015!)
Lighter AIRs in 2016, 2018, 2020,2021:
Information of financial progress and indicators
Actions to fulfil ex-ante conditionalities
Issues which affect the performance of the programme
Information on the implementation of major projects and JAPs

11. AIR (2) AIR to be submitted on 30 April each year
Data on common indicators essential part of AIR
Annual reporting for common ESF output and immediate result indicators

12. AIR (3) For 2017, 2019 & 2023 : analytical AIR
Thorough information and analysis of all the elements of the OP required (Art. 44, 101)
In 2019 and 2023 assess progress towards achieving OP objectives and the funds‘ contribution to Europe 2020 objectives
Information on achievement of milestones presented in AIR 2017 and 2019

13. Reporting – Partnership Contract
A progress report (at national level) common for the CSF Funds to be submitted in 2017 and 2019 – content corresponds to that of the Partnership Contract (Art. 46)

14. Evaluations Continuity with the principle of on-going evaluations
Ex ante evaluation on each OP
Evaluation plan for each OP approved and regularly reviewed by MonCom
MonCom to discuss evaluation findings and follow-up
Synthesis report of evaluation by MS in December 2020
Encourage MS to evaluate effects (impacts)

15. Ex-ante evaluation - future
Justification for selected thematic objectives and priorities, contributing to EU2020 & achieving country-specific recommendations, relevance and realism of indicators, targets & financial allocations
Monitoring and evaluation capacities and appropriate data collection arrangements

16. Ex-post evaluation
Carried out by the Commission in close cooperation with MS and MA
Due by the end of 2023

17. THANK YOU FOR YOUR ATTENTION
QUESTIONS?