1. Counterfactual impact evaluations - experience of EFS Managing Authority in Poland
Expert hearing on MS experiences on using control groups in ESF evaluations

2. Experience:
Department for European Social Fund in Polish Ministry of Regional Development has been responsible for coordination of two counterfactual impact evaluations:
“The impact of Cohesion Policy on the level and quality of employment in Poland” - on-going evaluation of Sectoral Operational Programme Human Resources Development 2004 – 2006 (SOP HRD);
“Study on achieved values of result indicators of the regional component of the Human Capital Operational Programme” Human Capital Operational Programme – on-going evaluation (to be completed in mid 2012).
Ministry of Regional Development -
May 2, 2019

3. Reasons for the evaluations;
Values of indicators;
ESF intervention efficiency (change in time);
Improving of the intervention logic (both: national and co-financed by EFS);
Success factors;
Databases.
Ministry of Regional Development -
May 2, 2019

4. Challenges in preparing and managing CIEs:
Level of representativeness of the sample;
High survey costs;
Long-lasting (real on-going) exercise;
Hard to predict everything (public procurement and persona data protection law);
Data utilization;
Data availability.
Ministry of Regional Development -
May 2, 2019

5. Possible improvements to undertake CIEs;
Legal requirements;
Data accessibility;
Sources of the „control groups twins” data;
Data quality.
Ministry of Regional Development -
May 2, 2019

6. Use and dissemination of results:
Recommendations for improvement of future CIEs surveys;
Recommendations for the policy improvements:
6 recommendation concerning the intervention logic;
1 recommendation for conducting in-depth study.
Ministry of Regional Development -
May 2, 2019

7. Thank you for your attention!!!
Ministry of Regional Development -
May 2, 2019