Counterfactual impact evaluations - experience of EFS Managing Authority in Poland Expert hearing on MS experiences on using control groups in ESF evaluations
Experience: Department for European Social Fund in Polish Ministry of Regional Development has been responsible for coordination of two counterfactual impact evaluations: “The impact of Cohesion Policy on the level and quality of employment in Poland” - on-going evaluation of Sectoral Operational Programme Human Resources Development 2004 – 2006 (SOP HRD); “Study on achieved values of result indicators of the regional component of the Human Capital Operational Programme” Human Capital Operational Programme – on-going evaluation (to be completed in mid 2012). Ministry of Regional Development - May 2, 2019
Reasons for the evaluations; Values of indicators; ESF intervention efficiency (change in time); Improving of the intervention logic (both: national and co-financed by EFS); Success factors; Databases. Ministry of Regional Development - May 2, 2019
Challenges in preparing and managing CIEs: Level of representativeness of the sample; High survey costs; Long-lasting (real on-going) exercise; Hard to predict everything (public procurement and persona data protection law); Data utilization; Data availability. Ministry of Regional Development - May 2, 2019
Possible improvements to undertake CIEs; Legal requirements; Data accessibility; Sources of the „control groups twins” data; Data quality. Ministry of Regional Development - May 2, 2019
Use and dissemination of results: Recommendations for improvement of future CIEs surveys; Recommendations for the policy improvements: 6 recommendation concerning the intervention logic; 1 recommendation for conducting in-depth study. Ministry of Regional Development - May 2, 2019
Thank you for your attention!!! Ministry of Regional Development - May 2, 2019