Debrief from the Regional Workshops on counterfactual impact evaluations Béatrice d’Hombres CRIE, DG-JRC ESF Evaluation Partnership Meeting 13 November 2015

2015 Regional Workshops (RWC) - Context 1 – North-Western RWC: 13-14 April 2015, Brussels Participating countries: BE, IE, NL,13 participants Trainers: Andrea Morescalchi, Sylke V. Schnepf 2- Eastern Central RWC: 22-24 Sept. 2015, Budapest Participating countries: BG, HR, CZ, HU, SK, SE, RO, 78 participants CRIE Trainers: Enkelejda Havari, Paolo Paruolo Experts: Gabor Kezdi and Martin Kahanec (Central European University), Joost de Laat, Celine Ferré (WB)

2015 Regional Workshops (RWC) - Context 3 – Nordic RWC: 13-15 October, 2105, Tallinn Participating countries: EE, SE, LV, LT, PL, 14 participants Trainers: Paolo Paruolo, Leandro Elia Experts: Mihails Hazans (IZA, University of Latvia) Céline Ferré (WB) 4- Western RWC: 28-30 October 2015, Dublin Participating countries: IE, DE, FR,IT, ES, PT, 58 participants CRIE Trainers: Béatrice d’Hombres, Giulia Santangelo Experts: Pedro Martins (Queen Mary, University of London), Enrico Rettore (Research Institute for the Evaluation of Public Policies and Trento University )

2015 – RWC – Core activities Three days workshop Sessions to refresh theoretical knowledge on CIE Sessions devoted to computer based training on CIE using the software Stata Sessions devoted to team work with the creation of a concrete evaluation plan Presentations of finalized/ongoing CIE studies by experts in the field of CIE

2015 RWC: Satisfaction and Impact Satisfaction of the participants Impact of the RWC Data Measuring the impact of the RWC: Evaluation quiz before and after the training. Satisfaction levels: Questionnaires filled by participants. Each indicator ranges between 0 and 100. The higher is the value of the indicator, the higher is the level of satisfaction of participants.

2015 RWC: some suggestions for the future Based on suggestions by participants & observations A - Improve CIE market Attract/Find contractors of good quality Ensure the quality of CIE based deliverables B - Improve data accessibility Administrative : ideal solution for CIE of ESF funded interventions Imply to address legal and ethical aspects of linking/analysing admin data Partnership between MA, statistical offices and CIE experts C - Continue evidence and capacity building Emphasis on topics of specific interest for MA such the Youth Employment Initiative Admin data & data linkages 2015 RWC: some suggestions for the future

Follow up of the RWC in 2016 Contribute to B and C Facilitating and running a community of practice on CIE First meeting of the community of practice – CoP (in the first half of 2016) Specific session of COMPIE 2016 dedicated to the ongoing work of the CoP Set up a web forum accessible from CRIE website Library  accessible from CRIE website with relevant documents for the members of the CoP Purpose of the CoP Create an environment to share experience through regular meetings & structured dialogue First meeting of the CoP Specific focus on the Youth Employment Initiative Administrative Data Contribute to B and C

Follow up of the RWC in 2016 Contribute to A and C Improve CIE market Set up of a single entry point for calls of CIE studies on CRIE website (provided that ToRs are written in English) COMPIE 2016 Second conference on Counterfactual Methods for Policy Impact Evaluation Follow up of the conference in Rome Follow up of the RWC in 2016 Contribute to A and C

Follow up of the RWC in 2016 Contribute to B and C Evidence building CRIE website archive of CIE on ESF type of interventions https://crie.jrc.ec.europa.eu/CIE_database/cieDatabase.php CIE Data fitness-contest of ESF funded interventions Purpose Increase awareness among MA of the Effort needed for data collection Transfer of knowledge Add of evidence Direct collaboration with CRIE Follow up of the RWC in 2016 Contribute to B and C

For more information and contacts: http://crie. jrc. ec. europa For more information and contacts: http://crie.jrc.ec.europa.eu email: crie@jrc.ec.europa.eu