1. Debrief from the Regional Workshops on counterfactual impact evaluations
Béatrice d’Hombres CRIE, DG-JRC
ESF Evaluation Partnership Meeting
13 November 2015

2. 2015 Regional Workshops (RWC) - Context
1 – North-Western RWC: April 2015, Brussels
Participating countries: BE, IE, NL,13 participants
Trainers: Andrea Morescalchi, Sylke V. Schnepf
2- Eastern Central RWC: Sept. 2015, Budapest
Participating countries: BG, HR, CZ, HU, SK, SE, RO, 78 participants
CRIE Trainers: Enkelejda Havari, Paolo Paruolo
Experts: Gabor Kezdi and Martin Kahanec
(Central European University),
Joost de Laat, Celine Ferré (WB)

3. 2015 Regional Workshops (RWC) - Context
3 – Nordic RWC: October, 2105, Tallinn
Participating countries: EE, SE, LV, LT, PL, 14 participants
Trainers: Paolo Paruolo, Leandro Elia
Experts: Mihails Hazans (IZA, University of Latvia)
Céline Ferré (WB)
4- Western RWC: October 2015, Dublin
Participating countries: IE, DE, FR,IT, ES, PT, 58 participants
CRIE Trainers: Béatrice d’Hombres, Giulia Santangelo
Experts: Pedro Martins (Queen Mary, University of London), Enrico Rettore
(Research Institute for the Evaluation of Public Policies and Trento University )

4. 2015 – RWC – Core activities Three days workshop
Sessions to refresh theoretical knowledge
on CIE
Sessions devoted to computer based training on CIE using the software Stata
Sessions devoted to team work with the creation of a concrete evaluation plan
Presentations of finalized/ongoing CIE studies by experts in the field of CIE

5. 2015 RWC: Satisfaction and Impact
Satisfaction of the participants
Impact of the RWC
Data
Measuring the impact of the RWC: Evaluation quiz before and after the training.
Satisfaction levels: Questionnaires filled by participants. Each indicator ranges between 0 and 100.
The higher is the value of the indicator, the higher is the level of satisfaction of participants.

6. 2015 RWC: some suggestions for the future
Based on suggestions by participants & observations
A - Improve CIE market
Attract/Find contractors of good quality
Ensure the quality of CIE based deliverables
B - Improve data accessibility
Administrative : ideal solution for CIE of ESF funded interventions
Imply to address legal and ethical aspects of linking/analysing admin data
Partnership between MA, statistical offices and CIE experts
C - Continue evidence and capacity building
Emphasis on topics of specific interest for MA
such the Youth Employment Initiative
Admin data & data linkages
2015 RWC: some suggestions for the future

7. Follow up of the RWC in 2016 Contribute to B and C
Facilitating and running a community of practice on CIE
First meeting of the community of practice – CoP (in the first half of 2016)
Specific session of COMPIE 2016 dedicated to the ongoing work of the CoP
Set up a web forum accessible from CRIE website
Library  accessible from CRIE website with relevant documents
for the members of the CoP
Purpose of the CoP
Create an environment to share experience through
regular meetings & structured dialogue
First meeting of the CoP
Specific focus on the Youth Employment Initiative
Administrative Data
Contribute to B and C

8. Follow up of the RWC in 2016 Contribute to A and C Improve CIE market
Set up of a single entry point for calls of CIE studies on CRIE website (provided that ToRs are written in English)
COMPIE 2016
Second conference on Counterfactual Methods for Policy
Impact Evaluation
Follow up of the conference in Rome
Follow up of the RWC in 2016
Contribute to A and C

9. Follow up of the RWC in 2016 Contribute to B and C Evidence building
CRIE website archive of CIE on ESF type of interventions
CIE Data fitness-contest of ESF funded interventions
Purpose
Increase awareness among MA of the Effort needed for data collection
Transfer of knowledge
Add of evidence
Direct collaboration with CRIE
Follow up of the RWC in 2016
Contribute to B and C

10. For more information and contacts: http://crie. jrc. ec. europa
For more information and contacts: