Data collection, Data access and Data merging European Commission Centre for Research on Impact Evaluation

The need of good data For a successful evaluation it is important that the data is well-organized, so that the evaluator can accurately assess, replicate, and evaluate a programme. If data is not collected in time, it may be impossible to retrieve it retrospectively, Learning about evaluation early-on and planning carefully helps the evaluator to navigate the process!

Main message of the video A well-planned data collection allows for a good and relatively inexpensive counterfactual impact evaluation.

Outline How to choose the right CIE according to data availability and intervention’s features The data collection process Types of data that could be used for CIE Data access Data merging

The design feature of the intervention. Choosing the CIE method The design feature of the intervention. Data availability.

Regression Discontinuity Design Example 1 Features: the participants are selected on the base of a particular score\threshold. Data requirements: running variable; observations on individuals at both sides of the threshold.

In the video we discuss: Differerence-in-difference IV Matching Other methods discussed in the Video Example 1 In the video we discuss: Differerence-in-difference IV Matching

What types of data is needed for evaluation? Data collection What types of data is needed for evaluation? When data should be collected? Which kind of data sources can be used for evaluation? Census data Administrative data Sample survey Monitoring data

Need to choose one data source? Datasets could be linked, merging information coming from different sources: different variables referring to the same individual may be present in different datasets. Need to have the unique identifier to be used to link different source of data.

Contractors may be in charge of collecting ad hoc survey. Who should collect data? Contractors may be in charge of collecting ad hoc survey. Administrative data usually already exist in house. Managing authorities have a crucial role to play as intermediary body in facilitating access to administrative data for evaluation.

Sensitive information. Data access Sensitive information. Protect people’s privacy and de-identify the data before it is used for any research. Strict collaboration between Managing Authorities and the National Central Statistical Offices is needed. Contact point Interministerial negotiation Merge data

Summing-up Take-home message A well-planned data collection allows for a good and relatively inexpensive counterfactual impact evaluation Managing authorities have a crucial role to play as intermediary body in facilitating access to administrative data for evaluation.

Stay in touch CRIE website: crie.jrc.ec.europa.eu email: jrc-crie@ec.europa.eu YouTube: JRC CRIE Yammer: https://www.yammer.com/counterfactualimpactevaluationnetworkcie-net/#/home