Ex post evaluation 2007-2014 of ERDF and CF: State of play DG Regional and Urban Policy Brussels, 15 January 2015 Cohesion Policy

Overview of work packages No. Work package Responsible in REGIO evaluation unit Data collection and quality assessment Daniele Vidoni 1 Synthesis Kai Stryczynski 2 Support to SMEs – Increasing Research and Innovation in SMEs and SME development Marielle Riché 3 Financial instruments for enterprise support Daniel Mouqué 4 Support to Large Enterprises 5 Transport Jan-Marek Ziolkowski 6 Environment Anette Holtmann 7 Modelling the effects of transport projects Postponed 8 Energy efficiency Patty Simou 9 Culture and Tourism Samuele Dossi 10 Urban development and Social Infrastructures 11 European Territorial Cooperation David Alba 12 Delivery system (covers also the ESF) Ivanka Lakova 13 Geography of expenditure Alida Staicu 14 Effect on GDP etc Modelling: QUEST, Rhomolo, Regional Discontinuity Design, Propensity Score Matching   15 Communication 2015

WP 1: Synthesis Two interim deliverables: - Macroeconomic situation - Regional developments Ultimate use for synthesis report in 2016

WP 2: Support to SME: research & Innovation and SME development Started July 2014, inception report accepted by Steering group last September Consultant: CSIL (IT), CSES (UK), ZEW (DE) First intermediate report to be examined on 23 January: Establish the main instruments funded in 50 programmes: context, funding, logic of intervention, beneficiary SMEs, effectiveness Pilot case study: Puglia + proposal for 7 other case studies Proposal for 7 policy instruments (in view of 3 theorie-based evaluations) In parallel: literature review (rationale for public support, evidence)

WP 2: Support to SME: research & Innovation and SME development Next steps: April: seminar on case studies' findings (MA, SMEs & external experts) May: 8 case studies October: 3 theory-based impact evaluations on 3 policy instruments January 2016: final report Contact: Marielle Riché

WP 3: Financial instruments Equity, loan and guarantee instruments – support to enterprise only First draft stocktaking report being finalised. Covers 12 MSs which account for 92% of support (BE, CZ, DK, DE, ES, FR, HU, IT, LT, PL, PO, UK) Will select 9 representative case study OPs to examine initial performance, using theory of change evaluation. Seminar in July, final report in November.

WP 4: Support to large enterprises Large enterprises as defined in EU law First draft stocktaking report being finalised. Covers 8 MSs which account for 75% of support (PO, DE, PT, ES, HU, IT, CZ, AT) Will select 8 representative case study OPs to examine initial performance, using theory of change evaluation Seminar in July, final report in November.

WP 5: Transport Consultant – AECOM + KPMG Italy Kick-off in December 2014 1st Interim report – April 2015 (cohesion policy contribution + review of financial analysis) 2nd Interim report – August 2015 (10 major project case studies + 6 MS case studies + draft catalogue of challenges) Seminar – October 2015 (to discuss and develop findings from the case studies) Final report – December, 2015 (draft in November 2015)

WP 6: Environment Analysis of Cohesion Policy contribution in 2007-2013 for environmental infrastructure projects (drinking water, wastewater and waste). Consultant – COWI Kick-off in December 2014 and list of 40 major projects provided by the Commission Inception report: 28 January 2015 (detailed methodology, selection of 20 projects for task 2) Interim report by mid-March (cohesion policy contribution, review of financial analysis for 20 major projects, verifying the correctness of assumptions for operational projects and proposal for 2 pilot case studies) All ten case studies by mid-August and catalogue of challenges by mid-September Seminar (to discuss and verify findings) in October 2015 Final Report in December 2015

WP 8: Energy Efficiency Consultant – Ramboll / Institute for European Environmental Policy Kick-off : 13 November 2014 Inception report: 09.01.2015 (detailed methodology, proposal for case study pilot) Interim report (Literature review / Review of ERDF/CF measures, finalised pilot case study) by mid April 2015 Remaining case studies to be submitted as they are completed, the latest by mid June 2015 Seminar (to discuss and verify findings) in June 2015 Final Report by the end of August 2015

WP 9: Culture and Tourism Consultant – IRS, CSIL BOP Consulting Kick-off : 21 August 2014 Inception report: December 2014 (detailed methodology, proposal for Survey to Managing Authorities) Interim report (Literature review / Data analysis and sampling / survey of selected programmes) by January 2015 Pilot Case study (Regional Strategy) and 2 min—case studies (project level) by February 2015 Six case studies and 12 mini-case studies, by May 2015 Seminar (to discuss and verify findings) in September 2015 Final Report by the end of October 2015

WP 10: Urban Development and Social Infrastructures Consultant – METIS Kick-off : November 2014 Inception report: December 2014 (detailed methodology, proposal for Survey to projects Implementation Bodies) Interim report (Distribution of Investments and reported outputs / Analysis of OPs and AIRs) by April 2015 Survey to project Implementation Bodies Final Report by the end of September 2015

WP 11: ETC Consultant – ADE Kick-off : 8 January 2014 Inception report: 12 February 2015 (detailed methodology, proposal for case study pilot) Interim report (Completion of Task 1 and case study selection) by mid May 2015 2nd Interim report (Completion of Task 2-4) by mid November 2015 Seminar (to discuss and verify findings) in mid December 2015 Final Report mid March 2016 Contact: David Alba

WP 12: Delivery Systems (1/2) Delivery System is defined as: programming, project selection, compliance with EU & national law, financial man't & control, monitoring, evaluation, reporting Main focus : the OP level, how well (i) it translates strategic guidelines into results delivered by the policy and (ii) in terms of: accountability, regularity, results, timeliness, responsiveness, cost TA's performance for reinforcing administrative capacity is assessed Data and evidence collection through: structured interviews, web-survey, case studies.

WP 12: Delivery Systems (2/2) Consultant – KPMG (DE) / Prognos A 16-months contract Kick-off on 18 November 2014 Inception report submitted 18 December 2014 (in progress) 1st Interim report 4 March 2015 2nd Interim report by June 2015 3rd and 4th Interim reports by mid-September and mid-October 2015, respectively Draft final report by January 2016 Final Report by the end March 2016 Contact: Ivanka Lakova

WP 13: Geography of expenditure Consultant – The Vienna Institute for International Economic Studies & Ismeri Europa 8 months contract Kick-off on 21 January 2015 Inception report by the end of January 2015 (detailed methodology for each task) 1st Interim report (Database & proposed methodology for estimates) by the end of April 2015 2nd Interim report (Database & maps & user's manual) by the end of June 2015 Draft final report by the end of July 2015 (2nd Interim Report + additional sections on tasks 5&6) Final Report by the end of August 2015

WP 14c / 14d: Effect on GDP etc Two low value contracts with econometric approaches signed - regression discontinuity design (G Pellegrini) - Propensity score matching (D Bondonio) Questions: - Effect of SF on GDP and other variables on a regional level - Attempt to capture effect of different aid intensity on regions

Gentle reminder: Have you finished new evaluations? - Finished in 2013 or 2014, - Please send them to us: regio-eval@ec.europa.eu - Title and weblink is enough! Use: - for ex post evaluation 2007 – 2013 - library of evaluations on INFOREGIO