EN Regional Policy EUROPEAN COMMISSION Impact evaluation: some introductory words Daniel Mouqué Evaluation unit, DG REGIO Brussels, November 2008.

Slides:



Advertisements
Similar presentations
Academic Network of European Disability experts (ANED) – VT/2007/005.
Advertisements

Counterfactual impact evaluation
REGIONAL POLICY EUROPEAN COMMISSION Perceptions of quality of life in 75 European Cities: a European survey Corinne Hermant-de Callataÿ
Theory-Based Evaluation:
1 The best of both worlds: combining approaches Daniel Mouqué Evaluation Unit, DG REGIO.
1 EU Strategy for the Baltic Sea Region Evaluation: Setting Outcome Indicators and Targets Seminar: 15 March 2011, La Hulpe Veronica Gaffey Acting Director.
Capturing Effects of Interventions, Policies and Programmes Murray Saunders President EES CSET Lancaster University Sixth European Conference on Evaluation.
1 European Union Regional Policy – Employment, Social Affairs and Inclusion Draft guidance on monitoring and evaluation : Concepts and recommendations.
1 First steps in practice Daniel Mouqué Evaluation Unit DG REGIO.
Towards reform of the EU Budget _________________________________________________________________________________Accountability, the aching tooth ? European.
University of Athens, GREECE Innovation and regional development : Prof. Lena J. Tsipouri.
Performance Framework
A Fresh Look at the Intervention Logic of Structural Funds
Regional Policy Revised version Marielle Riché Evaluation Unit DG Regional Policy International Monitoring Conference Budapest 11 th November 2011 Brussels.
FORESTUR: “Tailored training for professionals in the rural tourist sector” ES/06/B/F/PP QUALITY MANAGEMENT PLAN Valencia, November 2006.
Measuring the Impact of the RDP Issues being addressed at an EU level with regards to measuring the impact of the Rural Development programmes B. Schuh.
Regional Policy Meta-Evaluation Some Reflections Evaluation Conference, Warsaw 12/13 November 2012 Veronica Gaffey Head of Evaluation DG for Regional.
Social Impacts Measurement in Government and Academia Daniel Fujiwara Cabinet Office & London School of Economics.
Good Evaluation Planning – and why this matters Presentation by Elliot Stern to Evaluation Network Meeting January 16 th 2015.
Monitoring and evaluation of carers’ services and projects Dr Andrea Wigfield - Associate Professor of Social Policy Centre for International Research.
Designing Influential Evaluations Session 5 Quality of Evidence Uganda Evaluation Week - Pre-Conference Workshop 19 th and 20 th May 2014.
VIII Evaluation Conference ‘Methodological Developments and Challenges in UK Policy Evaluation’ Daniel Fujiwara Senior Economist Cabinet Office & London.
Strenghtening collaboration with Serbia - IPA4 Project expected outcomes Frédéric Denecker, Programme Management Officer Reitox and International Cooperation.
TOOLS OF POSITIVE ANALYSIS
Evaluation plans for programming period in Poland Experience and new arrangements Ministry of Infrastructure and Development, Poland Athens,
Lesson 3: Monitoring and Indicator Macerata, 23 nd October Alessandro Valenza, Director, t33 srl.
Evaluation methods and tools (Focus on delivery mechanism) Jela Tvrdonova, 2014.
Lesson 8: Effectiveness Macerata, 11 December Alessandro Valenza, Director, t33 srl.
VERONICA GAFFEY Acting Director – Policy Development DG FOR REGIONAL DEVELOPMENT Przyszłość polityki spójności V Raport Kohezyjny a wnioski z ewaluacji.
Evidencing Outcomes Ruth Mann / George Box Commissioning Strategies Group, NOMS February 2014 UNCLASSIFIED.
The Impact of Health Coaching
Evaluation – Principles and methods Matt Barnard Head of Evaluation NSPCC.
Specific Support Actions for Western Balkan Countries
BASELINE SURVEYS AND MONITORING OF PHARMACEUTICAL SITUATION IN COUNTRIES. Joseph Serutoke NPO/EDM WHO Uganda November 2002.
Project Cycle Management for International Development Cooperation Indicators Teacher Pietro Celotti Università degli Studi di Macerata 16 December 2011.
1 Cohesion Policy Ongoing Evaluation Budapest, 7 May 2010 Veronica Gaffey Head of Evaluation DG for Regional Policy European Commission.
Regional Policy Veronica Gaffey Evaluation Unit DG Regional Policy International Monitoring Conference Budapest 11 th November 2011 Budapest 26 th September2013.
Innovation Indicators across Innovation Agencies TAFTIE Policy Forum, 25 November 2014.
Evidence Based Practice RCS /9/05. Definitions  Rosenthal and Donald (1996) defined evidence-based medicine as a process of turning clinical problems.
Changes in the context of evaluation and assessment: the impact of the European Lifelong Learning strategy Romuald Normand, Institute of Education Lyon,
EN Regional Policy EUROPEAN COMMISSION National evaluation conference Marielle Riché Evaluation unit, DG REGIO Bucharest, 18.
The Scientific Method. Parts of an Experiment Independent variable; Input, the manipulated variable. What the experimenter chooses to change Dependent.
1 Support to enterprise – a counterfactual approach Daniel Mouqué Evaluation Unit, DG REGIO Ex post evaluation – WP 6c.
Research Methods Observations Interviews Case Studies Surveys Quasi Experiments.
1 General Elements in Evaluation Research. 2 Types of Evaluations.
Regional Policy Operational Programmes.
1 Counterfactual impact evaluation: What is it, why do it? Daniel Mouqué Evaluation Unit DG REGIO.
Social Experimentation & Randomized Evaluations Hélène Giacobino Director J-PAL Europe DG EMPLOI, Brussells,Nov 2011 World Bank Bratislawa December 2011.
Chapter 1: Section 1 What is Science?. What Science IS and IS NOT.. The goal of Science is to investigate and understand the natural world, to explain.
1 Counterfactual methods – summer school, future work Daniel Mouqué Evaluation Unit, DG REGIO.
Do European Social Fund labour market interventions work? Counterfactual evidence from the Czech Republic. Vladimir Kváča, Czech Ministry of Labour and.
1 Impact Evaluation in the European Commission Adam Abdulwahab Evaluation Unit, DG Regional Policy Budapest, 6 th May 2010.
Evaluation : goals and principles
Introduction to Evaluation
Assess Plan Do Review Resource 1: Types of Evaluation – which type of approach should I use? There are a number of different types of evaluation, the most.
Supporting material for CIE
Performance Framework
Impact evaluation: Examples in the ex post
Preparation of Annual Implemention Reports (AIR) 2013
#EUdatathon2017 Jobs, growth and investment … and #ESIFOpenData REGIO Evaluation and European Semester Unit ESI FUNDS ESI.
Evaluation plans for programming period in Poland
Daniele Vidoni European Commission - DG Regional and Urban Policy
Tailor made legislation for regions and cities?
On-going Evaluation in Germany
Counterfactual Impact Analysis applied in the ESF-Evaluation in Austria (period ) Contribution to the Expert-Hearing: Member States Experiences.
Welcome to Objective 2 programme South Netherlands
European Commission, DG Environment Air & Industrial Emissions Unit
Positive analysis in public finance
Preparation of Member States’ Strategic Reports 2009 European Commission seminar for managing and certifying authorities Brussels, 9 June 2009 John.
Guidance on Evaluation plan
Presentation transcript:

EN Regional Policy EUROPEAN COMMISSION Impact evaluation: some introductory words Daniel Mouqué Evaluation unit, DG REGIO Brussels, November 2008

Regional Policy EUROPEAN COMMISSION Evaluation Traditional tools include: Quantitative data, used descriptively: –Expenditure –Outputs (60% of indicators) –Results (eg jobs created) usually gross Qualitative methods (description, expert opinions, surveys) Macro-models – model, do not measure (« generic » actions, eg road building) Havent we always measured impact?

Regional Policy EUROPEAN COMMISSION Evaluation Observation, Description, Expert opinions… … all essential scientific methods, but…

Regional Policy EUROPEAN COMMISSION Evaluation Another essential scientific tool: comparison with control group Think drug trial A B C D

Regional Policy EUROPEAN COMMISSION Evaluation « Experimental » ie random selection of who to treat: potentially difficult 2.« Quasi-experimental » methods: Difference-in-difference Matching (eg by observed similarities) Where do you find your control group?

Regional Policy EUROPEAN COMMISSION Evaluation Strengths – rigour, quantification Weaknesses – establishing a control group, the black box problem => Suitable for discrete interventions with lots of units (eg aid to individuals, enterprises), not whole programmes or infrastructure => Tells you what/how much – combine with realistic evaluation for why/how? Strengths, weaknesses & applications

Regional Policy EUROPEAN COMMISSION Evaluation Accountability & public money – our duty to use all the tools available Convincing evidence for limited budgets Goal theory – those who are serious, measure progress Why impact evaluation, comparison/control groups?

Regional Policy EUROPEAN COMMISSION Evaluation In sum – one of several essential tools

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.