Evaluation network MS - DG REGIO 14th April 2011, Kai Stryczynski

Slides:

Advertisements

Similar presentations

Theory-Based Evaluation:

Advertisements

1 EU Strategy for the Baltic Sea Region Evaluation: Setting Outcome Indicators and Targets Seminar: 15 March 2011, La Hulpe Veronica Gaffey Acting Director.

1 European Union Regional Policy – Employment, Social Affairs and Inclusion Draft guidance on monitoring and evaluation : Concepts and recommendations.

A Fresh Look at the Intervention Logic of Structural Funds

Regional Policy Revised version Marielle Riché Evaluation Unit DG Regional Policy International Monitoring Conference Budapest 11 th November 2011 Brussels.

Regional Policy Meta-Evaluation Some Reflections Evaluation Conference, Warsaw 12/13 November 2012 Veronica Gaffey Head of Evaluation DG for Regional.

Good Evaluation Planning – and why this matters Presentation by Elliot Stern to Evaluation Network Meeting January 16 th 2015.

Session Four: M&E System for AfT bankable projects UNITED NATIONS Economic and Social Commission for Western Asia (ESCWA) Expert Group Meeting on Monitoring.

New frontiers Evaluation methods Theory of change Project cycle and risk management Jesper Johnsøn, CMI, U4 Bergen, February 4, 2014.

1 Monitoring and evaluation after 2013 – some first ideas, mainly for ERDF / CF Evaluation network DG REGIO 14 th October 2010.

V4 Expert Group V4 Expert Group Result Orientation Challenges – 17 June 2014 Budapest.

Andrey Ivanov, Senior Policy Advisor, Human Development and Roma Inclusion cluster, UNDP BRC.

Guidance notes on the Intevention Logic and on Building a priority axis 27 September 2013.

1 Ex-ante evaluations of ESF operational programmes Budapest 26 th September 2013 Kamil Valica Unit A.3 Impact Assessment and Evaluation DG Employment,

Impact Evaluation in Education Introduction to Monitoring and Evaluation Andrew Jenkins 23/03/14.

Regional Policy Concepts and Recommendations Update Kai Stryczynski DG Regional and Urban Policy Brussels, 10 March Cohesion Policy.

1 Monitoring & evaluation 2013+: concepts and ideas (ERDF & CF) CMEF meeting, 17 th June 2011, Kai Stryczynski, DG REGIO Evaluation Unit.

Regional Policy How are evaluations used in the EU? How to make them more usable? Stockholm, 8 October 2015 Kai Stryczynski, DG Regional and Urban Policy.

The P Process Strategic Design

 Finish reading If not finished in class. Answer questions on the last slide of this presentation.

SUMMARY Macerata, 8 th April Andrea Gramillano, t33 srl.

Identifying Monitoring Questions from your Program Logic.

Evaluation Plan Workshop for Cross-border Programmes February 2016 | Thessaloniki, Greece Interact is co-financed by the European Regional Development.

Stages of Research and Development

Evaluation and Assessment

Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 9. Periodic data collection methods.

Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 2. Session 5. Review of the organizational strategy.

Chapter 03 Project Design

Monitoring & Evaluation Processes A A walkthrough of the whole process

Specific objectives Structured approach for design and assessment

Module 9 Designing and using EFGR-responsive evaluation indicators

Keeping Track in Complicated and Complex Situations

Evaluation : goals and principles

Introduction to Evaluation

Veronica Gaffey & Antonella Schulte-Braucks

Program Evaluation Essentials-- Part 2

Small Charities Challenge Fund (SCCF) Guidance Webinar

Common Monitoring and Evaluation System for Rural Development

Multi-Sectoral Nutrition Action Planning Training Module

KEY PRINCIPLES OF THINKING SYSTEMICALLY

How to improve their contribution to programme quality?

Expert evaluation network

Preparation of Annual Implemention Reports (AIR) 2013

Competition for Evaluations & 2016 Conference

Group Work Lesson 9.

Evaluation network DG REGIO 14th April 2011

Ex-ante evaluation: major points and state of play

Patty Simou DG REGIO Evaluation Network October 2010

Daniele Vidoni European Commission - DG Regional and Urban Policy

Evaluation Network Meeting: Brussels, October 2010

Patty Simou DG REGIO Evaluation Network April 2009

Innovation evaluation activities 2010

Evaluation Network Meeting

Analysing Evaluation Plans

PEMPAL Internal Control Working Group– 45th IACOP Meeting

MIG-P orientation debate

Guidance document on ex ante evaluation

DG Environment, Unit D.2 Marine Environment and Water Industry

Expert evaluation network

Evaluation and Impact Assessment Unit DG EMPL Ines Hartwig

Legal issues and compliance checking in WFD implementation SCG meeting 5-6 November 2008 Jorge Rodríguez Romero, Unit D.2, DG Environment, European.

The DCMQC programme National programme running for one year to provide support to LAs in developing an MPS / delivering market facilitation. Part of the.

SAMBa Writing Sprint for ITT9 Assignment

ESF monitoring and evaluation in Draft guidance

DG REGIO Evaluation-Related Activities State of play

Guidance on Evaluation plan

INFORMATION SEMINAR Interreg V-A Latvia-Lithuania programme

Project intervention logic

Quality management in Youth centres

How will you know what you’re proposing is successful?

Presentation transcript:

Evaluation network MS - DG REGIO 14th April 2011, Kai Stryczynski Monitoring & evaluation after 2013 – Concepts and ideas, sections 1+2 (concepts) Evaluation network MS - DG REGIO 14th April 2011, Kai Stryczynski

Why this paper? Wrapping up some key ideas discussed in past few years on M+E Step towards single REGIO guidance paper for 2014 Time for discussion and preparation

What do you want to change? Programme priorities should clarify what they want to change - what concern is driving your intervention? Express the precise dimension of change by a result (outcome) indicator Clear expression of desired change is precondition for later M + E – cannot be fixed later on.

How do you want to change things? Put on paper what factors you think are likely to affect your result indicator – and how Select the factor(s) the public programme should influence – what would the programme produce? You have found your output indicator and described an intervention logic

Monitoring: what can be observed. Can outputs be observed? Yes! Output monitoring. Can changes in result indicators – driven by many factors - be observed? Yes! Surveys, statistics, expert judgement,... Can the share of factors contributing to the result indicator be observed? No! Only their sum is observable.

Evaluation: an inquiry into the non-observable Distinguishing the contribution of the programme – the impact – from the effect of other factors. Theory-based evaluations inquire the mechanisms that make a contribution of the programme happen. Counterfactual evaluations put a number on the contribution of the programme to the change.

Combine approaches and mix methods Both types of impact evaluation answer complementary questions – so combine them. Any inquiry delivers hints and partial answers – look at problems with different methods for a safe judgement.

After and beyond this paper Please comment on Concepts and Ideas (end of May) Change into draft REGIO guidance paper after publication of legislative proposals (July) EVALSED: methods for evaluation – continuing update