Managing for results in the new SF programming period? European Employment forum Benedict Wauters Coordinator Community of Practice on Results Based Management.

Slides:



Advertisements
Similar presentations
Performance Framework
Advertisements

Samuele Dossi DG for Regional Policy - Evaluation
Ex-ante conditionality – General guidance Workshop on strategic programming, monitoring and evaluation Ilse De Mecheleer, DG EMPL Madrid, 22 February 2013.
European Social Fund Evaluation in Italy Stefano Volpi Roma, 03 maggio 2011 Isfol Esf Evaluation Unit Human Resources Policies Evaluation Area Rome, Corso.
1 Final Report Results of the on-line Public Consultation of the Conclusions of the 5th Cohesion Report Peter Berkowitz Head of Unit Conception, forward.
Evaluating public RTD interventions: A performance audit perspective from the EU European Court of Auditors American Evaluation Society, Portland, 3 November.
Integrated Territorial Investment (ITI)
S3 Project aim The main goal, thus expected result, of the S3 project would be to strengthen tools used for Structural Fund policies (SF), through the.
CENTRAL EUROPE PROGRAMME SUCCESS FACTORS FOR PROJECT DEVELOPMENT: focus on activities and partnership JTS CENTRAL EUROPE PROGRAMME.
Ad hoc expert group meeting on draft templates and guidance for the Partnership Agreement and operational programmes under cohesion policy
Regional Policy Managing Authorities of the ETC programmes Annual Meeting W Piskorz, Head of Unit Competence Centre Inclusive Growth, Urban and.
The implementation of the rural development policy and its impacts on innovation and modernisation of rural economy Christian Vincentini, European Commission.
A project implemented by the HTSPE consortium This project is funded by the European Union SUSTAINABLE GROWTH LIFE
Quality assurance in IVET in Romania Lucian Voinea Mihai Iacob Otilia Apostu 4 th Project Meeting Prague, 21 st -22 nd October 2010.
Riga – Latvia, 4 & 5 December 2006
IPA Funds Programme Management sept Bölgesel Rekabet Edebilirlik Operasyonel Programı’nın Uygulanması için Kurumsal Kapasitenin Oluşturulmasına.
A new start for the Lisbon Strategy Executive summary Increase and improve investment in Research and Development Facilitate innovation,
EN Regional Policy EUROPEAN COMMISSION Innovation and the Structural Funds, Antwerp, 16 January 2007 Veronica Gaffey Innovative Actions Unit.
Reformed Partnership and Multi-Level Governance Ana Maria Dobre Political Administrator General Council Secretariat
1 European Union Regional Policy – Employment, Social Affairs and Inclusion The new architecture for cohesion policy post-2013 High-Level Meeting on the.
Guidance notes on the Intevention Logic and on Building a priority axis 27 September 2013.
Commissioning Self Analysis and Planning Exercise activity sheets.
Regional Policy Major Projects in Cohesion Policy Major Projects Team, Unit G.1 Smart and Sustainable Growth Competence Centre, DG Regional and Urban Policy.
European Commission Introduction to the Community Programme for Employment and Social Solidarity PROGRESS
Regional Policy Common Strategic Framework The Commission's revised proposal for the CPR - COM (2012) 496 of 11 Sept.
European Territorial Cooperation SAWP meeting, 9 July
1 European Union Regional Policy – Employment, Social Affairs and Inclusion Community-led local development Articles of the Common Provisions Regulation.
Institutional structures for Structural Funds assistance Ministry of Finance September 10, 2003.
Regional Policy EU Cohesion Policy 2014 – 2020 Proposals from the European Commission.
1 European Territorial Cooperation in legislative proposals Peter Berkowitz Head of Unit Conception, forward studies, impact assessment, DG Regional Policy.
Today PMO added value discussions coffee Output based subsidies Lunch Uses of performance information.
The European agenda on improving the efficiency of employment and social policies: Bratislava, December 2011 The example of social experimentation.
Regional Policy Veronica Gaffey Evaluation Unit DG Regional Policy International Monitoring Conference Budapest 11 th November 2011 Budapest 26 th September2013.
ACP S&T Programme - Stakeholder conference October Implemented by the ACP Secretariat Funded by the European Union EDULINK - ACP Science and.
Regional Policy Result Orientation of future ETC Programes Veronica Gaffey Head of Evaluation & European Semester 23 April 2013.
1 Cohesion Policy Brussels, 9 June 2009 “ Cohesion policy: response to the economic crisis” European Commission seminar for managing and certifying.
MONITORING SYSTEM OF EU STRUCTURAL FUNDS: PHYSICAL INDICATORS International Conference for New Member States February 1-2, 2012, Vilnius (Lithuania) European.
Regional Policy How are evaluations used in the EU? How to make them more usable? Stockholm, 8 October 2015 Kai Stryczynski, DG Regional and Urban Policy.
1 Eurostat’s grant policy for 2010 Luxembourg, 23/03/2010 Unit A4 – Financial Management Section 3 – Grant procedures and agreements.
Evaluation of NRNs Andreas Resch, Evaluation Advisor.
REGIONAL POLICY EUROPEAN COMMISSION The contribution of EU Regional/Cohesion programmes Corinne Hermant-de Callataÿ European Commission,
Information Overview SF: Planning & Programming Workshops for EC Delegation Patrick Colgan & Ján Krištín PROGRAMMING PROCEDURES in Support of Regional.
"The challenge for Territorial Cohesion 2014 – 2020: delivering results for EU citizens" Veronica Gaffey Acting Director EUROPEAN COMMISSION, DG for Regional.
Results orientation: what to remember Benedict Wauters Deputy director for strategy, innovation, evaluation and methodology Flanders ESF Agency COP RBM.
Jela Tvrdonova, The EU priorities:  Use the Leader approach for introducing innovation in the thematic axis  better governance at the local level.
Results orientation: audit perspective Jiri Plecity, Head of Unit H1, Relations with Control Authorities, Legal Procedures, Audit of Direct Management.
Interreg IIIB Trans-national cooperation: Budget comparison : 440 million EURO 420 m EURO (Interreg IIC prog.) + 20 m EURO (Pilot Actions)
Indicators – intervention logic, differences ( vs programming period, ESF vs. ERDF) Piotr Wolski Marshall’s Office Zachodniopomorskie.
Croatia: Result orientation within the process of preparation of programming documents V4+ Croatia and Slovenia Expert Level Conference Budapest,
Ministry of Finance Financial management and control of the Operational Programmes, co- financed under the Structural funds and the Cohesion fund of EU.
"The role of Rural Networks as effective tools to promote rural development" TAIEX/Local Administration Facility Seminar on Rural Development Brussels,
TAIEX-REGIO Workshop on Applying the Partnership Principle in the European Structural and Investment Funds Bratislava, 20/05/2016 Involvement of Partners.
PRIORITIES FOR THE FUTURE
Evaluation : goals and principles
Interreg V-A Romania-Bulgaria Programme
Veronica Gaffey & Antonella Schulte-Braucks
Ex-ante conditionality – General guidance
Evaluation plans for programming period in Poland
The role of the ECCP (1) The involvement of all relevant stakeholders – public authorities, economic and social partners and civil society bodies – at.
The Learning Networks under the ESF
Purpose of the presentation
Helene Skikos DG Education and Culture
Panel 1: Synergies between policies and EU funds Creating dynamics and impacts Grzegorz Gajewski DG Migration and Home Affairs EU Funds for integration.
ESF IMPLEMENTATION IN MALTA
EU Cohesion Policy : legislative proposals
Future of Cohesion Policy
Culture Statistics: policy needs
Ex ante conditionalities in cohesion policy:
DG Employment, Social Affairs and Inclusion
ESF monitoring and evaluation in Draft guidance
Presentation transcript:

Managing for results in the new SF programming period? European Employment forum Benedict Wauters Coordinator Community of Practice on Results Based Management Deputy director, Flemish ESF agency Lecturer at Rotterdam Business School, Hogeschool Den Haag, in Strategy, Risk Management and Research Methodology

Challenges for the new SF period Moving from a fragmented collection of Managing Authorities, Intermediate Bodies, beneficiaries, final beneficiaries... to a Programme Management Organisation, delivery partners and constituents, aligned to a common strategy? Moving from accountability to responsibility: what does it mean for indicators, evaluation, performance based-budgeting? COP on RBM has been discussing these challenges for + 2 years 2

3 Results based management (RBM) = Strategic management for the public sector Review and synthesis of tools from leading organisations led to the development of a RBM self-assessment framework (see –Public sector oriented sources New Zealand: Getting Better at Managing for Outcomes and Getting Better at Managing for Shared Outcomes Treasure Board of Canada: The Managing for Results Self-Assessment Tool World Bank: CAP-Scan Managing for Development Results Capacity Scan Asian Development Bank: Readiness Assessment Tool - Implementing a Results Focus in Organizations EIPA: CAF –Mainly private sector but also attention to public sector: Palladium: Balanced Scorecard Hall of Fame award for Executing Strategy Key starting point is to define the “Programme management organisation” (PMO)

4 Example: the ESF PMO in Lithuania Ministry of Finance (MA) Ministry of Employment (IB) ESF Agency Ministry of education (IB) PMO crosses organisational boundaries and may relate only to a (small) part of the legal entities involved Etc… EC? Audit Authorities? Partners? Who are the line units? Who is supporting who?

5 Example: the ESF PMO in Lithuania Ministry of Finance (MA) Ministry of Employment (IB) ESF Agency Ministry of education (IB) PMO crosses organisational boundaries and may relate only to a (small) part of the legal entities involved Etc… EC? Audit Authorities? Partners? Who are the line units? Who is supporting who? If these entities are in the programme management organisation together, that means they address common policy expectations!

6 A strategy map for programmes-1 An example of a PMO strategy (reconstituted on the basis of planning documents)

7 A strategy map for programmes-2 Four levels of expectations: –Legitimising authorities: who can pull the plug? –Constituents: ultimate beneficiaries (reciprocal expectations) –Process: Delivery and other external partners Internal innovation, production, relationship management processes –Learning and growth: intangible assets (human, organization and information capital) of the PM organization OUT- PUTS ALIGNMENTALIGNMENT INPUTS Conventional programme strategy Decreasing influence OUTCOMES PMO strategy!

8 A strategy map for programmes-2 Four levels of expectations: –Legitimising authorities: who can pull the plug? –Constituents: ultimate beneficiaries (reciprocal expectations) –Process: Delivery and other external partners Internal innovation, production, relationship management processes –Learning and growth: intangible assets (human, organization and information capital) of the PM organization OUT- PUTS ALIGNMENTALIGNMENT INPUTS Conventional programme strategy Decreasing influence OUTCOMES PMO strategy! PMO does NOT deliver any actions /outputs for constituents itself! PMO needs to define, given its chosen added value, what it expects from partners and what they should expect from the PMO

9 PMO added value Programme organisations can add value in three ways: –Either the PM organisation is an enhancer that supports delivery partners to produce already existing products/services to satisfy existing needs BUT also support continuous improvement (volume + process effects*); –or it is an incubator that supports delivery and other partners to continuously (re)develop new products and services for new needs and deploy them until they become stable and mainstream (scope + role effects); –or it is solutions manager where the focus is NOT on specific products and services but on developing detailed knowledge concerning specific challenges (a limited number of) delivery partners are facing regarding their constituents and work closely with them to solve these challenges. This entails supporting, through a portfolio of tailor-made calls, collaboration with other actors to integrate and customise a whole battery of products/services even crossing traditional policy domains (eg education, welfare, employment, economy,…) to better suit the needs of the constituents of the delivery partners (scope + role effects) * See DG EMPL Methodological note : A framework to describe the Community Added Value of the ESF

10 An example of a PMO strategy (reconstituted on the basis of planning documents) Managing for process outcomes at the level of external partners should be top priority for the PMO! Without success there, why should other (attributable) results be expected? Measuring PMO added value

Compliance versus responsability? Accountability = compliance –Follow the (financial) rules –Hit targets on indicators –Link finance to targets automatically Managing for results = responsability –Pro-active management: rules are not an end but just a means: if they do not add value, scrap them –Understand and be able to explain why you (did not) make progress: requires a good theory! –Make payment conditional on what was learnt from evaluation and actions taken 11

A theory of change in Flanders Most of these actions are part of pathways offered to the unemployed (mod 7) Actions oriented towards the unemployed ASSUMPTIONS TOC requires good understanding of actions!

Most of these actions are part of pathways offered to the unemployed (mod 7) Actions oriented towards the unemployed Output oriented: A theory of change in Flanders ASSUMPTIONS Used as a basis for evaluation of the relevant actions

14 Position of detailed theories of change in the overall PMO strategy

Opportunities in the Regulation? The Partnership Contract shall set out: …arrangements to ensure efficient implementation of the CSF Funds,including: (i) an assessment of whether there is a need to reinforce the administrative capacity of the authorities and, where appropriate, beneficiaries, and actions to be taken for this purpose An operation may receive support from one or more CSF Funds and from other Union instruments, provided that the expenditure item included in a request for payment for reimbursement by one of the CSF Funds does not receive support from another Fund or Union instrument, or support from the same Fund under another programme. General ex ante conditionality: 7. Statistical systems and result indicators:… The existence of an effective system of result indicators necessary to monitor progress towards results and to undertake impact evaluation: … the selection of result indicators for each programme providing information on those aspects of the well-being and progress of people that motivate policy actions financed by the programme… 15

Opportunities in the Regulation? Reinforced strategic programming geared towards results: the Commission proposes a more results-oriented programming process to ensure that cohesion policy programmes have a clear intervention logic, are oriented towards results, and include the appropriate provisions for an integrated approach to development and the effective implementation of the Funds. In particular, the Commission proposes to introduce the Joint Action Plans, which are operations comprising a group of projects as part of an operational programme, with specific objectives, result indicators and outputs agreed between the Member State and the Commission. They offer a simplified management and control system geared towards performance. The CSF Funds may be used to support financial instruments under a programme,…, in order to contribute to the achievement of specific objectives set out under a priority, based on an ex ante assessment which has identified market failures or suboptimal investment situations, and investment needs. Content and adoption of operational programmes …arrangements to ensure the efficient implementation of the Funds, including (i) the planned use of technical assistance including actions to reinforce the administrative capacity of authorities and beneficiaries…; 16

Threats in the Regulation? 'Ex post' conditionality will strengthen the focus on performance and the attainment of the Europe 2020 objectives. It will be based on the achievement of milestones related to targets for outputs and results linked to Europe 2020 objectives set for programmes in the partnership contract. 5% of the budget of the relevant funds will be set aside and allocated, during a mid-term performance review, to the Member States whose programmes have met their milestones. In addition to the performance reserve, failure to achieve milestones may lead to the suspension of funds, and a serious underachievement in meeting targets for a programme may give rise to a cancellation of funds… The Commission, in cooperation with the Member States, shall undertake a review of the performance of the programmes in each Member State in 2017 and 2019, with reference to the performance framework set out in the respective Partnership Contract and programmes. Ex ante evaluations shall appraise:…how the expected outputs will contribute to results 17

Threats in the Regulation? ESF: Common and programme specific result indicators relate to the priority axes or the sub-priorities established under a priority axis. Baseline indicators shall use the latest available data. Cumulative quantified target values shall be fixed for An operational programme shall consist of priority axes. A priority axis shall concern one Fund for a category of region and shall correspond, without prejudice to Article 52, to a thematic objective and comprise one or more investment priorities of that thematic objective, in accordance with the Fund specific rules. For the ESF, a priority axis may combine investment priorities from different thematic objectives set out in Article 9(8), (9), (10) and (11) in order to facilitate their contribution to other priority axes, in duly justified circumstances. 18

19 Thank you for your attention! Visit Contact:

Discussion What value are you striving to add with your EU programme(s)? –Enhancer –Incubator –Solutions manager Will you be able to seize the opportunities offered by the new Regulation? Deal with the threats? How? 20

Annex Some information about the Community of Practice on Results Based Management 21

The Community of Practice on results based management “Communities of practice are groups of people who share a concern or a passion for something they do and learn how to do it better as they interact regularly.” Oriented primarily to the ESF as funded by DG EMPL but also open to other Structural Funds

The Community of Practice on results based management: work programme +/-Three years: start 1/4/2009 end 1/4/ knowledge sharing meetings for programme managers –Adressing urgent issues concerning results based management –Reflecting more fundamentally on structural funds practice –Bringing in leading experts to stimulate discussion on the basis of reports on state of the art and on current practices in the structural funds but also beyond 3 study visits to an ESF programme manager to review and improve planning and operations Interactive website with discussion forum, wiki pages, cybrary etc. Dissemination activities: –A training seminar in cooperation with the European Institute for Public Administration in Maastricht –Sessions inside/with the European Commission –A revised Sourcebook + website ( –…–…

The Community of Practice on results based management: work programme +/-Three years: start 1/4/2009 end 1/4/ knowledge sharing meetings for programme managers –Adressing urgent issues concerning results based management –Reflecting more fundamentally on structural funds practice –Bringing in leading experts to stimulate discussion on the basis of reports on state of the art and on current practices in the structural funds but also beyond 3 study visits to an ESF programme manager to review and improve planning and operations Interactive website with discussion forum, wiki pages, cybrary etc. Dissemination activities: –A training seminar in cooperation with the European Institute for Public Administration in Maastricht –Sessions inside/with the European Commission –A revised Sourcebook + website ( –…–… COP will be prolonged until end of 2012

Interested? The CoP is open to all structural funds programmes (programme managers, evaluation officers, etc.) External experts can be invited as ad hoc contributors