1. GUIDELINES Evaluation of National Rural Networks 2014-2020
Sari Rannanpää, Capacity Building Manager
Nordic-Baltic Networking Meeting, Jelgava (LV), 12 September 2016

2. Content Introduction & legal background
Evaluation challenges and guidance
The Guidelines - Evaluation of National Rural Networks
Why using the Guidelines?
Where to find the Guidelines?

3. Evaluation of NRNs: Why and how?
Purpose
Forms
Stand-alone evaluation / as part of the RDP evaluation / thematic evaluation
NRN self – assessment
Self-assessment should be interlinked with NRN evaluation
NRN stakeholders
Outside world
Assess the achievement of objectives
Demonstrate achievements
Improve quality of implementation
Increase transparency
Enhance NRN governance
Justify the use of public funds
To know whether NRN support RD policy and involve more stakeholders

4. Legal background for NRN evaluation
Article 54, Regulation 1303/2013
Improve the quality of design and implementation of programmes and assess their effectiveness, efficiency and impact
Articles 67&68, Regulation 1305/2013
Common monitoring and evaluation system and its objectives
Article 7, Regulation 1305/2013
Minimum requirements of the evaluation plan

5. Existing common NRN evaluation elements
Generic intervention logic for NRN provided at the EU level (Article 54, Regulation 1305/2013)
CMES common elements – 3 output indicators and 1 common evaluation question (Annex IV & V, Regulation 808/2014)
Minimum common monitoring & evaluation requirements to be completed by programme-specific elements
Evaluation plan specifies NRN related evaluation activities (Point 1.9 of Annex I, Regulation 808/2014)
Better planning/design facilitates monitoring, evaluation, self-assessment…

6. Evaluation challenges and guidance
Challenges for
Existing guidance
Evaluation guidance document for MTE of NRNP (example of indicators, intervention logics…)
Ex post evaluation guidelines – each chapter has sections on NRN
NRN intervention logic
NRN programme specific evaluation questions and indicators
Sufficient and high quality data and information
Assessment of NRN progress and achievements, results and impacts
Management and governance of NRN evaluation
Ex ante evaluation guidelines – separate chapter on ex ante evaluation of the NRN
Evaluation plan guidelines - separate chapter on planning NRN evaluation
Guidelines for NRN evaluation in

7. Guidelines Evaluation of National Rural Networks 2014-2020
Why?
assessment typically limited to monitoring level
Support needed in the establishment of Intervention Logic
Common and programme-specific evaluation elements
How?
Thematic Working Group of the Evaluation Helpdesk
Evaluation experts drafted the Guidelines
Sounding board commented

8. Guidelines Evaluation of National Rural Networks 2014-2020
Who is the target audience?
Managing Authorities
Evaluators
Actors involved in NRN operations
DG AGRI officials
Other stakeholders
How are the guidelines structured?
Introduction
Part I – Managing NRN Evaluation
Part II – Methodological Handbook
Part III - Toolbox

9. Part I NRN Evaluation Process

10. Part I How to manage the NRN evaluation? (1)
Involve various types of stakeholders in planning and preparing the NRN evaluation and clarify their roles:
Actors involved in operating the network: MA, NSU, PA, MC, NRN coordinating body etc.
Network members
Evaluators
Steering group for NRN evaluation can facilitate the NRN evaluation

11. Part I How to manage the NRN evaluation? (2)
Planning the NRN evaluation has to be done
For the entire programming period
Biannually / annually
For each evaluation
Planning phase includes defining
NRN-specific evaluation needs and activities
Form of NRN evaluation (part of the RDP/stand-alone)
Timing and resources
Communication and capacity building needs
Careful planning allows to allocate realistic resources for NRN evaluation

12. Part I How to manage the NRN evaluation? (3)
Prepare the NRN evaluation :
Construct the NRN intervention logic
Hierarchy of objectives & indicators
Formulate the evaluation questions
Select the evaluation approach and plan a suitable mix of methods
Screen the data needs and sources
Draft the ToR and conduct the tendering procedure
Careful preparation of evaluation ensures the selection of right evaluators and high quality of evaluation

13. Part I How to manage the NRN evaluation? (4)
Assure the quality of
conducting the evaluation (process)
evaluation report/s (product)
Communicate and cooperate with the evaluator
Ongoing building capacities of stakeholders in NRN evaluation will enable to communicate with evaluators and demand evidence based evaluation findings

14. Part I How to manage the NRN evaluation? (5)
Disseminate and communicate evaluation findings
Plan communication contents, tools & channels and timing according to different audiences
Follow up the evaluation findings
E.g. in AIR revisions, Coordination Body meetings
Disseminate and communicate evaluation findings to:
Actors involved in operating NRN
NRN members
Policy makers
General public
Follow up the evaluation findings, in order to:
Design and implement the NRN activities more effectively and efficiently
Involve more stakeholders and encourage broader networking in rural areas
Better implementation of rural development policy as the outcome of NRN activities
Selection of right dissemination tools and targeting will allow to communicate the NRN evaluation findings effectively and efficiently and will facilitate their follow up to improve the future networks activities

15. Part II – How to conduct NRN Evaluation?
1. Structuring 2. Observing 3. Analysing 4. Judging

16. Part II Overview of the Structuring Phase

17. Part II Overview of the Observing Phase

18. Part II Overview of the Analysing Phase

19. Part II Overview of the Judging Phase

20. Part III Toolbox ToR for NRN evaluation
Examples of NRN intervention logic
Examples of assessment tools

21. Part III Indicative template of the ToR
Introduction
Context, objective and purpose of the evaluation
Scope and tasks of the NRN evaluation
Evaluation Questions
Methodological approach
Information sources
Time schedule and deliverables
Management of the evaluation contract
Budget
Qualification of the team
Exclusion, selection and award criteria
Submission rules

22. Why use the Guidelines? The Guidelines…
Help to understand the legal framework and the evaluation requirements
Give an overview of roles and steps to be considered when managing a NRN evaluation
Support with a methodological guidance for properly conducting a NRN evaluation
Provide some practical useful tools

23. Where to find the Guidelines?
Published in July 2016

24. Thank you for your attention!
European Evaluation Helpdesk for Rural Development
Boulevard Saint Michel 77-79
B-1040 Brussels
Tel