1. Supporting Learning and Organisational Effectiveness
The Communication Function of the Independent Office of Evaluation (IOE) of IFAD
EES Conference Maastricht
29 September 2016 (10: :30)

2. Basic assumptions and questions
Evaluation use for learning and accountability
Factors determining use of evaluation
Characteristics of the evaluation
Characteristics of the organisational setting
Communication critical element of engagement in evaluation (process)
Institutional mechanisms at IFAD

3. Strengthening evaluation use
Stakeholder participation (Core Learning Partnership)
Evaluation architecture, with key findings summarised in Annual Report on Results and Impact (ARRI)
Evaluation Communication Unit (ECU) to enhance IOE’s profile as a knowledge producer, reach out to difference audiences and share key lessons from evaluations
Management Response or Agreement at Completion Point at the end of every evaluation

4. Architecture of IOE Evaluation Products

5. IOE Evaluation Communication Unit
Publishing process
Graphic realization
Dissemination
Media relations, press releases
IOE website and databases
Information & knowledge sharing 5

6. IOE Communication Unit - Products
Evaluation briefs
Profiles - summary of the evaluation report, focusing on 3 or 4 key recommendations from the evaluation.
Insights - focus on ONE key learning issue emerging from the evaluation.
Visual sheets 6

7. Evaluation communication - feedback survey
Purpose: to gain feed back on the quality and utility of IOE communication products and services
Conducted in September 2016
Targeted: IFAD staff; IFAD Board Members; staff from other Rome-based agencies; bilateral, international organizations; academics, private sector employees, NGOs etc.
119 respondents (10.8%)

8. Feedback – evaluation reports
Evaluation reports still main source of information
>50% regularly or often read IOE evaluation reports
Preferred access through IOE website (55%)
Executive summary main source of information on evaluation findings (70%)
Full report read by 44% of respondents
Quality of reports rated positively by 94%

9. Feedback – communication products
Websites, newsletters and presentations most important communication services (>30% access regularly)
New communication products less used
E.g. social media posts (18%)
Insights/profiles (21%)
Infographics (26%)
Quality of Evaluation Briefs (Insights, Profiles) also rated less positive (66%/68%)

10. Feedback - Government

11. Feedback – IFAD Staff

12. Feedback Survey - Findings
Persuasiveness of evaluation findings still depends on the quality of evaluation reports
New communication products less important than thought
Government considers different types of evaluations
Some types of evaluations do not reach intended audiences (impact evaluations, evaluation syntheses)
Direct interaction (events) preferred for learning

13. IFAD Management’s Response System
IFAD’s Management response
Agreement at Completion Point (ACP)
President’s Report on the Implementation Status of Evaluation Recommendations and Management Actions (PRISMA)

14. Management Response - Trends
PRISMA 2016 – uptake of IOE recommendations (94%)

15. Management Response- Findings
Consistent follow up by Management and Quality Assurance
Higher number of “complex evaluations” requires follow up over several years
Issues consistently raised by IOE evaluations (e.g. Targeting, M&E, private sector involvement, policy engagement, gender) received increased attention and follow up.
Knowledge generated and consistent follow up seen as contributing to IFAD’s operational effectiveness and efficiency

16. Overall Conclusions
Uptake of evaluation findings firmly institutionalised in IFAD – internal and external legitimisation (Harberger, 2011)
Communication provides vital link between evaluators and users – report quality ensures credibility; direct interaction between evaluators and users (events) primarily supports learning function
Diversity of evaluation products requires absorptive capacity
Wide range of communication tools not equally effective; to be tailored to target audience and intended purpose