Evaluation of the Paris Declaration Phase 2 DAC Evaluation Network 15 June 2009 Niels Dabelstein

Phase II ’Architecture’ Again based on the principles of the Paris Declaration: a joint evaluation comprising: Country level evaluations assessing results/outcomes Additional donor/agency HQ studies Supplementary studies with focus on results Synthesis report to be presented to 4th HLF

Phase II Evaluation Model Two complementary foci: 1)Implementation focus (expanded Phase I): More diverse set of countries + wider range of stakeholders More attention to capacity building and assess donor support to analytic & advisory activities HQ level studies by donors not included in Phase I 2)Results focus: Identify PD influence on development effectiveness (outcomes & results)

Methodological Issues Challenges to evaluate the results: Brief time span since PD endorsed (March 2005) External influences make attribution difficult Demanding data requirements Complementary methodologies required To handle these challenges the evaluation should: Have a balanced & sufficient sample of countries Have sufficient coverage of sectors and themes Produce information of good quality Offer possibility of explanation and attribution

Methodological Issues Therefore methods should include: Synthesis of existing evaluations, research and indicators Comparative in-depth case studies chosen to contain a good cross-section of common themes/sectors Longitudinal studies: backward looking to track PD-like (longer established) policies and possibly forward looking (‘theory-based’ to map plausible directions of travel) Targeted comparative studies to ‘supplement’ country- based evaluations

Overseeing the evaluation International Reference Group, co-chaired by Sri Lanka and the Netherlands Members of the DAC Network on Development Evaluation (who actively support) Partner countries who conduct country-level evaluations Multilaterals and CSOs Tasks: Endorse overall Evaluation Framework and ToRs for component & supplementary studies Review draft reports for quality, credibility & clarity

Participants in Int. Ref. Group Australia Austria Belgium Canada Denmark Finland France Germany Global Fund/GAVI Ireland Japan The Netherlands New Zealand Norway Spain Sweden Switzerland United Kingdom USA UNDG/UNDP OECD/DAC CONCORD World Bank/IEG Afghanistan Bangladesh Benin Bolivia Cambodia Cameroun Columbia DRC Indonesia Ghana Kyrgyz Republic Malawi Mali Mozambique Papua New Guinea Samoa Senegal South Africa Sri Lanka Uganda Viet Nam Zambia Reality of Aid

Managing the evaluation Management Group r esponsible for: Developing the overall evaluation framework and ToR Core Evaluation Team Coordinating and managing the evaluation process Guiding the component studies Developing and managing supplementary studies and synthesis of findings and recommendations. Evaluation Secretariat at Danish Institute for International Studies

Managing the evaluation National Reference Groups Established in-country and with key government, development partners and NGO stakeholders Approve detailed design of country study Serve as resource for country evaluation teams Review draft evaluation products for quality, credibility and clarity

1,30 Country Level Studies (18) Donor HQ Studies (4) Reference Group meetings (4) Management Group Meetings (8) Regional workshops (8) Core team Special Studies Dissemination Secretariat DIIS Contingencies Total Estimated Cost BUDGET

Contributions Euro Austria Norway * Australia Spain Belgium Sweden * Canada *Switzerland Denmark UK Finland US France *AfDB Germany *AsDB Ireland80.000EC Japan IDB Luxemburg UN Netherlands World BankIn kind New Zealand TOTAL Budget Outstanding

Schedule of Events – 13 Feb.1st Meeting of the Reference Group for PD Evaluation Phase 2 Kick-off workshop - 1st draft Approach paper. 15 MayApproach Paper and TOR for Core Team approved. 3 JuneTender process initiated w. three bidders. (one has withdrawn) 5 AugustTeam Selection 7 SeptemberCore Team operational 1 OctoberDraft Report on Untying of Aid to IRG for comments (by 11 October) 26 – 28 Oct.Asia Pacific Regional Workshop in Cambodia 1 NovemberFinal Report on Untying of Aid 3 – 5 Nov.Latin America Regional Workshop in Colombia 10 – 12 Nov.Anglophone Africa Regional Workshop in Malawi 18 – 20 Nov.Francophone Africa Regional Workshop in Benin 20 NovemberUntying of Aid Report discussed in DAC 30 November 2nd Meeting of the Reference Group for PD Evaluation Phase 2. 1 DecemberCountry Level TOR; Work plan for – 3 Dec.WP-EFF, presentation of progress report and Untying of Aid Study