1. EuropeAid Joint Monitoring Approaches Main results of toolbox matrix analysis May 2009 EuropeAid E5

2. EuropeAid 2 The toolbox matrix Information on 13 agencies is available. 7 agencies completed the Toolbox Matrix in Excel; information on the others was extracted from previous surveys (before the Seminar in June).

3. EuropeAid 3 Monitoring systems 9 agencies use Results-oriented Monitoring (ROM) Systems. 4 agencies (SIDA, AECID, CMRS, LD) focus on activities, inputs and/or outputs. All agencies (except BTC and AFD) use their “ROMS” for projects/programmes and also for sector support (EC is currently testing ROM for sector programmes). 3 donors state that their monitoring data can be compared and aggregated (EC, AFD, DFID).

4. EuropeAid 4 Criteria/rating system 5 agencies use internal staff to perform their monitoring activities, while other 5 use both internal and external experts and 2 use only external experts. All (except WB) use the DAC evaluation criteria. AFD and NMFA leave out the efficiency criterion. 5 agencies use rating systems in their ROMS (such as grading (a-d), colors…)

5. EuropeAid 5 Timing of ROM AFD uses its ROM exclusively at the design phase of the project/programme cycle. All other ROM intervene during the project implementation and in some cases also at/near completion (DFID, USAID, WB, BTC, GTZ) and after completion (EC, USAID, GTZ).

6. EuropeAid 6 Joint Monitoring, Shared results? Monitoring jointly with PG? Are results shared/published? PGPublicNo ECX Overall data DFIDXX US-DOSXX USAIDXX WBX SIDAX BTCX GTZXX AECIDX LDX AFDDependsonPM NL-MFAX With PGWith DonorsNo ECX DFIDX US-DOS USAIDXX WBX SIDAX BTCX GTZXX AECIDX LDX AFDX NL-MFA For SWAp + BS only

7. EuropeAid 7 Uses of Monitoring Monitoring is mainly used to provide feedback to project management (11) and to contribute to lessons learned (8). Feedback to Project Management Lessons Learned Portfolio Performance Overview Accountability ECXXX DFIDXX US-DOSXX USAIDXXXX WBXXX SIDAX BTCXX GTZXXXX AECIDX LuxDXX AFDX NL-MFAXXX

8. EuropeAid 8 Users of Monitoring Main users of results from monitoring are managers at projects level and country level and often senior management in HQ Users Project level management Country level Management Senior Management in HQ Other donorsPG ECXXXX DFIDXXX US-DOSX USAIDXXXXX WBXXX SIDAXX BTCXX GTZXXX AECIDX LuxDXXX AFDX NL-MFAXXX

9. EuropeAid 9 Areas to improve… Inexistence/ low quality of indicators; monitoring less precise and objective (EC, DFID UK, LD, NMFA). Not all projects are covered / assessed (EC). “Learning” captured by external monitors and not “in house” (EC). Alignment with PG monitoring systems should be enhanced (LD). Improving link between on-going implementation and design phase (AFD). Result chains used not always detailed (NMFA). Need of indicators for process-oriented interventions such as the policy dialogue or institutional strengthening. Result-based monitoring of contributions to multilateral organizations, international agencies and civil society organizations remains difficult (NMFA).