1. Project Cycle Management for International Development Cooperation Indicators Teacher Pietro Celotti Università degli Studi di Macerata 16 December 2011

2. Agenda  Background  Definition and types of indicators  Monitoring  Quality of the indicator system

3. Programmes and projects Programme Project 1Project nProject …  Financial contribution from programmes to projects  Information (e.g. progress reports) concerning the status of implementation to the authorities responsible for the programme -> support the day to day management

4. Agenda  Background  Definition and types of indicators  Monitoring  Quality of the indicator system

5. Indicators: what is needed?  Definition  Unit of measurement  Source of information (going from internal to external)  Baseline (i.e. the initial value against which an indicator is subsequently measured) Refers to local context; or Refers to activities in previous programmes  Target (combined with baseline information, provides information concerning the importance of the planned interventions)  Current status

6. Project indicators - Output Output indicators: direct products of the project Normally requires information from beneficiaries

7. Project indicators - Results Result indicators: relate to the direct and immediate effect on direct beneficiaries brought about by a project. They provide information on changes to, for example, the behaviour, capacity or performance of beneficiaries.

8. Project indicators - Output Indicator typeIndicator NameUnit OutputLength of rehabilitated/modernized county roadsKM Results Increase passengers and freight traffic on the rehabilitated, constructed, modernized roads % Other examples - Regional and local transport infrastructure :

9. Project indicators - Output Indicator typeIndicator nameUnit Output Inhabitants benefiting from the implementation of integrated urban development plans N Other examples - Sustainable development of urban growth poles: Result Companies established in the “urban action zones” N

10. Project indicators - Output Indicator typeIndicator NameUnit Output Rehabilitated/equipped health care mobile units (total and by type) N Other examples - Social Infrastructure: ResultAverage response time of mobile unitsN

11. Project indicators - Output Indicator typeIndicator NameUnit Other examples - Regional and local business environment: OutputMicro-enterprises created and supportedN Results New jobs created in the supported micro- enterprises N

12. Project indicators - Output Indicator typeIndicator NameUnit Other examples - Sustainable development and promotion of tourism: OutputTourism small infrastructures implementedN ResultIncrease of overnights-staying%

13. Core indicators  Core indicators can be used to make comparisons or aggregations of data across similar programmes, priorities or measures.  How does it work? Programme authorities are required to include a number of ‘core’ indicators in their monitoring systems……

14. Programme indicators - Impacts Impact indicators: refer to the consequences of the programme beyond the immediate effects; often available only after a considerable time lag and they often need substantial methodological input in order to be valid. At which stage of the programming cycle are they used?  during programme design, the ex-ante quantification of impacts clarifies the strategic direction of the programme;  ex-post, it helps understanding if the programme achieved the initial objectives (success or failure?)

15. Context indicators Context indicators: reflect the socio- economic conditions of a programme area they enable to assess local needs of the programme area, to assess how the general context of a programme is evolving Not just programme indicators…

16. Monitoring  Background  Definition and types of indicators  Monitoring  Quality of the indicator system

17. Indicators – Physical, financial, procedural  Physical indicators: describe the concrete ‘products’ of the programme;  Financial indicators: provide a basic picture for usage of the available resources (i.e. how fast? which priorities?): Committed/spent; Year/Priority/Source of funding.  Procedural indicators: provide information on the current status of the operational level and forecasts for the next steps.

18. Physical monitoring Example of physical monitoring: Indicator (number of enterprises) Unit of Measurement TargetAchievement MicroN14291 SmallN133111 MediumN3921 Owner (women)N5040 Owner (<30y)N263 Start-upN543

19. Financial monitoring Example of financial monitoring: PriorityExpected expenditures Resources committed Expenditures Amount % % (a)(b)(b/a)(c)(c/a) P1133.4100.475.271.853.9

20. Procedural monitoring Most public activities have to follow a more or less rigid schedule in which the different steps are mandated and the deadlines fixed (i.e.). Procedural monitoring usually provides information about how project pipelines are progressing (where and when calls for tenders have been published, contracts have been awarded, …). Procedure Status Specificationsready Call published Contractawarded …… Final payment Expected Actual Expected Actual Expected Actual …… Expected Actual P1Open 08-08-10 14-08-1019-08-10 ……

21. Demand Procedural monitoring Priority Applications Being assessed Not eligible operations Eligible not co-funded Co-funded operations Started Cancelled Renounced Total Completed Being implemented P13,6501563416432,3951,7691,6151545164 Implementation status (number of projects): Project capacity Mortality Operational efficiency

22. Monitoring and evaluation Monitoring =information about the ongoing situation Evaluation = analysis (using monitoring and additional data) Indicators are not used just for the purpose of day to day management…

23. Monitoring and evaluation Quantitative and qualitative data, used as input in evaluation exercises. Monitoring Evaluation Lessons to improve monitoring systems – e.g. identify better indicators for future projects / programming. Monitoring: data are collected concerning the progress with respect to stated objectives. Evaluation: using monitoring and additional data, provides policy recommendations.  Surveys of beneficiaries  Stakeholders interviews  Focus Group  Case studies  Participative techniques

24. Monitoring  Background  Definition and types of indicators  Monitoring  Quality of the indicator system

25. Quality - individual indicators  Timeliness: information concerning the indicator can be collected and reported in time to influence the managerial decisions.  Sensibility: interventions can influence the valorisation of the indicator. (e.g. supporting exports, better turnover related to new customers reached through the programme than general turnover)  Availability: this means that the costs necessary to collect information from sources must be reasonable.  Validity: understanding of the indicator shall be the same for every potential user. and… possible perverse effects…

26. Quality – indicator system  Coverage: adequate coverage of expected allocation of financial resources;  Balance: among the different categories of indicators;  Selection: capacity of the authorities to absorb data and information is limited!  Relevance: advanced development for indicators related to the most significant themes and interventions.

27. Thank you p.celotti@t33.it