1. Lesson 3: Monitoring and Indicator Macerata, 23 nd October Alessandro Valenza, Director, t33 srl

2. Agenda  Definition and types of indicators  Monitoring  Quality of the indicator system

3. Programs and projects Programme Project 1Project nProject …  Financial contribution from programmes to projects  Information (e.g. progress reports) concerning the status of implementation to the authorities responsible for the programme -> support the day to day management

4. Indicators: what is it needed?  Definition  Unit of measurement  Source of information (going from internal to external)  Baseline (i.e. the initial value against which an indicator is subsequently measured) Refer to local context; or Refer to activities in previous programmes  Target (combined with baseline information, provides information concerning the importance of the planned interventions)  Current status

5. Monitoring and Indicator Monitoring is the observation of project and program by measuremnts These measurements are the Indicators The indicators can be related to different parts of the project: ouput, result and impact.

6. Programme indicators - Output Output indicators: direct products of the programme Could require information from beneficiaries, or can be calculated directly at the programme level

7. Programme indicators - Result Result indicators: relate to the direct and immediate effect on direct beneficiaries brought about by a programme. They provide information on changes to, for example, the behaviour, capacity or performance of beneficiaries.

8. Programme indicators - Output Indicator typeIndicator NameUnit OutputLength of rehabilitated/modernized county roadsKM Result Increase passengers and freight traffic on the rehabilitated, constructed, modernized roads % Other examples - Regional and local transport infrastructure :

9. Programme indicators - Output Indicator typeIndicator nameUnit Output Inhabitants benefiting from the implementation of integrated urban development plans N Other examples - Sustainable development of urban growth poles: Result Companies established in the “urban action zones” N

10. Programme indicators - Output Indicator typeIndicator NameUnit Output Rehabilitated/equipped health care mobile units (total and by type) N Other examples - Social Infrastructure: ResultAverage response time of mobile unitsN

11. Programme indicators - Output Indicator typeIndicator NameUnit Other examples - Regional and local business environment: OutputMicro-enterprises created and supportedN Result New jobs created in the supported micro- enterprises N

12. Programme indicators - Output Indicator typeIndicator NameUnit Other examples - Sustainable development and promotion of tourism: Output Tourism infrastructure / accommodation projects implemented N ResultIncrease of overnights-staying%

13. Programme indicators - Impacts Impact indicators: refer to the consequences of the programme beyond the immediate effects; often available only after a considerable time lag and they often need substantial methodological input in order to be valid. At which stage of the programming cycle are they used?  during programme design, the ex-ante quantification of impacts clarifies the strategic direction of the programme;  ex-post, it helps understanding if the programme achieved the initial objectives (success or failure?)

14. Context indicators Context indicators: reflect the socio- economic conditions of a programme area they enable to assess local needs of the programme area, to assess how the general context of a programme is evolving Not just programme indicators…

15. Indicators – Physical, financial, procedural  Physical indicators: describe the concrete ‘products’ of the programme;  Financial indicators: provide a basic picture for usage of the available resources (i.e. how fast? which priorities?): Committed/spent; Year/Priority/Source of funding.  Procedural indicators: provide information on the current status of the operational level and forecasts for the next steps.

16. Monitoring and evaluation Quantitative and qualitative data, used as input in evaluation exercises. Monitoring Evaluation Lessons to improve monitoring systems – e.g. identify better indicators for future projects / programming. Monitoring: data are collected concerning the progress with respect to stated objectives. Evaluation: using monitoring and additional data, provides policy recommendations.  Surveys of beneficiaries  Stakeholders interviews  Focus Group  Case studies  Participative techniques

17. Quality - individual indicators  Timeliness: information concerning the indicator can be collected and reported in time to influence the managerial decisions.  Sensibility: interventions can influence the valorisation of the indicator. (e.g. supporting exports, better turnover related to new customers reached through the programme than general turnover)  Availability: this means that the costs necessary to collect information from sources must be reasonable.  Validity: understanding of the indicator shall be the same for every potential user. and… possible perverse effects…

18. Quality – indicator system  Coverage: adequate coverage of expected allocation of financial resources;  Balance: among the different categories of indicators;  Selection: capacity of the authorities to absorb data and information is limited!  Relevance: advanced development for indicators related to the most significant themes and interventions.

19. See you www.t33.it a.valenza@t33.it