1. SUB-MODULE 5. MEANS OF VERIFICATION RESULTS BASED LOGICAL FRAMEWORK TRAINING Quality Assurance and Results Department (ORQR.2)

2.  Introduction to the RLF  Participatory Approach for RLF development  The results chain  Performance indicators  Means of verification  Risks and mitigation measures 6 Sub-Modules TRAINING CONTENT 2 RESULTS BASED LOGICAL FRAMEWORK TRAINING Evaluation  Test at end of training  Multiple choice, open questions and case studies

3. CONTENT: SUB-MODULE 5 3 I.The means of verification in the RLF. II.Definition. III.Characteristics of the Means of Verification. IV.Types of data sources. V.Steps. VI.Data collection matrix. VII.Examples of means of verification. VIII.Practical tips. RESULTS BASED LOGICAL FRAMEWORK TRAINING

4. 4 OBJECTIVE: SUB-MODULE 5 At the end of this sub-module, Bank staff should be able to:  Define exactly how to gather information for each indicator.  Identify primary and secondary sources of information. RESULTS BASED LOGICAL FRAMEWORK TRAINING

5. I. The means of verification in the RBLF 5 Country and project name: Project objective: Results chain Performance indicators Means of verification Risks and mitigation measures IndicatorBaselineTarget Impact Outcomes Outcome 1 Outcome 2 … etc. Outputs Component 1 Output 1.1 Output 1.2 … etc. Component 2 Output 2.1 Output 2.2 … etc. Key activity Component 1: Component 2: Inputs Component 1: Component 2: RESULTS BASED LOGICAL FRAMEWORK TRAINING

6. 6  Sources of information and resources for each indicator, which can be used to check whether the expected results of the project are / have been achieved.  The means of verification (MoV) provide the basis for monitoring and evaluation of performance indicators of a project.  The information derived from the sources identified in the MoV column will be used:  As feedback for project management.  To make adjustments to the project.  To improve future projects (preparation). II. Definition RESULTS BASED LOGICAL FRAMEWORK TRAINING

7. 7  Must be practical and economic (low cost)  They should specify: The format in which the information will be available. Who will provide the informations. Frequency (monthly, quarterly, annual, etc.).  An RLF indicator is relevant if there is a planned or existing system for collecting the corresponding information on a timely basis. RESULTS BASED LOGICAL FRAMEWORK TRAINING III. Characteristics of the Means of Verification

8. 8 IV. Types of data sources (1/3)  Secondary sources. Data that have been collected by various organizations (other than the implementing agency), such as: Socio-economic survey data. Government statistics  Limitations: Timeliness, quality of data and level of disaggregation. Data may have been collected with other interests in mind. RESULTS BASED LOGICAL FRAMEWORK TRAINING

9. 9  Primary sources. Data that is collected by the implementing entity itself and may include: Surveys, focus group interviews, direct observation, as well as administrative, budget or personnel data.  Limitations: Primary data normally involves a cost, along with consideration as to which organization will collect the data. RESULTS BASED LOGICAL FRAMEWORK TRAINING IV. Types of data sources (2/3)

10. 10  Statistical databases, census.  Databases of sectoral ministries.  Records of local governments.  Documents from project management.  Policies and strategies of the Bank.  Country Strategy Papers.  Gender patterns in the country.  The Bank’s gender and environment indicators.  Reports on the MDGs and Human Development.  Report on World Development, other donor reports. RESULTS BASED LOGICAL FRAMEWORK TRAINING IV. Types of data sources (3/3)

11. 11 V. Steps During the development of the RLF indicators, the team must…  Review the country’s information systems relevant to the project – assess the validity, accuracy, level of disaggregation, and timely availability of the data.  Use indicators that already exist / widely available.  Do an inventroy of secondary sources.  If no secondary data sources for the indicators exist, consider gathering the data — primary sources.  Possibility of using proxy indicators.  If it is necessary to collect primary data, the following questions need to be considered: How? Who? When? Financing? (Data collection matrix) RESULTS BASED LOGICAL FRAMEWORK TRAINING

12. VI. Data collection matrix  The purpose of this matrix is to ensure that the project spells out specifics of every aspect of verification for an indicator. Means of verification Performance indicators Data sources Method for data collection Method for data analysis Reporting format Responsible agency Frequency Data collection cost (USD) Latrines built for girls in 3 regions (#) Primary Bill of Quantity count Project Progress Report Executing Agency Quarterly150 Annual revenue increased (CFA) SecondaryN/A Tax Report Provincial Directorate of Administration and Finance Annual20 12 RESULTS BASED LOGICAL FRAMEWORK TRAINING

13. VII. Examples of means of verification – Impact (1/3) 13 Performance indicators Means of verification Indicator Baseline (2010) Target (2015) Impact: Prevalence of waterborne diseases (%) 2316 Ministry of Health – National monitoring report, 2016, Table 9B Impact: Poverty rate (%)6548 Poverty Reduction Strategy Paper (2011-2016) – Annual monitoring, 2015. RESULTS BASED LOGICAL FRAMEWORK TRAINING

14. 14 Performance indicators Means of verification Indicator Baseline (2010) Target (2015) Outcome: School enrollment in project area (%) 3545 Ministry of Education – Annual monitoring report, 2016, Table 9B –Regions Outcome: Annual incomes of small farmers (CFA/Month) 30 00075 000 Provincial Directorate of Administration and Finance - Annual Tax Report, 2016. Outcome: Conflicts between communities (Conflict Scale) HighLow Minutes of meeting with the community RESULTS BASED LOGICAL FRAMEWORK TRAINING VII. Examples of means of verification – Outcomes (2/3)

15. 15 Performance indicators Means of verification Indicator Baseline (2010) Target (2015) Output: Classrooms built (#)0150 Quarterly Project Progress Report Output: Latrines built for girls (#)025 Quarterly Project Progress Report Output: Varieties of climate- resilient seeds tested in the province (#) 015 Quarterly Project Progress Report RESULTS BASED LOGICAL FRAMEWORK TRAINING VII. Examples of means of verification – Outputs (3/3)

16. 16  Always draw data from reliable and functional information system.  Determine the data sources and performance indicators together to ensure that the indicators are practical and data collection is cost-effective.  Consider creating an independent information management system and conduct occasional surveys if secondary sources are not available.  Consider the participation of stakeholders in the monitoring of the project. This is often an effective way of monitoring performance. RESULTS BASED LOGICAL FRAMEWORK TRAINING VIII. Practical tips

17. 17 Your one-stop shop to quality assurance and results reporting tools used throughout the project cycle RESULTS BASED LOGICAL FRAMEWORK TRAINING ACCESSIBLE THROUGH THE INTRANET Quality Assurance Assistant