1 Results-based Monitoring, Training Workshop, Windhoek, 2.11.-4.11.2009 Results-based Monitoring Purpose and tasks Steps 1 to 5 of establishing a RbM.

Slides:



Advertisements
Similar presentations
Results-Based Management (RBM) and the UNDAF Results Matrix.
Advertisements

Introduction to Monitoring and Evaluation
Donald T. Simeon Caribbean Health Research Council
A plain English Description of the components of evaluation Craig Love, Ph.D. Westat.
Results-Based Management: Logical Framework Approach
M&E Issues: RAFIP and REP Kaushik Barua Accra, 12 Dec
Role of Result-based Monitoring in Result-based Management (RBM) Setting goals and objectives Reporting to Parliament RBM of projects, programs and.
Evaluation. Practical Evaluation Michael Quinn Patton.
Pestalozzi Children‘s Foundation emPower 2012 Monitoring & Evaluation Lecturers: Beatrice Schulter.
Policy and Operations Evaluation Department (IOB) Evaluability Asessment: Preparatory Steps before Starting an Evaluation Prof. dr. Ruerd Ruben Director.
Indicator Baseline Target Milestones PERFORMANCE MEASUREMENTS.
How to Develop a Project Evaluation Plan Pat Gonzalez Office of Special Education Programs
Codex Guidelines for the Application of HACCP
How to Develop the Right Research Questions for Program Evaluation
CASE STUDIES IN PROJECT MANAGEMENT
USAID’s Experience and Lessons Learned in Approaches used in Monitoring and Evaluating Capacity Building Activities Duane Muller, USAID November 7, 2008.
CONCEPT PAPER RESULT BASED PLANNING. RESULT-ORIENTED PLANNING Overall Objective/ Goal Specific Objective/ Purposes Expected Result/ Output Activities.
Results-Based Management
Improving Results Reporting Operations Managers Workshop Kiev, October 2008 Bratislava Regional Center Management Practice.
1 RBM Background Development aid is often provided on a point to point basis with no consistency with countries priorities. Development efforts are often.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
Classroom Assessments Checklists, Rating Scales, and Rubrics
Developing Indicators
KEYWORDS REFRESHMENT. Activities: in the context of the Logframe Matrix, these are the actions (tasks) that have to be taken to produce results Analysis.
Overview of Evaluation Designs. Learning objectives By the end of this presentation, you will be able to: Explain evaluation design Describe the differences.
Understanding Meaning and Importance of Competency Based Assessment
Setting the Stage: Workshop Framing and Crosscutting Issues Simon Hearn, ODI Evaluation Methods for Large-Scale, Complex, Multi- National Global Health.
EVALUATION APPROACHES Heather Aquilina 24 March 2015.
Private & Confidential1 (SIA) 13 Enterprise Risk Management The Standard should be read in the conjunction with the "Preface to the Standards on Internal.
International Center for Agricultural Research in the Dry Areas Socioeconomic and Policy Research Program (SEPRP) - ICARDA Roberto Telleria, Agricultural.
UNDAF M&E Systems Purpose Can explain the importance of functioning M&E system for the UNDAF Can support formulation and implementation of UNDAF M&E plans.
M&E Basics Miguel Aragon Lopez, MD, MPH. UNAIDS M&E Senior Adviser 12 th May 2009.
SUB-MODULE 5. MEANS OF VERIFICATION RESULTS BASED LOGICAL FRAMEWORK TRAINING Quality Assurance and Results Department (ORQR.2)
Project Management Learning Program 7-18 May 2012, Mekong Institute, Khon Kaen, Thailand Writing Project Report Multi-Purpose Reporting.
Indicators to Measure Progress and Performance IWRM Training Course for the Mekong July 20-31, 2009.
Screen 1 of 22 Food Security Policies – Formulation and Implementation Policy Monitoring and Evaluation LEARNING OBJECTIVES Define the purpose of a monitoring.
Monitoring and Evaluation Orientation 17 th May 2011 MCA Namibia.
1 The Good, the Bad, and the Ugly: Collecting and Reporting Quality Performance Data.
Project Management Learning Program 23 Mar – 3 Aprl 2009, Mekong Institute, Khon Kaen, Thailand Managing for Development Results Results-Oriented Monitoring.
Changing the way the New Zealand Aid Programme monitors and evaluates its Aid Ingrid van Aalst Principal Evaluation Manager Development Strategy & Effectiveness.
Quality Assessment of MFA’s evaluations Rita Tesselaar Policy and operations Evaluation Department Netherlands Ministry of Foreign Affairs.
1 The project is financed from the European Union funds within the framework of Erasmus+, Key Action 2: Cooperation for innovation and the exchange of.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 9, 2012.
Monitoring Afghanistan, 2015 Food Security and Agriculture Working Group – 9 December 2015.
Key Components of a successful Proposal OAS / IACML Workshop on Technical Assistance. San José, Costa Rica May 8, 2007 By: José Luis Alvarez R. Consultant.
Monitoring and evaluation Objectives of the Session  To Define Monitoring, impact assessment and Evaluation. (commonly know as M&E)  To know why Monitoring.
ICT4D: Evaluation Dr David Hollow DSV, University of Stockholm.
Developing Program Indicators Measuring Results MEASURE Evaluation.
Evaluation What is evaluation?
Reporting, Monitoring and Evaluation Giovanni Rum, Chao Xing GEO Secretariat GEO Work Programme Symposium Geneva, 2-4 May 2016.
OGB Partner Advocacy Workshop 18 th & 19 th March 2010 Indicators.
Seite 1 Martina Vahlhaus GTZ Evaluation Unit Monitoring & Evaluation Efforts: How do they influence resource allocation? GMF-IFC-GTZ Meeting.
Classroom Assessments Checklists, Rating Scales, and Rubrics
Project monitoring and evaluation
M&E Basics Miguel Aragon Lopez, MD, MPH
Session 1 – Study Objectives
PURPOSE AND SCOPE OF PROJECT MONITORING AND EVALUATION M&E.
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 2. Session 6. Developing indicators.
Strategic Planning for Learning Organizations
Classroom Assessments Checklists, Rating Scales, and Rubrics
Multi-Sectoral Nutrition Action Planning Training Module
Results of the Organizational Performance
Monitoring & Reporting 2019
WHAT is evaluation and WHY is it important?
MONITORING AND EVALUATION IN TB/HIV PROGRAMS
Results Based Management for Monitoring & Evaluation
OGB Partner Advocacy Workshop 18th & 19th March 2010
Data for PRS Monitoring: Institutional and Technical Challenges
How is an M & E framework derived from the logframe?
Presentation transcript:

1 Results-based Monitoring, Training Workshop, Windhoek, Results-based Monitoring Purpose and tasks Steps 1 to 5 of establishing a RbM system

2  Generally, monitoring means the continuous and systematic collection, analysis and use of information.  Monitoring was in practice often used to provide mainly information on whether a project has been implemented as planned.  The main purpose of results-based monitoring (RbM) is to provide information on whether a project is on track towards achieving the desired results What is new related to results-based monitoring?

3 Purpose of Results-based Monitoring Monitoring Information Steering Taking informed management decisions Timely interventions if the projects is not on track  “Early warning system” Reporting on the project progress in order to fulfil accountability requirements Knowledge management Learning from experience: what did work? what did not work and why?

4 Scope of Results-based Monitoring  Observing progress made towards achieving the objective, i.e. expected results at all levels of the results chains  Identifying results with respect to cross-cutting themes (e.g. gender, good governance)  Providing evidence on the plausible contribution of the development measure to indirect results  Identifying possible risks that threaten the achievement of intended results  Identifying unintended positive and negative results (side effects) caused by the development measures.  Lessons learnt

5 Seven Steps to Establish a Results-Based Monitoring System 2 Clarify interests, expectations and contributions of stakeholders 4 Review objective indicators, define process indicators 5 Operationalise indicators, establish procedures 3 Define key areas to be monitored 6 Conduct data collection, document and process data 7 Utilise monitoring results 1 Review (and complete) the results chains Steps in which constitutive elements of the RbM system are established:

6 Step 1: Review (and complete) the results Chains

7 Step 2: Clarifying interests, expectations, contributions of stakeholders  The RbM system should be aligned to the needs and possible contributions of main stakeholders.  Partners should be involved in designing and implementing the RbM system:  What kind of information do they need? What are their interests and expectations?  Which data sources are already be available? How can they be used?  Which RbM tasks can be carried out by partners?  Training needs should be assessed.  The result of this joint analysis should be documented.

8 Step 3: Define key areas to be monitored  In case of quite complex results chains it is neither feasible nor necessary that a RbM system covers all results.  It is compulsory to monitor the objective.  At lower levels, results along the results chains have to be selected.  Results which may be jeopardized by risks or which are very important for achieving the results (e.g. use of outputs) should be included

9  Indicators serve as reference to measure to what extent the results selected for monitoring have been achieved  Indicators for the objective are already specified.  For the selected monitoring areas below the objective process indicators have to be defined.  Indicators should fulfil quality standards, i.e. being e.g. Valid: Does the indicator directly represent the results? Objective: Is the definition precise and unambiguous? Reliable: Is the data consistent and comparable over time? Practical: Can data be collected at reasonable cost?  Usually, a combination of both quantitative and qualitative indicators will be required. Step 4: Review objective indicators, define process indicators

10 Step 5: Operationalise indicators (1): Main tasks  Baseline values and target values: to be defined in order to assess whether an indicator has been met or not  Data source: as far as possible making use of available data  Methods for data collection: e.g. sample surveys, focus group discussions, analysis of documents, interrogations etc.  Frequency of data collection: e.g. annually, semi-annually, quarterly – depending on the specific information demands and the result level  Timing of data collection: must be related to important deadlines like deadlines for reports, dates of planning workshops, important meetings  Persons in charge: for data collection, processing, compilation

11 Step 5: Operationalise indicators (2): Indicator Matrix  Information required to measure the indicators, respectively for gathering monitoring data should be documented systematically in an Indicator Matrix Example:

12 Thank you very much for your attention ! Step 6 and 7: To be continued