PURPOSE AND SCOPE OF PROJECT MONITORING AND EVALUATION M&E

What is the Purpose of M&E At the programme level, the purpose of monitoring and evaluation is to track implementation and outputs systematically, and measure the effectiveness of programmes. It helps determine exactly when a programme is on track and when changes may be needed.

WHAT IS Scope of Evaluation? The scope specifies those aspects of the project or programme and its context that are within the boundaries of the evaluation: what the evaluation aims to find out and what the evaluation will focus on.... The scope of the evaluation can be identified in the project or programme document.

The Scope of The Evaluation The scope of the evaluation will set the boundaries around how far the study is to go. The scope of the evaluation is everything that is to be judged. How big is the evaluation? How much ground will be covered? This is important because it sets limits on the effort expended and the funds that will be spent.

Set The Scope of The Evaluation This evaluation will cover: How many years of program operation? Over which time frame? Which set of clients? Which operations/regions/comm unity? The following agreements/funding sources: This evaluation will not cover: The focus of the evaluation: Particular issues: A) B) C) D)

Begin to draft the Terms of Reference (ToR) The Terms of Reference must include nearly everything that you want to do for the evaluation. This document is your touchstone. It will explain to everyone what you and your team have decided to do. It is a really good idea to have it formally approved. Here is a suggestion for what it might contain

Understanding The Scope and Scale Of The Activity To Monitor and Evaluate Understanding the scope and scale of the activity which we intend to measure is an important consideration in deciding and evaluation. The frameworks that provide a starting point for thinking about how deeply we want to look for outcomes and results: Targeting Outcomes of Programs (TOP), The three rings approach The order of outcomes

Targeting Outcomes of Programs (TOP) and The Three Rings Approach Targeting Outcomes of Programs (TOP), encourages us to look at how well we are doing activities that involve people, such as workshops and trainings. Targeting Outcomes of Programs (TOP) The three rings approach reminds us that our projects rarely achieve societal change in and of themselves, they only contribute within a wider network of projects and influences. three rings approach

Targeting Outcomes of Programs (Bennett’s hierarchy) LevelDescriptionSummary 7End resultsAchieving and end result of economic, social, environmental/health value 6Practice changeBehavioural changes in target group (direct/proxy evidence) 5KASAKASA changes: Knowledge – Attitudes – Skills – Aspirations (proxy indicators for behaviour change) 4ReactionsReaction to involvement (e.g. one-page survey) 3InvolvementInvolvement of different stakeholders (participation, monitoring, etc.) 2ActivitiesImplementation of activities (activities monitoring) 1InputsProgramming resources to support program activities (inputs monitoring)

The Three Rings Approach

Systems-Based Evaluations Systems-based evaluations provides a framework for how information can be arranged and understanding developed. Systems-based evaluations Rather than emphasising discrete elements and properties (e.g. roles and values), systems thinking emphasises relationships and context. These properties are ideally suited to multi- stakeholder situations where the aim is to help participants see how different activities and relations of cooperation between different parties fit together within a wider social programme.

Systems-Based Evaluations

The Order of Outcomes Framework The order of outcomes framework enables us to acknowledges that most sustainable development projects will only come to fruition in the long term and provides a pathway that shows how our progress towards increasingly sustainable forms of development will be monitored and evaluated.order of outcomes This framework offers a sequence of tangible outcomes which, if pursued successfully over long-term time periods, can indeed move us towards increasingly sustainable positions.

Planning Checklist Determined the primary reason for the evaluation. Defined the purpose of the evaluation Determined the stage of the program Selected questions Scoped out the evaluation parameters Sketched out the terms of reference

Consider The Following Steps And Answer The Following Questions: 1.Key question: What do we need to assess? 2.Key question: What do we want to achieve? 3.Key question: Who needs what kind of information? 4.Key questions: What are we specifically looking at to measure achievement? Where are we today relative to our goals? When do we want to achieve what? 5.Key questions: Who is responsible for data collection? In which sequence? 6.Key questions: How are we doing relative to our targets? Why? What did we achieve and what needs to be done? 7.Key question: How can we ensure the information is systematically being disseminated and used to generate lessons learned? 8.Key question: What kinds of capacities are needed and should be strengthened?

Observations Comments Questions ? Thank you for your attention