Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.

Slides:



Advertisements
Similar presentations
Il Project Cycle Management :A Technical Guide The Logical Framework Approach 1 1.
Advertisements

Gender Perspective in the Cycle of Operations
Results Based Monitoring (RBM)
Donald T. Simeon Caribbean Health Research Council
Prepared by BSP/PMR Results-Based Programming, Management and Monitoring Presentation to Geneva Group - Paris Hans d’Orville Director, Bureau of Strategic.
Theory of Change, Impact Monitoring, and Most Significant Change EWB-UK Away Weekend – March 23, 2013.
Project Monitoring Evaluation and Assessment
Results-Based Management: Logical Framework Approach
An Introduction to an Integrated P,M&E System developed by IDRC Kaia Ambrose October, 2005.
INSTITUTO DE ESTUDIOS POLÍTICOS PARA ÁMERICA LATINA Y ÁFRICA LOGICAL FRAMEWORK APPROACH HUMANA.
Project Cycle Management (PCM)
Results-Based Management: Logical Framework Approach
Pestalozzi Children‘s Foundation emPower 2012 Monitoring & Evaluation Lecturers: Beatrice Schulter.
Katherine Smithson Policy and public affairs officer Charity Finance Group.
Monitoring, Review and Reporting Project Cycle Management A short training course in project cycle management for subdivisions of MFAR in Sri Lanka.
HOW TO WRITE A GOOD TERMS OF REFERENCE FOR FOR EVALUATION Programme Management Interest Group 19 October 2010 Pinky Mashigo.
CASE STUDIES IN PROJECT MANAGEMENT
Developing the Logical Frame Work …………….
ISTEP: Technology Field Research in Developing Communities Instructor: M. Bernardine Dias CAs: Sarah Belousov and Ermine Teves Spring 2009.
Nine steps of a good project planning
CONCEPT PAPER RESULT BASED PLANNING. RESULT-ORIENTED PLANNING Overall Objective/ Goal Specific Objective/ Purposes Expected Result/ Output Activities.
This project is funded by the EUAnd implemented by a consortium led by MWH Logical Framework and Indicators.
May 12 th Monitoring and Project Control. Objectives Anticipated Outcomes Express why Monitoring and Controlling are Important. Differentiate between.
Evaluation methods and tools (Focus on delivery mechanism) Jela Tvrdonova, 2014.
1 RBM Background Development aid is often provided on a point to point basis with no consistency with countries priorities. Development efforts are often.
What makes a successful development project? Kristin Olsen IOD PARC
Developing Indicators
KEYWORDS REFRESHMENT. Activities: in the context of the Logframe Matrix, these are the actions (tasks) that have to be taken to produce results Analysis.
Progress towards outcomes: Developing a logic model and theory of change 1 Mary Ryan Research in Practice associate Margaret Davies Director, Red Dragonfly.
IAOD Evaluation Section, the Development Agenda (DA) and Development Oriented Activities Julia Flores Marfetan, Senior Evaluator.
EVALUATION APPROACHES Heather Aquilina 24 March 2015.
The LOGICAL FRAMEWORK Scoping the Essential Elements of a Project Dr. Suchat Katima Mekong Institute.
Mothers unwilling to go to clinics Low staff skills Inadequate number of clinics Shortage of drugs High infant mortality rates Commercial pressure for.
UNDAF M&E Systems Purpose Can explain the importance of functioning M&E system for the UNDAF Can support formulation and implementation of UNDAF M&E plans.
Promising Ideas and Issues to Consider in Reaching Reading and Literacy Goals Logistics of supervision, training, support to teachers Sakil Malik Director.
INTEGRATED ASSESSMENT AND PLANNING FOR SUSTAINABLE DEVELOPMENT 1 Click to edit Master title style 1 Analysis of the planning process Why and how? Session.
Monitoring & Evaluation Presentation for Technical Assistance Unit, National Treasury 19 August 2004 Fia van Rensburg.
Monitoring & Evaluation: The concepts and meaning Day 9 Session 1.
1 Designing Effective Programs: –Introduction to Program Design Steps –Organizational Strategic Planning –Approaches and Models –Evaluation, scheduling,
Monitoring and Evaluation of GeSCI’s Activities GeSCI Team Meeting 5-6 Dec 2007.
The Results-Based System Awoke Kassa ENTRO M&E Officer ENTRO M&E Officer SDCO Capacity Building Workshop IV October 2008 Cairo Nile Basin Initiative.
SESSION 3: FROM SETTING PRIORITIES TO PROGRAMMING FOR RESULTS.
Project Management Learning Program 7-18 May 2012, Mekong Institute, Khon Kaen, Thailand Writing Project Report Multi-Purpose Reporting.
Screen 1 of 22 Food Security Policies – Formulation and Implementation Policy Monitoring and Evaluation LEARNING OBJECTIVES Define the purpose of a monitoring.
Monitoring and Evaluation
Monitoring and Evaluating in the PHEA Educational Technology Initiative Patrick Spaven.
Project Management Learning Program 23 Mar – 3 Aprl 2009, Mekong Institute, Khon Kaen, Thailand Managing for Development Results Results-Oriented Monitoring.
INTEGRATED ASSESSMENT AND PLANNING FOR SUSTAINABLE DEVELOPMENT 1 Click to edit Master title style 1 Evaluation and Review of Experience from UNEP Projects.
A framework for demonstrating impact – how do we know community action makes a difference? Sheila Durie The SROI Network.
Independent Enquirers Learners process and evaluate information in their investigations, planning what to do and how to go about it. They take informed.
This was developed as part of the Scottish Government’s Better Community Engagement Programme.
ACTED AME Appraisal, Monitoring and Evaluation. Summary 1/ ACTED AME department 2/ AME Responsibilities 3/ AME throughout project cycle 4/ Involvement.
Monitoring and evaluation Objectives of the Session  To Define Monitoring, impact assessment and Evaluation. (commonly know as M&E)  To know why Monitoring.
The Logical Framework (Log Frame). Programs & Projects Programs Broad areas of work required to implement policy decisions. Usually focused on a sector.
Logical Framework Approach An Evaluation Toolbox Presentation
Evaluation What is evaluation?
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
Social return on investments (SROI)
Gender-Sensitive Monitoring and Evaluation
Gender-Sensitive Monitoring and Evaluation
Strategic Planning for Learning Organizations
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 7. Managers’ and stakeholders’ information needs.
Prepared by BSP/PMR Results-Based Programming, Management and Monitoring Presentation to Geneva Group - Paris Hans d’Orville Director, Bureau of Strategic.
CATHCA National Conference 2018
Regulation 4 - Elements of the Plan
WHAT is evaluation and WHY is it important?
Integrating Gender into Rural Development M&E in Projects and Programs
How is an M & E framework derived from the logframe?
Presentation transcript:

Monitoring Evaluation Impact Assessment

Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify what you want to monitor, how and for whom n Identify indicators that can be used to monitor and evaluate your work n Know what tools can be used for monitoring and evaluating, their limitations and advantages

Stakeholders n Who has an interest in monitoring and evaluation in your organisation n is this primarily accountability, quality, learning? n What are the relationships between them? n What are their key questions from m and e?

What is the cause and effect relationship? nTnThe underlying principle of the logframe structure is cause and effect, ie. If……..Then nInIF we carry out activities THEN we will produce outputs…THEN we will achieve objectives…THEN we will contribute to the overall goal. nTnThe better the cause and effect linkage the better the project design.

Indicators for different levels of monitoring and evaluation

Planning: n Situation analysis/needs assessment n Aims (goals, wider objectives) n Objectives (outcomes, purpose) n Activities (outputs and inputs) n plan of action, budget, resources n Indicators to measure progress n baseline information

Monitoring (& management) n Continuous throughout project n Strengths and weaknesses. What adjustments need to be made? n External changes. Does work need to change to respond? n Progress towards achieving outcomes. Do activities need to be changed? n Impact. How is the project affecting different groups in longer term? n Critical analysis and feedback

Evaluation n Carried out at significant stages in project’s development. n Looks backwards at what has been done, learns lessons for the future. n Assesses progress towards, outcomes, objectives and goal. n Answers specific questions about effectiveness, efficiency, sustainability – set in TOR n Self evaluation or external n can be peer evaluation

Impact assessment n Short term impact n longer term impact n intended and unintended impact n positive and negative n attribution vs contribution n “plausible association” of contributions to impact

A BOND Approach to Quality Standards in NGOs: Putting Beneficiaries First u Throughout our research, we consistently heard that NGOs deliver quality when their work is based on a sensitive and dynamic understanding of beneficiaries’ realities; responds to local priorities in a way that beneficiaries feel is appropriate; and is judged to be useful by beneficiaries

Downward accountability n Meaningful participation: process outputs and empowering? n Adequate attention to quality of relationships n ongoing learning and reflection: keep debates alive n efficient use of resources and minimise costs n sustainability and impact. (quality does not always produce impact)

Tools

Methods for collecting and analysing information n Qualitative approaches: allow a more open- ended and in-depth investigation, but often over a smaller area. n Quantitative approaches: useful for examining predetermined variables. n Participatory approaches: allow differences in people’s interests, needs and priorities to be recognised, and form the basis for negotiation between stakeholders. They also allow people to benefit from analysing and asserting their own interests.

How to choose different methods n Who needs the information and why? n What key questions are you trying to answer? What indicators are you monitoring? n What resources are there to collect and analyse the information? n RIGOUR Vs. PARTICIPATION n critical thinking more important than actual tools

n Specific n M easurable or Monitorable n Achievable n Relevant n Timebound OBJECTIVES

Logical Framework Analysis n The logical framework is a tool for: n organising thinking n relating activities to expected results n setting performance objectives n allocating responsibilities

The logical framework matrix

Indicators and Means of verification n Set indicators for all levels of the hierarchy n Show how you will get the information; sources and methods. Are these realistic?

What about the influence of uncertain factors? n Good project design requires uncertain factors to be taken into account n Assumptions/risks are the uncertainty factors between each level n Assumptions complete the if/then logic and are set out in the last column of the matrix n The project team is not responsible for Assumptions/Risks but they must monitor changes and report on the implications.

Complementary approaches n Most significant change - no indicators, reflect on what happened and what changes were significant n Outcome mapping - focus on changes in behaviour and relationships of “boundary partners”

Impact: What Change Did We Make? Most Significant Change n Each tell a story n Draw out common themes n Pick a story that is representative n Share stories

Put it into practice for your project n Who are main stakeholders? n What is main focus – learning, quality or accountability? n Select one outcome and activity from your project n identify some indicators. n What m and e tools could be used? n How will the resulting information be used?