Identifying Monitoring Questions from your Program Logic.

Slides:



Advertisements
Similar presentations
Reasons for Monitoring and Evaluation at the Project Level
Advertisements

Developing Problem Tree & Solution Tree
2014 AmeriCorps External Reviewer Training Assessing Need, Theory of Change, and Logic Model.
Theory of Change, Impact Monitoring, and Most Significant Change EWB-UK Away Weekend – March 23, 2013.
Contemporary Questions in Project Monitoring and Evaluation By Maiwada Zubairu Snr. M & E Specialist NMEMS II BROWN BAG FORUM (BBF)
RBM in the context of Operations and Programme and Project Management Material of the Technical Assistance Unit (TAU)
Getting on the same page… Creating a common language to use today.
Evaluation in the Field: Putting Concepts into Action Janet Myers, PhD MPH Richard Vezina, MPH CAPS HIV Prevention Conference April 21, 2006.
On-Line Version of the MI PRS Face-to-Face Training 1 Bruce Haas, Ph.D. Michigan State University Extension.
Role of Result-based Monitoring in Result-based Management (RBM) Setting goals and objectives Reporting to Parliament RBM of projects, programs and.
2014 AmeriCorps State and National Symposium How to Develop a Program Logic Model.
Role of Program Theory in Building Program Evaluations Joe E. Heimlich, Ph.D. The Ohio State University, Columbus, Ohio, USA The Institute for Learning.
New frontiers Evaluation methods Theory of change Project cycle and risk management Jesper Johnsøn, CMI, U4 Bergen, February 4, 2014.
HOW TO WRITE A GOOD TERMS OF REFERENCE FOR FOR EVALUATION Programme Management Interest Group 19 October 2010 Pinky Mashigo.
Objectives and Indicators for MCH Programs
1 Introduction to State Logic Models and Related Planning Stephanie Lampron, NDTAC.
Program Evaluation Debra Spielmaker, PhD Utah State University School of Applied Sciences, Technology & Education - Graduate Program Advisor USDA-NIFA,
How to Develop the Right Research Questions for Program Evaluation
1 Qualitative Evaluation Terms Coding/categorization The process of condensing qualitative data through the identification of common themes. Data Matrix.
Dr. G. Johnson, Program Evaluation and the Logic Model Research Methods for Public Administrators Dr. Gail Johnson.
ACHIEVING THE THINGS YOU AIM FOR IN LIFE.  SHORT-TERM  LONG-TERM TAKES MORE PLANNING INVOLVES MANY SHORT-TERM GOALS.
Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.
Nine steps of a good project planning
1 Module 4: Designing Performance Indicators for Environmental Compliance and Enforcement Programs.
(c) 2014 Michael Sikes, Ph.D. Theory of Change: Bridging Ideas, Actions, and Results Michael Sikes, Ph.D. (805)
Opioid Misuse Prevention Program “OMPP” Strategic Planning Workshop
Types of evaluation examine different aspects of performance Resources (Inputs) ActivitiesOutputs Short-Term Outcomes Intermediate Outcomes (through customers)
1 Introduction to Evaluating the Minnesota Demonstration Program Paint Product Stewardship Initiative September 19, 2007 Seattle, WA Matt Keene, Evaluation.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Evaluation Assists with allocating resources what is working how things can work better.
OECD/INFE Tools for evaluating financial education programmes Adele Atkinson, PhD Policy Analyst OECD With the support of the Russian/World Bank/OECD Trust.
Interactive Power Point Evaluating Your Program. Evaluating your Program First – Review the Steps Step 1 ◦State overall objectives Step 2 ◦State desired.
QUICK OVERVIEW - REDUCING REOFFENDING EVALUATION PACK INTRODUCTION TO A 4 STEP EVALUATION APPROACH.
Nancy L. Weaver, PhD, MPH Department of Community Health School of Public Health Saint Louis University 16 July 2010 LOGIC MODEL FUNDAMENTALS.
The Results-Based System Awoke Kassa ENTRO M&E Officer ENTRO M&E Officer SDCO Capacity Building Workshop IV October 2008 Cairo Nile Basin Initiative.
EDPQS in 10 minutes: Overview of European Drug Prevention Quality Standards (EDPQS) With financial support from the Drug Prevention and Information Programme.
Center for Leadership Development Guarantee The Money: Making Your Case Through Program Evaluation.
M&E Monitoring & Evaluation Outcomes Measurement – Monitoring & Evaluation Creating Opportunities for Rural Youth (CORY)
Federal Department of Economic Affairs, Education and Research EAER Federal Office for Agriculture FOAG WP5 Impact assessment and evaluation of ERA-NET.
Outcomes, Outputs & Context Tammy Horne, Ph.D. WellQuest Consulting Ltd. (780)
restricted external Evaluating the vinspired 24/24 programme Ewan King, director OPM 30 September
Planning for Performance Measurement:
Adrienne DiTommaso, MPA, CNCS Office of Research and Evaluation
Integrating Evaluation into the Design of the Minnesota Demonstration Project Paint Product Stewardship Initiative St. Paul, MN May 1, 2008 Matt Keene,
Changing the way the New Zealand Aid Programme monitors and evaluates its Aid Ingrid van Aalst Principal Evaluation Manager Development Strategy & Effectiveness.
Evaluation: from Objectives to Outcomes Janet Myers, PhD MPH AIDS Education and Training Centers National Evaluation Center
Welcome to Program Evaluation Overview of Evaluation Concepts Copyright 2006, The Johns Hopkins University and Jane Bertrand. All rights reserved. This.
Tools to guide project development
What IE is not and is not Male Circumcision Impact Evaluation Meeting Johannesburg, South Africa January 18-23, 2010 Nancy Padian UC Berkeley.
Session 2: Developing a Comprehensive M&E Work Plan.
Developing a Program Logic. What is a Program Logic? A program logic is like a roadmap for a project that sets out how a project will achieve its desired.
Developing a Monitoring and Evaluation (M&E) Plan.
STRATEGIC PLANNING January 12-13, Where are we in the planning process? Needs assessment data collection and prioritization - Consequence - Consumption.
From Program Logic to Monitoring & Evaluation (M&E) Plan.
Supporting voluntary organisations that work with offenders and their families Theory of change – what? Describes how a service or intervention.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
M&E Workshop for Full Proposal
Rebecca McQuaid Evaluation 101 …a focus on Programs Rebecca McQuaid
Resource 1. Involving and engaging the right stakeholders.
Monitoring and Evaluation
Strategic Planning for Learning Organizations
بسم الله الرحمن الرحيم.
General Notes Presentation length - 10 – 15 MINUTES
New Song outcomes guiding project structuring
What is Evaluation?.
New Song outcomes guiding project structuring
Developing Effective Logic Models for Continuous Program Improvement
OGB Partner Advocacy Workshop 18th & 19th March 2010
Data for PRS Monitoring: Institutional and Technical Challenges
Presentation transcript:

Identifying Monitoring Questions from your Program Logic

Overview of the Process Identify monitoring questions for the steps of the logic model Identify indicators that you can collect Use this to guide the development of your M&E plan

When you want to evaluate your project delivery and design You may have the following evaluation questions: – Was the project delivered as planned?, or – Was the theory of change supported? Look at the steps in your program logic, and identify what relevant monitoring questions fit under the evaluation questions, and what indicators would provide the answers?

Review the program logic...

And identify monitoring questions and indicators….

How is it done? This is the activity that we want to monitor and evaluate….. This is the monitoring question that we could ask….. This is the indicator that could be collected to answer the question. Other indicators could include: time required to develop templates, funds spent on development of templates, number of templates produced vs number planned to be produced etc…..

Another example…Outputs This is the output that we want to monitor and evaluate….. These are the monitoring question that we could ask….. These are the indicators that could be collected to answer the questions. This would allow us to make a judgement (evaluation) as to whether the templates were being use, whether they were being used by the target group (intended audience), and whether the templates were useful.

Short-term outcomes This is the short-term outcome that we want to monitor and evaluate….. This is the monitoring question that we could ask….. This is the indicator that could be collected to answer the question. This could be collected by an online user survey.

Intermediate and long-term outcomes The boundary of an evaluation may often be limited to short-term outcomes. A longitudinal evaluation may be require to monitor and evaluate intermediate and long- term outcomes. This can be identified in your M&E plan.

It is important to determine the boundary and scope of your evaluation Longer term outcomes may require a longitudinal evaluation

Use the monitoring questions and indicators to guide the development of your Monitoring and Evaluation Plan. Next Step