+ Monitoring, Learning & Evaluation Questions or problems during the webinar?

Slides:



Advertisements
Similar presentations
Introduction to Performance Measurement for Senior Corps Project STAR Support and Training for Assessing Results Recorded 9/10/2007.
Advertisements

M & E for K to 12 BEP in Schools
Evaluation Overview Plus 50 Conference July , 2009 Washington, DC.
Logic Models and Evaluation Glen W. White 1 Jamie Simpson 2 1 University of Kansas, Research and Training Center on Independent Living 2 Kansas Department.
Health & Social Care AS & A2
How to Evaluate Your Health Literacy Project Jill Lucht, MS Project Director, Center for Health Policy
Kathy Keeley Northland Foundation Strengthening Communities April 14, 2011 Writing Result Measures and Program Evaluation.
A plain English Description of the components of evaluation Craig Love, Ph.D. Westat.
Everyday Program Evaluation Sheena Cretella MSPH SC DHEC Diabetes Division Program Evaluator 1.
Measuring and reporting outcomes for your BTOP grant 1Measuring and Reporting Outcomes.
Developing a Logic Model
The Lumina Center Grantseeking Workshop Series Presents Outcomes & Evaluations April 20, 2006.
Objectives and Indicators for MCH Programs MCH in Developing Countries January 25, 2011.
Key Terms for Monitoring and Evaluation. Objectives Explain the difference between monitoring and evaluation. Introduce the most common M&E terms. Review.
1 Designing a Monitoring and Evaluation System for a Rural Travel and Transport Project Michael Bamberger Gender and Development Group The World Bank RTTP.
APPRENTICESHIPS AND VALUES BASED RECRUITMENT. The Suffolk Brokerage has recently launched a new recruitment support service for adult social care employers.
Developing Earmark Grant Performance Measures: Grant Proposal Section 3 Deanna Khemani.
TOOLS FOR POLICY DEVELOPMENT AND ANALYSIS Goals and Objectives.
Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.
Monitoring, Learning & Evaluation
Objectives and Indicators for MCH Programs
Evaluation of Math-Science Partnership Projects (or how to find out if you’re really getting your money’s worth)
Helping Non-Profit Organizations Understand The Value of Their Work Copyright Postrain Consulting Services 2009.
Measuring for Success Module Nine Instructions:
Dr. Albrecht Research Team EXAMPLE of EVALUATIO N RESEARCH SERVICE LEARNING
Performance Measurement and Evaluation Basics 2014 AmeriCorps External Reviewer Training.
Edward M. Haugh Jr. ESC Consultant. III. Recommendations for Applying Outcomes Planning to ESC  I. Introduction to Outcomes Planning II. A Sample ESC.
This project is funded by the EUAnd implemented by a consortium led by MWH Logical Framework and Indicators.
Selective Prevention Working Group: Considerations for the Performance Indicator Table Reporting to the Plenary Session of the VII Meeting of the CICAD.
Performance Measures AmeriCorps Project Director Training Saratoga, NY October 7 th – 9 th, 2013.
Theory of Change Designing Effective Action for Change How a Theory of Change helps you clarify the cause-and-effect relationship at the heart of your.
2015 AmeriCorps Logic Model A presentation for AmeriCorps grant applicants.
SUPPORT FOR YOUR STUDENT EQUITY PLAN Presented by the Institute for Evidence-Based Change October 10th, 2014.
Measuring the effectiveness of your volunteer program Meals On Wheels Association of America 2011 Annual Conference August 30, 2011 Stacey McKeever, MPH,
Program Evaluation and Logic Models
Outcome-Based Management Program Data Collection Requirements – Program Instructors.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Performance and Progress 2005/2006. Introduction  Data collected during 2005/2006 fiscal year.  Who did our programs serve?  Did programs reach the.
The Logic Model An Introduction. Slide 2 Innovation Network, Inc. Who We Are National nonprofit organization Committed to evaluation as a tool for empowerment.
“NEXT STEPS” BIE FAMILY ENGAGEMENT Facilitated by:
Julie R. Morales Butler Institute for Families University of Denver.
Tell the Story: Why Performance Measures Matter Cat Keen, M.S.W., M.B.A National Service Programs Director.
W HAT IS M&E  Day-to-day follow up of activities during implementation to measure progress and identify deviations  Monitoring is the routine and systematic.
Indicators for ACSM.
Measuring and reporting outcomes for BTOP grants: the UW iSchool approach Samantha Becker Research Project Manager U.S. IMPACT Study 1UW iSchool evaluation.
Performance and Progress 2006/2007. Introduction Data collected during 2006/2007 fiscal year. Who did our programs serve? Did programs reach the intended.
Family Resource and Youth Services Centers: Action Component Plan.
Community Planning Training 5- Community Planning Training 5-1.
Texas Homeless Education Office The University of Texas at Austin Charles A. Dana Center 2901 N IH 35,
Outcomes Working Group: Webinar 2: Theory of Change Facilitators: Frances Sinha, Director EDA Rural Systems (India) and board member of SPTF. Anton Simanowitz,
Leadership Teams Implementing PBIS Module 14. Objectives Define role and function of PBIS Leadership Teams Define Leadership Team’s impact on PBIS implementation.
Tools and techniques to measuring the impact of youth work (Caroline Redpath and Martin Mc Mullan – YouthAction NI)
Performance Measurement 101. Performance Measurement Performance Measurement is: –The ongoing monitoring and reporting of program accomplishments and.
CAREER PATHWAYS THE NEW WAY OF DOING BUSINESS. Agenda for our Discussion Today we’ll discuss: Career Pathways Systems and Programs Where we’ve been and.
Session 2: Developing a Comprehensive M&E Work Plan.
Introduction to Monitoring and Evaluation. Learning Objectives By the end of the session, participants will be able to: Define program components Define.
Development of Gender Sensitive M&E: Tools and Strategies.
Using Data to Assess Quality Improvement Results February 23, 2009 Presentation at the CLP/ADRC 2010 Annual Meeting Debra J. Lipson.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
SUPPORT FOR YOUR STUDENT EQUITY PLAN
Logic Models How to Integrate Data Collection into your Everyday Work.
GFC M&E 101 THE BASICS OF MONITORING AND EVALUATION AT GFC
Outcome Logic Model Guide
Module 2 Basic Concepts.
Utilizing the LOGIC MODEL for Program Design and Evaluation
Strategic Prevention Framework - Evaluation
SUCCESSFUL MEASURING JAMES HARDIN, DIRECTOR, HEALTH IMPACT
Troubleshooting Logic Models
Resources Activity Measures Outcomes
BOOTCAMP SOCIAL INNOVATION ACCELERATOR TO CREATE LASTING CHANGE
Presentation transcript:

+ Monitoring, Learning & Evaluation Questions or problems during the webinar?

+ Learning Goals Learn about the benefits and value of monitoring and evaluating programs Understand monitoring and evaluation fundamentals, including: Logical frameworks Key terms and definitions Understand how to use monitoring and evaluation Become comfortable with The Global Fund for Children’s monitoring and evaluation processes for your proposals and reports

+ What Is Monitoring & Evaluation? Monitoring Evaluation An ongoing, continuous process of counting, tracking, and collecting data. What are the things you can measure about your program? For example, how many children completed a training on healthy lifestyles this month? A measure of the change that has taken place because of your program. Evaluation measures how well you have met the program’s goals. Did your program help the people you thought it would help, or change what you were hoping to change? For example, are the children who completed a training on healthy lifestyles healthier ?

+ Monitoring ● Learning ● Evaluation Monitoring is done consistently throughout the project to check your progress Evaluation is used to help you see if you have made progress toward your goals Learning

+ Write down three ways your organization can benefit from monitoring and evaluation. Why Monitoring & Evaluation? Now You! M&E helps you answer these questions: Was the program completed as planned? Did the target population benefit from the program, and at what cost? Which program activities were most effective, and which were least effective? Use resources well. Make good decisions for project changes. [2 minutes]

+ Key Words to Know Impact Changes in the condition of the people who benefit from your work, particularly changes reflecting the goal of the project. Outcome The intermediate effects, often behavioral, resulting directly from project outputs. This is the change that takes place because of the activity. Output The easily measurable, immediate, and intended effect of your work. Activity Actions taken or work performed in a project to produce specific outputs by using inputs. Input Funds, technical assistance, and other resources needed to complete a project.

+ The Logical Framework

+ INPUT (Resources) Time Money Donors Equipment Facilities ACTIVITY/ PROGRAM (Interventions) Services Trainings Home Visits Classes Sessions OUTPUT (Direct result from interventions) Who did we reach? (# and population) What did we do? (action and duration/ frequency) OUTCOME (Change in participants, result of your project) Behavior Awareness Knowledge Skills Practices Attitude IMPACT (Change in society) Environment Social condition Political condition Economic condition Policy The Logical Framework Before Activity Change = Outcome After

+ Logical Framework: Example University enrollment increases 90% of students in the after- school tutoring program pass the end-of-year exam 20 hours of after-school math lessons are provided After-school tutoring is offered Tutors are hired and classroom space is secured for tutoring Many students are not able to attend university because they are unprepared for the end-of-year exam ACTIVITY/PROGRAM OUTPUT OUTCOME IMPACT INPUT PROBLEM

+ Logical Framework: Your Turn A. 95 out of 100 girls complete their secondary- school education B. More girls pursue higher education at university C. $800 raised to fund scholarships D. Scholarships for girls to attend secondary school E. 100 girls receive academic scholarships ACTIVITY/PROGRAM OUTPUT OUTCOME IMPACT Now You! INPUT [5 minutes] PROBLEM Secondary-school completion rates for girls are low

+ M&E for GFC: Outcome Sentences & Reports

+ SMART Measurements Program outcome: Program goal A program goal should be SMART S = Specific M = Measurable A = Appropriate R = Realistic T = Timely

+ Is This Outcome Sentence SMART? “Trafficked children went back to school.” S: Specific – Yes and No. “Trafficked children” is specific, but how many are in school, and what kind of school do they go to? M: Measurable – No. How many children went back to school? A: Appropriate – Maybe. Are there children in the community who are trafficked and in need of formal schooling? R: Realistic – Maybe. Can the organization reach the children and enroll them in school? T: Timely – No. In what time frame did these children go back to school? “Last year, 46 formerly trafficked children were reintegrated into formal schooling, based on school records.” Now You! [5 minutes]

+ Outcome Sentence for GFC # or % (4) What? (1) How? (2) Who? (3) Last year, 66% of program participants were successfully enrolled in formal school, based on statistics from local schools. 1. For the program you run, what outcome (change) does the organization measure? 2. How does the organization collect data for (measure) this outcome? 3. Who is affected (benefits) in this outcome measure? 4. How much/how many did the organization count for this outcome last year? What How Who When How many # or % (4) What? (1) How? (2) Who? (3) Last year, 66% of program participants were successfully enrolled in formal school, based on statistics from local schools.

+ Put the Parts of This Outcome Sentence in the Correct Order based on employment records last year successfully secured jobs following training 55% of disabled youth Last year, 55% of disabled youth successfully secured jobs following training, based on employment records. Now You! # or % What? How?Who? Last year, 66% of program participants were successfully enrolled in formal school, based on statistics from local schools. [2 minutes]

+ Practice: Write an Outcome Sentence for GFC Use the questions below to determine what program outcome your organization would like to report to The Global Fund for Children. Now You! Last year, _(4)__ of (3) were (1), based on (2). [6 minutes]

+ Collecting Data Why? Makes monitoring and evaluation possible Where can you get data from? Your own records Local organizations Tools: Questions to consider Who collects the data, how is it collected, and when is it collected? Where is the data stored, and how is it organized? Other resources: My M&E website on how to collect data: recomm-page?q=node/94 Keep track of the resources, number of participants, and what happened during your program in a consistent and repeatable way.

+ Additional Resources M&E Learning Center My M&E Global Health E-Learning Children & Evaluation aluation_and_children M&E Studies Pan Asia-Africa RBM&E Forum

+ Please write down three changes you can make that will improve M&E for your organization. What Did You Learn? What changes can you make in your work today? Now You! [5 minutes]

+ Thank you Contact: Sarah Ellison Please take the follow- up survey!