How to Prepare and Manage FFP Mid-term Evaluations Food and Nutrition Technical Assistance III Project (FANTA) FHI 360 1825 Connecticut Ave., NW Washington,

Slides:



Advertisements
Similar presentations
Food and Nutrition Technical Assistance III Project (FANTA) FHI Connecticut Ave., NW Washington, DC Tel: Fax:
Advertisements

Food and Nutrition Technical Assistance III Project (FANTA) FHI Connecticut Ave., NW Washington, DC Tel: Fax:
Training for Participants Date, Location, Venue 1 Welcome! Welcome to PEM 2 Module!
OVERVIEW OF ClASS METHODS and ACTIVITIES. Session Objectives By the end of the session, participants will be able to: Describe ClASS team composition.
Food and Nutrition Technical Assistance III Project (FANTA) FHI Connecticut Ave., NW Washington, DC Tel: Fax:
Improving Program Outcomes: Workshop on Uses of Title II Reporting Requirements Beatrice Lorge Rogers Tufts University TOPS FSN Knowledge Management Workshop.
Food and Nutrition Technical Assistance III Project (FANTA) FHI Connecticut Ave., NW Washington, DC Tel: Fax:
Food and Nutrition Technical Assistance III Project (FANTA) FHI Connecticut Ave., NW Washington, DC Tel: Fax:
M&E Plan Overview M&E Capacity Strengthening Workshop Addis Ababa
Food and Nutrition Technical Assistance III Project (FANTA) FHI Connecticut Ave., NW Washington, DC Tel: Fax:
District 5390 Foundation Seminar October 20, 2012 Butte, Montana.
Multisector Program Integration
Comprehensive Regulatory Revision Office of Developmental Programs.
Assessments. Assessment in the Project Cycle DESIGN IMPLEMENTATION MONITORING EVALUATION ASSESSMENT.
Food and Nutrition Technical Assistance III Project (FANTA) FHI Connecticut Ave., NW Washington, DC Tel: Fax:
Training Facilitators to Use the Community Health Worker Assessment and Improvement Matrix (CHW AIM) Toolkit Model Slides for Adaptation by Implementers.
How to Prepare for an Ohio Technical Assistance Visit.
The Global Fund - Proposal Process & Round 8 February 19, 2008.
Malnutrition: Uganda Is Paying Too High a Price Uganda PROFILES Part C UGANDA PROFILES
Office of Performance Review (OPR) U.S. Department of Health and Human Services (DHHS) Health Resources and Services Administration (HRSA) Stephen Dorage.
Abstract ID: 395 Author Name: Araya Sripairoj Presenter Name: Araya Sripairoj Authors: Sripairoj A, Liamputtong P, Harvey K.
Guidelines for LDS preparation for Croatian LAG’s Estonian Leader Union Kadri Tillemann and Kristiina Timmo 28 th of September, Zagreb.
Overview of Grant Agreements - Agreement Process - Roadmap to the Agreement Document - Agreement Requirements/ Compliance Issues - Timelines for Reporting.
Mid-Decade Assessment of the United Nations 2010 World Population and Housing Census Program Arona L. Pistiner Office of the Associate Director for 2020.
Evaluation Plan Steven Clauser, PhD Chief, Outcomes Research Branch Applied Research Program Division of Cancer Control and Population Sciences NCCCP Launch.
IAEA International Atomic Energy Agency. IAEA Outline LEARNING OBJECTIVES REVIEW TEAM AMD COUNTERPARTS Team Composition Qualification PREPARATORY PHASE.
Monitoring Afghanistan, 2015 Food Security and Agriculture Working Group – 9 December 2015.
Office of International Research, Education, and Development, Virginia Tech Policy and Operating Procedures (POP) Manual Theo Dillaha, Program Director.
Yvonne Abel, Abt Associates Inc. November 2010, San Antonio, TX Enhancing the Quality of Evaluation Through Collaboration Among Funders, Programs, and.
Karen Cheung, MPH, Pamela Luna, DrPH, MST, Sarah Merkle, MPH American Evaluation Association Annual Meeting November 11, 2009 The findings and conclusions.
MEASURE Evaluation Data Quality Assurance Workshop Session 3 Introduction to Routine Data Quality Assessment.
Engaging USAID Missions in Research Activities SANREM Technical Committee Meeting Blacksburg, Virginia April , 2006.
Monitoring & Evaluation Capacity Strengthening Workshop WORKSHOP INTRODUCTION AND OVERVIEW.
Performance-Based Accreditation
Monitoring and Evaluation (M&E) Plan
PILOT SCHOOL PRINCIPAL EVALUATION
Preparation of the Self-Study and Documentation
Well Trained International
Food for Peace Monitoring and Evaluation Workshop for
Teacher Evaluation Timeline
Data Quality Assurance Workshop
Department of Political Science & Sociology North South University
MONITORING AND EVALUATION IN THE GEF
Priority Gender Equality
Pharmacy and Therapeutics Committees in Thai Hospitals under Health Reform Sripairoj A, Liamputtong P, Harvey K La Trobe University, Australia.
FY 16 Refine and Implement
Descriptive Analysis of Performance-Based Financing Education Project in Burundi Victoria Ryan World Bank Group May 16, 2017.
Development and Use of a Multi-dimensional Index for Nutrition Knowledge among Mothers and Health Workers in Malawi Kate Schneider and Will Masters.
Multi-Sectoral Nutrition Action Planning Training Module
Final Debrief Presentation
Tubaramure, a food-assisted integrated health and nutrition program in Burundi improves maternal and child hemoglobin levels and reduces anemia: a theory-based.
The Gender Analysis Process in Food For Peace Development Programs
Background to The Conference
Session 4: SDG follow-up and review mechanisms
Alternative reporting to the Committee on the Rights of Persons with Disabilities Module 7.2.
Project and Program Information and Impact Reporting System (PIIRS) The FY17 data collection and reporting process.
Introduction to the training
United Nations Voluntary Fund on Disability (UNVFD)
MONITORING AND EVALUATION IN THE GEF
Session: 9 On-going Monitoring & Follow Up
A Guide to the Sharing Information on Progress (SIP)
Guidelines on the Mid-term Evaluation
MONITORING AND EVALUATION IN THE GEF
Summary for the use of UN Habitat staff
Integrating Gender M&E Capacity Strengthening Workshop, Addis Ababa
"Experience with the peer reviews, successes and things to change for next reviews" Delina Ibrahimaj, Albania.
MONITORING AND EVALUATION IN THE GEF
Gender Training Workshop Name of Institution Place Date
Institutional Self Evaluation Report Team Training
MONITORING AND EVALUATION IN THE GEF
Presentation transcript:

How to Prepare and Manage FFP Mid-term Evaluations Food and Nutrition Technical Assistance III Project (FANTA) FHI Connecticut Ave., NW Washington, DC Tel: Fax: Website: HOW TO PREPARE AND MANAGE FFP MID-TERM EVALUATIONS Pamela Velez-Vega, Monitoring & Evaluation Research Associate September 22 nd, 2015

How to Prepare and Manage FFP Mid-term Evaluations 2

3 Session Objectives Participants will: 1.Recognize requirements for a mid-term evaluation (MTE) 2.Identify steps to prepare and manage a MTE

How to Prepare and Manage FFP Mid-term Evaluations 4 Case Example Your organization was awarded a 5-year FFP development food assistance project in Madagascar. You are the Chief of Party.

How to Prepare and Manage FFP Mid-term Evaluations 5 Roles of USAID and Awardee Project Staff

How to Prepare and Manage FFP Mid-term Evaluations 6

7 MTE Objectives MTE design and support should be strongly oriented toward Objective 1 1 a)Adherence to terms agreed b)Target communities’ perceptions of intervention c)Factors challenging or supporting implementation 2 Intended and unintended changes 3 Adjustments to implementation and ToC or RF Photo by: Alex Harsha, Medic Mobile

How to Prepare and Manage FFP Mid-term Evaluations 8 Key Evaluation Questions Focus of evaluation a)Adherence to terms b)Target perceptions c)Factors 3. Adjustments to implementation 2. Intended and unintended changes 1.

How to Prepare and Manage FFP Mid-term Evaluations 9 MTE Methods FFP discourages large-scale quantitative surveys

How to Prepare and Manage FFP Mid-term Evaluations 10 MTE Methods Unstructured or semi-structured interviews Observation Mostly Qualitative

How to Prepare and Manage FFP Mid-term Evaluations 11 MTE Methods Project data and secondary data analysis Small-scale surveys: Test hypothesis Capture perceptions Cross-check What kinds of quantitative data collection methods are encouraged?

How to Prepare and Manage FFP Mid-term Evaluations 12 MTE Methods: Sampling Site selection Informant selection Project intervention

How to Prepare and Manage FFP Mid-term Evaluations 13 Cooperative and iterative process among Awardee FFP AOR and M&E team and Mission FFP AOR and M&E team and Mission Preparing the Statements of Work (SOW)

How to Prepare and Manage FFP Mid-term Evaluations 14 Illustrative MTE SOW A.Introduction (overview, project background) B.MTE Objectives C.MTE Methods D.Contractor Responsibilities E.MTE Team Composition, Qualifications and Roles F.Project Responsibilities G.Intellectual Property H.Ethical Guidelines

How to Prepare and Manage FFP Mid-term Evaluations 15 Project Responsibilities 1.Prepare SOW 2.Select evaluation team 3.Provide secondary data 4.Serve as informant 5.Provide logistical advice 6.Offer administrative support (optional)

How to Prepare and Manage FFP Mid-term Evaluations 16 Project Responsibilities: Provision of secondary data Geographic orientation documents Proposal and amendments Reports to USAID M&E plan Intervention protocol descriptions Intervention reports and data Exit strategy and sustainability plan

How to Prepare and Manage FFP Mid-term Evaluations 17 Illustrative MTE Statement of Work (SOW) A.Introduction (overview, project background) B.MTE Objectives C.MTE Methods D.Contractor Responsibilities E.MTE Team Composition, Qualifications and Roles F.Project Responsibilities G.Intellectual Property H.Ethical Guidelines

How to Prepare and Manage FFP Mid-term Evaluations 18 Conclusions Evidence Recommendations Interpretation of the data Data Proposed actions for management Contractor Responsibilities: MTE Report

How to Prepare and Manage FFP Mid-term Evaluations 19 Illustrative MTE Statement of Work (SOW) A.Introduction (overview, project background) B.MTE Objectives C.MTE Methods D.Contractor Responsibilities E.MTE Team Composition, Qualifications and Roles F.Project Responsibilities G.Intellectual Property H.Ethical Guidelines

How to Prepare and Manage FFP Mid-term Evaluations 20 Team Composition External evaluator quantitative and qualitative All technical sector and cross-cutting themes EWS, Gender, Environment Ag & Livelihoods MCHN Unbiased

How to Prepare and Manage FFP Mid-term Evaluations End of Year 1 End of Year 2 End of Year 3 MTE timeline 21 Project award SOW draft to USAID within 15 months of award MTE submission Approval and Procurement of evaluators Secondary data review and work plan prep Data collection and field validation Data analysis and report drafting USAID feedback and report finalization Set up MTE timing within first year

How to Prepare and Manage FFP Mid-term Evaluations End of Year 1 End of Year 2 End of Year 3 MTE timeline 22 Project award SOW draft to USAID within 15 months of award MTE submission Approval and procurement of evaluators Secondary data review and work plan prep Data collection and field validation Data analysis and report drafting USAID feedback and report finalization Set up MTE timing within first year (3-4 months) (3-4 months for agreement & final approval) (4-6 weeks) (6-8 weeks excluding travel time) (6-8 weeks) (4-8 weeks)

How to Prepare and Manage FFP Mid-term Evaluations 23 MTE Budget Minimum $150,000-$200,000 per award Increased coverage of interventions in the field Travel time to and among intervention sites

How to Prepare and Manage FFP Mid-term Evaluations 24 Common Pitfalls to avoid! Late or incomplete provision of secondary data Team leader with insufficient evaluation training Logistics bias site selection

How to Prepare and Manage FFP Mid-term Evaluations 25 Common Pitfalls to avoid (cont.) ! MTE team not aware of logistical responsibilities (e.g. vehicles, interpreters) MTE report: Recommendations not supported by conclusions No evidence provided to support conclusion

How to Prepare and Manage FFP Mid-term Evaluations 26 Session Objectives (Recap) Participants will: 1.Recognize requirements for a mid-term evaluation (MTE) 2.Identify steps to prepare and manage a MTE

How to Prepare and Manage FFP Mid-term Evaluations 27 Resources Draft: USAID’s Office of Food for Peace Policy and Guidance for Monitoring, Evaluation, and Reporting for Development Food Assistance Projects Submit inputs to by October 29, 2015!

How to Prepare and Manage FFP Mid-term Evaluations This presentation is made possible by the generous support of the American people through the support of the Office of Health, Infectious Diseases and Nutrition, Bureau for Global Health, U.S. Agency for International Development (USAID) and the Office of Food for Peace, Bureau for Democracy, Conflict and Humanitarian Assistance, under terms of Cooperative Agreement No. AID-OAA-A , through the Food and Nutrition Technical Assistance III Project (FANTA), managed by FHI 360. The contents are the responsibility of FHI 360 and do not necessarily reflect the views of USAID or the United States Government. 28