Key Terms for Monitoring and Evaluation. Objectives Explain the difference between monitoring and evaluation. Introduce the most common M&E terms. Review.

Slides:



Advertisements
Similar presentations
Planning M&E to Tell Our ACSM Story. Objectives Discuss how ACSM activities can address barriers to help reach national TB control targets. Describe how.
Advertisements

Donald T. Simeon Caribbean Health Research Council
I am cutting rocks.
Selecting the Right Evaluation Method. Objectives Why should we evaluate? Which activities should we evaluate? When should we evaluate? How should we.
MEASURE Evaluation M&E and Advocacy Tools in the response to the Emergency Declaration.
Monitoring and Evaluation Frameworks Kyiv, Ukraine May 23, 2006 MEASURE Evaluation.
Monitoring and Evaluation: A Review of Terms. Goals To provide better treatment for people with tuberculosis in Country X To achieve a treatment success.
Comprehensive M&E Systems
Compendium of Indicators for Monitoring and Evaluating National Tuberculosis Programs.
Monitoring and Evaluation for TB Programs
Compendium of Indicators for Monitoring and Evaluating National Tuberculosis Programs.
Monitoring and Evaluation Frameworks   What is an M&E Framework?   Why do we use M&E Frameworks?   How do we develop M&E Frameworks? MEASURE Evaluation.
Monitoring and Evaluation for TB Programs Developing a Monitoring and Evaluation Plan Charlotte Colvin 2 February 2006 New Delhi, India.
Logic Models. A logic model is your program ROAD MAP. Where are you trying to go? How are you trying to get there? What will tell you that you’ve arrived?
Role of Result-based Monitoring in Result-based Management (RBM) Setting goals and objectives Reporting to Parliament RBM of projects, programs and.
Objectives and Indicators for MCH Programs
Tools for HIV/TB Integration and the Civil Society Experience Carol Nawina Nyirenda Executive Director Community Initiative for Tuberculosis, HIV/AIDS.
Evaluation Methods.
Essential Service # 7:. Why learn about the 10 Essential Services?  Improve quality and performance.  Achieve better outcomes – improved health, less.
Importance of Health Information Systems Information explosion during 1990s  It is estimated that in the next 50 years, the amount of knowledge currently.
Development and Implementation of a National Multisectoral Output Monitoring System (SHAPMoS) for HIV Responses in Swaziland:  Challenges and lessons learned.
Unit 8: Uses and Dissemination of HIV Sentinel Surveillance Data #3-8-1.
SMART Objectives.
Action Plan Good Health Situation of Population in Capital of Myanmar Yangon Division By DR MYA THIDA AYE.
Program Evaluation and Logic Models
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
September 2009 Guide to Producing Campaign to End Pediatric Aids (CEPA) National Advocacy Action Plans (NAAPs)
TB PUBLIC-PRIVATE MIX DOTS Dr. Team Bakkhim Deputy Director CENAT Intercontinental Hotel 7 th November, 2012 NATIONAL FORUM ON PUBLIC-PRIVATE PARTNERSHIP.
Overview of Advocacy, Communication, and Social Mobilization.
Introduction to Evaluation. Objectives Introduce the five categories of evaluation that can be used to plan and assess ACSM activities. Demonstrate how.
U pdates on the development of the NTP National Strategic Plan GC National TB Conference Pokhara, July 14-15, 2014 Giampaolo Mezzabotta Medical.
Juggling the Program Management Ball 1. One day thou art an extension educator… The next day thou art a county director or district extension director…how.
Real-World Challenges of M&E. Objectives Outline the “real-world” challenges of conducting program monitoring and evaluation. Identify practical and feasible.
Monitoring &Evaluation System in Health Program. Brief overview of NACP Reporting units and quality aspects Data sets Learning/ Analysis of the data sets.
Japan Dr. Ismail M. Aboshama Zidan Surveillance Coordinator of NTP-Egypt Action Plan to Strengthen Laboratory Diagnostic.
Indicators for ACSM.
Model Name Transition Project Learning Network Workshop 3 IYF Transition Project.
21/4/2008 Evaluation of control measures 1. 21/4/2008 Evaluation of control measures 2 Family and Community Medicine Department.
Experiences in Tanzania: Community Based Efforts to Support HIV/TB Integration Jackson Mugyabuso Dr. Charlotte Colvin PATH 25 July 2012.
Uses for Data.
The P Process Strategic Design
Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.
Community involvement in scaling up TB/HIV activities.
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
Contribution of operational research in China National Center for TB Control and Prevention, China CDC Jiang Shiwen Cancun.
Using Logic Models to Create Effective Programs
Monitoring and Evaluation for ACSM Charlotte Colvin, PhD TB/HIV Technical Officer PATH 23 February 2010.
ROOTS 1+2 Advocacy toolkit
Georgia Comprehensive Cancer Control Program 3/10/2015 Program Monitoring and Evaluation Activities Short-Term Outcomes Long-Term Outcomes Intermediate.
ACSM at Country Level Sub Group Meeting
Introduction to Monitoring and Evaluation. Learning Objectives By the end of the session, participants will be able to: Define program components Define.
European Union COMMUNICATION AND VISIBILITY. Importance of Visibility EU taxpayer money Need for awareness, accountability and transparency EU should.
Effect of Clinical Program Integration on Eliminating Disparities in Access to Care P. Tambe, M. Allen, R. Lewis-Hardy, T. Dupree-Bright, E. Benning, S.
Compendium of Indicators for Monitoring and Evaluating National Tuberculosis Programs.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
TB AND HIV: “THE STRATEGIC VISION FOR THE COUNTRY” Dr Lindiwe Mvusi 18 May 2012 MMPA Congress 2012.
Designing Effective Evaluation Strategies for Outreach Programs
Monitoring and Evaluation: A Review of Terms
Monitoring and Evaluation Frameworks
Short term Medium term Long term
Find and Treat All Missing Persons with TB
Community involvement in scaling up TB/HIV activities
Monitoring and Evaluation
Introduction to M&E Frameworks
MANAGEMENT, STAFF, NATIONAL COALITION, FINANCIAL RESOURCES,
National Cancer Center
monitoring & evaluation THD Unit, Stop TB department WHO Geneva
Indicator: % of population in an area of BMU implementing DOTS
Monitoring and Evaluation: A Review of Terms
Stakeholder engagement and research utilization: Insights from Namibia
Presentation transcript:

Key Terms for Monitoring and Evaluation

Objectives Explain the difference between monitoring and evaluation. Introduce the most common M&E terms. Review examples of each term.

Monitoring versus Evaluation Monitoring Data collected on program activities Ongoing, routine Focus on activities and output, compared to target Are we doing the work we planned? Evaluation Data collected to answer specific questions Periodic Focus on outcome, impact How effective were our activities?

Monitoring or Evaluation? Local researchers conduct a study to determine if there are more people with possible TB symptoms coming to DOTS clinics as a result of a media campaign to promote TB screening. Evaluation

Monitoring or Evaluation? A district manager reports on how many nurses were trained on interpersonal communication skills for her quarterly donor report. Monitoring

It Starts with QUESTIONS Monitoring and evaluation answer different questions. If we do not ask good questions about our activities, we will not get useful data!

The ultimate result of efforts at a broad, population level. Achieved over the long term (years) and through combined efforts of multiple programs (not always related to ACSM). What is a GOAL? Decrease morbidity and mortality due to TB in Country X. Reduce prevalence of TB by 50%. Eliminate stigma of TB in our communities.

OBJECTIVES GOAL ACSM activities How the results of your short-term program activities contribute to the big goal. Several objectives can relate to the same goal. Link between ACSM activities and the NTP. What is an OBJECTIVE?

Objective Examples Aggressively advocate to increase NTP budget by 8% each year for the next four years. Double the percentage of secondary school students who can correctly identify TB symptoms by Design and pilot a treatment support program for newly released prisoners with TB by 2015.

INPUTS Resources needed to plan and implement ACSM “Raw materials” of an ACSM project Examples Money Staff Policies, guidelines Equipment Partners

ACTIVITIES The work that we do, what we implement Also called “processes” Examples Training events Meetings Events Outreach Home visits

OUTPUTS Immediate results of activities What we can measure/count right after the activity Examples Number of people trained Number of brochures produced Number of policymakers reached with advocacy activity

OUTCOMES “Ripple effects” of ACSM activities What changes after outputs are produced Examples Increased funding for TB after lobbying meeting Short: Improved attitudes toward TB patients among DOTS nurses after a training Medium: Increased satisfaction of TB clients Long: TB clients stay in treatment longer

INDICATORS How we define our activities, outputs, or outcomes Signs or evidence we watch for to see if we have reached them ACTIVITY: Meeting with Finance Minister and NTP Director to lobby for more funding for NTP OUTPUT: Number of officials attending the meeting INDICATOR: Number of officials attending the meeting compared to number invited OUTCOME: Increased funding INDICATOR: Percentage of NTP budget covered by the Ministry of Health

The Crow and the Pitcher

IMPACT More related to goal Very broad-scale result over long term Examples Higher rate of treatment success Reduction in deaths among MDR-TB patients