I am cutting rocks.

Slides:

Advertisements

Similar presentations

Key Criteria/Principles in selecting indicators Follow-up consultation on TFI Recommendations on Communication for EPI/Polio Dakar - Senegal, 05 and 07.

Advertisements

1 Mateja Bizilj PEMPAL BCOP KEY CONCEPTS AND APPROACHES TO PROGRAMS AND PERFORMANCE Tbilisi, June 28, 2007.

Overview M&E Capacity Strengthening Workshop, Maputo 19 and 20 September 2011.

Donald T. Simeon Caribbean Health Research Council

How to Evaluate Your Health Literacy Project Jill Lucht, MS Project Director, Center for Health Policy

HL7 MHWG LMIC Use Case Using Mobile Devices to Reduce Childhood Mortality Rate in Sub- Saharan Africa and Southern Asia.

THE CONCEPT OF CLINICAL AUDITS IN OBSTETRIC CARE.

National Conference on MDG 5 – Improving Maternal Health in Pakistan November, 2013 Islamabad, Pakistan.

Dining for Women. To decrease maternal and neonatal mortality in remote, rural areas One Heart World-Wide’s Mission In 1997, Arlene Samen had a life-changing.

Developing a Logic Model

An Introduction to Monitoring and Evaluation for National TB Programs.

Introduction to Monitoring and Evaluation for National TB Programs 20 September 2005.

Role of Result-based Monitoring in Result-based Management (RBM) Setting goals and objectives Reporting to Parliament RBM of projects, programs and.

2014 AmeriCorps State and National Symposium How to Develop a Program Logic Model.

Key Terms for Monitoring and Evaluation. Objectives Explain the difference between monitoring and evaluation. Introduce the most common M&E terms. Review.

Monitoring, Review and Reporting Project Cycle Management A short training course in project cycle management for subdivisions of MFAR in Sri Lanka.

How to IMPLEMENT responses. Who and when ? IMMEDIATEPERIODICLONG TERM Region National Woreda Facility Comm’ty Level and timing of action.

The introduction of social workers in the primary health care system and its impact on the reduction of baby abandonment in Kazakhstan 10 September 2014,

Objectives and Indicators for MCH Programs

How to Develop the Right Research Questions for Program Evaluation

President’s December 10 Appeal 2011 Overview Educate – rolling out 4 levels of education for birth attendants in Papua New Guinea Empower – giving skills.

Continuing QIAT Conversations Planning For Success Joan Breslin Larson Third webinar in a series of three follow up webinars for.

Performance Measures AmeriCorps Project Director Training Saratoga, NY October 7 th – 9 th, 2013.

Monitoring and Evaluation for Adult Education Programmes Module 1 © 2013 PRIA International Academy | Appreciation Courses Monitoring and Evaluation for.

Program Evaluation and Logic Models

1 What are Monitoring and Evaluation? How do we think about M&E in the context of the LAM Project?

Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,

Evaluation Assists with allocating resources what is working how things can work better.

Logic Models and Theory of Change Models: Defining and Telling Apart

Juggling the Program Management Ball 1. One day thou art an extension educator… The next day thou art a county director or district extension director…how.

Key priorities for 2012/2013 ACCELERATED REDUCTION OF MATERNAL AND CHILD MORBIDITY AND MORTALITY ‘CARMMA – CH’ THE ROAD MAP TO 2014.

Primer on Monitoring and Evaluation. The 3 Pillars of Monitoring and Evaluation  Identifying the Performance Indicators  Collecting information using.

Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.

M&E Basics Miguel Aragon Lopez, MD, MPH. UNAIDS M&E Senior Adviser 12 th May 2009.

Nancy L. Weaver, PhD, MPH Department of Community Health School of Public Health Saint Louis University 16 July 2010 LOGIC MODEL FUNDAMENTALS.

21/4/2008 Evaluation of control measures 1. 21/4/2008 Evaluation of control measures 2 Family and Community Medicine Department.

CARMMA Working groups - Hospital 16 July Key areas of focus to address gaps and challenges HR and Training appropriate pre-service and in-service.

“A Truthful Evaluation Of Yourself Gives Feedback For Growth and Success” Brenda Johnson Padgett Brenda Johnson Padgett.

Katherine Perdomo Alanna Pugliese CATEGORIES OF EVALUATION.

Indicators Review of key indicators to be measured in the baseline assessment.

Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.

Adrienne DiTommaso, MPA, CNCS Office of Research and Evaluation

1 The project is financed from the European Union funds within the framework of Erasmus+, Key Action 2: Cooperation for innovation and the exchange of.

Human resources for maternal, newborn and child health: opportunities and constraints in the Countdown priority countries Neeru Gupta Health Workforce.

Evaluation: from Objectives to Outcomes Janet Myers, PhD MPH AIDS Education and Training Centers National Evaluation Center

Quality Assurance. Define Quality (product & service) Exceeds the requirements of the customer. General excellence of standard or level. A product which.

Basic Concepts of Outcome-Informed Practice (OIP).

Session 2: Developing a Comprehensive M&E Work Plan.

RE-AIM Framework. RE-AIM: A Framework for Health Promotion Planning, Implementation and Evaluation Are we reaching the intended audience? Is the program.

Introduction to Monitoring and Evaluation. Learning Objectives By the end of the session, participants will be able to: Define program components Define.

Session 5: Selecting and Operationalizing Indicators.

Session 7: Planning for Evaluation. Session Overview Key definitions:  monitoring  evaluation Process monitoring and process evaluation Outcome monitoring.

Definition of indicators Facilitators’ Workshop on District Health Performance Improvement Lilongwe, 25 th – 27 th March 2015.

People lives communities Preparing for Adulthood Getting a good life Contribution through volunteering Julie Pointer Preparing for Adulthood March 2016.

DHPI Approach at a Glance Facilitators’ Workshop on District Health Performance Improvement Lilongwe, 25 th – 27 th March 2015.

Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.

ADRCs Do What? Using Logic Models to Document and Improve ADRC Outcomes Glenn M. Landers.

Module 2 Basic Concepts.

M&E Basics Miguel Aragon Lopez, MD, MPH

Policy Brief: Maternal Mortality Case Of LESOTHO

Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 7. Managers’ and stakeholders’ information needs.

IX- PREPARING THE BUDGET

SBCC Strategy Development: Innovations & Common Pitfalls

Logic Models and Theory of Change Models: Defining and Telling Apart

CATHCA National Conference 2018

What is a Logic Model? A depiction of a program showing what the program will do and what it is to accomplish. A series of “if-then” relationships that.

Involving Families Early Childhood Outcomes Center.

What is a Logic Model? A depiction of a program showing what the program will do and what it is to accomplish. A series of “if-then” relationships that.

Presentation transcript:

I am cutting rocks

I am building a temple

Some principles of monitoring and evaluating health programmes

Questions  What is monitoring?  How is this different from evaluation?  As DCSTs, what monitoring are you involved in?  What evaluation activities are you involved in?

Learning Objectives  Understand basic concepts of M&E  Be able to critique M&E systems more rigorously (especially your own role in this)  Think critically about how you are monitoring and evaluating your own work

“If you don't know where you are going, you will probably end up somewhere else” Laurence J. Peter Laurence J. Peter US educator & writer ( )

Monitoring Monitoring is an on-going systematic review of the implementation of a program/project What, when, how many, where, at what cost, how well? Where is the project at any given time – relative to objectives? Is implementation is taking place as planned? Does implementation vary from site to site? How well has the project been implemented?

Why do we monitor? Measures whether programme is on track Ensures the most effective and efficient use of resources Assist in making informed decisions about what to change Provides the opportunity to spot difficulties in implementation early enough to take remedial action Help distinguish between theory and implementation failure

What are you monitoring? The implementation of your work plans Are you performing activities as planned? Are you reaching the intended target population? Are you reaching the intended number of participants? Is it leading to the products (outputs) you expected? How do the participants perceive these services and activities?

Problem statement Goals Objective Rationales and assumptions InputsActivitiesOutputs Outcomes

Problem statement The district has high stillbirth and perinatal asphyxia rates Objective To increase the knowledge, skills and confidence of midwives and doctors in labour ward to use and interpret the partogram effectively and manage obstetric emergencies appropriately Goals To increase the quality of intrapartum care in order to reduce the number of stillbirths and asphyxiations

Activities 1.Regular partogram audits 2.Train managers in partogram use and assessment 3.ESMOE training and EOST and on- site mentorship 4.Set up/strengthen MMR processes Inputs Master trainers Fire drill dummy Printed training aids Projector Transport Excel and data presentation skills Trainers – O&G, ADM, FP Printed training aids Projector Transport

Activities 1.Regular partogram audits 2.Train managers in partogram use and assessment 3.ESMOE training and EOST and on- site mentorship 4.Set up/strengthen MMR processes OutputsOutcomes # facilities with quarterly partogram spot checks by DCSTs % partograms filled in correctly # managers/staff trained in partogram use and assessment # doctors, midwives, EMS personnel who received ESMOE training

What is evaluation? Evaluation is the systematic collection of information about a program that enables stakeholders to better understand the program, improve its effectiveness, and/or make decisions about future programming. Focuses on the impact of the activities Did the activities achieve the planned objectives and targets?

Evaluation is about outcomes Outcomes are the changes that occur or the difference that is made for individuals, groups, families, organizations, systems, or communities during or after the program. Outcomes fall along a continuum from immediate (initial; short-term) to intermediate (medium-term) to final outcomes (long-term), often synonymous with impact.

Activities 1.Regular partogram audits 2.Train managers in partogram use and assessment 3.ESMOE training and EOST and on- site mentorship 4.Set up/strengthen MMR processes OutputsOutcomes # facilities with quarterly partogram spot checks by DCSTs % partograms filled in correctly # managers/staff trained in partogram use and assessment # doctors, midwives, EMS personnel who received ESMOE training Relevant managers skilled in assessment of partogram and able to address weaknesses with feedback and training Midwives and doctors knowledgeable and skilled in use and interpretation of partogram Partogram used effectively to identify problems timeously and take effective, appropriate action Fresh stillbirth rate in facilities decreases ST MT LT

ESMOE training of midwives LEARNING: The knowledge the midwives gain from training. Midwives knowledgeable and skilled in the use and interpretation of partograms BEHAVIOUR: The actions midwives take as a result of that knowledge. Improved management of labour through correct use and interpretation of partograms CONDITION: The conditions that change as a result of those actions. Reduction in stillbirths and early neonatal deaths Short term Long term Medium term

Evaluation of DCST work What difference did you make? What will you evaluate? Changes in knowledge, skill, attitudes, behaviour, motivation, decisions, policies and conditions How will you know these changes have happened? How will you know these changes happened as a result of your activities?

WBOT – household visits to pregnant women to educate family about danger signs in pregnancy LEARNING: The knowledge families gain from the health messages. Families are equipped with appropriate health care messages on danger signs during pregnancy. BEHAVIOR: The actions families take as a result of that knowledge. An increase in families of pregnant women recognising danger signs of pregnancy and seeking timely health care. CONDITION: The conditions that change as a result of those actions. Decrease in Maternal Mortality Ratio Short term Long term Medium term

Setting up a Kangaroo Mother Care Unit Change that occurred: Increase in the number of prem babies and mother pairs admitted to the KMC unit Difference that was made: Impact caused by difference: Short term Long term Medium term

Homework Develop a monitoring and evaluation plan for one of your flagship projects/activities Carry this through – document your monitoring indicators and your outcomes (short term, medium term and long term) Write this up

Guidelines Choose your project/activity What do you want to monitor about the: Inputs Outputs What are the short term, medium term and long term outcomes you wish to see? How will you measure these? What will your indicators be?