1. http://img359.imageshack.us/img359/7104/picture420bt2.jpg I am cutting rocks

2. http://img359.imageshack.us/img359/7104/picture420bt2.jpg I am building a temple

3. Some principles of monitoring and evaluating health programmes

4. Questions  What is monitoring?  How is this different from evaluation?  As DCSTs, what monitoring are you involved in?  What evaluation activities are you involved in?

5. Learning Objectives  Understand basic concepts of M&E  Be able to critique M&E systems more rigorously (especially your own role in this)  Think critically about how you are monitoring and evaluating your own work

6. “If you don't know where you are going, you will probably end up somewhere else” Laurence J. Peter Laurence J. Peter US educator & writer (1919 - 1988)

7. Monitoring Monitoring is an on-going systematic review of the implementation of a program/project What, when, how many, where, at what cost, how well? Where is the project at any given time – relative to objectives? Is implementation is taking place as planned? Does implementation vary from site to site? How well has the project been implemented?

8. Why do we monitor? Measures whether programme is on track Ensures the most effective and efficient use of resources Assist in making informed decisions about what to change Provides the opportunity to spot difficulties in implementation early enough to take remedial action Help distinguish between theory and implementation failure

9. What are you monitoring? The implementation of your work plans Are you performing activities as planned? Are you reaching the intended target population? Are you reaching the intended number of participants? Is it leading to the products (outputs) you expected? How do the participants perceive these services and activities?

10. Problem statement Goals Objective Rationales and assumptions InputsActivitiesOutputs Outcomes

11. Problem statement The district has high stillbirth and perinatal asphyxia rates Objective To increase the knowledge, skills and confidence of midwives and doctors in labour ward to use and interpret the partogram effectively and manage obstetric emergencies appropriately Goals To increase the quality of intrapartum care in order to reduce the number of stillbirths and asphyxiations

12. Activities 1.Regular partogram audits 2.Train managers in partogram use and assessment 3.ESMOE training and EOST and on- site mentorship 4.Set up/strengthen MMR processes Inputs Master trainers Fire drill dummy Printed training aids Projector Transport Excel and data presentation skills Trainers – O&G, ADM, FP Printed training aids Projector Transport

13. Activities 1.Regular partogram audits 2.Train managers in partogram use and assessment 3.ESMOE training and EOST and on- site mentorship 4.Set up/strengthen MMR processes OutputsOutcomes # facilities with quarterly partogram spot checks by DCSTs % partograms filled in correctly # managers/staff trained in partogram use and assessment # doctors, midwives, EMS personnel who received ESMOE training

14. What is evaluation? Evaluation is the systematic collection of information about a program that enables stakeholders to better understand the program, improve its effectiveness, and/or make decisions about future programming. Focuses on the impact of the activities Did the activities achieve the planned objectives and targets?

15. Evaluation is about outcomes Outcomes are the changes that occur or the difference that is made for individuals, groups, families, organizations, systems, or communities during or after the program. Outcomes fall along a continuum from immediate (initial; short-term) to intermediate (medium-term) to final outcomes (long-term), often synonymous with impact.

16. Activities 1.Regular partogram audits 2.Train managers in partogram use and assessment 3.ESMOE training and EOST and on- site mentorship 4.Set up/strengthen MMR processes OutputsOutcomes # facilities with quarterly partogram spot checks by DCSTs % partograms filled in correctly # managers/staff trained in partogram use and assessment # doctors, midwives, EMS personnel who received ESMOE training Relevant managers skilled in assessment of partogram and able to address weaknesses with feedback and training Midwives and doctors knowledgeable and skilled in use and interpretation of partogram Partogram used effectively to identify problems timeously and take effective, appropriate action Fresh stillbirth rate in facilities decreases ST MT LT

17. ESMOE training of midwives LEARNING: The knowledge the midwives gain from training. Midwives knowledgeable and skilled in the use and interpretation of partograms BEHAVIOUR: The actions midwives take as a result of that knowledge. Improved management of labour through correct use and interpretation of partograms CONDITION: The conditions that change as a result of those actions. Reduction in stillbirths and early neonatal deaths Short term Long term Medium term

18. Evaluation of DCST work What difference did you make? What will you evaluate? Changes in knowledge, skill, attitudes, behaviour, motivation, decisions, policies and conditions How will you know these changes have happened? How will you know these changes happened as a result of your activities?

19. WBOT – household visits to pregnant women to educate family about danger signs in pregnancy LEARNING: The knowledge families gain from the health messages. Families are equipped with appropriate health care messages on danger signs during pregnancy. BEHAVIOR: The actions families take as a result of that knowledge. An increase in families of pregnant women recognising danger signs of pregnancy and seeking timely health care. CONDITION: The conditions that change as a result of those actions. Decrease in Maternal Mortality Ratio Short term Long term Medium term

20. Setting up a Kangaroo Mother Care Unit Change that occurred: Increase in the number of prem babies and mother pairs admitted to the KMC unit Difference that was made: Impact caused by difference: Short term Long term Medium term

22. Homework Develop a monitoring and evaluation plan for one of your flagship projects/activities Carry this through – document your monitoring indicators and your outcomes (short term, medium term and long term) Write this up

23. Guidelines Choose your project/activity What do you want to monitor about the: Inputs Outputs What are the short term, medium term and long term outcomes you wish to see? How will you measure these? What will your indicators be?