M&E Basics Miguel Aragon Lopez, MD, MPH M&E Basics Miguel Aragon Lopez, MD, MPH. UNAIDS M&E Senior Adviser 12th May 2009

A common understanding of M&E terminology is critical for: Why Standardized M&E Terminology? A common understanding of M&E terminology is critical for: maintaining clear communication taking a common approach UNCT 26th February 2009

M&E Definitions: Why Standardized M&E Terminology? Monitoring—routine tracking and reporting of priority information about a plan / program / project, its inputs and intended outputs, outcomes and impacts Measurement of progress toward achieving program/project objectives; most often involves counting what we are doing. UNCT 26th February 2009

M&E Definitions: Why Standardized M&E Terminology? Evaluation—the rigorous, scientifically-based collection of information about plan / program / intervention activities, characteristics, and outcomes that determine the merit or worth of the program/intervention

The Purpose of M&E Program Improvement Data Sharing with Partners Reporting/ Accountability

M&E Definitions: Results – RBM approach UNDAF and agency programmes in terms of a hierarchy of SMART results which has five levels: MDG related national priority/ goal (equated with impact) UNDAF outcome, know in Moz also as pillars Outcome of one or more agencies working together Output usually of one agency, but possibly of more than one working together Activity Result

M&E Definitions: Results – RBM approach SMART Results S pecific: Results must use change language – they must describe a specific future condition M easurable: Results, whether quantitative or qualitative, must have measurable indicators, making it possible to assess whether they were achieved or not A chievable: Results must be within the capacity of the UNCT and partners to achieve R elevant: Results must make a contribution to selected priorities of the national development framework T imebound: Results are never open-ended - there is an expected date of accomplishment

The chain of results: causal sequence for an intervention to achieve desired objective OUTPUTS ACTIVITIES OUTCOMES IMPACT INPUTS Quality of life Conditions: . Human . Economic . Civic . Environment MDGs: . Poverty . Morbidity . Mortality . HIV prevalence . Education . Employment . Gender equality . Services - Access - Quality . Awareness . Knowledge . Attitude . Capacities . Competency . Opinion . Aspiration . Motivation . Behaviors . Practices . Decision . Utilization of services .Infrastructure . Human . Finance . Equipment . Technology . Policy . Time . Volunteers . Partners . Management . Training . Counseling . Logistic management . Operation research . BCC . Conference . Facilitation . etc. UNCT 26th February 2009 Measure process Measure impact

-Formative Evaluation -Input/Output Monitoring What & how well we are doing? Planning Implementation Outcomes -Formative Evaluation (Planning and Assessment) -Input/Output Monitoring -Process Evaluation -Outcome Monitoring -Outcome Evaluation -Impact Monitoring -Impact Evaluation

Baselines, targets and performance Commitment Performance Current level of achievement Baseline Target Achievement

WFP Emergency Operation M&E Framework Population-based Survey RESULTS Input (Resources) Activities ( Interventions, Services) Output Targeted women receiving full family ration Outcomes Increased household food supply Impact Increased consumption especially W, Ch & V Ind. X kg maize, X kg oil X Kg other Distribution of Family ration to Women # of family ration recipients disaggregated by gender % of target house Hold with adequate Food supply Average # of Meals per day by gender and age Program-based Data Population-based Survey Measure process Measure impact

HIV/AIDS M&E Framework Assessment & Planning Input (Resources) Activities ( Interventions, Services) Output (Immediate Effects) Outcomes (Intermediate Effects) Impact (Long-term Effects) Situation Analysis Response Analysis Stakeholder Needs Resource Analysis Collaboration plans Staff Funds Materials Facilities Supplies Trainings Services Education Treatments Interventions # Staff Trained # Condoms Provided # Clients Served # Tests Conducted Provider Behavior Risk Behavior Service Use Clinical Outcomes Quality of Life Social Norms HIV prevalence STI Incidence AIDS Morbidity AIDS Mortality Economic Impact Program Development Data Program-based Data Population-based Biological, Behavioral & Social Data Measure process Measure impact

one aspect of a program/project and useful to measure changes M&E Definitions: Indicators An Indicator is…. a variable that measures one aspect of a program/project and useful to measure changes Indicators are measures used to monitor progress made towards the achievement of intended RESULTS, considering as the output, outcome or impact of a development intervention.

M&E Definitions: SMART Indicators Specific: indicators need to measure what they claim to measure Measurable: can be quantified and measured by some scale Achievable: can data on the indicator actually be colleted? Relevant: does it provide information that is relevant to the programme decision makers? Time-bound: when is change expected?

Strategic Planning for M&E: Setting Realistic Expectations All Most Some Few* Number of Projects Input/ Output Monitoring Process Evaluation Outcome Monitoring / Evaluation Impact Monitoring / Evaluation Levels of Monitoring & Evaluation Effort 15

Key messages: The main purpose of M&E is programme/project improvement. M&E is not only about INDICATORS. M&E is an essential management tool and it is present along programme/project implementation. M&E starts with the planning process.

THANK YOU