Introduction to Monitoring and Evaluation of National Tuberculosis Programs Lisa V. Adams, MD E&E Regional Workshop Kiev, Ukraine May 23-26, 2006

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Overview  What is monitoring and evaluation (M&E)?  How can you use M&E for program management?  Practical applications of monitoring and evaluation

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting What is M&E?  Data collection?  Reporting?  Analysis?  Supervision?  Policy support  Program design & implementation  Systematic  “Working smarter, not harder”

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Definitions Monitoring is the routine reporting of data on program implementation and performance Evaluation is the periodic assessment of program impact at the population level and value

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Monitoring  Has the program been implemented according to the plan?  Are there any changes in program resources or service utilization?  Are there any weaknesses in the implementation of the program?  Where are the opportunities to improve program performance?

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Evaluation  Are there any changes in behavior or health outcomes in the target population?  To what extent are observed changes in the target population related to program efforts?

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting “Improve the quality and quantity of staff involved in TB control” Decrease average number of days from identification of TB suspect and initiation of DOT Training of health workers to identify and refer TB suspects for sputum testing in a timely fashion GFATM implements supply chain activity to keep labs stocked and avoid delays in testing sputum ?

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Monitoring vs. Evaluation Level of measurement: Monitoring Data come from routinely reported data Example: Monthly service statistics Evaluation Data are measured at the population level Example: Prevalence of MDR-TB in Country X

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting estimated TB cases all true TB cases cases presenting to health facilities cases presenting to public health facilities cases presenting to DOTS facilities cases correctly diagnosed by DOTS facilities diagnosed cases reported by DOTS facilities Chris Dye, 2002 The “ONION” Chris Dye, WHO, 2002

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Why is M&E important for National TB Programs?  To follow epidemiological trends in TB  To identify strengths and weaknesses in program design and/or implementation  To address changing priorities  To convince policy makers of the need for action and financial and human resources

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Uses of M&E for program management (1)  Informs decisions about program operations and service delivery  Ensures effective and efficient use of resources  Determine whether or not the program is implemented according to plan

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Uses of M&E for program management (2)  Meets reporting requirements by different agencies and sectors of government  Evaluates the extent to which the program/project is having or has had the desired impact

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Practical applications (1)

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Practical applications (2) Case notification and death rates are falling, but not fast enough Case notification

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Practical applications (3)

Tuberculosis Technical Focus Area Activties and Update All-Staff Meeting Comments/questions?