Monitoring and Evaluation for ACSM Charlotte Colvin, PhD TB/HIV Technical Officer PATH 23 February 2010

M&E for ACSM What is the “status” of M&E for ACSM? –Opportunities! What are some of the key challenges and how can we address them? What are the next steps?

Principles of M&E for ACSM Is ACSM linked to overall NTP goal and objectives? ACSM to increase KAP about TB? More political commitment for DOTS implementation Increased knowledge about the symptoms of TB Increased awareness about availability of free diagnosis and treatment Improved health seeking behavior ACSM to increase case detection and treatment success? Increase in symptomatic individuals seeking care Increase in number of smear positive cases detected Improved case detection rate? Increase in number of people with TB who complete full course of treatment Improved treatment successrate?

Challenges of M&E for ACSM Lack of capacity and dedicated staff Need for standardized, practical indicators to measure inputs, activities/tasks, outputs, outcomes, and impact –?? Impact is particularly challenging: –Implies that we can measure the contribution of an activity to improved NTP performance –Multiple activities implemented to reach NTP case detection and treatment goals –ACSM impact limited to specific events on the diagnostic and treatment pathway (Cough to Cure) –When done correctly, impact can be VERY expensive and requires SIGNIFCANT human resources.

How can we overcome these challenges? Invest in basic M&E training for staff –Donor resources, on-line training, training events Creative partnerships –Think outside the box! Global work to improve indicator definitions (??) Clearly link NTP goals, objectives, gaps, ACSM activities, expected outputs, etc. with comprehensive frameworks

M&E Guide for ACSM (1) Rationale: –Need for comprehensive document to support M&E needs of ACSM stakeholders Process: –Formation of M&E advisory group for ACSM –Three drafts/reviews until now –Fourth draft will include broader review –Goal of completing final draft by December 15

M&E Guide for ACSM (2) Organization: –ACSM and M&E: the “basics” of both –M&E Frameworks for ACSM: Links to ACSM planning cycle –Indicators –M&E Plans –Challenges –Practical applications –Common M&E Strategies for ACSM: Mix of methods –Appendices

M&E Guide for ACSM (3) Challenges: –Indicator section –Technical detail: too much or too little? Appendices? –Realistic ACSM planning scenarios Framework vs. reality –Responsiveness to needs of partners Ex, How useful for supporting Global Fund applications?

M&E Guide for ACSM (4) Feedback/Input Needed: –How much technical detail is needed? Are there too many examples? –Indicator quandary –ACSM/M&E planning case study –Field testing, tools, future training, roll out strategy

Comments/Questions/Discussion