1. Measuring Success Toolkit
Webinar Presentation
19 September 2012

3. TAB 1: Home Page
Measuring Success Toolkit provides guidance on how to plan, monitor, and evaluate health programs, through compilation of resources:
Review of related terms and concepts
Additional reading materials
Practical examples in the form of tools and guides
Links to relevant web sites and e-learning courses
As explained in text, there are 4 ways that information has been arranged for accessing:
8 tabs across the top offering quick access to broad topics: what M&E can answer followed by specific resources categories
7 health program areas under “Resources by Health Topics” (General Health, HIV/AIDS+TB, Malaria, MCH, NTD, RH/FP, Water+Sanitation) (on right side)
Search function (upper right corner)
Site map, an outline listing of the website’s contents (below search function on upper right)

4. TAB 1: Home Page (bottom of this web page)
In addition: just below on this Home Page are the 3 broad functional areas in health programming – planning, monitoring, evaluating.
They are used to orient users to access resources.
In this approach, under each of the 3 functional areas is a set of work considerations, each of which is linked to resources elsewhere within the toolkit
For example, when planning a program — consider:
what is the problem and why does it exist?
framework for guiding program design
sample M&E plan
selection of program indicators
plans for sharing and use of program data

5. TAB 1: Home Page (back at the top of this web page)
Few other features:
Above “Quick Links” is “Google Translate” function – allows for instant translation into any one of 50 languages
Above “Quick Links” is a widgit for bookmarking and sharing through social media
Under “Quick Links” is glossary of related planning, M&E terms (right side)
Under “Quick Links” is also found a 5-minute video tutorial
Under “Quick Links” is link for communicating by comments and suggestions

6. TAB 2: What M&E can Answer
Short definition of monitoring and evaluation, along with characteristic aspects of each

7. TAB 2: What M&E can Answer (bottom of this web page)
Graphically represented as the climbing of six steps (Deborah Rugg staircase)
2 steps for each of these 3 functional areas, color-coded (planning = red; monitoring = green, evaluation = yellow)
Steps’ color scheme tied to color scheme of “tool-using” figure
Each step defined by a question
At bottom half of screen, link for each question brings you to new web page that helps to answer that question with text explanation and links to other sections of the toolkit

8. TAB 2: What M&E can Answer
What is the problem and why does it exist?
Previous and next buttons at bottom allow you to page through the six “step” questions

9. TAB 2: What M&E can Answer (bottom of this web page)
Last link -- “Resources and Tools” – offers practical M&E guides and resources that are categorized under:
Needs assessment
Situation analysis/operations research
M&E plans/performance monitoring plans
Conducting evaluations
Sustainability/scalability

10. TAB 2: What M&E can Answer (page link to “Needs Assessment”)
“Resources and Tools” – M&E guides and resources for:
Needs assessment (partial example)

11. TAB 3: Frameworks
“In this section” box with links to relevant section on this webpage
Short definition of frameworks (“models”)
Characteristic aspects of the 4 types of frameworks, along with graphic display of components
Conceptual
Results
Logical
Logic model

12. TAB 3: Frameworks (bottom of this web page)
At bottom of page, links to guides and examples of each framework type

13. TAB 4: Indicators
“In this section” box with links to relevant section on this webpage
Short definition, with differentiation of monitoring indicators versus evaluation indicators
Characteristic aspects of the SMART indicators

14. TAB 4: Indicators (bottom of this web page)
Link to sample indicator reference sheet (at end of text, just before “General Health” links)
Links to guides for indicators by 7 Health Topics

15. TAB 5: Data Sources
“In this section” box with links to relevant section on this webpage
Differentiation made between quantitative and qualitative data
Common data collection methods: surveys, interviews, focus groups

16. TAB 5: Data Sources (bottom of this web page)
Links to web pages offering further explanations on data source issues:
Common Data Sources, including service environment (RHIS; health facility surveys) data and population-level data (DHS, LQAS, census, epidemiologic surveillance, GIS, biomarker)
Data Triangulation, use of different types of data to inform and add credibility M&E findings
Ensuring Data Quality, through data auditing and data quality assurance approaches
Ethical Guidelines when collecting personally sensitive information
Last link -- “Resources and Tools” – offers practical M&E guides and resources that are categorized as shown in next slide

17. TAB 5: Data Sources (page link to “Resources and Tools”)
“Resources and Tools” – Categories
* Service environment data sources
* Population-based data sources Common data sources
* Lot quality assurance sampling
* Qualitative data sources
* Data triangulation Data triangulation
* Data quality Ensuring data quality
* Ethical considerations Ethical guidelines

18. TAB 6: Study Designs for Evaluation
“In this section” box with links to relevant section on this webpage
Explanation for need of evaluation
Definition of summative evaluation (outcome, impact of intervention) and requirements to demonstrate causality
Reference to three experimental designs of evaluation

19. TAB 6: Study Designs for Evaluation (bottom of this web page)
Links to web pages offering further explanations on evaluation administration issues:
Types of evaluation designs
Randomized experimental
Quasi-experimental
Non-experimental
Sampling methods (random and non-random)
“Resources and Tools” – offers practical guides and resources that are categorized under:
Study designs
Sampling methods

20. TAB 6: Study Designs for Evaluation (page link to “Resources and Tools”)
Last link -- “Resources and Tools” – offers practical guides and resources that are categorized under:
Study designs
Sampling methods

21. TAB 7: Sharing and Using Data
Brief discussion on value of data sharing
Comparison and contrast with knowledge management
Links to MEASURE Evaluation’s web home page DDU and K4Health’s web home page on KM
Links offering practical guides and resources that are categorized under:
Data demand and use …

22. TAB 7: Sharing and Using Data (continued)
Links offering practical guides and resources that are categorized under:
Knowledge management

23. TAB 8: Learn More
Links:
M&E guides (by health topic)
E-Learning courses (on M&E)
Other websites/tools (by health topic)

24. TAB 8: Learn More (page link to “eLearning Courses”)

25. Thank You!

26. MEASURE Evaluation is funded by the U.S. Agency for
International Development (USAID) and implemented by the
Carolina Population Center at the University of North Carolina
at Chapel Hill in partnership with Futures Group International,
ICF International, John Snow, Inc., Management Sciences for
Health, and Tulane University. Views expressed in this
presentation do not necessarily reflect the views of USAID or the
U.S. government.
MEASURE Evaluation is the USAID Global Health Bureau's
primary vehicle for supporting improvements in monitoring and
evaluation in population, health and nutrition worldwide.