Module 2 Basic Concepts

Learning Objectives At the end of this session participants will: Understand the concepts of monitoring and evaluation Be aware of (or understand) the program model Understand causality and why it is important Define and formulate different types of questions Increase awareness of issues of gender in monitoring and evaluation

M&E are used at different levels - national, sector, program, project - to assess: Programs involving a number of separate projects The effectiveness of national policies in areas such as environment, gender and indigenous peoples The implementation of major development strategies such as poverty reduction, community driven development or decentralization The implementation, effectiveness and impact of individual projects.

Monitoring “The periodic measurement of progress towards program objectives.” Helps ensure the program achieves its defined objectives within a prescribed time-frame and budget Provides regular feedback on progress of program implementation, and problems faced: Tracks resource acquisition and allocation, costs, production and delivery of services Degree and quality of stakeholder participation

Some Examples of Monitoring Infant Health Girls’ Education Policy Monitoring Decreasing Infant Mortality Rates Increasing girls education attainment Program Monitoring Information on pre-natal care targeted to pregnant women Expanding capability of school facilities Project Monitoring Awareness of good pre-natal care in 6 targeted villages Number of girls completing primary education

Example of Monitoring from Family Health Project Think about examples of policy/program/project monitoring using Family Health Project case

Evaluation “The application of systematic methods to assess the program/project/policy,” for: the appropriateness of program design and implementation methods in achieving specified objectives and broader development objectives. the program results, both intended and unintended. factors affecting the level and distribution of benefits produced. the project’s sustainability. attribution of causality: Can the observed changes be attributed to the project and not other factors?

Example: Micro-credit Changes in behavior Did participation in the micro-credit program increase the household income of the participants? What else might have affected household income? Did the micro-credit program reduce poverty in the community? What else might have affected poverty in the community?

Example: Family Health Project Did the program increase the availability of services to families? What else might have affected the availability of services to families? Did the program decrease the fertility rate? What else might have affected the fertility rate?

Gender Issues in Defining Problem Women and vulnerable groups have limited voices in many cultures Need to identify gender differences about: Roles: family, family size, reproductive choice Access and opportunities to education and employment Obtaining health care for self and family Security Empowerment

Models: Definition What is a Model? A simplified abstraction of the program or project It shows the major parts, or elements, of the program and their relationships

Use of Models in M&E Program/Project Models help us: Visualize a program in context Identify the relationships between various components Think more analytically about cause and effect Identify key assumptions that can be tested Recognize role of gender in program or project

Models Help Understand Causality Did the program cause a change? Are the changes we observe a consequence of the program? What else besides the program contributed to the observed changes? Often depicted in a schematic overview How does gender influence on program outcome and impact

Generic Program Model Impacts Outcomes Outputs Activities Inputs

Program Model Input: Resources Activity: What the program does People, dollars, medicine, facilities, etc. Activity: What the program does Provides health education Provides health services Output: Products or Services A calculation of effort or activity How many men and women have participated? How many men and women have received birth control services? No agreement on these terms. Some people call these different things: impact, results, outcomes, effects. We will use these terms interchangeably. Sometimes it is hard to decide what is in output and what is an immediate outcome. Don’t worry too much about categorizing. You should be able to tell an input from an output or outcome.

Program Model (Continued) Outcome: Benefits to participants Results, changes More immediate More people use birth control consistently Impact: Long Term Benefits Achievement of the project’s goals As more men and women use birth control consistently, the fertility rate will decrease No agreement on these terms. Some people call these different things: impact, results, outcomes, effects. We will use these terms interchangeably. Sometimes it is hard to decide what is in output and what is an immediate outcome. Don’t worry too much about categorizing. You should be able to tell an input from an output or outcome.

Gender in Program Models Are there differences in inputs and activities based on gender? Are there different outputs based on gender? Does the program cause different outcomes based on gender? Are there differences in impact on gender groups (causality)?

Case Discussion Micro-Credit Program Model What are major program inputs? Gender? What are the program’s components? Gender? What are some program outputs? Gender? What are some program outcomes? Gender? What are some long-range impacts of the program? Gender?

Micro Credit Model Poverty Reduction Impacts Outcomes Outputs Businesses created Income & Expenditures * by sex Outcomes Outputs Loans approved * by sex Activities Contacting people Make loans Inputs Money, Staff

Case Discussion: Family Health Project What are major program inputs? Gender? What are the program’s components? Gender? What are some program outputs? Gender? What are some program outcomes? Gender? What are some long-range impacts of the program? Gender?

Family Health Model Reduced fertility rate Impacts Outcomes Outputs Number of participants who use birth control consistently Outputs Number of participants in education and health services Activities Community Education Health services Inputs Money, Staff

Determine M & E Questions Models help determine what it is you want to know. Consider: Who wants to know? Why do they want to know? How will the results be used? What’s most important? What are the relevant gender issue?

Determine M & E Questions (Continued) Models help determine what it is you want to know. Develop monitoring and/or evaluation questions Consider gender in question development

Types of Questions 1. Descriptive Questions: “ What Is” 2. Normative Questions: “What should be” 3. Impact or Cause/Effect Questions: “What difference does it make?” Do program participants have new skills? Do they have better paying jobs? Is the poverty rate reduced? Does this imply causality?

Introduce Gender in Question Development Critical Point If gender sensitive questions are not introduced here, you lose the opportunity to consider gender in later stages of the evaluation or in monitoring the program.

Case Discussion Questions for Economic Micro-Credit Study Who and how many use the micro-credit project? What percent are men and women? What was their income before and after their participation in the program? Is there a difference in income changes between men and women?

Case Discussion (Continued) What is the income of the villages before and after the project? Are there other changes caused by the project? Health, education, use of contraception?

Case Discussion Questions for Social Micro-Credit Study Who and how many use the micro-credit project? What percent are men and women? How do they use the money? Are there differences based on marital status? What percent of the women control borrowing and productive activities? Are there differences based on type of business?

Case Discussion: Family Health Project How many attend health education classes? Receive birth control services? What percent are men and women? What percent used birth control before the project and what percent used birth control afterward? Is there a difference in use based on gender? What factors contribute to gender differences in use of contraceptives?

Group Exercise: Review Family Health Project Consider how gender influences the formulation and implementation of the the Family Health Project. How important is gender in terms of using health services? How do you find out what supports are needed to encourage local women to participate in medical assistants training? How do you find out what is needed for women to work as medical assistants in their communities?

Group Exercise: Review Family Health Project Consider some likely questions that you might ask if you wanted to Monitor Family Health Project? Evaluate this Family Health Project? What additional questions might you ask to make sure your questions are gender-sensitive? What other actions would you take?