1. Gender-Sensitive Monitoring and Evaluation
Module D 1

2. Review of the BIG IDEAS from previous sections.
Presenter briefly reviews list of “Big Ideas” from Modules A, B, and C.
Review of the BIG IDEAS from previous sections.

3. Learning Objectives
Identify critical considerations of a gender-sensitive monitoring and evaluation framework.
Understand what qualitative and quantitative gender-sensitive indicators are.
Identify the necessary components of a gender-sensitive evaluation.

4. What is Monitoring & Evaluation?
Monitoring measures how a program is going.
Evaluation is an exercise that attempts to systematically and objectively assess progress towards and the achievement of an outcome.
Findings from program evaluation are used to:
Improve programming if evaluation is conducted mid- project.
Draw lessons if evaluation is conducted at the end of the project.
Source: UNDP Handbook

5. Monitoring and Evaluation (M&E) In Practice
M&E is a way to ensure that:
Programs are implemented efficiently.
Programs are managed properly.
The effectiveness of programs is measured.
Programs provide learning opportunities for future work. 5

6. Defining Key Terms in “M&E”
Evaluation
Analysis of how the program helped contribute to the impact.
Monitoring
Periodic reporting on indicators that measure how the outputs have influenced the outcomes.
Focus on process.
Outputs
Products of project activities.
Outcomes
Changes in individual behaviors, improvements in access to resources
or quality of institutional systems.
Impact
Sustainable improvements in human conditions or well-being
We have direct control over project outputs.
Outcomes are the result of what beneficiaries do with the outputs.
Our project contributes to impact, but cannot achieve it completely 6

7. Why does GENDER Matter in Monitoring & Evaluation?
Gender-sensitive M&E :
Captures different impacts of the project on men and women
Identifies aspects of the program that need to change to better respond to the needs and priorities of men and women.
Provides accountability to both male and female participants
Provides accountability to Communities and Donors
Provides accountability to TAF internally.
Gender-sensitive M&E Improves Program’s Implementation, Outcome, and Impact.
Gender-sensitive M&E improves program’s implementation through providing: results-based management and cost-effectiveness. It provides suggestions of areas where ineffective activities can be cut and adjustments made to program strategy during implementation. 7

8. Monitoring: Baseline Data Collection
Baseline data is information on a program collected prior to implementation.
It enables comparison of data pre- and post- project.

9. Examples of gender-sensitive evaluation results using baseline data
At least 50% of women participating in water committees report active involvement in management and decision-making by the end of Year 2.
Baseline of 10% at the start of the project.
At least 70% of women respond positively to evaluation of police handling of their case in targeted police stations by the end of Year 3
Baseline of 5% average at the start of the project.
These results are clearly more meaningful with the baseline data!

10. Monitoring: Indicators
An indicator is a criteria that provides a simple and reliable means to measure achievement, change, or assessment in gender equality programming.
Types of Indicators
Quantitative
Percentage
Numbers
Qualitative
Descriptive
E.g. gender equality framework points

11. How do we know we’re making progress?: Indicators!
Outputs
Outcomes
Impact
Looks at progress on a set of proposed activities for the project.
Example: Training workshops held; Stakeholder meetings convened; research conducted.
Looks at project progress on a set of intermediary or short-term outcomes.
Example: New standard operating procedures in place; more cases filed with police; less tolerance for violence; more people accessing services.
Looks at overall attribution of the stated goal.
Example: Reduced incidence of trafficking; fewer outbreaks of intra-community violence in target areas. 11

12. Gender Sensitive Indicators
Gender-Sensitive Indicators allow measurement of benefit to women and to men distinctly.
Gender-Sensitive Indicators allow measurement of benefit to women and to men distinctly. (Skip this if there is not enough time. The following slide will show examples of indicators) Depending on the policy/project, this might include:
The impact/effectiveness of activities designed to promote access for women and men to new resources, opportunities, services and/or influence;
The impact/effectiveness of targeted activities designed to address needs or rights specific to women or men;
The impact/effectiveness of activities designed to develop gender-awareness and skills amongst policy making, management and implementation staff;
The impact/effectiveness of activities to promote greater gender equality within the staffing and organizational culture of development organizations. The impact of affirmative action policies.

13. Examples of gender-sensitive indicators
Number and percentage of entrepreneurs who move into a higher part of the value chain, disaggregated by sex.
Number of hours spent on collecting fuel or water before and after project initiated, disaggregated by sex.
Changes in knowledge, attitudes, and behaviors related to living wage campaigns.
Ask the group which examples of these indicators are quantitative or qualitative and which demonstrate SMART (specific, measurable, attainable, relevant, time-bound)
1. Quantitative – Specific, Measurable, Attainable, Relevant
2. Qualitative –Attainable, Relevant, Time-bound
3. Quantitative – Specific, Measurable, Attainable, Relevant
4. Quantitative – Specific, Measurable, Attainable, Relevant, Time-bound
5. Qualitative –Measurable, Attainable, Relevant

14. Overview: Critical Components to Include in gender-sensitive M&E
Design/Monitoring
Logical Framework
Gender-sensitive indicators
Baseline data
Evaluation
Methodology: Conduct quantitative and qualitative data collection mid-project, end-of project, and as needed throughout. Ensure collection of sex-disaggregated data.
Terms of Reference
The program design and monitoring phase should include a logical framework with gender-sensitive outputs, outcomes, and impacts.
This phase should include: 1. Gender-sensitive indicators including qualitative and quantitative indicators. These should be routinely collected in Project Monitoring Reports (PMR). 2. Baseline data collection which incorporates behavior and attitudes through methods such as sex-disaggregated surveys, women-only focus group discussions and interviews.
A program’s evaluation phase should be conducted at a project’s mid-term, end, and as needed at specific points to identify program strategy changes needed). Qualitative and quantitative data should be collected. Collection methods can include women-only groups/individuals. Data collection instruments should be developed that specifically target women’s different experience and contributions to project outcomes.
Terms of Reference (TORs) provide an overview of the evaluation, articulating requirements and expectations. Ensure TORs integrate gendered questions and ensure evaluator is capable of carrying out gender-sensitive evaluation. Review draft evaluation report carefully to ensure that gender related omissions and successes are reflected. 14

15. Logical Frameworks
A Logical Framework (“LogFrame”) is a tool used in the design, monitoring, and evaluation of development projects.
It includes a systematic analysis of the development situation including key problems and options to address the problems.

16. Gender and Logical Frameworks
Objective/Purpose
■ Is it clear who the program is targeting?
■ Will women and men get a fair share of benefits and/or is the program designed to empower women?
Activities
Promoting a fair share of benefits for women and men will require targeted
action to address existing constraints to equality eg. capacity building for staff, training for women,
targeted services and
opportunities.
Outputs
■ Benefits for women and
men should be considered as an aspect
of each output.
■ It may be useful to
have one output specifically concerned with targeted activities
for women.
Activities to promote
greater equality or promote women’s rights need to be backed up with
budgets, and staffing.
Outcomes
■ Is it clear who the program is targeting?
■ Will women and men get a fair share of benefits and/or is the program designed to empower women?
Risks and Assumptions
Is there likely to be opposition to greater gender equality from key stakeholders?
Will this undermine the achievement of the purpose? If so, include activities to build understanding and buy-in, and/or adjust targets?
Important to note that logical frameworks can change throughout the life of the project to better reflect actual project implementation and learning. Should be adjusted based on data collected.
Oversimplification potential in the assumptions 16

17. Exercise: Conflict Case Study
Note to instructor: First go through this log frame with the group as an example of a log frame. Afterwards, use it as a tool to assess where gender considerations could be better incorporated.

18. Exercise: Conflict Case Study
Review the provided log frame (including outcome, outputs, indicators). This logframe represents the kinds of activities that might have been proposed if project designers had not undertaken a gender analysis. Please critique the activities and outcomes using the tools we have just discussed.
Refer to handouts: Gender-Blind PMP with critique” and “Gender-blind PMP”

19. Exercise: Conflict Case Study
Referring to the logframe, identify 2-3 gender-sensitive indicators (qualitative and quantitative) that would be relevant for measuring the outcome of this project. How would that data inform the project or its evaluation?

20. What are the BIG IDEAS from this section?
Presenter asks participants to state the main ideas from this Module. Presenter writes down these ideas as a list. The main ideas from this section may include:
(note: presenter can choose whether to share any of the ideas from this list time permitting)
Monitoring measures how a program is going.
Evaluation measures if the program needs to change to accomplish its intended goals.
Evaluation may be conducted mid-term or at the end of a program.
Gender-sensitive M&E captures different impacts of the project on men and women.
Baseline data collection allows comparison of a program prior to and after implementation.
An indicator provides a way to measure change or assess a program.
Gender-sensitive indicators allow measurement of benefit to men and women distinctly.
A Logical Framework (LogFrame) is a tool used in the design, monitoring, and evaluation of development projects.
What are the BIG IDEAS from this section?