1. Monitoring and Evaluation
Operational Guidelines on Community based mental health and psychosocial support in humanitarian settings: Three-tiered support for children and families
An orientation to the field test version

2. Objectives of the Module
To Understand:
The Importance of Monitoring and Evaluation
The MHPSS Log Frame
Selecting Outcomes and Indicators
Ethics in M&E
Objectives of the Module

3. The Importance of Monitoring and Evaluation (M&E)

4. A Question for You

5. In your own work, what has been the importance of M&E?
Can you think of a time when you were part of a project that lacked M&E? What happened?

6. Monitoring and Evaluation is important for...

7. 01 02 03 tracking progress towards programme goals
making necessary programme adjustments 02
demonstrating programme outcomes 03

8. The MHPSS Log Frame

9. …supports the assessment, design, implementation and M&E of MHPSS strategies implemented by UNICEF and partners around the world.
…helps staff to learn from and improve MHPSS approaches to support children and families in various crisis contexts.
…draws upon the ‘Common Monitoring and Evaluation Framework for Mental Health and Psychosocial Support in Emergency Settings’ (IASC MHPSS Reference Group, 2016)
The log frame…

10. It includes six related key impact indicators
The log frame adapts from the IASC MHPSS M&E framework the common strategic goal of ‘reduced suffering and improved mental health and psychosocial wellbeing of children and families’
It includes six related key impact indicators
And five key outcomes adapted to better target children and families
The full log frame also include specific indicators for each key outcome and their corresponding outputs, also suggesting means of verification (MoVs) and best practices for data collection and reporting.

11. For each of the 5 outcomes -> Corresponding Outcome Indicators and Means of Verification,
Corresponding Outputs, Output Indicators and Means of Verification

12. Example Outcome (Outcome 1:Emergency responses do not cause harm to children and families, and are dignified, participatory, community-owned and socially and culturally acceptable)
Example Indicators:
Percentage of affected children and families who report that emergency responses fit with local values, are appropriate and are provided respectfully.
Percentage of staff trained on and following guidance (e.g., IASC MHPSS Guidelines, CP frameworks) on how to avoid harm.
Perceptions of needs addressed (that is, needs perceived as serious problems by affected children and families themselves, such as problems with shelter, livelihood).
Example Means of Verification:
Focus group discussion (FGD) reports
Training and supervision reports Quality standards checklist
FGD and key informant interviews (KIIs) and informal interview reports
Example Output:
Community members are engaged in assessment, design and planning of child and family MHPSS and protection programmes.
Example Output Indicators:
Per cent of affected children and families who report being actively involved in different phases of emergency response (e.g., in needs assessment, programme design, implementation and M&E).
Per cent of target communities where local people (representatives of children and families, inclusive of age, gender, diversity) have been enabled to design, organize and implement emergency responses themselves.
Per cent of children and family representatives engaged in committees for emergency service delivery.
Example Means of Verification for Outputs:
Programme cycle monitoring tools (attendance sheets, meeting reports)
Child and family/caregiver questionnaires (disaggregated for age, gender and diversity)

13. Selecting MHPSS Outcomes and Impact Indicators

14. Each MHPSS programme is unique to its context and requires its own M&E framework depending on the specific activities and envisioned outcomes and goal.
This log frame can be used as inspiration for designing an M&E framework relevant to specific programme approaches.
Staff should not report against every impact, outcome and output indicator in the framework, but will choose relevant indicators, adapt them or add their own accordingly.
The IASC Common M&E Framework for MHPSS in Emergency Settings recommends MHPSS Programmes use at least 1 impact indicator from the common goal and at least 1 outcome and corresponding outcome indicator from the common framework.

15. A Question for You

16. For Outcome 2: Using Outcome 1 as an example, can you think of:
Outcome 2: Children and families are safe and protected, human rights violations are addressed
For Outcome 2: Using Outcome 1 as an example, can you think of:
2 Corresponding Outcome Indicators
2 Means of Verification?

17. Ethical Standards in Monitoring and Evaluation

18. Humanitarian evaluations should be participatory and promote the active involvement of communities.
Evaluation activities must avoid exacerbating existing mental health and psychosocial distress among affected populations or putting communities at risk.
UNICEF-supported evaluations should adhere to ethical standards for child protection evaluations

19. Questions?