The signification process applied during an Outcome Harvesting Evaluation of a Global Network dedicated to improving the life of vulnerable children Goele Scheers EES-2016 Conference Maastricht Using the signification process of SenseMaker to enrich Outcome Mapping and Outcome Harvesting 30 Sept 2016 14:15h-15:45h Room 2.7 Add picture children?
Family for Every Child is a global alliance of national civil society organisations working together to mobilise knowledge, skills and resources to build a world where every child grows up in a permanent, safe and caring family, and to provide quality alternative care where needed
Outcome Harvesting for Family for Every Child OH Evaluation: outcomes 2012-2016 Integrate OH into the M&E system of the network
6 OH steps applied to Family for Every Child 1. Design the Harvest 2. Review documentation and draft outcomes 3. Engage network members, board and staff 6. Support use of findings and make strategic decisions 5. Substantiation 4. Analyse and interpret
Harvesting the outcomes Outcomes were gathered during focus groups with secretariat staff, board and members 95 outcomes
Harvesting the outcomes
Example of an external outcome from Family Outcome description: In June 2015, The Ministry of Women and Child Development of India invited Butterflies (Family’s Indian member) to lead the Foster Care Committee in developing guidelines, training modules and monitoring tools on foster care and included their contribution in the Foster Care guidelines that were launched in October 2015. Significance: This was a key moment in the development of state policy and guidance in India, when not only international NGOs and experts, but also national NGOs, including Butterflies were asked to contribute. Previously, there had been piecemeal and patchy development of foster care in India, led by internationally supported NGOs, but not strongly or consistently coordinated by the government. Contribution: The exposure of Butterflies to foster care through its membership of Family enabled it to respond to a request it received from its government, and thereby make a significant contribution to the government’s development of policy and guidance for foster care providers. Butterflies was able to respond within tight deadlines because of the help of network members finding and sharing with them the policy and practice examples from various countries. Network contribution can be secretariat as well as members, board, etc
Harvesting the outcomes
Tagging of outcomes: Nature of the outcome
Tagging of outcomes: Significance
Tagging of outcomes: Contribution
Tagging of outcomes: Effects of the outcomes
Analysis: triad
Analysis/Triads filtered
Analysis: contribution dyad
Analysis: Dyad filtered CONTRIBUTION OF THE NETWORK Internal outcomes 68% External outcomes 10 outcomes 14 outcomes Change has happened without influence of the network Change only happened because of the interventions of the network
Analysis: dyads filtered
Analysis: useless triad Better Outcomes Children 55% STRATEGIC OBJECTIVES Example where the triad was not useful 37% 8% Governance Membership Income
Tagging of outcomes: Significance
Tagging of outcomes: Contribution
Tagging of outcomes: Effects of the outcomes
Analysis: triad
Analysis/Triads filtered
Analysis: contribution dyad
Analysis: Dyad filtered CONTRIBUTION OF THE NETWORK Internal outcomes 68% External outcomes 10 outcomes 14 outcomes Change has happened without influence of the network Change only happened because of the interventions of the network
Analysis: dyads filtered
Analysis: useless triad Better Outcomes Children 55% STRATEGIC OBJECTIVES Example where the triad was not useful 37% 8% Governance Membership Income
Reflections on Sensemaker for OH - Strenghts COLLECTIVE SIGNIFICATION Stimulates discussion and joint reflection during harvesting Common understanding about program, outcomes and the role of the implementer Triads are easy to understand, useful, possibility to make nuances ANALYSIS More depth, new layers of meaning/connections Easy visualization of patterns Change agents can relate to the analysis
Reflections on Sensemaker for OH - Strenghts SUPPORTING USE OF FINDINGS Feedback of the results of the OH evaluation Further collective sensemaking on the outcomes Generate actionable insights
Reflections on Sensemaker for OH - Challenges Three corners need to be well-defined Triads have to be connected to the use and the evaluation questions Need to have a substantial amount of outcomes
Thank you! Goele Scheers Independent consultant goelescheers@gmail.com www.goelescheers.be