Making a difference: evaluating and assessing impact Jean Barclay Based on: Making a difference: funding financial inclusion An external evaluation of the Friends Provident Foundation’s Financial Inclusion Funding Programme 2005 to 2012, by Margaret Bolton and Jean Barclay Knowledge base increased
Focus on The evaluation methods used 5 key lessons for the Foundation Challenges in evaluating foundations What can help? …………………………………… Useful references: Trying Hard is not Good Enough: How to produce measurable improvements for customers and communities, M Friedman, Trafford Publishing, Canada (2005)
What methods were used? Grouping projects by purpose Results accountability approach: how much was done, how well was it done, did it make any difference? Qualitative interviews with experts/sample of funded projects, plus project data/evaluations Building on knowledge of staff/trustees Evaluation framework derived from “outcome mapping” techniques
Mapping whose outcomes? Knowledge System Organisations Individuals
What are 5 key lessons for FPF? Articulating knowledge base / building learning around a “theory of change” Deciding what to fund and who to target: financial inclusion or financial capability? Sustainability of services funded Commissioning vs open funding programmes Focus for strategic impact: balance of funding across research, infrastructure and service delivery…supported by FPF communications/dissemination/championing
Evaluating foundations: how to TACKLE the challenges? T heory of change A ttribution C hampioning K nowledge base L earning E xternal environment