Institutionalizing Impact Evaluation in Human Development The Spanish Impact Evaluation Fund (SIEF) Sebastian Martinez Human Development Network World Bank

Impact Evaluation Portfolio in Human Development 67% of IEs at the WB are in HD Total of 125 IEs in HD  98 IEs are considered ‘ongoing’ – have an evaluation designed or data collected  By Sector: Education (42%) Health (28%) Social Protection (25%) Cross-cutting (5%)

Regional Distribution of HD IEs

Spanish Impact Evaluation Fund (SIEF) Gov. of Spain and World Bank:  Shard interest in Results Agenda TF Managed by HD Network:  Build global knowledge about what works  Build capacity to conduct and consume IE  Disseminate knowledge and improve effectiveness of social policy 11M Euros between  Largest TF for IE at WB  But many others supporting and promoting IE

SIEF Priorities: Gov. of Spain sets priority areas & countries  Evaluation of interventions that improve HD Outcomes 11 broad areas 66 countries Policy relevance is key criteria  Test innovative approaches/new questions  Large programs Favor prospective evaluations with robust methodolgies  Experimental & Quasi-experimental Control Groups

SIEF: Building Global Knowledge About What Works Three windows of IE funding:  Quick wins: $1.5 million IEs giving results in 1-2 years  Cluster Fund: $6.0 million Funding programs of evaluation  Innovation Fund: $1.5 million Funding stand-alone, highly innovative evaluations

SIEF: Cluster Fund ($6m) First call for Proposals:  Large demand for IE funding  $42 million in requests  34 Proposed clusters (16 of > 3 proposals)  163 Individual proposals Short listed 7 clusters with $10M of requested funding

SIEF Funded Clusters Youth to Work Transition/Active Labor Markets Conditional Cash Transfers (second generation) Basic Education Accountability Health Contracting / Performance HIV/AIDS Malaria Control

Cluster Approach Improve coordination and quality of evaluation activities:  Generate “body of knowledge” Meta-analyses  Communities of Practice: Common measurement tools Cross-fertilization between evaluation teams  Quality: External peer review to access funds Cluster leaders provide TA

SIEF: Capacity Development in IE 5 field-based regional evaluation workshops per year in partnership with region  participants: government, development partners, NGOs, academic  IE experts & moderators  Organized around project teams Technical/policy tracks Lectures followed by hands on application to projects Teams develop their own IE concept note Presentations and feedback from colleagues

Dissemination Activities  Publication costs  Spanish translation costs  SIEF website and public use databases  Global/regional conferences