David Evans World Bank Joint work with Brian Holtemeyer and Katrina Kosec (IFPRI) July 9, 2015.

Slides:



Advertisements
Similar presentations
AFRICA IMPACT EVALUATION INITIATIVE, AFTRL Africa Program for Education Impact Evaluation Muna Meky Impact Evaluation Cluster, AFTRL Slides by Paul J.
Advertisements

Evaluation of demand-side incentives to improve education and health outcomes: Evidence from past and ongoing randomized interventions in Burkina Faso.
Knowing if the RBF mechanism is working Incorporating Rigorous Impact Evaluation into your HRBF program Sebastian Martinez World Bank.
Conditional Cash Transfer penalties Vs. no penalties.
Impact Evaluation Click to edit Master title style Click to edit Master subtitle style Impact Evaluation World Bank InstituteHuman Development Network.
Chapter 11 What Works and What Doesn’t. Are Hospitals Good for You? From Angrist and Pischke, Mostly Harmless Econometrics.
Information Campaigns to Strengthen Participation & Improve Public Schools: Experimental Evidence from Two Studies in Uttar Pradesh and Madhya Pradesh.
BUSINESS AND FINANCIAL LITERACY FOR YOUNG ENTREPRENEURS: EVIDENCE FROM BOSNIA-HERZEGOVINA Miriam Bruhn and Bilal Zia (World Bank, DECFP)
Conclusions and Implications
Assessing the benefits of unified transfers to multiple categories of individuals through targeting the household: Zimbabwe’s Harmonized Social Cash Transfers.
GENEVA JULY, 2015 The limits of cash transfer in addressing child labour.
Improving Accessibility and Utilization of Dental Services for Vulnerable Populations Child Health Policy Research Symposium University of Southern California.
Impact Evaluation of a Community Development Program in the Central African Republic Radu Ban, World Bank Matthias Rieger, Graduate Institute Geneva.
Paying Health Care Providers for Performance: Evidence from Rwanda Paul Gertler UC Berkeley January 2009.
THE EFFECT OF INCOME SHOCKS ON CHILD LABOR AND CCTs AS AN INSURANCE MECHANISM FOR SCHOOLING Monica Ospina Universidad EAFIT, Medellin Colombia.
Ariel Fiszbein Chief Economist Human Development World Bank.
Evaluating the Impact of Health Insurance for the Poor: Evidence from Indonesia John Giles DEC-Research Group The World Bank Elan Satriawan TNP2K–VP Office.
2015 EAST AFRICA Evidence Summit July 8-9, 2015 | Nairobi, kenya
Targeting the Hardcore Poor An Impact Assessment March, 2011 Abhijit Banerjee, Esther Duflo, Raghabendra Chattopadhyay and Jeremy Shapiro.
Children’s Health Insurance Matters: Findings from Surveys of Healthy Kids Participants Grantmakers in Health Site Visit Meeting Christopher Trenholm Mathematica.
Department of International Health Effect of quality improvements on equity of health service utilization and patient satisfaction in Uttar Pradesh, India.
Where are the four year olds? Evidence from three Indian states Suman Bhattacharjea ASER Centre, New Delhi August 28, 2012.
Bargaining Power and Biofortification: The Role of Gender in Adoption of Orange-Fleshed Sweet Potato in Uganda Julia Behrman, Daniel O. Gilligan, Neha.
The effects of reducing the direct cost of care on health services utilization and health outcomes in Ghana: a randomized controlled trial EVELYN KORKOR.
Pitfalls of Participatory Programs: Evidence from a randomized evaluation in education in India Abhijit Banerjee (MIT) Rukmini Banerji (Pratham) Esther.
Social Capital and Early Childhood Development Evidence from Rural India Wendy Janssens Washington, 20 May 2004.
SEDA IMPACT EVALUATION WESTERN CAPE (SOUTH AFRICA) Varsha Harinath (the dti) Francisco Campos (World Bank) Finance and Private Sector Development IE Workshop.
MEXICO ’ S PROGRESA PROGRAM: WHO BENEFITS? A Presentation by Deon Filmer Of Material by David Coady.
Association of Health Plan’s HEDIS Performance with Outcomes of Enrollees with Diabetes Sarah Hudson Scholle, MPH, DrPH April 9, 2008.
Using willingness to pay data to inform the design of health insurance for the poor: evidence from micro-lending clients in Lagos, Nigeria November 1,
1 Targeting and Calibrating Educational Grants: Focus on Poverty or on Risk of Non-Enrollment? Elisabeth Sadoulet and Alain de Janvry University of California.
Evaluating a test-based subsidy program for low-cost private schools: Regression-discontinuity evidence from Pakistan Felipe Barrera-Osorio Dhushyanth.
Multi-dimensional measures of empowerment Contact:
Strengthening existing information systems to provide improved analysis to support the design of cash transfer programmes John Seaman Evidence for Development.
Innovations in Assessing Reproductive Health Access and Utilisation in non-camp Refugees in Low to Middle Income Countries Experience from Jordan and Lebanon.
The World Bank Human Development Network Spanish Impact Evaluation Fund.
November 6, 2003Social Policy Monitoring Network1 Evaluation of the pilot phase of the Social Safety Net (RPS) * in Nicaragua: Health and Nutrition Impacts.
2015 EAST AFRICA EVIDENCE SUMMIT JULY 8-9, 2015 | NAIROBI, KENYA COMMUNITY PERFORMANCE-BASED FINANCING IMPACT EVALUATION DISSEMINATION MEETING JEANINE.
Evaluating Pay for Performance in Health Provincial Maternal -Child Health Investment Project in Argentina Sebastian Martinez HDNVP Presentation joint.
IMPACT EVALUATION OF PERFORMANCE BASED CONTRACTING FOR A collaboration between the Ministry of Health, CNLS, SPH, INSP-Mexico and World Bank GENERAL HEALTH.
Journal Club Alcohol, Other Drugs, and Health: Current Evidence September–October 2012.
The World Bank Human Development Network Spanish Impact Evaluation Fund.
Reproducing Inequality: Family Background and Schooling in Peru Santiago Cueto, Alejandra Miranda, Juan León, and María Cristina Vásquez GRADE - Young.
Nigeria Impact Evaluation Community of Practice Abuja, Nigeria, April 2, 2014 Measuring Program Impacts Through Randomization David Evans (World Bank)
Non-experimental methods Markus Goldstein The World Bank DECRG & AFTPM.
What is randomization and how does it solve the causality problem? 2.3.
Evaluating the Indonesia Early Childhood Education and Development Project.
Africa RISING M&E Expert Meeting Addis Ababa, 5-7 September 2012.
Africa Impact Evaluation Program on AIDS (AIM-AIDS) Cape Town, South Africa March 8 – 13, Steps in Implementing an Impact Evaluation Nandini Krishnan.
Can a Market-Assisted Land Redistribution Program Improve the Lives of the Poor? Evidence from Malawi Gayatri Datar (World Bank, IEG) Ximena V. Del Carpio.
Cross-Country Workshop for Impact Evaluations in Agriculture and Community Driven Development Addis Ababa, April 13-16, 2009 Steps in Implementing an Impact.
11 Isolating the incentive effect PBF  Performance incentives  Additional resources Compensate control facilities with equal resources  Average of what.
On the use and misuse of computers in education: Evidence from a randomized experiment in Colombia Felipe Barrera-Osorio, World Bank Leigh L. Linden, Columbia.
PRESENTATION BY THE GHANA TEAM By Eunice Dapaah Senior Education Specialist World Bank- Ghana Office.
Children’s Health Insurance Matters: Findings from Surveys of Healthy Kids Participants Symposium: Status on Children’s Health in Santa Clara County May.
1 GETTING A BETTER START IN LIFE THE PHILIPPINES EARLY CHILDHOOD DEVELOPMENT PROJECT Have Poor Children Benefited?
Mediation & Moderation A PRIMER, REFRESHER, AND CLARIFICATION OF TERMS.
The vulnerability of indebted households during the crisis: evidence from the euro area The vulnerability of indebted households during the crisis: evidence.
Ingrid Woolard, University of Cape Town Cash transfers in South Africa: their role in short-run poverty alleviation and human capital investment.
IMPLEMENTATION AND PROCESS EVALUATION PBAF 526. Today: Recap last week Next week: Bring in picture with program theory and evaluation questions Partners?
Conditional Cash Transfer Pilot Upper Egypt. Background Currently Egypt has a welfare regime that is comprehensive and generous but which has some limitations.
Session 3: International experience: Impact of social protection programs Puja Vasudeva Dutta World Bank.
Reach Out and Read Fresno: Ongoing benefits in early literacy practices among underserved families Lydia Herrera-Mata, MD Susan Hughes, MS April 27, 2012.
PRESENTED BY JAMILAH ADAMU ( ).  Nigeria is the most populous country in Africa, with over 174 million inhabitants  TFR=5.7/woman.MMR=243/100000LB.
TANZANIA VIRTUAL BUSINESS INCUBATOR Overview and preliminary findings.
© Plan International Xu Jian, Country Health Advisor, Plan China Piloting Children’s Medical Insurance in Rural China: The Experience of Plan China.
1 Causal Inference Counterfactuals False Counterfactuals
Improved Patient Outcomes Best Available Clinical Evidence Patient’s
Sampling for Impact Evaluation -theory and application-
Steps in Implementing an Impact Evaluation
Presentation transcript:

David Evans World Bank Joint work with Brian Holtemeyer and Katrina Kosec (IFPRI) July 9, 2015

Cash transfers have expanded dramatically around the world!

Source: Fiszbein et al 2009

Source: Garcia & Moore 2012 Countries in which CT programs have been implemented (35) Countries in which CT programs have been discussed, planned, or implemented (39)

… and so has evidence surrounding their impacts!

Source: Andrews et al (forthcoming)

Operational experience and contextual expertise International expertise on cash transfers and on impact evaluation Initial funding for the program & evaluation

≈ ≈

per child ( US $3) per month per adult ( US $6) per month on average

EducationHealth Children (age 0-5)Visit clinic 6x per year Children (age 7-15)Be enrolled with 80% attendance ElderlyVisit clinic 1x per year

 Identification of the poor…by communities  Distribution of payments…by communities  Monitoring of conditions…by communities

 Initial (after 18 mos.) positive impacts on health clinic visits disappeared by 2.5 years  Health benefits take 2.5 years to materialize (not present at 18 mos.), and are mostly driven by young children aged 0‐5 (not elderly)  Large increase in use of health insurance  Shift toward using publicly‐provided healthcare  Initial (after 18 mos.) increase in satisfaction with healthcare disappeared by 2.5 years (habituation)  No increase in objective healthcare quality

3 provinces selected to pilot Initial TreatmentInitial Comparison 80 eligible villages but only cash for 40 Treatment 2 years later with additional funding randomization

Randomizing led to balance on observable characteristics

Baseline survey (2009) Roll-out of payments (2010) Follow-up survey #1 (2011) Focus groups #1 (2011) Follow-up survey #2 (2012) Focus groups #2 (2013)

Time Outcome BaselineEndline Roll out program Treatment Comparison Diff at baseline Diff at endline Difference at endline - Difference at baseline Impact of program

 Carried out a principal components analysis (PCA) using dummy variables for ownership of 13 HH assets  Took the first principal component as our index of HH wealth  Households with above-median wealth: “moderately poor”  Households with below-median wealth: “extremely poor”

Private

 Use three methods to correct  Median significant results after correction Outcome area# significant results (90%) # significant results (corrected) Health clinic visits55 Illness or injury83 Health insurance66 Type of health provider146 Satisfaction22

 Conditional cash transfers effectively increase health for children  Initial increase in clinic visits (conditions)  Major increase in health insurance take-up (not conditioned)  Beware of satisfaction measures: Effects may disappear