Kevin Croke World Bank kcroke@worldbank.org Long run educational gains from malaria control in Tanzania: Preliminary results CSAE Conference March 19,

Slides:



Advertisements
Similar presentations
AFRICA IMPACT EVALUATION INITIATIVE, AFTRL Africa Program for Education Impact Evaluation Muna Meky Impact Evaluation Cluster, AFTRL Slides by Paul J.
Advertisements

Impact of Large-Scale Infant Feeding Promotion on Child Survival and Health in Madagascar.
APPMG World Malaria Day Event, 2013 Invest in The Future: Defeat Malaria Kolawole Maxwell, Malaria Consortium Nigeria Country Director.
Africare’s Health Niche In what areas should Africare strive to position itself to be widely known as the “go to” organization? Office of Health.
Mosquito nets, Social marketing and equity in rural southern Tanzania 1 Ifakara Health Research & Development Centre, Tanzania 2 Tanzania Essential Health.
The World Bank Institute and Futures Group in collaboration with O’Hanlon Health Consulting, Tropical Health LLP, and University of California at San Francisco.
Rural Non-Farm Enterprises Operate Mainly in Survival Mode Paula Nagler and Wim Naudé Annual Bank Conference on Africa, Paris, 23 June 2014 AGRICULTURE.
Malaria Landscape 2007 Executive Director's Report to the 13 th Board Meeting.
1 Eritrea National Malaria Control Program: On the road to malaria eradication Saleh Meky Minister of Health Government of Eritrea.
Child deaths: Causes and epidemiological dimensions Robert E. Black, M.D., M.P.H. Johns Hopkins Bloomberg School of Public Health.
2015 EAST AFRICA Evidence Summit July 8-9, 2015 | Nairobi, kenya
The risk of malaria worldwide: prospects for control and elimination Bob Snow KEMRI-University of Oxford collaboration, Nairobi, Kenya
Matching Methods. Matching: Overview  The ideal comparison group is selected such that matches the treatment group using either a comprehensive baseline.
Health Programme Evaluation by Propensity Score Matching: Accounting for Treatment Intensity and Health Externalities with an Application to Brazil (HEDG.
Social Capital and Early Childhood Development Evidence from Rural India Wendy Janssens Washington, 20 May 2004.
Roadmap Progress Report 2011 Zambia SARN-RBM PARTNERS ANNUAL CONSULTATIVE MEETING, JULY 2011.
United Republic of Tanzania Ministry of Health London, Dec 2005 Tanzania Under five Mortality Reduced by a Quarter: Why?? United Republic of Tanzania.
Assessing the Feasibility of Continuous Net Distribution in Kenya using Community Based Approach.
Africa Impact Evaluation Program on AIDS (AIM-AIDS) Cape Town, South Africa March 8 – 13, Steps in Implementing an Impact Evaluation Nandini Krishnan.
Performance-based financing of maternal and child health: non-experimental evidence from Cambodia and Burundi Ellen Van de Poel Institute of Health Policy.
Africa Program for Education Impact Evaluation Dakar, Senegal December 15-19, 2008 Experimental Methods Muna Meky Economist Africa Impact Evaluation Initiative.
Comments on: The Evaluation of an Early Intervention Policy in Poor Schools Germano Mwabu June 9-10, 2008 Quebec City, Canada.
State of the Field: The Need to Understand and Incorporate Variation in Impact in Seeking to Influence Outcomes for Women and Children Kate Schwartz &
5 Education for All Development Issues in Africa Spring 2007.
Differences-in- Differences. Identifying Assumption Whatever happened to the control group over time is what would have happened to the treatment group.
Using SBCC to create demand for mosquito nets in the private sector The Case of the Malaria Control Culture Project in Uganda SBCC Summit / 8-10 February.
Florence M. Turyashemererwa Lecturer- Makerere University
What works in education: where and why? Howard White International Initiative for Impact Evaluation.
Effects of migration and remittances on poverty and inequality A comparison between Burkina Faso, Kenya, Nigeria, Senegal, South Africa, and Uganda Y.
Children’s Emotional and Behavioral Problems and Their Parents’ Labor Supply Patrick Richard, Ph.D., M.A. Nicholas C. Petris Center on Health Markets and.
PANEL: THE ROLE OF PALNETWORK IN ENSURING THAT NO CHILD IS LEFT BEHIND Integrating disabilities into large-scale assessment of learning outcomes in Pakistan.
National Vector Borne Disease Control Program INDIA.
The effect of paid maternity leave on early childhood growth in low and middle income countries Deepa Jahagirdar June 10, 2016 Canadian Society for Epidemiology.
An Introduction to Cost-Effectiveness Analysis. AN OVERVIEW OF CEA.
Knowledge Systems for Sustainable Development The design of effective systems to harness research- based knowledge for sustainable development.
Breastfeeding : A High Return on Investment to Achieve SDGs
The Long-Term Effects of Universal Primary Education:
Malaria in pregnancy:A case of Ruhengeri district hospital in Rwanda
Overview of Phase II, proposed directions for Phase III
TANZANIA.
Ezeigbo*1, O. R., Ibegbulem2, Z. O. and Agomoh1, N. G.
Microfinance and small holder farmers productivity
Interpreting Recent Mortality Trends
Bangladesh Country Presentation
Food and Agriculture Organization of the United Nations
WHO Millennium Development Goals Grant Project
General belief that roads are good for development & living standards
UKES Annual Conference
XVI I IAC Mexico 3-8 August 2008 Txema Calleja WHO/OMS
Uganda: The Pearl of Africa
Eliminating Reproductive Risk Factors and Reaping Female Education and Work Benefits: A Constructed Cohort Analysis of 50 Developing Countries Qingfeng.
Drivers of Unit Cost Variation in Voluntary Medical Male Circumcision in Sub-Saharan Africa: A meta-regression analysis Drew Cameron UC Berkeley IAEN.
Differences-in-Differences
Malaria Knowledge, Attitudes, Practices and Behaviour survey 2014
Free Distribution or Cost-Sharing
Knowing your epidemic and knowing your response – maximising routinely collected data to measure and monitor HIV epidemics in sub-Saharan Africa Monitoring.
Rwanda Integrated Campaign
Impact Evaluation Methods
Kenya Agricultural Productivity Project
Sources of vital statistics
Implementation Challenges
Randomization This presentation draws on previous presentations by Muna Meky, Arianna Legovini, Jed Friedman, David Evans and Sebastian Martinez.
Randomization This presentation draws on previous presentations by Muna Meky, Arianna Legovini, Jed Friedman, David Evans and Sebastian Martinez.
Explanation of slide: Logos, to show while the audience arrive.
EVALUATION OF THE ZANZIBAR UNIVERSAL PENSION SCHEME (ZUPS) TO ASSESS THE IMPACT OF THE SOCIAL PENSION ON RECIPIENTS AND THEIR FAMILIES Logo Logo The sample:
Partners for Measles Advocacy 7th Annual Meeting
Increasing breastfeeding prevalence
London Business School and City University, London
Sample Sizes for IE Power Calculations.
TTL: Nyambura Githagui
Presentation transcript:

Kevin Croke World Bank kcroke@worldbank.org Long run educational gains from malaria control in Tanzania: Preliminary results CSAE Conference March 19, 2013 Kevin Croke World Bank kcroke@worldbank.org

motivation Major push on malaria control in Africa over past decade Well-established health benefits of insecticide treated nets (ITNs) Any reason to expect non-health impacts? Literature on early childhood health and long run outcomes Deworming (Ozier 2012; Baird et al 2011); Nutrition (Yang and Maccini 2009; Alderman et al 2006; many others) Malaria: Lucas, Kremer et al, Bleakley (all 2010) show educational or labor impacts from earlier generation of malaria control in Latin America and South Asia Can we trace the impact of recent malaria interventions on current learning outcomes?

Malaria control in Tanzania 1997-1999: Pilot social marketing of insecticide treated bed nets in two districts. 2000-2008: national scale up of social marketing (SMITN- SMARTNET and TNVS projects) 2008-2011: Mass free ITN distribution to all children, then all sleeping spaces Challenges No blanket simultaneous national treatment or randomized roll out Can we exploit “semi-phased” nature of roll out to identify impact on non-health outcomes? We would need a large scale, comprehensive national data set

The Uwezo test Initiative of donor consortium (Hewlett, DFID, CIDA, others) to measure learning outcomes, modeled on India’s ASER test Under aegis of Tanzanian NGO Twaweza 2010 – 2014 annual test in Tanzania, Uganda, and Kenya In order to generate district-level results, very large sample size needed 2011 Tanzania test: 77,000 households, 128,000 children See more at www.uwezo.net Survey Sample size frequency Representativeness DHS 10,000 3-5 years Regional level Household Budget Survey/National Panel Survey 2,000-3,200 Previously 7-10 years; now every 2 years Urban/rural Uwezo survey 80,000 households, 128,000 children Every year, 2010-2014 District level

The KINET project Social marketing of insecticide treated bed nets in Kilombero and Ulanga (“KINET”) ITNs sold for $5 (33% discount), treatment kits for $0.42, through private sector and by door-to-door promotion Results in Kilombero and Ulanga district surveillance area: From very low ITN coverage (~10%) to high coverage (>60%) over two year period. Malaria prevalence drops from 63%  38% for children under 2. Anemia drops from 49%  26% References: Schellenberg, J.R.M. Armstrong, S. Abdulla, H. Minja, R. Nathan, O. Mukasa, T. Marchant, H. Mponda, et al. 1999. “KINET: a Social Marketing Programme of Treated Nets and Net Treatment for Malaria Control in Tanzania, with Evaluation of Child Health and Long-term Survival.” Transactions of the Royal Society of Tropical Medicine and Hygiene 93 (3) (May): 225–231.

empirical model Uwezo (2011) captures outcome data for 128,000 children in Tanzania between ages 7-16 Given phased roll out, some district x cohort combinations have been protected by ITNs, others have not Exogenous shock/discontinuity separating 15-16 year old cohort (born in 1995-1996) in Kilombero and Ulanga from younger cohorts They were born too soon to benefit from KINET Hence a difference-in-difference estimation strategy 2011 Uwezo score = β + β1(“progam” cohort) + β2 (Kilombero/Ulanga dummy +β3 (Kilombero/Ulanga dummy*program cohort) + β4 (χ1) +ε

Table 1: Differential exposure to the KINET program across age cohorts Age in 1997 (when KINET introduced) Year of birth Age in 2011 Max years exposed to program from ages 0-2 (Kil/Ulanga) Max years exposed to program from ages 0-2 (other districts) Not born 2004 7 2 2003 8 2002 9 2001 10 2000 11 1999 12 -1 1998 13 1997 14 1 1996 15 1995 16

Results: KINET program   (1) (2) (3) (4) Kilombero/Ulanga protected cohort 0.2000*** 0.1881*** 0.1557*** 0.2013* (0.0711) (0.0717) (0.0572) (0.1177) Kilombero/Ulanga district -0.0927 0.0876 0.0462 -0.0393 (0.2235) (0.2293) (0.2472) ITN protected cohort 0.6003*** 0.6081*** 0.5648*** 0.6032*** (0.0392) (0.0385) (0.0442) (0.0382) village has tarmac road 0.1690*** (0.0569) 2011 school funding 0.0000*** (0.0000) distance district capital -0.0019*** (0.0005) secondary school in village 0.1697*** (0.0367) Has donor project -0.0462 (0.0432) Regional dummies no yes Additional controls Observations 94186 65441 66659 r2 0.4817 0.4935 0.4927 0.4943

Post-pilot scale up Based on success of KINET, social marketing scaled up nationally SMITN/SMARTNET program: 2000-2008 Tanzania National Voucher Scheme 2004-present No clear programmatic phase-in by region Predictors of high coverage rates: urban “council” district, KINET program, capital city, or proximity to Tanga/Mwanza

Results: post-2000 scale up   (1) (2) (3) (4) Kilombero/Ulanga x protected cohorts 0.1889*** 0.1599*** 0.1880*** 0.1638*** (0.0710) (0.0528) (0.0709) (0.0507) post-2000 high coverage dist. x cohort 0.1161 0.2192 (0.1657) (0.2342) post-2000 high ITN coverage dist. x cohort 0.0322 -0.0050 (0.0256) (0.0453) Regional dummies yes Yes Standard controls School and community controls no Observations 94186 65441 r2 0.4936 0.4930 0.4932 0.4810

robustness Unrelated variables test Selective mortality Labor market differentials Migration Limitations Non-experimental data Cannot rule out role of cohort- and district-specific characteristics

Follow up work Other Tanzania possibilities Experimental interventions: e.g. IPTi in southern Tanzania Quasi-experiments: Zanzibar eradication More phase-in models: U5CC phase in, exploit district-level TNVS data, work with DSS research teams? Kenya’s universal coverage campaign Uganda?

conclusions Preliminary conclusions Preliminary evidence of substantial effect size (0.1-0.2 st deviations) Further evidence for ITN distribution, early childhood health interventions more broadly Implications for cost effectiveness of ITN distribution Value of large sample surveys for non-experimental program evaluation