Winning Hearts and Minds through Development: Evidence from a Field Experiment in Afghanistan Andrew Beath, Fotini Christia, Ruben Enikolopov.

Slides:



Advertisements
Similar presentations
Econometric analysis informing policies UNICEF workshop, 13 May 2008 Christian Stoff Statistics Division, UNESCAP,
Advertisements

An impact evaluation of Ethiopias Food Security Program John Hoddinott, IFPRI (in collaboration with Dan Gilligan, Alemayehu Seyoum and Samson Dejene)
Implementing NICE guidance
Monitoring and Evaluation of ICT Use in Rural Schools Ok-choon Park Global Symposium on ICT in Education – Measuring Impact: Monitoring and Evaluation.
Girls’ scholarship program.  Often small/no impacts on actual learning in education research ◦ Inputs (textbooks, flipcharts) little impact on learning.
Understanding the personal, social and environmental impact upon physical activity of the ‘Devon Active Villages’ programme Emma Solomon (PhD researcher)
raCrdæaPi)alk m
BRITISH SOCIAL ATTITUDES TOWARDS THE MILITARY AND CONTEMPORARY CONFLICT Are the Armed Forces understood and supported by the public?
Sudan Community Development Fund: Preliminary Slice I Impact Evaluation Results and Needs for Future Evaluations Abdulgadir Turkawi, Krishna Pidatala,
Evaluation Team Andrew Beath (Harvard University) Fotini Christia (M.I.T.) Ruben Enikolopov (New Economic School, Moscow) Shahim Kabuli.
EPAG Study Team (World Bank / MoGD/ Subah-Belleh Associates) Making Cents / Youth Economic Opportunities Conference 12 September 2012 EPAG Impact Evaluation:
Operationalizing IE: Case Study example: Textbooks and Teacher Training in Sierra Leone APEIE Workshop, May
Crime and crime prevention in SA Presentation to the Safety and Security Portfolio Committee Anton du Plessis, Duxita Mistry and Makubetse Sekhonyane Crime.
Wellbeing in England and China James Banks, Xiaoyan Lei, Albert Park, Andrew Steptoe, Yafeng Wang, Winnie Yip, Paola Zaninotto, Yaohui Zhao.
The Role of Financial System in Economic Growth Presented By: Saumil Nihalani.
Agenda: Block Watch outcome map Program Theory overview Evaluation theory overview Mentoring Evaluation Assignment 1 Evaluation Debrief.
Girls’ education in conflict and emergencies, case Afghanistan
Chapter 4 Selecting a Sample Gay, Mills, and Airasian
Chapter 5 Copyright © Allyn & Bacon 2008 This multimedia product and its contents are protected under copyright law. The following are prohibited by law:
At the end of this module, participants should have a better understanding of the following : Elements of Gender Mainstreaming Basics of Gender Analysis.
Job Training Programs. What has been tried? How well does it work?
Research Methods If we knew what it was we were doing, it would not be called research, would it? Albert Einstein.
Integrated household based agricultural survey methodology applied in Ethiopia, new developments and comments on the Integrated survey frame work.
The Impact of Court Decentralization on Domestic Violence Against Women Raúl Andrade Jimena Montenegro March 2009.
4th Russia-India-China Conference, New Dehli, November Entry to and Exit from Poverty in Russia: Evidence from Longitudinal Data Irina Denisova New.
School Dropout in Rural Vietnam: Does Gender Matter?
Assessing the Impact of the Ishraq Program in Egypt Ghada Barsoum, PhD Senior Program Manager Poverty, Gender and Youth Program Population Council International.
Food For Peace: Title II Programs and Gender 1 FSN Knowledge Sharing Meeting November 15, 2012 Presented by Michelle Gamber, MA, DrPH AAAS Fellow, FFP.
Pitfalls of Participatory Programs: Evidence from a randomized evaluation in education in India Abhijit Banerjee (MIT) Rukmini Banerji (Pratham) Esther.
SEILA Program and the Role of Commune Database Information System (CDIS) Poverty and Economic Policy (PEP) Research Network Meeting June 2004, Dakar,
Social Capital and Early Childhood Development Evidence from Rural India Wendy Janssens Washington, 20 May 2004.
Access to Electricity, Food Security and Poverty Reduction in Rural South-western Nigeria Awotide, B.A., T.T. Awoyemi, and A.O. Obayelu A paper prepared.
Economics and Statistics Administration U.S. CENSUS BUREAU U.S. Department of Commerce Research on Estimating International Migration of the Foreign-Born.
Racial/Ethnic Disparities in the HIV and Substance Abuse Epidemics: Communities Responding to the Need Hortensia Amaro, Anita Raj, Rodolfo Vega, Thomas.
Access to services for men in Scotland. 2 A brief look at: Some of the statistics and data that are available What do these tell us about how men perceive.
Hampshire County Council: Customer Insight Project, Community Safety Steve Postlethwaite and Sam Hepenstal.
Energy Drinks!. By: Michael Williams, Erica Lee, Erica Kim, and Davis Song.
1 Public Perceptions of the Security Sector and Police Work in Yemen A Yemen Polling Center Survey Major Findings January 30, 2013 funded by the European.
Learning about learning The GEC approach to M&E UKFIET Conference Joseph Holden & Jason Calvert 15 th September 2015 © PEAS.
PKSS Community Survey – Analysis and Conclusions Sep 11 th, 2009.
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
Impacts of Formalizing Customary Land Rights in Burkina Faso: Preliminary Findings From MCC Rural Land Governance Project 2015 World Bank Conference on.
 PROJECT PERIOD AND COSTS PERIOD - Five Years: Sept 2010 to SEPT 2015 COSTS - $ 1.5 billion (IDA 40m, ARTF 1.3bn, Comm. Cont. 160m)  PROJECT PROCESSING:
Impact Evaluation Designs for Male Circumcision Sandi McCoy University of California, Berkeley Male Circumcision Evaluation Workshop and Operations Meeting.
Impact Evaluation of CDBC under Vietnam Second Northern Mountains Poverty Reduction Project Ms. Nguyen Thi Minh Nghia Mr. Le Hong Phong Mr. Tran Duy Hung.
Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.
Managing Statistics in Conflict Situations: The case of Afghanistan Abdul Rahman Ghafoori President General Central Statistics Organization, Afghanistan.
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
Durable solutions: An approach based on age, gender and diversity.
GENDER DIFFERENCES LITTLE DIFFERENCE FOR PSYCHOSES MOST VERY GENDER SPECIFIC WOMEN = 2/3 OF DEPRESSION, ANXIETY, DISTRESS, SUICIDE ATTEMPTS, ALMOST.
Observations vs. Experiments Target Goals: I can distinguish between an observational study and an experiment. I can explain how a lurking variable in.
Chapter 13: Experiments and Observational Studies AP Statistics.
Methodological Workshop on Measuring Impacts of Refugees and IDPs on Host Countries and Host Communities (November 20-21, 2015) Alvin Etang Ndip (Economist,
Approaching Days of Tranquility Afghanistan Polio Eradication Initiative February
Does Food Assistance Lessen the Adverse Impacts of Adult Morbidity and Mortality on Household Welfare in Zambia? Gelson Tembo University of Zambia Department.
IDPs and Returnees Profiling Joint IDP Profiling Service Presented by William Chemaly Geneva, August 10, 2010 Yemen, June 16-July 10.
National Solidarity Program Augmentation of Impact Evaluation Abdul Rahman Ayubi, HayatullahFazil, SakhiFrozish,Andrew Beath, Michael Gilligan.
Shaping Opinions – A Case of Afghanistan’s Young Generation By: M. Nazo Hotaki, Sample Answers.
Regional Workshop on Sustainable Sanitation in South Asia April 27 – 29, 2009 Water, Sanitation and Hygiene Education Sector - Afghanistan.
Common Pitfalls in Randomized Evaluations Jenny C. Aker Tufts University.
Income Convergence in South Africa: Fact or Measurement Error? Tobias Lechtenfeld & Asmus Zoch.
Child marriage and female wellbeing in Bangladesh Erica Field (Duke), Rachel Glennerster, Abdul Latif Jameel Poverty Action Lab Shahana Nazneem (Save the.
[Presentation location] [Presentation date] (Confirm ABT logo) Building Bridges and Bonds (B3): An introduction.
FAST TRACK PROJECT: IMPACT EVALUATION DESIGN Musa Kpaka & Kevin Leiby | Component Leaders Meeting | 3 Aug, 2015.
BY SANDRA BLACK PAUL DEVEREUX KJELL SALVANES QUARTERLY JOURNAL OF ECONOMICS, 2005 The More the Merrier? The Effect of Family Size and Birth Order on Children’s.
Improving learning outcomes through information provision: Experimental evidence from Indian villages Farzana Afridi (ISI, Delhi) Bidisha Barooah (3ie)
National Solidarity Program
Implementation Challenges
ELM DICIPE Mozambique Gaza, Nampula, and Tete Midline 2016
Impact Evaluation Designs for Male Circumcision
Presentation transcript:

Winning Hearts and Minds through Development: Evidence from a Field Experiment in Afghanistan Andrew Beath, Fotini Christia, Ruben Enikolopov

Motivation  Internal conflicts play important role in underdevelopment  more than half of the world affected by civil war in last 50 years  Development aid used as a counterinsurgency tool  both in Iraq and Afghanistan  Limited empirical evidence on aid’s effectiveness in winning over the support of an embattled population.  Recent research has produced conflicting results.  Methodological Challenge: Non-random assignment of aid.

Testing the “Hearts and Minds” Strategy  Randomized field experiment deals with selection bias.  Examine effects both at the interim and final phase.  Examine both perceptions and objective measures.  Providing basic public goods through development projects is considered part of an effective counterinsurgency strategy. H1. Public goods provision improves people’s economic well-being, H2. which leads to improved attitudes towards the government, H3. and in turns reduces the number of people willing to support the insurgency, leading to fewer security incidents.

Preview of Results  Development aid can positively effect economic wellbeing, attitudes toward the government, and security perceptions and conditions.  Timeframe of Implementation and Initial Violence Matter  Effects on economic welfare and attitudes towards the government stronger during program implementation, though still observed almost a year after completion. Effect observed in secure and insecure areas.  Violence goes down during program implementation but the effect diminishes after the flow of resources stops. Effect observed only in areas with low levels of initial violence.

Context: National Solidarity Program (NSP)  NSP is the largest development program in Afghanistan.  Over 32,000 of Afghanistan’s 38,000 villages have received NSP.  Sponsored by international donors and run by the Ministry of Rural Rehabilitation and Development.  Implemented by NGOs in two main stages:  Election of Community Development Councils (CDCs) through secret-ballot election  Size of CDC proportional to size of community with equal number of males and females.  Project Selection  $200 per household; max community grant $60,000

Evaluation Covers 10 Districts across 6 Provinces Herat Ghor Daykundi Balkh Baghlan Nangarhar

Similarity of Treatment and Control Villages Create CDCs Treatment Villages (NSP) Select Projects Implement Projects Projects Finished Control Villages (Non-NSP) May – Oct. 2009May-Nov Midline EstimatesEndline Estimates Baseline Survey Aug. – Sep st Follow- Up Survey 2 nd Follow- Up Survey The evaluation estimates impacts by collecting data over four years in 500 villages: 250 NSP (treatment) & 250 non-NSP (control) Structure of Evaluation and Data Collection

Security Events Data  ISAF data on security incidents (almost exclusively IEDs-) with exact location, date and time for the period 01/ /2011.  Look at three different periods  Before the start of the program (Jan 2006 –Sept 2007)  Midline Period (Oct Sept 2009)  Endline Period (Oct Dec 2011)

VariableTreatment Effect Midline Treatment Effect Endline P value for equality of coefficients N Male Respondent Expects Household's Situation to Improve Next Year (0.011)*** [0.012]*** (0.019)* [0.013] ,946 Female Respondent Expects Household Situation to Improve Next Year (0.014)*** [0.024]* (0.010)*** [0.023]* ,017 Summary Measure of Objective Wellbeing (0.015)** [0.023] (0.017) [0.018] ,990 Economic Welfare and Governance Attitudes Summary Measure of Governance Attitudes (0.021)*** [0.043]** (0.018)*** [0.031]* ,982

Perceptions of Security and Security Incidents VariableTreatment Effect Midline Treatment Effect Endline P value for equality of coefficients N Security In and Around Village has improved in Past Two Years (0.013)** [0.022] ** (0.015)*** [0.026]* ,962 Compared to Two Years Ago Teenage Girls feel less Safe when Traveling to School and Socializing (0.016)** [0.011]*** (0.014) (0.020) ,128 Attacks based on ISAF measure (0.041) [0.037]** (0.031) [0.047] ,000 Occurrence of a Security Incident (0.041) [0.029]* (0.037) [0.039] 0.301,000

VariableTreatment Effect Mid*Insecure Treatment Effect Mid* Secure Treatment Effect End* Insecure Treatment Effect End* Secure Male Respondent Expects Household's Situation to Improve Next Year (0.021)*** [0.023]** (0.013)*** [0.012]*** (0.023)* [0.021]** (0.010) [0.021] Female Respondent Expects Household Situation to Improve Next Year (0.024) [0.003]*** (0.015)*** [0.021]*** (0.027)** [0.010]*** (0.013)*** [0.027]* The Role of Initial Level of Insecurity Summary Measure for Objective Wellbeing [0.036] [0.011]*** [0.017]* [0.026] [0.040] [0.039] [0.018]* [0.028] Summary Measure for Governance Attitudes (0.043) [0.031] (0.023)*** [0.048]** (0.037)*** [0.007]*** (0.021)]** [0.035]

VariableTreatment Effect Mid*Insecure Treatment Effect Mid* Secure Treatment Effect End* Insecure Treatment Effect End* Secure Security Around Village has Improved in Past Two Years (0.022) [0.023] (0.016)*** [0.026]** (0.034) [0.015] (0.016)** [0.032] Teenage Girls Feel Less Safe Going to School and Socializing Compared to Two Years Ago (0.033) [0.049] (0.018)** [0.012]*** (0.026) [0.014] (0.028) [0.013]** Attacks based on ISAF measure (0.122) [0.155] (0.033)** [0.028]** (0.105) [0.132] (0.019)* [0.030] Occurrence of a Security Incident (0.164) [0.167] (0.036)** [0.034]*** (0.095) [0.154] (0.042) [0.029] The Role of Initial Level of Insecurity

Conclusion  We find that the provision of development aid to villages can: 1. Positively affect economic welfare of population 2. Improve attitudes towards the government 3. Improve security  But effects are conditional on initial levels of security and timeframe of implementation of development program suggesting that development aid:  Can prevent spread of insurgency in areas with low initial violence, but cannot contain it in areas with notable violence.  Need for continual provision of aid rather than one-shot projects.

Specification We estimate the following OLS regression: where Y tvi is the outcome of interest for household i in village v in the midline (1) or endline (2), so that t ∈ {1,2}; T v is the village treatment dummy, τ t is the dummy for period t, φ pt is the village-pair*period fixed effect. Standard errors clustered at village-cluster level; also account for spatial correlation( Conley, 1999 ).