Felipe Barrera-Osorio (HDNED World Bank)

Slides:



Advertisements
Similar presentations
AFRICA IMPACT EVALUATION INITIATIVE, AFTRL Africa Program for Education Impact Evaluation Muna Meky Impact Evaluation Cluster, AFTRL Slides by Paul J.
Advertisements

Robin L. Donaldson May 5, 2010 Prospectus Defense Florida State University College of Communication and Information.
Presented by Malte Lierl (Yale University).  How do we measure program impact when random assignment is not possible ?  e.g. universal take-up  non-excludable.
Experimental Research Designs
The World Bank Human Development Network Spanish Impact Evaluation Fund.
Pakistan Punjab Female Stipend Program Evaluating the Impact.
Impact Evaluation: The case of Bogotá’s concession schools Felipe Barrera-Osorio World Bank 1 October 2010.
Chapter 9 Experimental Research Gay, Mills, and Airasian
CORRELATIO NAL RESEARCH METHOD. The researcher wanted to determine if there is a significant relationship between the nursing personnel characteristics.
School meals and child outcomes in India Farzana Afridi, Delhi School of Economics IGC-ISI Conference, 20 th – 21 st December, 2010.
Sampling and Participants
THE EFFECT OF INCOME SHOCKS ON CHILD LABOR AND CCTs AS AN INSURANCE MECHANISM FOR SCHOOLING Monica Ospina Universidad EAFIT, Medellin Colombia.
Matching Methods. Matching: Overview  The ideal comparison group is selected such that matches the treatment group using either a comprehensive baseline.
Recent Trends in Worker Quality: A Midwest Perspective Daniel Aaronson and Daniel Sullivan Federal Reserve Bank of Chicago November 2002.
Evaluating a test-based subsidy program for low-cost private schools: Regression-discontinuity evidence from Pakistan Felipe Barrera-Osorio Dhushyanth.
Session III Regression discontinuity (RD) Christel Vermeersch LCSHD November 2006.
AFRICA IMPACT EVALUATION INITIATIVE, AFTRL Africa Program for Education Impact Evaluation David Evans Impact Evaluation Cluster, AFTRL Slides by Paul J.
Applying impact evaluation tools A hypothetical fertilizer project.
Non-experimental methods Markus Goldstein The World Bank DECRG & AFTPM.
Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition
MELISSA MCINERNEY Workplace Safety and the Economic Impact of Workers’ Compensation Insurance.
Africa Program for Education Impact Evaluation Dakar, Senegal December 15-19, 2008 Experimental Methods Muna Meky Economist Africa Impact Evaluation Initiative.
IMPORTANCE OF STATISTICS MR.CHITHRAVEL.V ASST.PROFESSOR ACN.
Randomized Assignment Difference-in-Differences
The Economic Costs of Educational Inequality in Developing Countries Wael Moussa, Ph.D. Carina Omoeva, Ph.D. Charles Gale March 2016 FHI 360 Education.
Patricia Gonzalez, OSEP June 14, The purpose of annual performance reporting is to demonstrate that IDEA funds are being used to improve or benefit.
Impact Evaluation Methods Regression Discontinuity Design and Difference in Differences Slides by Paul J. Gertler & Sebastian Martinez.
The Evaluation Problem Alexander Spermann, University of Freiburg, 2007/ The Fundamental Evaluation Problem and its Solution.
Outline Sampling Measurement Descriptive Statistics:
Presenter Disclosures
PROVIDING INTERNATIONAL COMPARABILITY OF POVERTY ASSESSMENTS
Sampling Meaning, Types, Procedure
EXPERIMENTAL RESEARCH
Widening Participation whilst Narrowing Attainment Gaps between Student Groups: A Realistic Objective for Higher Education? Introduction: How this study.
Research Department Inter-American Development Bank
Carina Omoeva, FHI 360 Wael Moussa, FHI 360
Residential Mobility, Heterogeneous Neighborhood effects and Educational Attainment of Blacks and Whites Li Gan Texas A&M University and NBER Yingning.
International Labour Office
Engagement and Treatment Completion in a Correctional Sample
Quasi-Experimental Methods
Know and understand market segmentation and target marketing elements
Ageing Poorly? Accounting for the Decline in Earnings Inequality in Brazil, Francisco Ferreira, PhD1; Sergio Firpo, PhD2; Julián Messina, PhD3.
By Agarwal, Hadzic, Song, Yildirim Discussion by Tullio Jappelli
Sampling.
Hasan Tekgüç (MAÜ), Değer Eryar (İEÜ) & Dilek Cindoğlu (MAÜ)
Experimental Design.
Chapter Eight: Quantitative Methods
Matching Methods & Propensity Scores
Practice Mid-Term Exam
Matching Methods & Propensity Scores
Multiple Regression Analysis with Qualitative Information
David Pieper, Ph.D. STATISTICS David Pieper, Ph.D.
Ontario`s Mandated High School Community Service Program: Assessing Civic Engagement After Four Years S. D. Brown, S.M. Pancer, P. Padanyi, M. Baetz, J.
Honors Statistics Chapter 2
Shudong Wang, NWEA Liru Zhang, Delaware DOE G. Gage Kingsbury, NWEA
Matching Methods & Propensity Scores
ECO173: Applied Statistics II Introductory Concepts & Random Variables
Impact Evaluation Methods: Difference in difference & Matching
The incidence of Mandated Maternity Benefits
The European Statistical Training Programme (ESTP)
Explanation of slide: Logos, to show while the audience arrive.
Explanation of slide: Logos, to show while the audience arrive.
Chapter: 9: Propensity scores
Applying Impact Evaluation Tools: Hypothetical Fertilizer Project
Methodology for New Measurement of Human Capital at World Bank
Using Big Data to Solve Economic and Social Problems
Steps in Implementing an Impact Evaluation
Exercises Causal Comparative Research
Types of Statistical Studies and Producing Data
Presentation transcript:

The Effects of User Fee Reductions on Enrollment: Evidence from a quasi-experiment Felipe Barrera-Osorio (HDNED World Bank) Leigh L. Linden (Columbia University) Miguel Urquiola (Columbia University)

The objective of the study What are the effects of user fee reductions on enrollment? It is possible to see differential responses to the program from different groups of populations Specifically, we can analyze the different responses between females and males

Gratuidad program Each year the government issues a resolution that stipulates which items schools may charge for and the maximum fee for each. These expenses are equivalent to between 7 and 29 monthly dollars, (between 6 and 25 percent of the minimum wage) The Gratuidad program subsidizes some of these fees. The program is targeted using the Sisben index that identify the most vulnerable households in Colombia. The system is implemented with a survey about households’ infrastructure, demographics and human capital characteristics. Based on these, each household receives an score between 0 and 100 Based on the score, it places households into six different levels, 1 being the most poor, and 6 the richest. Households with scores below a cutoff score of 11 are given a Level of 1; those between 11 and a cutoff of 22 receive a Level 2; Level 3—22 and 43, and so on The extent to which students benefit from these reductions is a function of their Sisben level.

Gratuidad For basic education (grades 1-9) Sisben 1 children enjoy a 100 percent reduction of complementary service charges, while those in Sisben levels 2 and above receive no reduction. For high school (grades 10-11), Sisben 1 children benefit from the elimination of both academic and complementary services fees, while Sisben 2 households receive roughly a 50 percent reduction Households in levels 3 and higher receive no benefit.

Gratuidad: items of charges

Direct cost of education

Distribution of cost across items

Identification and Estimation Whether or not students benefit from the program is a discrete function of their score. Characteristics of the household (observable and unobservable) are similar for students just above and below the cutoff scores. Under this assumption, discrete differences in attendance rates between treated and untreated students close to the cutoff can be attributed to the fee reductions. Students with scores of 21.5 might provide an adequate control group for students with scores of 22.5 In short, close to the cutoffs the RD design resembles a (localized) randomized experiment

Data The information comes from two sources. First, data collected (in 2004 and 2005) directly through the Sisben survey. Demographic characteristics (gender, age, household composition, pregnancy, and marital status). Educational attainment (grades completed), type of enrollment (public/private), labor force participation, and income. Second, we use administrative enrollment records (October 2006) kept by the District Education Department (SED)

Descriptive statistics

Validation of the exercise First, properties of the assignment variable: We verified that the students’ Sisben score is a good predictor of their level And we verified that households were not able to influence their Sisben score Second, we investigated that the characteristics of individuals are smoothly related to the Sisben score at the cutoff points (e.g., that the control and treatment groups are similar) The treatment and control groups are similar. For example:

Example, Validation of similarity between treatment and control groups: Income

Results We present regressions’ coefficients between enrollment and level of Sisben (controlling by cube on the score) We present results for several subpopulations (e.g., gender, public / private students, etc) We discuss results with a band of 1 point

Results

Results

Results Results suggest that the program had a significant impact. The program raises the probability of enrollment for basic-aged Sisben 1 students by about 3 percent, and for high school-aged Sisben 2 students by about 6 percent. These positive effects seem to be larger for at-risk students. The program also seems to display a substantial degree of heterogeneous impacts for different populations. The program seems to increase the probability of attendance for males in the first grades and for girls in the higher grades