Incentives James Habyarimana Impact Evaluation Initiative World Bank.

Slides:



Advertisements
Similar presentations
TESTING PERFORMANCE-BASED REMUNERATION FOR PRIMARY CARE PROVIDERS IN ARMENIA Tatyana Makarova Mark McEuen Abt Associates Inc. GHC Conference, May 30 -
Advertisements

RE-THINKING ACCOUNTABILITY Social Accountability and the Search for More Effective Public Expenditure Jeff Thindwa Participation and Civic Engagement.
The World Bank Human Development Network Spanish Impact Evaluation Fund.
Gathering Evidence of Impact: A Continued Conversation Jan Middendorf Cindy Shuman Office of Educational Innovation and Evaluation.
Teacher Evaluation and Rewards OECD Mexico Joint Workshop December 1-2, 2009 Susan Sclafani National Center on Education and the Economy.
Girls’ scholarship program.  Often small/no impacts on actual learning in education research ◦ Inputs (textbooks, flipcharts) little impact on learning.
Teaching Community Assistant Initiative
#ieGovern Impact Evaluation Workshop Istanbul, Turkey January 27-30, 2015 Measuring Impact 1 Non-experimental methods 2 Experiments Vincenzo Di Maro Development.
Chapter 11 What Works and What Doesn’t. Are Hospitals Good for You? From Angrist and Pischke, Mostly Harmless Econometrics.
Equity vs. Adequacy By: Jay Masterson. For 100 years…  School financing through local wealth and property taxes  Creates a situation if significant.
Performance Based Incentives for Learning in the Mexican Classroom Brian Fuller, MPA, Foundation Escalera Victor Steenbergen, MPA Candidate, London School.
Pricing the right to education The cost of reaching new targets by 2030 Aaron Benavot Director, EFA Global Monitoring Report Launch Event, Results for.
Incentive Pay: Good or Bad for Teachers?. Merit Pay Basics Definition: “Incentive pay,” or “Pay for performance” A monetary payment provided to an employee.
LEARNING OBJECTIVES 1. Discuss the rationale behind the implementation of a systematic performance appraisal system. 2. Discuss the difficulties in implementing.
Howard White Theory Based Evaluation Impact Evaluation Howard White International Initiative for Impact Evaluation.
CHAPTER 11 Performance Measurement, Compensation,
The Economics of Education Crisis and Reform 6. Introduction Effectiveness of the US education system The US education “crisis” Alternative ways of offering.
Variable Pay: Incentives for Performance
School meals and child outcomes in India Farzana Afridi, Delhi School of Economics IGC-ISI Conference, 20 th – 21 st December, 2010.
Comments on Teacher Incentive Papers: Duflo, Dupas and Kremer (Kenya) Muralidharan and Sundararaman (India) Bruns, Ferraz and Rangel (Brazil) By Paul Glewwe.
Title I Needs Assessment/ Program Evaluation Title I Technical Assistance & Networking Session October 5, 2010.
Pascaline Dupas, UCLA Pupil-Teacher Ratios, Locally-Hired Contract Teachers, and School-Based Management: Evidence from Kenya Making Schools Accountable:
Evaluation of Math-Science Partnership Projects (or how to find out if you’re really getting your money’s worth)
Lessons for Education Policy in Africa Evidence from Randomized Evaluations in developing countries James Habyarimana Georgetown University.
School Board’s Role in Special Education Vermont School Boards Association.
School-Based Management: Harry Anthony Patrinos
Edward M. Haugh Jr. ESC Consultant. III. Recommendations for Applying Outcomes Planning to ESC  I. Introduction to Outcomes Planning II. A Sample ESC.
Evaluating Charter Schools. Harlem Children’s Zone Started by Geoffrey Canada in a 97 block area of Harlem in NYC. Combines high energy “no excuses” type.
Leaky Education Pipeline Of every 100 students who enter kindergarten: 71 graduate from high school 42 enter a community college or university 18 receive.
Community Participation in Public Schools: Impact of Information Campaigns in three Indian States Priyanka Pandey, Sangeeta Goyal & Venkatesh Sundararaman.
Lessons for Education in Africa Evidence from Randomized Evaluations in Kenya Esther Duflo J-PAL A B D U L L A T I F J A M E E L P O V E R T Y A C T I.
What’s the Evidence: Does RBF lead to better results? Rena Eichler, PhD Broad Branch Associates Results Based Financing to Reduce Maternal, Newborn, and.
Economics 172 Issues in African Economic Development Lecture 14 March 2, 2006.
Chapter 10 Incentive Issues IDIS 364 – Spring 2007.
Education for Accountability Workshop, June 22 nd, 2009 Overview of the Evidence: Interventions in Teacher Incentives Barbara Bruns Lead Education Economist,
Lecture 8 APPLYING MOTIVATION THEORIES: REWARDS AND PERFORMANCE MANAGEMENT.
3ie  Context: the results agenda  The call for evidence  Rigorous impact evaluation  The international response  Reactions.
Assessing the Distributional Impact of Social Programs The World Bank Public Expenditure Analysis and Manage Core Course Presented by: Dominique van de.
TAP Expansion, Impact and Outcomes Lewis C. Solmon President Teacher Advancement Program Foundation April 27, 2006 TAP Expansion, Impact and Outcomes Lewis.
1 A Randomized Evaluation of a School Scholarship Program in Rural India Karthik Muralidharan (with Michael Kremer, Venkatesh Sundararaman) Conference.
Private involvement in education: Measuring Impacts Felipe Barrera-Osorio HDN Education Public-Private Partnerships in Education, Washington, DC, March.
ECON 3039 Labor Economics By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 31.
Laying the Foundation for Scaling Up During Development.
Results-based financing Why? What? How?. Jagaman district just erected a new health center and the health workers have started work. What are health workers.
Second Cross-country Workshop of the Africa Programs for Education and AIDS Impact Evaluation Dakar, December 2008 What do we know about school bursaries?
Research on teacher pay-for-performance Patrick McEwan Wellesley College (Also see Victor Lavy, “Using performance-based pay to improve.
What Works? What Doesn’t? Overview of Teacher Compensation: What Works? What Doesn’t? James H. Stronge College of William and Mary Williamsburg, Virginia.
Nigeria, January 2010 Petra Vergeer Health Specialist, RBF Team.
Evaluating Ongoing Programs: A Chronological Perspective to Include Performance Measurement Summarized from Berk & Rossi’s Thinking About Program Evaluation,
Africa Program for Education Impact Evaluation Dakar, Senegal December 15-19, 2008 Experimental Methods Muna Meky Economist Africa Impact Evaluation Initiative.
T EACHER INCENTIVES AND LOCAL PARTICIPATION : E VIDENCE FROM A RANDOMIZED PROGRAM IN K ENYA Joost de Laat Michael Kremer Christel Vermeersch.
Pay for Performance A strategic approach to design Dermot Hand August 2012.
1 Opportunity NYC CCT Pilot Program in New York City Inter-American Social Protection Network September 22, 2009 Linda Gibbs, Deputy Mayor for Health &
PRESENTATION BY THE GHANA TEAM By Eunice Dapaah Senior Education Specialist World Bank- Ghana Office.
School Based Management: Evidence from Kenya
Making services work for poor people: What’s decentralization got to do with it? World Development Report 2004 Shanta Devarajan and Shekhar Shah Decentralization.
Finance in Education Chapter 15.
Managerial Accounting: An Introduction To Concepts, Methods, And Uses Chapter 14 Incentive Issues Maher, Stickney and Weil.
What is Impact Evaluation … and How Do We Use It? Deon Filmer Development Research Group, The World Bank Evidence-Based Decision-Making in Education Workshop.
Goal Setting and Motivation MANA 4328 Dr. George Benson
CHAPTER 23 Performance Measurement, Compensation,
Measuring Results and Impact Evaluation: From Promises into Evidence
Descriptive Analysis of Performance-Based Financing Education Project in Burundi Victoria Ryan World Bank Group May 16, 2017.
CHAPTER 11: COMPENSATION
Chapter Six Training Evaluation.
Module 7: Monitoring Data: Performance Indicators
School Based Management
Human Resources Development Project (HRDP) – Tanzania Case Study
MONITORING AND EVALUATION IN TB/HIV PROGRAMS
Steps in Implementing an Impact Evaluation
Presentation transcript:

Incentives James Habyarimana Impact Evaluation Initiative World Bank

Incentives in Education Fashionable avenue for improving school performance – raising school, teacher and student effort Essentially involves tying remuneration to behavior or outcomes – Performance-based awards Has become a major ingredient in education reform in recent years – School-based performance grants/awards – Conditional cash transfers/scholarships – Contract teachers and performance bonuses Concern that we do not crowd out intrinsic motivation

Examples of Incentives-targeting learning Teacher incentives – Kenya (group) – India (group & individual) Based on performance of pupils in externally administered tests Contract teachers – India – Rwanda – Kenya Contract renewable conditional on performance Teacher ladders (Schemes of service) – Mexico – Uganda (under consideration)

Other Incentives-paying for inputs Camera project – India Number of complete days worked Lottery in up-state New York – Share of winnings depends on the number of sick- days not taken

Who mediates these incentives What determines the performance-related remuneration? How and who measures performance How much discretion do mediators have in determining eligibility? – Too much discretion and ‘corruption’ attenuates incentives Example of a mediated incentives program – Teacher attendance program in Western Kenya

Mediated Incentives: Who monitors the monitor? Kenya Kremer & Chen (2001) Head teachers asked to monitor presence of pre- primary school teachers Prize of a bicycle if attendance sufficiently high – Large incentive? Verified attendance with un-announced visits – No difference between program and comparison schools – Evidence of ‘cheating’ Collusion, altruism e.t.c

School Performance Awards Nigeria (Lagos State?) Chile (SNED 1998-) Within each homogenous group, the top n schools that account for 25% of enrollment are selected Award is based on six sub-indices – Test score levels (37) – Test score growth (28) – Equality of opportunity (22) – School initiatives (6) – Parental involvement (5) – Working Conditions (2)

School Performance Awards Chile SNED Program Selected schools receive an excellence subsidy – 90% is divided among teachers (based on instruction time) Annual benefit to winning teachers is about half a monthly salary (4-7% salary increase) – Remaining 10% can be used at school’s discretion. Public announcement of school’s quality

Student based awards Conditional cash transfers – Can be used for attendance – Student effort and performance Scholarships are really conditional transfers – PROGRESA – Washington DC Paying for performance – Up to $100 per month per student » For good behavior, attendance and performance – Also in NYC, Baltimore and other school districts

Rewards for Performance Classic knee-jerk reaction of your typical economist Some caution in design of high-powered incentives warranted – People don’t like the inherent assumption that they are lazy – If output multi-dimensional then can generate very inefficient allocation of effort – Test scores easy to measure, creativity harder

COST EFFECTIVENESS ANALYSIS

CBA or CEA? In general two ways to determine the desirability of programs – Cost Benefit Analysis – Cost Effectiveness Analysis Cost Benefit Analysis – Compares all the net benefits of a policy, program, project to the net costs. Cost Effectiveness Analysis – Cost per unit of output achieved by program

Cost Benefit Analysis Typically used for large macro policies or programs All social ‘costs’ and ‘benefits’ must be assigned a monetary value – For instance noise, teacher or parent satisfaction – Costs of funding – taxes Need to convert the stream of benefits, costs into a $ equivalent today Typically involves double counting – Costs of teacher incentives are also benefits to teachers

Cost Effectiveness Analysis Typically used for program activities Measures the financial costs of producing a specific outcome Generally more appropriate for IE – Short term gains observed No double counting Allows us to compare different programs, processes targeting same outcome

CEA Example Suppose we want to increase girls participation in school through CCTs But don’t know whether the monthly transfer should be $X or $X+Δ Then can conduct a prospective IE in which eligible pupils in group A receive $X and those in group B receive $X+Δ Compute the impact of each intervention Compare cost effectiveness of treatment A vs B $(Overhead A + X)/Impact A vs $(Overhead A + X+ Δ)/Impact B