1 Comment on Zabel/Schwartz/Donald: An Analysis of the Impact of SSP on Wages Alexander Spermann Mannheim 28 October 2006.

Slides:



Advertisements
Similar presentations
Impact analysis and counterfactuals in practise: the case of Structural Funds support for enterprise Gerhard Untiedt GEFRA-Münster,Germany Conference:
Advertisements

The World Bank Human Development Network Spanish Impact Evaluation Fund.
Treatment Evaluation. Identification Graduate and professional economics mainly concerned with identification in empirical work. Concept of understanding.
1 Difference in Difference Models Bill Evans Spring 2008.
Evaluation of the impact of the Natural Forest Protection Programme on rural household incomes Katrina Mullan Department of Land Economy University of.
Can Financial Work Incentives Pay For Themselves? Final Report on the Self-Sufficiency Project for Welfare Applicants Reuben Ford, David Gyarmati, Kelly.
Pooled Cross Sections and Panel Data II
How Policy Evaluations and Performance Management are Used Maureen Pirog Rudy Professor of Public and Environmental Affairs, Indiana University Affiliated.
Programme to Support Pro-Poor Policy Development A partnership between the Presidency, Republic of South Africa and the European Union Explaining Education.
PAI786: Urban Policy Class 2: Evaluating Social Programs.
The Impacts of Integrated Pest Management (IPM) Farmer Field Schools on Inputs and Output: Evidence from Onion Farmers in the Philippines Santi Sanglestsawai,
OCTOBER ED DIRECTOR PROFESSIONAL DEVELOPMENT 10/1/14 POWERFUL & PURPOSEFUL FEEDBACK.
IMPACTS OF A WORK-BASED POVERTY REDUCTION PROGRAM ON CHILDREN’S ACHIEVEMENT AND SOCIAL BEHAVIOR: THE NEW HOPE PROJECT Aletha C. Huston, Greg J. Duncan,
Tax Subsidies for Out-of-Pocket Healthcare Costs Jessica Vistnes Agency for Healthcare Research and Quality William Jack Georgetown University Arik Levinson.
Some perspectives on the importance of policy evaluation Joost Bollens HIVA- K.U.Leuven 1Joost Bollens.
Matching Methods. Matching: Overview  The ideal comparison group is selected such that matches the treatment group using either a comprehensive baseline.
Policy Analyses at IZA Hilmar Schneider IZA IDSC Scientific Advisory Board Meeting, Bonn, May 29, 2009.
1/17 The Transition from Welfare to Work and the Role of Potential Labor Income Hilmar Schneider (IZA, DIW Berlin) Arne Uhlendorff (DIW Berlin, IZA)
Quasi Experimental Methods I Nethra Palaniswamy Development Strategy and Governance International Food Policy Research Institute.
Designing a Random Assignment Social Experiment In the U.K.; The Employment Retention and Advancement Demonstration (ERA)
Welfare Reform and Lone Parents Employment in the UK Paul Gregg and Susan Harkness.
Modelling Charitable Donations: A Latent Class Panel Approach Sarah Brown (Sheffield) William Greene (New York) Mark Harris (Monash) Karl Taylor (Sheffield)
Evaluating Job Training Programs: What have we learned? Haeil Jung and Maureen Pirog School of Public and Environmental Affairs Indiana University Bloomington.
© Michael Lechner, 2006, p. 1 (Non-bayesian) Discussion (translation) of Principal Stratification for Causal Inference with Extended Partial Complience.
Faculty of Economics and Business Administration Page 1 Discussion on: Estimating the impact of a policy reform on welfare participation:
IPSS Ch 2. Selection Problem 2.1. The Nature of the Problem Non-Response, Dropped from Census, Sample Attrition in Longitudinal Survey, Censored Data We.
RCTs and instrumental variables Anna Vignoles University of Cambridge.
Public Policy Analysis ECON 3386 Anant Nyshadham.
AFRICA IMPACT EVALUATION INITIATIVE, AFTRL Africa Program for Education Impact Evaluation David Evans Impact Evaluation Cluster, AFTRL Slides by Paul J.
0 Emerging Findings from the Employment Retention and Advancement (ERA) Evaluation Gayle Hamilton, MDRC Workforce Innovations 2005 Conference.
Applying impact evaluation tools A hypothetical fertilizer project.
Non-experimental methods Markus Goldstein The World Bank DECRG & AFTPM.
Instrumental Variables: Introduction Methods of Economic Investigation Lecture 14.
Lecture Alexander Spermann, University of Freiburg, SS Drawbacks of Microsimulation studies.
What is randomization and how does it solve the causality problem? 2.3.
Off- Farm Labor Supply of Farm- Families in Rural Georgia Dr. Ayal Kimhi Ofir Hoyman Tbilisi, 2005.
An Analysis of the Impact of SSP on Wages Jeffrey Zabel Economics Department Tufts University Saul Schwartz School of Public Policy and Administration.
Africa Program for Education Impact Evaluation Dakar, Senegal December 15-19, 2008 Experimental Methods Muna Meky Economist Africa Impact Evaluation Initiative.
Using Propensity Score Matching in Observational Services Research Neal Wallace, Ph.D. Portland State University February
Using microsimulation model to get things right: a wage equation for Poland Leszek Morawski, University of Warsaw Michał Myck, DIW - Berlin Anna Nicińska,
REBECCA M. RYAN, PH.D. GEORGETOWN UNIVERSITY ANNA D. JOHNSON, M.P.A. TEACHERS COLLEGE, COLUMBIA UNIVERSITY ANNUAL MEETING OF THE CHILD CARE POLICY RESEARCH.
Bilal Siddiqi Istanbul, May 12, 2015 Measuring Impact: Non-Experimental Methods.
1 Joint meeting of ESF Evaluation Partnership and DG REGIO Evaluation Network in Gdańsk (Poland) on 8 July 2011 The Use of Counterfactual Impact Evaluation.
Do European Social Fund labour market interventions work? Counterfactual evidence from the Czech Republic. Vladimir Kváča, Czech Ministry of Labour and.
The Evaluation Problem Alexander Spermann, University of Freiburg 1 The Fundamental Evaluation Problem and its Solution SS 2009.
Alexander Spermann University of Freiburg, SS 2008 Matching and DiD 1 Overview of non- experimental approaches: Matching and Difference in Difference Estimators.
Assessing the Impact of Informality on Wages in Tanzania: Is There a Penalty for Women? Pablo Suárez Robles (University Paris-Est Créteil) 1.
September 2005Winterhager/Heinze/Spermann1 Deregulating Job Placement in Europe: A Microeconometric Evaluation of an Innovative Voucher Scheme in Germany.
Post-secondary vocational training courses: are they effective for Italian unemployed youth with a high school diploma? COMPIE 2014 Conference Rome, 27th.
Henrik Winterhager Econometrics III Before After and Difference in Difference Estimators 1 Overview of non- experimental approaches: Before After and Difference.
The Targeted Negative Income Tax (TNIT) in Germany: Evidence from a quasi-experiment European Econonomic Association Amsterdam, 27 August 2005 Alexander.
The Evaluation Problem Alexander Spermann, University of Freiburg, 2007/ The Fundamental Evaluation Problem and its Solution.
Looking for statistical twins
Measuring Results and Impact Evaluation: From Promises into Evidence
Quasi-Experimental Methods
Introduction to Microeconometrics
Deregulating Job Placement in Europe:
Impact evaluation: The quantitative methods with applications
Matching Methods & Propensity Scores
Matching Methods & Propensity Scores
Methods of Economic Investigation Lecture 12
Impact evaluation of actions for jobseekers under the current OP ESF- Flemish Community : beyond classical parameters for success Expert Hearing.
Introduction to Microeconometrics
European Econonomic Association Amsterdam, 27 August 2005
The Use of Counterfactual Impact Evaluation Methods in Cohesion Policy
Matching Methods & Propensity Scores
Impact Evaluation Methods: Difference in difference & Matching
Evaluating Impacts: An Overview of Quantitative Methods
Sampling for Impact Evaluation -theory and application-
Presentation transcript:

1 Comment on Zabel/Schwartz/Donald: An Analysis of the Impact of SSP on Wages Alexander Spermann Mannheim 28 October 2006

2 Why is this paper important? Time-restricted employee or employer subsidies are a promising instrument of Active Labour Market Policy Wage progression: Main channel to self sufficiency Card et al. 2001: Limits to wage progression

3 Few empirical papers to time-restricted subsidies so far: e.g. Michalopoulos et al on SSP (JPubEc): evidence from social experiments with the Canadian SSP e.g. Orszag/Snower 2003 (LE): numerical simulation on time-restricted wage subsidies (Benefit-Transfer Program) e.g. Spermann/Strotmann 2005 (ZEW DP): quasi- experiment with the Targeted Negative Income Tax (TNIT) in Mannheim; now implemented in Germany This paper focuses exclusively on wage progression.

4 How does the Canadian SSP work? Source: Blank, Card and Robins (2000)

5 What is done in the paper?

6 1. Decomposing the program group The program group includes participants (randomly assigned) of the SSP. The take-up group comprises those participants who took up a supplemented full-time job. The incentivized group is the part of the take-up group that would not have worked full-time without the program. The non-incentivized group would have worked anyway.

7

8 Problem: The subsets of the take-up group cannot be directly observed. Solution for identification: Propensity Score Matching 2. Identification

9 Result of Matching: First step: Non-incentivized program group: PS- Matching to link CG (465 members) and PG (465 members) via predicted wage probabilities Second step: Remaining 389 member of the take- up group constitute the incentivized program group Question 1: Does the selection-on-observables assumption hold?

10 incentivized non-incentivized

11 Simple comparison of median wages for non-incentivized program group reveals positive effect (month 15-52) Same procedure for incentivized program and control group. But: Simple comparison of median wages is not meaningful, because the incentivized control group did not work during the first 13 months Question 2: Why exactly?

12 3. Measuring the impact of SSP on wages Problem: Partial observability of starting and ending wages w i is not observed for all those who are working in time s Question 3: Why don‘t you motivate this crucial point more clearly?

13 Solution: Estimation of a model of individual wages -Observed labor experience -Other covariates

14 Absolute wage progression: Mean returns for program and control groups in % Relative wage progression (=TOT): Difference of these means in ppt

15 Three treatment effects: TOT of SSP TOT of non-incentivized program group TOT of incentivized program group

16 Problems to overcome –Sample selection –Endogeneity of experience –Unobserved individual effects Appropriate Solutions –Heckman Two step –IV –FE due to Hausman test

17 4. Results observed experience in months estimated absolute wage progression in % relative wage progression (=TOT) in ppt PG Δ1.9 CG TOT of SSP for British Columbia by month 52:

18 TOT of non-incentivized program group: + TOT of non-incentivized program group after the end of the supplement period: + TOT of incentivized program group: ++ (8.9 ppt)

19 5. Discussion 1. What’s new? Card et al apply Matching as well 2. Policy Conclusion Can’t we be more optimistic? What should be done to improve wage progression?

20 3. Lessons for Germany - Low Wage Progression in Germany (Rhein et al. 2005) - Inspiration for TNIT evaluation in Germany