Make slide with no dummies, add time dummy, then state dummy, then interaction term.

Slides:



Advertisements
Similar presentations
The effects of maternity leave policies Elizabeth Washbrook Department of Economics University of Bristol.
Advertisements

REGRESSION, IV, MATCHING Treatment effect Boualem RABTA Center for World Food Studies (SOW-VU) Vrije Universiteit - Amsterdam.
Advantages and limitations of non- and quasi-experimental methods Module 2.2.
School District Consolidation William Duncombe and John Yinger The Maxwell School, Syracuse University February 2013.
1 Examples of Fixed-Effect Models. 2 Almond et al. Babies born w/ low birth weight(< 2500 grams) are more prone to –Die early in life –Have health problems.
1 Almond et al. Babies born w/ low birth weight(< 2500 grams) are more prone to – Die early in life – Have health problems later in life – Educational.
1 Difference in Difference Models Bill Evans Spring 2008.
Random Assignment Experiments
Economics 20 - Prof. Anderson1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 7. Specification and Data Problems.
Two-way fixed-effect models Difference in difference 1.
Presented by Malte Lierl (Yale University).  How do we measure program impact when random assignment is not possible ?  e.g. universal take-up  non-excludable.
Lecture 28 Categorical variables: –Review of slides from lecture 27 (reprint of lecture 27 categorical variables slides with typos corrected) –Practice.
3.2 OLS Fitted Values and Residuals -after obtaining OLS estimates, we can then obtain fitted or predicted values for y: -given our actual and predicted.
Differences-in-Differences
Heterogeneity One limitation of the static LS model lies in the heterogeneity assumption. In reality, individuals differ in preference and in information.
Multiple Regression Fenster Today we start on the last part of the course: multivariate analysis. Up to now we have been concerned with testing the significance.
4.3 Confidence Intervals -Using our CLM assumptions, we can construct CONFIDENCE INTERVALS or CONFIDENCE INTERVAL ESTIMATES of the form: -Given a significance.
Assumption MLR.3 Notes (No Perfect Collinearity)
Difference in difference models
Pooled Cross Sections and Panel Data II
1 Two-way fixed effects Balanced panels i=1,2,3….N groups t=1,2,3….T observations/group Easiest to think of data as varying across states/time Write model.
Intro to Statistics for the Behavioral Sciences PSYC 1900
Saving Babies: The Efficacy and Cost of Recent Changes in the Medicaid Eligibility of Pregnant Women The Journal of Political Economy, Vol. 104, No.6 (Dec.,
Multicollinearity Omitted Variables Bias is a problem when the omitted variable is an explanator of Y and correlated with X1 Including the omitted variable.
Regression Discontinuity Design 1. 2 Z Pr(X i =1 | z) 0 1 Z0Z0 Fuzzy Design Sharp Design.
1 Difference in Difference Models Bill Evans Spring 2008.
Educational Research by John W. Creswell. Copyright © 2002 by Pearson Education. All rights reserved. Slide 1 Chapter 11 Experimental and Quasi-experimental.
Chapter Objectives Define maternal, infant, and child health.
L1 Chapter 11 Experimental and Quasi- experimental Designs Dr. Bill Bauer.
Single and Multiple Spell Discrete Time Hazards Models with Parametric and Non-Parametric Corrections for Unobserved Heterogeneity David K. Guilkey.
Tax Subsidies for Out-of-Pocket Healthcare Costs Jessica Vistnes Agency for Healthcare Research and Quality William Jack Georgetown University Arik Levinson.
The Impact of Air Pollution on Infant Mortality: Evidence from Geographic Variation in Pollution Shocks Induced by a Recession Kenneth Y. Chay and Michael.
1 Research Method Lecture 6 (Ch7) Multiple regression with qualitative variables ©
Inequality and social policy Growing Inequality since ‘74.
Paper written by: Dr. Aydemir and Dr. Skuterud Presentation by: Curt Pollock, Marc Dales, Levon Sarmazian, Jessica Lindgren and Chad Johnson.
Chapter 11 Experimental Designs
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 11 Experimental Designs.
Copyright © 2014 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Remuneration Reforms in Public Sector: a Case of Russian Healthcare Marina Kolosnitsyna Higher School of Economics Moscow, Russia APPAM 2011 Conference.
Has Public Health Insurance for Older Children Reduced Disparities in Access to Care and Health Outcomes? Janet Currie, Sandra Decker, and Wanchuan Lin.
Problems with the Design and Implementation of Randomized Experiments By Larry V. Hedges Northwestern University Presented at the 2009 IES Research Conference.
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
IPSS Ch 2. Selection Problem 2.1. The Nature of the Problem Non-Response, Dropped from Census, Sample Attrition in Longitudinal Survey, Censored Data We.
Benefit-Cost Analysis of Preschool Education W. Steven Barnett, Ph.D. Director, National Institute for Early Education Research Rutgers—The State University.
Spillover Effects of State Mandated-Benefit Laws The Case of Outpatient Breast Cancer Surgery June 5, 2007 John Bian, Ph.D., Atlanta VAMC, American Cancer.
Public Policy Analysis ECON 3386 Anant Nyshadham.
Application 3: Estimating the Effect of Education on Earnings Methods of Economic Investigation Lecture 9 1.
The Latina Infant Mortality Paradox: Explanations and a Policy Prescription Michael S. McGlade Department of Geography Western Oregon University.
Public Finance and Public Policy Jonathan Gruber Third Edition Copyright © 2010 Worth Publishers 1 of 24 Empirical Tools of Public Finance 3.1 The Important.
MELISSA MCINERNEY Workplace Safety and the Economic Impact of Workers’ Compensation Insurance.
Alcoholtaxessavelives.org Julie Martinez, Chris Weathers, Cassandra Romero.
Aid, policies and Growth
Maternal Smoking & the 1998 Master Settlement Agreement Douglas E. Levy, Ph.D. Ellen R. Meara, Ph.D. Dept. Health Care Policy, Harvard Medical School Support.
Sampling Design and Analysis MTH 494 Lecture-21 Ossam Chohan Assistant Professor CIIT Abbottabad.
Lecture notes Prepared by Anton Ljutic. © 2004 McGraw–Hill Ryerson Limited Growth, Unemployment and Inflation CHAPTER FOUR.
Compensating Differentials Chapter Labor Economics Workers get paid what they are worth Workers get paid what they are worth Their marginal revenue.
Multiple Regression Analysis: Inference
Differences-in-Differences
The Latina Infant Mortality Paradox:
Pooling Cross Sections across Time: Simple Panel Data Methods
Econometrics ITFD Week 8.
Difference-in-Differences
Pooling Cross Sections across Time: Simple Panel Data Methods
Methods of Economic Investigation Lecture 12
EMPIRICAL STUDY AND FORECASTING (II)
Empirical Tools of Public Finance
Ch. 13. Pooled Cross Sections Across Time: Simple Panel Data.
Summary of Slide Content
Ch. 13. Pooled Cross Sections Across Time: Simple Panel Data.
Presentation transcript:

Make slide with no dummies, add time dummy, then state dummy, then interaction term

Difference in Difference Model with two states and two time periods. The estimating equation is: y st = α 0 + α 1 Treatment s +α 2 Post t + + δ Treatment s *Post t + ε st Traffic Fatality Rate time Colorado Nebraska Colorado Implements Policy α0α0 α 0+ α 1 α2α2 α 2+ δ

Difference in Difference Model with two states and two time periods. The estimating equation is: y st = α 0 + α 1 Treatment s +α 2 Post t + + δ Treatment s *Post t + ε st Traffic Fatality Rate time Colorado Nebraska Colorado Implements Policy α0α0 α 0+ α 1 α2α2 δ α2α2

Difference in Difference Model with two states and two time periods. The estimating equation is: y st = α 0 + α 1 Treatment s +α 2 Post t + + δ Treatment s *Post t + ε st Traffic Fatality Rate time Colorado Nebraska Colorado Implements Policy. α2α2 α2α2 δ

This estimating equation is exactly the same as: y ist = α 0 + α 1 dCO s +α 2 d2 t + + δ Policy st + ε ist dCO is dummy for CO; d2 is dummy for year 2; Policy is dummy =1 in CO after policy is passed Traffic Fatality Rate time Colorado Nebraska Colorado Implements Policy. α2α2 α2α2 δ

Traffic Fatality Rate time Colorado Nebraska. α2α2 δ

Traffic Fatality Rate time Colorado Nebraska. δ

When we have lots of states and years, an author typically writes y st = β 0 + δPolicy st + v s + z t +ε st And then the author might say that the equation is estimated including state and year fixed effects Start with state fixed effects, common time trend

If we’re using state-level data, then each state contributes one observation per year. The estimating equation with a common time trend is y ist = α 0 + α 1 dCO s +α 2 t + δ Policy st + ε ist Traffic Fatality Rate time Colorado Nebraska Colorado Implements Policy. α0α0 α 0 + α 1

Traffic Fatality Rate time Colorado Nebraska Colorado Implements Policy.

Traffic Fatality Rate time Colorado Nebraska Colorado Implements Policy. New Mexico New Mexico Implements Policy. With multiple states δ will be the mean vertical change y st = α 0 + α 2 t + δPolicy st + v s + ε st

If we’re using repeated cross-sectional data at the individual level, then each state contributes multiple observations per year. The estimating equation is: y ist = α 0 + δ Policy st + α 2 t + v s + ε ist Traffic Fatality Rate time Colorado Nebraska Colorado Implements Policy... New Mexico New Mexico Implements Policy.

Now look at time shocks. What if all states experience a common shock in a given year? What if the means varies by time as well as by state?

z3z3 Crime Rate time Barber Jefferson Barber legalizes by-the-drink sales Common time fixed effects-- δ will still be the average vertical change from before and after the policy Violent Crime ct = π 0 + δ Wet Law ct + X ‘ ct π 2 + v c + z t + ε ct. Jefferson legalizes by-the-drink sales Positive shock to crime Negative shock to crime z3z3 z8z8 z8z8

Crime Rate time Barber Jefferson Barber legalizes by-the-drink sales But note if you look at it, Barber is increasing faster than Jefferson: Violent Crime ct = π 0 + π 1 Wet Law ct + X ‘ ct π 2 + v c + z t + ε ct. Jefferson legalizes by-the-drink sales Positive shock to crime Negative shock to crime

Crime Rate time Barber Jefferson Barber legalizes by-the-drink sales Franklin Franklin legalizes by-the- drink sales Adding state specific time trends Violent Crime ct = π 0 + δ Wet Law ct + X ‘ ct π 2 + v c + z t + Θ c ∙ t + ε ct. Jefferson legalizes by-the-drink sales Positive shock to crime Negative shock to crime

17 Meyer et al. Workers’ compensation State run insurance program Compensate workers for medical expenses and lost work due to on the job accident Premiums Paid by firms Function of previous claims and wages paid Benefits -- % of income w/ cap

18 Typical benefits schedule Min( pY,C) P=percent replacement Y = earnings C = cap e.g., 65% of earnings up to $400/month

19 Concern: Moral hazard. Benefits will discourage return to work Empirical question: duration/benefits gradient Previous estimates Regress duration (y) on replaced wages (x) Problem: given progressive nature of benefits, replaced wages reveal a lot about the workers Replacement rates higher in higher wage states

20 Y i = X i β + αR i + ε i Y (duration) R (replacement rate) Expect α > 0 Expect Cov(R i, ε i ) Higher wage workers have lower R and higher duration (understate) Higher wage states have longer duration and longer R (overstate)

21 Solution Quasi experiment in KY and MI Increased the earnings cap Increased benefit for high-wage workers (Treatment) Did nothing to those already below original cap (comparison) Compare change in duration of spell before and after change for these two groups

22

23

24 Model Y it = duration of spell on WC A it = period after benefits hike H it = high earnings group (Income>E 3 ) Y it = β 0 + β 1 H it + β 2 A it + β 3 A it H it + β 4 X it ’ + ε it Diff-in-diff estimate is β 3

25

26 Questions to ask? What parameter is identified by the quasi-experiment? Is this an economically meaningful parameter? What assumptions must be true in order for the model to provide and unbiased estimate of β 3 ? Do the authors provide any evidence supporting these assumptions?

27 Almond et al. Neonatal mortality, dies in first 28 days Infant mortality, died in first year Babies born w/ low birth weight(< 2500 grams) are more prone to Die early in life Have health problems later in life Educational difficulties generated from cross-sectional regressions 6% of babies in US are low weight Highest rate in the developed world

28 Let Y it be outcome for baby t from mother I e.g., mortality Y it = α + bw it β + X i γ + α i + ε it bw is birth weight (grams) X i observed characteristics of moms α i unobserved characteristics of moms

29 Cross sectional model is of the form Y it = α + bw it β + X i γ + u it where u it =α i + ε it Many observed factors that might explain health (Y) of an infant Prenatal care, substance abuse, smoking, weight gain (of lack of it) Some unobserved as well Quality of diet, exercise, generic predisposition α i not included in model Cov(bw it,u it ) < 0

30 Solution: Twins Possess same mother, same environmental characterisitics Y i1 = α + bw i1 β + X i γ + α i + ε i1 Y i2 = α + bw i2 β + X i γ + α i + ε i2 ΔY = Y i2 -Y i1 = (bw i2 -bw i1 ) β + (ε i2 - ε i1 )

31 Questions to consider? What are the conditions under which this will generate unbiased estimate of β? What impact (treatment effect) does the model identify?

32

33 Large change In R2 Big Drop in Coefficient on Birth weight

34

35 More general model Many within group estimators that do not have the nice discrete treatments outlined above are also called difference in difference models Cook and Tauchen. Examine impact of alcohol taxes on heavy drinking States tax alcohol Examine impact on consumption and results of heavy consumption death due to liver cirrhosis

36 Y it = β 0 + β 1 INC it + β 2 INC it-1 + β 1 TAX it + β 2 TAX it-1 + u i + v t + ε it i is state, t is year Y it is per capita alcohol consumption INC is per capita income TAX is tax paid per gallon of alcohol

37 Model requires that untreated groups provide estimate of baseline trend would have been in the absence of intervention Key – find adequate comparisons If trends are not aligned, cov(T it A it,ε it ) ≠0 Omitted variables bias How do you know you have adequate comparison sample?

38 Concern: suppose that the intervention is more likely in a state with a different trend Do the pre-treatment samples look similar? Tricky. D-in-D model does not require means match – only trends. If means match, no guarantee trends will However, if means differ, aren’t you suspicious that trends will as well?

39 Add state specific time trends Y it = β 0 + β 1 INC it + β 2 INC it-1 + β 1 TAX it + β 2 TAX it-1 + β i T + u i + v t + ε it i is state, t is year Y it is per capita alcohol consumption INC is per capita income TAX is tax paid per gallon of alcohol β i gives state specific time trend

First-Stage Estimates: Wet Laws and On-Premises Alcohol Licenses, On-Premises Licenses Wet Law.177*** (.025).143*** (.022) Mean of the dependent variable.617 N3,352 R2R F-Statistic Year FEsYes County FEsYes CovariatesYes County linear trendsNoYes Notes: Regressions are weighted by county population and standard errors are corrected for clustering at the county level. The dependent variable is equal to the number of active on-premises liquor licenses per 1,000 population in county c and year t. The years 1995, 1996, and 1999 are excluded because of missing crime data.

On-Premises Alcohol Licenses and Violent Crime, OLS Violent Crime OLS Violent Crime 2SLS Violent Crime 2SLS Violent Crime On-Premises Licenses.853* (.500) 1.24* (.667) 4.31** (1.77) 5.00*** (1.87) N3,352 R2R Year FEsYes County FEsYes CovariatesYes County linear trends NoYesNoYes Notes: Regressions are weighted by county population and standard errors are corrected for clustering at the county level. The dependent variable is equal to the number of violent crimes per 1,000 population in county c and year t. The years 1995, 1996, and 1999 are excluded because of missing crime data.

42 Falsification tests Add “leads” to the model for the treatment Intervention should not change outcomes before it appears If it does, then suspicious that covariance between trends and intervention Y it = β 0 + β 3 A it + α 1 A it-1 + α 2 A it-2 + α 3 A it-3 + u i + v t + ε it Three “leads” Test null: H o : α 1 =α 2 =α 3 =0

43 Pick control groups that have similar pre-treatment trends Most studies pick all untreated data as controls Example: Some states raise cigarette taxes. Use states that do not change taxes as controls Example: Some states adopt welfare reform prior to TANF. Use all non- reform states as controls Can also use econometric procedure to pick controls Appealing if interventions are discrete and few in number Easy to identify pre-post