Advanced Tools and Techniques of Program Evaluation

Slides:



Advertisements
Similar presentations
Designing an impact evaluation: Randomization, statistical power, and some more fun…
Advertisements

REGRESSION, IV, MATCHING Treatment effect Boualem RABTA Center for World Food Studies (SOW-VU) Vrije Universiteit - Amsterdam.
Multiple Regression Analysis
The Simple Regression Model
There are at least three generally recognized sources of endogeneity. (1) Model misspecification or Omitted Variables. (2) Measurement Error.
Review of Identifying Causal Effects Methods of Economic Investigation Lecture 13.
Regresi Linear Sederhana Pertemuan 01 Matakuliah: I0174 – Analisis Regresi Tahun: Ganjil 2007/2008.
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.
Advanced Time Series PS 791C. Advanced Time Series Techniques A number of topics come under the general heading of “state-of-the-art” time series –Unit.
A Short Introduction to Curve Fitting and Regression by Brad Morantz
Lecture 4 Econ 488. Ordinary Least Squares (OLS) Objective of OLS  Minimize the sum of squared residuals: where Remember that OLS is not the only possible.
The Generalized IV Estimator IV estimation with a single endogenous regressor and a single instrument can be naturally generalized. Suppose that there.
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
Simple Linear Regression
Econ Prof. Buckles1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 1. Estimation.
1Prof. Dr. Rainer Stachuletz Simultaneous Equations y 1 =  1 y 2 +  1 z 1 + u 1 y 2 =  2 y 1 +  2 z 2 + u 2.
Regression Hal Varian 10 April What is regression? History Curve fitting v statistics Correlation and causation Statistical models Gauss-Markov.
FIN357 Li1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 1. Estimation.
FIN357 Li1 The Simple Regression Model y =  0 +  1 x + u.
Lesson #32 Simple Linear Regression. Regression is used to model and/or predict a variable; called the dependent variable, Y; based on one or more independent.
Economics 310 Lecture 18 Simultaneous Equations There is a two-way, or simultaneous, relationship between Y and (some of) the X’s, which makes the distinction.
FIN357 Li1 The Simple Regression Model y =  0 +  1 x + u.
Linear Regression Models Powerful modeling technique Tease out relationships between “independent” variables and 1 “dependent” variable Models not perfect…need.
3. Multiple Regression Analysis: Estimation -Although bivariate linear regressions are sometimes useful, they are often unrealistic -SLR.4, that all factors.
Hypothesis Testing in Linear Regression Analysis
JDS Special program: Pre-training1 Carrying out an Empirical Project Empirical Analysis & Style Hint.
Statistical Methods Statistical Methods Descriptive Inferential
1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u.
Roger B. Hammer Assistant Professor Department of Sociology Oregon State University Conducting Social Research Ordinary Least Squares Regression.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Regression Analysis A statistical procedure used to find relations among a set of variables.
Christine Pal Chee October 9, 2013 Research Design.
Discussion of time series and panel models
ECON 338/ENVR 305 CLICKER QUESTIONS Statistics – Question Set #8 (from Chapter 10)
1 Some Basic Stuff on Empirical Work Master en Economía Industrial Matilde P. Machado.
1 Prof. Dr. Rainer Stachuletz Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 1. Estimation.
Chapter 6 Introduction to Multiple Regression. 2 Outline 1. Omitted variable bias 2. Causality and regression analysis 3. Multiple regression and OLS.
Review Section on Instrumental Variables Economics 1018 Abby Williamson and Hongyi Li October 11, 2006.
Chapter 11: Linear Regression and Correlation Regression analysis is a statistical tool that utilizes the relation between two or more quantitative variables.
Class 5 Multiple Regression CERAM February-March-April 2008 Lionel Nesta Observatoire Français des Conjonctures Economiques
10-1 MGMG 522 : Session #10 Simultaneous Equations (Ch. 14 & the Appendix 14.6)
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 7: Regression.
Regression Analysis: A statistical procedure used to find relations among a set of variables B. Klinkenberg G
The Instrumental Variables Estimator The instrumental variables (IV) estimator is an alternative to Ordinary Least Squares (OLS) which generates consistent.
1 AAEC 4302 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH Part II: Theory and Estimation of Regression Models Chapter 5: Simple Regression Theory.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Lecture 6 Feb. 2, 2015 ANNOUNCEMENT: Lab session will go from 4:20-5:20 based on the poll. (The majority indicated that it would not be a problem to chance,
Chapter 4 Basic Estimation Techniques
Multiple Regression Analysis: Estimation
Objectives By the end of this lecture students will:
Econometrics ITFD Week 8.
Instrumental Variable (IV) Regression
More on Specification and Data Issues
Simultaneous equation system
Chapter 3: TWO-VARIABLE REGRESSION MODEL: The problem of Estimation
Multiple Regression Analysis
More on Specification and Data Issues
Chapter 6: MULTIPLE REGRESSION ANALYSIS
Regression Models - Introduction
The Regression Model Suppose we wish to estimate the parameters of the following relationship: A common method is to choose parameters to minimise the.
Migration and the Labour Market
Identification: Instrumental Variables
Simple Linear Regression
Tutorial 1: Misspecification
Linear Regression Summer School IFPRI
More on Specification and Data Issues
Simultaneous Equations Models
Measuring the Wealth of Nations
Tools and Techniques of Program Evaluation
Regression Models - Introduction
Presentation transcript:

Advanced Tools and Techniques of Program Evaluation James Fodor, July 2018 Effective Altruism Melbourne

Simple Linear Regression

Simple Linear Regression

Least Squares Method The “right” parameters are the ones which minimise the sum of squared residuals of the model. This is called Ordinary Least Squares (OLS). If our model is correctly specified and we have no endogeneity, OLS gives unbiased estimates for the population parameters.

Assumptions of OLS

Assumptions of OLS

1: Omitted Variables But our estimates will be biased if we have omitted variables.

2: Model Misspecification But our estimates will be biased if we have specified the wrong interactions and functional form.

So What is the Right Model?

3: Simultaneity But our estimates will be biased if we have not incorporated bidirectional causation through simultaneous equations.

4: Measurement Error But our estimates will be biased if we have measurement error in our independent variable.

Program Evaluation Approach Instead of trying to control for all confounding variables explicitly, we can just let random variation do the job for us. If something is decided by chance or by some exogenous factor, it should not be correlated with any unobserved variables!

Instrumental Variables Instrument must be correlated with independent variable (can test) Instrument must not be correlated with errors (can’t test) What does the result actually mean? (Local Average Treatment Effect)

Randomised Controlled Trial Can be hard/expensive to conduct, but if done properly there cannot be hidden confounds!

Randomised Controlled Trial ?

Clash of Econometricians

Limitations of RCTs Expensive and time consuming, can’t conduct everywhere Do not factor in general equilibrium effects Do not incorporate heterogeneity of parameters Trials differ from full-scale programs Do not tell us why anything works or doesn’t work

Hard to Implement

General Equilibrium

Heterogeneity Eva Vivalt meta-analysis of RCT results.

What Do RCTs Tell Us?

Structural Models These make assumptions about the causal processes that generate results Typical approach: Define utility function Define production function or resource constaints Define timespan and information available Define institutional setup Maximise utility subject to constraints over timespan given information Derive equation to estimate Use data to determine structural parameters

Structural Models Actually tells you about how the system works But requires lots of assumptions about functional forms Also often hard to identify all parameters (not enough data)

Structural Models

Summary

Book Recommendations

My Blog