Working Independence versus modeling correlation Longitudinal Example

Slides:



Advertisements
Similar presentations
Econometric Analysis of Panel Data Panel Data Analysis – Random Effects Assumptions GLS Estimator Panel-Robust Variance-Covariance Matrix ML Estimator.
Advertisements

Spatial autoregressive methods
Multiple Regression Analysis
BA 275 Quantitative Business Methods
Lecture 4 (Chapter 4). Linear Models for Correlated Data We aim to develop a general linear model framework for longitudinal data, in which the inference.
Economics Prof. Buckles1 Time Series Data y t =  0 +  1 x t  k x tk + u t 1. Basic Analysis.
CHAPTER 3 ECONOMETRICS x x x x x Chapter 2: Estimating the parameters of a linear regression model. Y i = b 1 + b 2 X i + e i Using OLS Chapter 3: Testing.
Economics 310 Lecture 15 Autocorrelation. Correlation between members of series of observations order in time or space. For our classic model, we have.
Generalized Regression Model Based on Greene’s Note 15 (Chapter 8)
12.3 Correcting for Serial Correlation w/ Strictly Exogenous Regressors The following autocorrelation correction requires all our regressors to be strictly.
Linear beta pricing models: cross-sectional regression tests FINA790C Spring 2006 HKUST.
Maximum Likelihood We have studied the OLS estimator. It only applies under certain assumptions In particular,  ~ N(0, 2 ) But what if the sampling distribution.
Economics 20 - Prof. Anderson
OLS versus MLE Example YX Here is the data:
Quantitative Business Analysis for Decision Making Simple Linear Regression.
12 Autocorrelation Serial Correlation exists when errors are correlated across periods -One source of serial correlation is misspecification of the model.
GEE and Generalized Linear Mixed Models
1 MADE WHAT IF SOME OLS ASSUMPTIONS ARE NOT FULFILED?
What does it mean? The variance of the error term is not constant
AP Statistics Chapter 15 Notes. Inference for a Regression Line Goal: To determine if there is a relationship between two quantitative variables. Goal:
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
AP Statistics Chapter 15 Notes. Inference for a Regression Line Goal: To determine if there is a relationship between two quantitative variables. –i.e.
Maximum Likelihood Estimation Methods of Economic Investigation Lecture 17.
Term 4, 2006BIO656--Multilevel Models 1 PART 4 Non-linear models Logistic regression Other non-linear models Generalized Estimating Equations (GEE) Examples.
1Spring 02 Problems in Regression Analysis Heteroscedasticity Violation of the constancy of the variance of the errors. Cross-sectional data Serial Correlation.
Christopher Dougherty EC220 - Introduction to econometrics (revision lectures 2011) Slideshow: autocorrelation Original citation: Dougherty, C. (2011)
1 Standard error Estimated standard error,s,. 2 Example 1 While measuring the thermal conductivity of Armco iron, using a temperature of 100F and a power.
Problems with the Durbin-Watson test
Estimation Method of Moments (MM) Methods of Moment estimation is a general method where equations for estimating parameters are found by equating population.
Quantitative Methods. Bivariate Regression (OLS) We’ll start with OLS regression. Stands for  Ordinary Least Squares Regression. Relatively basic multivariate.
R. Kass/W03 P416 Lecture 5 l Suppose we are trying to measure the true value of some quantity (x T ). u We make repeated measurements of this quantity.
AUTOCORRELATION 1 Assumption B.5 states that the values of the disturbance term in the observations in the sample are generated independently of each other.
Statistics 350 Review. Today Today: Review Simple Linear Regression Simple linear regression model: Y i =  for i=1,2,…,n Distribution of errors.
High Speed Heteroskedasticity Review. 2 Review: Heteroskedasticity Heteroskedasticity leads to two problems: –OLS computes standard errors on slopes incorrectly.
Lecturer: Ing. Martina Hanová, PhD..  How do we evaluate a model?  How do we know if the model we are using is good?  assumptions relate to the (population)
Covariance components II autocorrelation & nonsphericity
Multilevel modelling: general ideas and uses
Stochastic Process - Introduction
REGRESSION DIAGNOSTIC III: AUTOCORRELATION
Dynamic Models, Autocorrelation and Forecasting
REGRESSION (CONTINUED)
Kakhramon Yusupov June 15th, :30pm – 3:00pm Session 3
REGRESSION DIAGNOSTIC II: HETEROSCEDASTICITY
The general linear model and Statistical Parametric Mapping
Chapter 5: The Simple Regression Model
The Maximum Likelihood Method
Maximum Likelihood & Missing data
Fundamentals of regression analysis
Chapter 3: TWO-VARIABLE REGRESSION MODEL: The problem of Estimation
Fundamentals of regression analysis 2
Chapter 15 Panel Data Analysis.
Pure Serial Correlation
Slope of the regression line:
BA 275 Quantitative Business Methods
Confidence Intervals Tobias Econ 472.
Serial Correlation and Heteroskedasticity in Time Series Regressions
The Regression Model Suppose we wish to estimate the parameters of the following relationship: A common method is to choose parameters to minimise the.
Serial Correlation and Heteroscedasticity in
Simple Linear Regression
The general linear model and Statistical Parametric Mapping
Confidence Intervals Tobias Econ 472.
Chapter 13 Additional Topics in Regression Analysis
Violations of Assumptions In Least Squares Regression
Autocorrelation MS management.
Serial Correlation and Heteroscedasticity in
Maximum Likelihood We have studied the OLS estimator. It only applies under certain assumptions In particular,  ~ N(0, 2 ) But what if the sampling distribution.
Violations of Assumptions In Least Squares Regression
Why does the autocorrelation matter when making inferences?
Maximum Likelihood Estimation (MLE)
Inferences 10-3.
Presentation transcript:

Working Independence versus modeling correlation Longitudinal Example Generate data in clusters (i.e., a person) 5 observations per cluster Response is a linear function of time Yit = 0 + 1t + eit The residuals are first-order autoregressive, AR(1) eit = ei(t-1) + uit (the u’s are independent) corr(ei(t+s) , eit) = s Estimate the slope by OLS: assumes independent residuals Maximum likelihood: models the autocorrelation Bio753: Adv. Methods III

Comparisons Compare the following reported Var(1) That reported by OLS (it’s incorrect) That reported by a robustly estimated SE for the OLS slope (It’s correct for the OLS slope) That reported by the MLE model It’s correct if the MLE model is correct You can use any working correlation model, but need a robust SE to get valid inferences Bio753: Adv. Methods III

Variance of OLS & MLE Estimates of b versus , the first-lag Correlation MLE reported variance OLS reported variance True variance of OLS Bio753: Adv. Methods III

Benefits & Drawbacks of working non-independence Efficient estimates Valid standard errors and sampling distributions Protection from some missing data processes The MLM/RE approach allows estimating conditional-level parameters, estimating latent effects and improving estimates Drawbacks Working non-independence imposes more strict validity requirements on the fixed effects model (the Xs) Can get valid SEs via working independence with robust standard errors At a sacrifice in efficiency Bio753: Adv. Methods III

There is no free lunch! Working independence models (coupled with robust SEs!!!) are sturdy, but inefficient Fancy models are potentially efficient, but can be fragile Bio753: Adv. Methods III