Limited Dependent Variables

Slides:



Advertisements
Similar presentations
Dummy Dependent variable Models
Advertisements

Qualitative and Limited Dependent Variable Models Chapter 18.
Continued Psy 524 Ainsworth
Brief introduction on Logistic Regression
Analysis of Categorical Data Nick Jackson University of Southern California Department of Psychology 10/11/
Logistic Regression Psy 524 Ainsworth.
Discrete Choice Modeling William Greene Stern School of Business IFS at UCL February 11-13, 2004
Binary Logistic Regression: One Dichotomous Independent Variable
Nguyen Ngoc Anh Nguyen Ha Trang
Models with Discrete Dependent Variables
1Prof. Dr. Rainer Stachuletz Limited Dependent Variables P(y = 1|x) = G(  0 + x  ) y* =  0 + x  + u, y = max(0,y*)
Binary Response Lecture 22 Lecture 22.
GRA 6020 Multivariate Statistics; The Linear Probability model and The Logit Model (Probit) Ulf H. Olsson Professor of Statistics.
FIN357 Li1 Binary Dependent Variables Chapter 12 P(y = 1|x) = G(  0 + x  )
An Introduction to Logistic Regression JohnWhitehead Department of Economics Appalachian State University.
Log-linear and logistic models Generalised linear model ANOVA revisited Log-linear model: Poisson distribution logistic model: Binomial distribution Deviances.
Log-linear and logistic models
Qualitative and Limited Dependent Variable Models Prepared by Vera Tabakova, East Carolina University.
Aaker, Kumar, Day Seventh Edition Instructor’s Presentation Slides
An Introduction to Logistic Regression
MODELS OF QUALITATIVE CHOICE by Bambang Juanda.  Models in which the dependent variable involves two ore more qualitative choices.  Valuable for the.
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
1 G Lect 11W Logistic Regression Review Maximum Likelihood Estimates Probit Regression and Example Model Fit G Multiple Regression Week 11.
Logistic Regression- Dichotomous Dependent Variables March 21 & 23, 2011.
Qualitative and Limited Dependent Variable Models Adapted from Vera Tabakova’s notes ECON 4551 Econometrics II Memorial University of Newfoundland.
ALISON BOWLING THE GENERAL LINEAR MODEL. ALTERNATIVE EXPRESSION OF THE MODEL.
Teaching Microeconometrics using at Warsaw School of Economics Marcin OwczarczukMonika Książek.
9-1 MGMG 522 : Session #9 Binary Regression (Ch. 13)
Limited Dependent Variables Ciaran S. Phibbs May 30, 2012.
AN INTRODUCTION TO LOGISTIC REGRESSION ENI SUMARMININGSIH, SSI, MM PROGRAM STUDI STATISTIKA JURUSAN MATEMATIKA UNIVERSITAS BRAWIJAYA.
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Linear vs. Logistic Regression Log has a slightly better ability to represent the data Dichotomous Prefer Don’t Prefer Linear vs. Logistic Regression.
Lecture Slide #1 Logistic Regression Analysis Estimation and Interpretation Hypothesis Tests Interpretation Reversing Logits: Probabilities –Averages.
Week 5: Logistic regression analysis Overview Questions from last week What is logistic regression analysis? The mathematical model Interpreting the β.
Forecasting Choices. Types of Variable Variable Quantitative Qualitative Continuous Discrete (counting) Ordinal Nominal.
“Analyzing Health Equity Using Household Survey Data” Owen O’Donnell, Eddy van Doorslaer, Adam Wagstaff and Magnus Lindelow, The World Bank, Washington.
Chapter 13: Limited Dependent Vars. Zongyi ZHANG College of Economics and Business Administration.
Multiple Logistic Regression STAT E-150 Statistical Methods.
Regression Continued. Example: Y [team finish] =  +  X [spending] Values of the Y variable (team finish) are a function of some constant, plus some.
1 Topic 4 : Ordered Logit Analysis. 2 Often we deal with data where the responses are ordered – e.g. : (i) Eyesight tests – bad; average; good (ii) Voting.
I271B QUANTITATIVE METHODS Regression and Diagnostics.
Qualitative and Limited Dependent Variable Models ECON 6002 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s notes.
Analysis of Experimental Data IV Christoph Engel.
Dates Presentations Wed / Fri Ex. 4, logistic regression, Monday Dec 7 th Final Tues. Dec 8 th, 3:30.
Logistic Regression Saed Sayad 1www.ismartsoft.com.
4. Binary dependent variable Sometimes it is not possible to quantify the y’s Ex. To work or not? To vote one or other party, etc. Some difficulties: 1.Heteroskedasticity.
Roger B. Hammer Assistant Professor Department of Sociology Oregon State University Conducting Social Research Logistic Regression Categorical Data Analysis.
Logistic Regression and Odds Ratios Psych DeShon.
Linear Probability and Logit Models (Qualitative Response Regression Models) SA Quimbo September 2012.
The Probit Model Alexander Spermann University of Freiburg SS 2008.
Instructor: R. Makoto 1richard makoto UZ Econ313 Lecture notes.
LOGISTIC REGRESSION. Purpose  Logistical regression is regularly used when there are only two categories of the dependent variable and there is a mixture.
The Probit Model Alexander Spermann University of Freiburg SoSe 2009
BINARY LOGISTIC REGRESSION
Logistic Regression When and why do we use logistic regression?
Logistic Regression APKC – STATS AFAC (2016).
Basic Estimation Techniques
THE LOGIT AND PROBIT MODELS
Limited Dependent Variable Models and Sample Selection Corrections
Introduction to logistic regression a.k.a. Varbrul
Basic Estimation Techniques
THE LOGIT AND PROBIT MODELS
LIMITED DEPENDENT VARIABLE REGRESSION MODELS
Introduction to Logistic Regression
BIVARIATE ANALYSIS: Measures of Association Between Two Variables
Modeling with Dichotomous Dependent Variables
BIVARIATE ANALYSIS: Measures of Association Between Two Variables
MPHIL AdvancedEconometrics
Limited Dependent Variables
Presentation transcript:

Limited Dependent Variables Often there are occasions where we are interested in explaining a dependent variable that has only limited measurement Frequently it is even dichotomous.

Examples War(1) vs. no War(0) Vote vs. no vote Regime change vs. no change

These are often Probability Models E.g. Power disparity leads to war: Where Yt is the occurrence (or not) of war, and Xt is a measure of power disparity We call this a Linear Probability Model

Problems with LPM Regression OLS in this case is called the Linear Probability Model Running regression produces some problems Errors are not distributed normally Errors are heteroskedastic Predicted Ys can be outside the 0.0-1. bounds required for probability

Logistic Model We need a model that produces true probabilities The Logit, or cumulative logistic distribution offers one approach. This produces a sigmoid curve. Look at equation under 2 conditions: Xi = +∞ Xi = -∞

Sigmoid curve

Probability Ratio Note that Where

Log Odds Ratio The logit is the log of the odds ratio, and is given by: This model gives us a coefficient that may be interpreted as a change in the weighted odds of the dependent variable

Estimation of Model We estimate this with maximum likelihood The significance tests are z statistics We can generate a Pseudo R2 which is an attempt to measure the percent of variation of the underlying logit function explained by the independent variables We test the full model with the Likelihood Ratio test (LR), which has a χ2 distribution with k degrees of freedom

Neural Networks The alternate formulation is representative of a single-layer perceptron in an artificial neural network.

Probit If we can assume that the dependent variable is actually the result of an underlying (and immeasurable) propensity or utility, we can use the cumulative normal probability function to estimate a Probit model Also, more appropriate if the categories (or their propensities) are likely to be normally distributed It looks just like a logit model in practice

The Cumulative Normal Density Function The normal distribution is given by: The Cumulative Normal Density Function is:

The Standard Normal CDF We assume that there is an underlying threshold value (Ii) that if the case exceeds will be a 1, and 0 otherwise. We can standardize and estimate this as

Probit estimates Again, maximum likelihood estimation Again, a Pseudo R2 Again, a LR ratio with k degrees of freedom

Assumptions of Models All Y’s are in {0,1} set They are statistically independent No multicollinearity The P(Yi=1) is normal density for probit, and logistic function for logit

Ordered Probit If the dependent variable can take on ordinal levels, we can extend the dichotomous Probit model to an n-chotomous, or ordered, Probit model It simply has several threshold values estimated Ordered logit works much the same way

Multinomial Logit If our dependent variable takes on different values, but they are nominal, this is a multinomial logit model

Some additional info The Modal category is good benchmark Present % correctly predicted This can be calculated and presented. This, when compared to the modal category, gives us a good indication of fit.

Stata Use Leadership Change data (1992 cross section) 1992-Stata

Test different models Dependent variable Leadership change Examine distribution tables ledchan1 Independent variables Try different Try corr and then (pwcorr)

Try the following regress ledchan1 grwthgdp hlthexp illit_f polity2 logit ledchan1 grwthgdp hlthexp illit_f polity2 logistic ledchan1 grwthgdp hlthexp illit_f polity2 probit ledchan1 grwthgdp hlthexp illit_f polity2 ologit ledchan1 grwthgdp hlthexp illit_f polity2 oprobit ledchan1 grwthgdp hlthexp illit_f polity2 mlogit ledchan1 grwthgdp hlthexp illit_f polity2 tobit ledchan1 grwthgdp hlthexp illit_f polity2, ul ll

Tobit Assumes a 0 value, and then a scale E.g., the decision to incarcerate 0 or 1 (Imprison or not) If Imprison, than for how many years?

Other models This leads to many other models Count models & Poisson regression Duration/Survival/hazard models Censoring and truncation models Selection bias models