THE LOGIT AND PROBIT MODELS

Slides:



Advertisements
Similar presentations
Dummy Dependent variable Models
Advertisements

Brief introduction on Logistic Regression
FIN822 Li11 Binary independent and dependent variables.
CHAPTER 8 MULTIPLE REGRESSION ANALYSIS: THE PROBLEM OF INFERENCE
Limited Dependent Variables
1 BINARY CHOICE MODELS: LOGIT ANALYSIS The linear probability model may make the nonsense predictions that an event will occur with probability greater.
1 BINARY CHOICE MODELS: PROBIT ANALYSIS In the case of probit analysis, the sigmoid function F(Z) giving the probability is the cumulative standardized.
Nguyen Ngoc Anh Nguyen Ha Trang
Models with Discrete Dependent Variables
1Prof. Dr. Rainer Stachuletz Limited Dependent Variables P(y = 1|x) = G(  0 + x  ) y* =  0 + x  + u, y = max(0,y*)
Binary Response Lecture 22 Lecture 22.
In previous lecture, we highlighted 3 shortcomings of the LPM. The most serious one is the unboundedness problem, i.e., the LPM may make the nonsense predictions.
QUALITATIVE AND LIMITED DEPENDENT VARIABLE MODELS.
Regression with a Binary Dependent Variable. Introduction What determines whether a teenager takes up smoking? What determines if a job applicant is successful.
FIN357 Li1 Binary Dependent Variables Chapter 12 P(y = 1|x) = G(  0 + x  )
So far, we have considered regression models with dummy variables of independent variables. In this lecture, we will study regression models whose dependent.
In previous lecture, we dealt with the unboundedness problem of LPM using the logit model. In this lecture, we will consider another alternative, i.e.
Lecture 14-2 Multinomial logit (Maddala Ch 12.2)
Generalized Linear Models
9. Binary Dependent Variables 9.1 Homogeneous models –Logit, probit models –Inference –Tax preparers 9.2 Random effects models 9.3 Fixed effects models.
1 Regression Models with Binary Response Regression: “Regression is a process in which we estimate one variable on the basis of one or more other variables.”
MODELS OF QUALITATIVE CHOICE by Bambang Juanda.  Models in which the dependent variable involves two ore more qualitative choices.  Valuable for the.
Lecture 14-1 (Wooldridge Ch 17) Linear probability, Probit, and
1 G Lect 11W Logistic Regression Review Maximum Likelihood Estimates Probit Regression and Example Model Fit G Multiple Regression Week 11.
1 BINARY CHOICE MODELS: PROBIT ANALYSIS In the case of probit analysis, the sigmoid function is the cumulative standardized normal distribution.
9-1 MGMG 522 : Session #9 Binary Regression (Ch. 13)
Limited Dependent Variables Ciaran S. Phibbs May 30, 2012.
Lecture 2 Review Probabilities Probability Distributions Normal probability distributions Sampling distributions and estimation.
Lecture 14 Summary of previous Lecture Regression through the origin Scale and measurement units.
Chapter 13: Limited Dependent Vars. Zongyi ZHANG College of Economics and Business Administration.
Limited Dependent Variables Ciaran S. Phibbs. Limited Dependent Variables 0-1, small number of options, small counts, etc. 0-1, small number of options,
Qualitative and Limited Dependent Variable Models ECON 6002 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s notes.
Introduction to Multiple Regression Lecture 11. The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & 2 or more.
04/19/2006Econ 6161 Econ 616 – Spring 2006 Qualitative Response Regression Models Presented by Yan Hu.
Economics 310 Lecture 22 Limited Dependent Variables.
Roger B. Hammer Assistant Professor Department of Sociology Oregon State University Conducting Social Research Logistic Regression Categorical Data Analysis.
1 BINARY CHOICE MODELS: LOGIT ANALYSIS The linear probability model may make the nonsense predictions that an event will occur with probability greater.
Linear Probability and Logit Models (Qualitative Response Regression Models) SA Quimbo September 2012.
The Probit Model Alexander Spermann University of Freiburg SS 2008.
Instructor: R. Makoto 1richard makoto UZ Econ313 Lecture notes.
Econometric analysis of CVM surveys. Estimation of WTP The information we have depends on the elicitation format. With the open- ended format it is relatively.
Probit Regression Psych DeShon.
The Probit Model Alexander Spermann University of Freiburg SoSe 2009
CHAPTER 12 MODELING COUNT DATA: THE POISSON AND NEGATIVE BINOMIAL REGRESSION MODELS Damodar Gujarati Econometrics by Example, second edition.
MULTINOMIAL REGRESSION MODELS
M.Sc. in Economics Econometrics Module I
QUALITATIVE AND LIMITED DEPENDENT VARIABLE MODELS
CHAPTER 10: Logistic Regression
REGRESSION DIAGNOSTIC II: HETEROSCEDASTICITY
THE LINEAR REGRESSION MODEL: AN OVERVIEW
Drop-in Sessions! When: Hillary Term - Week 1 Where: Q-Step Lab (TBC) Sign up with Alice Evans.
Financial Econometrics Lecture Notes 4
Multiple Regression Analysis
Generalized Linear Models
CHAPTER 18 SURVIVAL ANALYSIS Damodar Gujarati
Introduction to logistic regression a.k.a. Varbrul
ASSET PRICE VOLATILITY: THE ARCH AND GARCH MODELS
Jeffrey E. Korte, PhD BMTRY 747: Foundations of Epidemiology II
Introduction to microeconometrics
THE LOGIT AND PROBIT MODELS
REGRESSION DIAGNOSTIC I: MULTICOLLINEARITY
LIMITED DEPENDENT VARIABLE REGRESSION MODELS
Introduction to Logistic Regression
ORDINAL REGRESSION MODELS
Chapter 7: The Normality Assumption and Inference with OLS
MPHIL AdvancedEconometrics
9. Binary Dependent Variables
Introduction to Econometrics, 5th edition
Limited Dependent Variables
Presentation transcript:

THE LOGIT AND PROBIT MODELS Lecturing 08 THE LOGIT AND PROBIT MODELS Damodar Gujarati Econometrics by Example

QUALITATIVE RESPONSE REGRESSION MODELS Regression models involving nominal scale dependent variables are among a broader class of models known as qualitative response regression models. Here we will consider the simplest of such models, the binary or dichotomous or dummy dependent variable regression models. Damodar Gujarati Econometrics by Example

THE LINEAR PROBABILITY MODEL (LPM) Yi=B1 + B2Agei + B3Edui + B4Incomei + B5Pcigsi + ui (1) Which, for brevity of expression, we we write as: Yi= BX + ui (2) or Yi=E(Yi) + ui = P + ui E(Yi)=P=B1 + B2Xi Model (2) is called a linear probability model (LPM) because the conditional expectation f the dependent variable (Smoking status), given the values of the explanatory variables, can be interpreted as the conditional probability that event (i.e smoking) will occur Damodar Gujarati Econometrics by Example

THE LINEAR PROBABILITY MODEL (LPM) Damodar Gujarati Econometrics by Example

PROBLEMS WITH LINEAR PROBABILITY MODEL The linear probability model (LPM) uses the OLS method to determine the probability of an outcome. Problems: 1. The LPM assumes that the probability of the outcome moves linearly with the value of the explanatory variable, no matter how small or large that value is. 2. The probability value must lie between 0 and 1, yet there is no guarantee that the estimated probability values from the LPM will lie within these limits. 3. The usual assumption that the error term is normally distributed cannot hold when the dependent variable takes only values of 0 and 1, since it follows the binomial distribution. 4. The error term in the LPM is heteroscedastic, making the traditional significance tests suspect. Damodar Gujarati Econometrics by Example

THE LOGIT MODEL If the outcome decision depends on an unobservable utility index, then this index can be expressed as: If a person’s utility index I exceeds the threshold level I*, the dichotomous outcome Y=1, and if not, then Y=0: Yi = 1 if Yi = 0 if Therefore: Damodar Gujarati Econometrics by Example

THE LOGIT MODEL (CONT.) If the probability is symmetric around zero, then: Therefore: ui is assumed to follow a cumulative probability distribution, where the probability that Y=1 is given as: where + ui P(Y=0) is given as: Cumulative probability distribution describes the probability that a real-valued random variable X with a given probability distribution will be found to have a value less than or equal to x. Damodar Gujarati Econometrics by Example

THE LOGIT MODEL (CONT.) The ratio of the two probabilities is the odds ratio in favor of the outcome: The log of the odds ratio (logit) is given as: + ui Damodar Gujarati Econometrics by Example

CHARACTERISTICS OF LOGIT MODEL 1. As Pi goes from 0 to 1, Li goes from -∞ to ∞. 2. Although Li is linear in Xi, the probabilities themselves are not. 3. If Li is positive, when the value of the explanatory variable(s) increases, the odds of the outcome increase. If it negative, the odds of the outcome decrease. 4. The interpretation of the logit model is as follows: Each slope coefficient shows how the log of the odds in favor of the outcome changes as the value of the X variable changes by a unit. 5. Once the coefficients of the logit model are estimated, we can easily compute the probabilities of the outcome. 6. In the LPM the slope coefficient measures the marginal effect of a unit change in the explanatory variable on the probability of the outcome, holding other variables constant. In the logit model, the marginal effect of a unit change in the explanatory variable not only depends on the coefficient of that variable but also on the level of probability from which the change is measured. The latter depends on the values of all the explanatory variables in the model. Odds - probability the odds how likely it is that something will or will not happen Damodar Gujarati Econometrics by Example

THE PROBIT MODEL In the probit model, the error term follows a normal distribution. Given the assumption of normality, the probability that is less than or equal to Ii can be computed from the standard normal cumulative distribution function (CDF) as: F, the standard normal CDF, can be written as: If we multiply the probit coefficient by about 1.81 ( ), we will get approximately the logit coefficient. The marginal effect is given by the coefficient of the variable multiplied by the value of the normal density function evaluated for all the X values for that individual. Damodar Gujarati Econometrics by Example

LOGIT vs. PROBIT Logit and probit models generally give similar results The main difference between the two models is that the logistic distribution has slightly fatter tails. The conditional probability Pi approaches 0 or 1 at a slower rate in logit than in probit. In practice there is no compelling reason to choose one over the other. Many researchers choose the logit over the probit because of its comparative mathematical simplicity. Damodar Gujarati Econometrics by Example