L OGISTIC R EGRESSION Now with multinomial support!

Slides:

Advertisements

Similar presentations

Dummy Dependent variable Models

Advertisements

Qualitative and Limited Dependent Variable Models Chapter 18.

Continued Psy 524 Ainsworth

Statistical Analysis SC504/HS927 Spring Term 2008

Sociology 680 Multivariate Analysis Logistic Regression.

Linear Regression.

Brief introduction on Logistic Regression

Logistic Regression Psy 524 Ainsworth.

Binary Logistic Regression: One Dichotomous Independent Variable

Chapter 8 – Logistic Regression

Logit & Probit Regression

Limited Dependent Variables

Nguyen Ngoc Anh Nguyen Ha Trang

1Prof. Dr. Rainer Stachuletz Limited Dependent Variables P(y = 1|x) = G(  0 + x  ) y* =  0 + x  + u, y = max(0,y*)

Regression with a Binary Dependent Variable

Binary Response Lecture 22 Lecture 22.

In previous lecture, we highlighted 3 shortcomings of the LPM. The most serious one is the unboundedness problem, i.e., the LPM may make the nonsense predictions.

QUALITATIVE AND LIMITED DEPENDENT VARIABLE MODELS.

SLIDE 1IS 240 – Spring 2010 Logistic Regression The logistic function: The logistic function is useful because it can take as an input any.

Introduction to Logistic Regression. Simple linear regression Table 1 Age and systolic blood pressure (SBP) among 33 adult women.

FIN357 Li1 Binary Dependent Variables Chapter 12 P(y = 1|x) = G(  0 + x  )

An Introduction to Logistic Regression JohnWhitehead Department of Economics Appalachian State University.

In previous lecture, we dealt with the unboundedness problem of LPM using the logit model. In this lecture, we will consider another alternative, i.e.

Lecture 14-2 Multinomial logit (Maddala Ch 12.2)

Generalized Linear Models

Lecture 14-1 (Wooldridge Ch 17) Linear probability, Probit, and

1 G Lect 11W Logistic Regression Review Maximum Likelihood Estimates Probit Regression and Example Model Fit G Multiple Regression Week 11.

1 BINARY CHOICE MODELS: PROBIT ANALYSIS In the case of probit analysis, the sigmoid function is the cumulative standardized normal distribution.

9-1 MGMG 522 : Session #9 Binary Regression (Ch. 13)

AN INTRODUCTION TO LOGISTIC REGRESSION ENI SUMARMININGSIH, SSI, MM PROGRAM STUDI STATISTIKA JURUSAN MATEMATIKA UNIVERSITAS BRAWIJAYA.

Logistic (regression) single and multiple. Overview  Defined: A model for predicting one variable from other variable(s).  Variables:IV(s) is continuous/categorical,

By Sharath Kumar Aitha. Instructor: Dr. Dongchul Kim.

When and why to use Logistic Regression?  The response variable has to be binary or ordinal.  Predictors can be continuous, discrete, or combinations.

Linear vs. Logistic Regression Log has a slightly better ability to represent the data Dichotomous Prefer Don’t Prefer Linear vs. Logistic Regression.

Copyright © 2014 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.

Lecture Slide #1 Logistic Regression Analysis Estimation and Interpretation Hypothesis Tests Interpretation Reversing Logits: Probabilities –Averages.

Week 5: Logistic regression analysis Overview Questions from last week What is logistic regression analysis? The mathematical model Interpreting the β.

Forecasting Choices. Types of Variable Variable Quantitative Qualitative Continuous Discrete (counting) Ordinal Nominal.

Assessing Binary Outcomes: Logistic Regression Peter T. Donnan Professor of Epidemiology and Biostatistics Statistics for Health Research.

Logistic Regression. Linear Regression Purchases vs. Income.

Multiple Logistic Regression STAT E-150 Statistical Methods.

LOGISTIC REGRESSION Binary dependent variable (pass-fail) Odds ratio: p/(1-p) eg. 1/9 means 1 time in 10 pass, 9 times fail Log-odds ratio: y = ln[p/(1-p)]

Logistic Regression Analysis Gerrit Rooks

Qualitative and Limited Dependent Variable Models ECON 6002 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s notes.

Dates Presentations Wed / Fri Ex. 4, logistic regression, Monday Dec 7 th Final Tues. Dec 8 th, 3:30.

Logistic Regression Saed Sayad 1www.ismartsoft.com.

Logistic Regression Hal Whitehead BIOL4062/5062.

Roger B. Hammer Assistant Professor Department of Sociology Oregon State University Conducting Social Research Logistic Regression Categorical Data Analysis.

Logistic Regression and Odds Ratios Psych DeShon.

Week 7: General linear models Overview Questions from last week What are general linear models? Discussion of the 3 articles.

The Probit Model Alexander Spermann University of Freiburg SS 2008.

Quantitative Research Methods for Social Sciences Spring 2012 Module 2: Lecture 7 Introduction to Generalized Linear Models, Logistic Regression and Poisson.

Logit Models Alexander Spermann, University of Freiburg, SS Logit Models.

Instructor: R. Makoto 1richard makoto UZ Econ313 Lecture notes.

LOGISTIC REGRESSION. Purpose  Logistical regression is regularly used when there are only two categories of the dependent variable and there is a mixture.

The Probit Model Alexander Spermann University of Freiburg SoSe 2009

Logistic Regression When and why do we use logistic regression?

EHS Lecture 14: Linear and logistic regression, task-based assessment

Advanced Quantitative Techniques

Limited Dependent Models

Logistic Regression.

M.Sc. in Economics Econometrics Module I

LOGISTIC REGRESSION 1.

Drop-in Sessions! When: Hillary Term - Week 1 Where: Q-Step Lab (TBC) Sign up with Alice Evans.

Generalized Linear Models

Introduction to logistic regression a.k.a. Varbrul

THE LOGIT AND PROBIT MODELS

Introduction to Logistic Regression

Modeling with Dichotomous Dependent Variables

MPHIL AdvancedEconometrics

Presentation transcript:

L OGISTIC R EGRESSION Now with multinomial support!

A N I NTRODUCTION Logistic regression is a method for analyzing relative probabilities between discrete outcomes (binary or categorical dependent variables) Binary outcome: standard logistic regression ie. Dead (1) or NonDead (0) Categorical outcome: multinomial logistic regression ie. Zombie (1) or Vampire (2) or Mummy (3) or Rasputin (4)

H OW I T A LL W ORKS The logistic equation is written as a function of z, where z is a measure of the total contribution of each variable x used to predict the outcome Coefficients determined by maximum likelihood estimation (MLE), so larger sample sizes are needed than for OLS

G RAPH OF THE L OGISTIC F UNCTION

C OEFFICIENT I NTERPRETATION Standard coefficients (untransformed) report the change in the log odds of one outcome relative to another for a one-unit increase of the independent variable (positive, negative) Exponentiating the coefficients reports the change in the odds-ratio (greater than, less than one) By evaluating all other values at particular levels (ie. their means) it is possible to obtain predicted probability estimates

SPSS Standard Logistic Regression: logistic regression [dep. var] with [ind. vars] Multinomial Logistic Regression: nomreg [dep. var] with [ind. vars]

STATA Standard Logistic Regression: logit [dep. var] [ind. vars] Multinomial Logistic Regression: mlogit [dep. var] [ind. vars] Odds-Ratio Coefficients [regression], or Predicted Probability Estimates (new to Stata 11) margins [ind. var to analyze], at[value of other ind. vars]

O THER M ETHODS ? Probit Very similar to logit Easier to interpret coefficients (predicted probabilities) Probabilities aren’t bounded between 0 and 1

E XAMPLES Stata: use logit admit gre gpa i.rank logit, or odds-ratio (instead of log odds-ratio) interpretation of the coefficients margins rank, atmeans predicted probability of rank with gre and gpa at their means margins, at(gre=(200(100)800)) start with gre=200, increase by steps of 100, end at 800

E XAMPLES SPSS Download binary.sav from After opening the file: logistic regression admit with gre gpa rank /categorical = rank.