Chapter 13 Logistic regression.

Slides:



Advertisements
Similar presentations
Objectives 10.1 Simple linear regression
Advertisements

April 25 Exam April 27 (bring calculator with exp) Cox-Regression
Basic Statistical Concepts Donald E. Mercante, Ph.D. Biostatistics School of Public Health L S U - H S C.
Marshall University School of Medicine Department of Biochemistry and Microbiology BMS 617 Lecture 12: Multiple and Logistic Regression Marshall University.
Fundamentals of Hypothesis Testing: One-Sample Tests
CHP400: Community Health Program - lI Research Methodology. Data analysis Hypothesis testing Statistical Inference test t-test and 22 Test of Significance.
1 Tests with two+ groups We have examined tests of means for a single group, and for a difference if we have a matched sample (as in husbands and wives)
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Inference on the Least-Squares Regression Model and Multiple Regression 14.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
April 4 Logistic Regression –Lee Chapter 9 –Cody and Smith 9:F.
Chapter Seventeen. Figure 17.1 Relationship of Hypothesis Testing Related to Differences to the Previous Chapter and the Marketing Research Process Focus.
1 Say good things, think good thoughts, and do good deeds.
Introduction to Multiple Regression Lecture 11. The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & 2 or more.
Marshall University School of Medicine Department of Biochemistry and Microbiology BMS 617 Lecture 13: Multiple, Logistic and Proportional Hazards Regression.
Other tests of significance. Independent variables: continuous Dependent variable: continuous Correlation: Relationship between variables Regression:
Methods of Presenting and Interpreting Information Class 9.
Hypothesis Testing.
Lecture Slides Elementary Statistics Twelfth Edition
HYPOTHESIS TESTING.
CHAPTER 12 More About Regression
Lecture #25 Tuesday, November 15, 2016 Textbook: 14.1 and 14.3
Statistics for Managers Using Microsoft® Excel 5th Edition
Correlation and Linear Regression
EMPA P MGT 630.
Chapter 9 Hypothesis Testing.
Chapter 14 Inference on the Least-Squares Regression Model and Multiple Regression.
Chapter 12 Analysis of count data.
Logistic Regression APKC – STATS AFAC (2016).
Inference for Regression (Chapter 14) A.P. Stats Review Topic #3
April 18 Intro to survival analysis Le 11.1 – 11.2
Chapter 8 Linear normal models.
Binary Logistic Regression
Statistics Sweden September 2004 Dan Hedlin
Review and Preview and Basics of Hypothesis Testing
Warm Up Check your understanding P. 586 (You have 5 minutes to complete) I WILL be collecting these.
Chapters 20, 21 Hypothesis Testing-- Determining if a Result is Different from Expected.
Hypothesis Testing Review
Chapter 8 Linear normal models.
LOGISTIC REGRESSION 1.
CHAPTER 12 More About Regression
Statistical inference: distribution, hypothesis testing
Chapter 25 Comparing Counts.
Chapter 8: Inference for Proportions
CRITICAL NUMBERS Bivariate Data: When two variables meet
AP Stats Check In Where we’ve been…
Chapter 11 Goodness-of-Fit and Contingency Tables
Analysis of count data 1.
Problems: Q&A chapter 6, problems Chapter 6:
Multiple Regression BPS 7e Chapter 29 © 2015 W. H. Freeman and Company.
Hypothesis Testing.
Mathematical Foundations of BME Reza Shadmehr
Logistic Regression.
STAT 312 Introduction Z-Tests and Confidence Intervals for a
Introduction to Logistic Regression
Tutorial 4 For the Seat Belt Data, the Death Penalty Data, and the University Admission Data, (1). Identify the response variable and the explanatory.
Hypothesis Testing.
Virtual University of Pakistan
Paired Samples and Blocks
Statistics Sweden September 2004 Dan Hedlin
CHAPTER 12 Inference for Proportions
Chapter 26 Comparing Counts.
Product moment correlation
CHAPTER 12 Inference for Proportions
Chapter 7: Statistical Issues in Research planning and Evaluation
Intro to Confidence Intervals Introduction to Inference
CHAPTER 12 More About Regression
Chapter 26 Comparing Counts Copyright © 2009 Pearson Education, Inc.
What’s the plan? First, we are going to look at the correlation between two variables: studying for calculus and the final percentage grade a student gets.
Chapter 26 Comparing Counts.
Presentation transcript:

Chapter 13 Logistic regression

Odds The odds of an event A are calculated as the probability of observing event A divided by the probability of not observing event. For example, in humans an average of 51 boys are born in every 100 births, so the odds of a randomly chosen delivery being a boy are: If the probability of an event is 0.5, then the odds of that event is one. If the odds of an event are greater than one, then the event is more likely to happen than not (the odds of an event that is certain to happen is infinite); if the odds are less than one, the event is less likely to happen.

Odds ratio The odds ratio is the ratio of two odds from different groups or conditions. If we let p1 denote the probability of some event in one group and p2 denote the probability in another group, then is the odds ratio of A. An odds ratio of 1 means that some event is equally likely in both groups. An odds ratio greater than one implies that the event is more likely in the first group, while an odds ratio less than one implies that the event is less likely in the first group relative to the second group. The odds ratio measures the effect size between two binary data values.

Example: Risk of Avadex The increasing risk of the fungicide Avadex on pulmonary cancer in mice was studied. Sixteen male mice were continuously fed small concentrations of Avadex (the treatment population), while 79 male mice were given the usual diet (the control population). After 85 weeks, all animals were examined for tumors, with the results shown below:

Example: Risk of Avadex The odds of tumors in the Avadex group and the odds in control group are respectively and Thus, the odds ratio is The odds of having tumors are 4.9 times as great for Avadex mice as for control mice.

Logistic regression model The logistic regression model is defined by We can formulate the logistic regression model in the same way as we defined the multiple regression model. The model can handle both quantitative and categorical explanatory variables. Unlike in linear models, we see that there is no error term. This is because the uncertainty of binary response of some event is determined directly by the probability of the event. All estimates are on the log odds scale.

Logit transformation

Logistic regression model We model the probability of success for observations, and that it is linear on the logit scale. This ensures that the probabilities pi are always between 0 and 1 regardless of the right-hand side of linear regression. It is possible to back-transform the results if we desire to present the results as actual probabilities: βj is the estimated additive effect on the log odds if variable xj is increased by one unit, whereas exp(βj) is the estimated change in odds.

Example: Lethality of insecticide In a study groups of 20 male and female moths were exposed to various doses of trans-cypermethrin in order to examine the lethality of the insecticide. After three days it was registered how many moths were dead or immobilized. Data are shown in the table below:

Example: Lethality of insecticide Here we will look only at male moths, and we would like to model the effect of dose on the proportion of moths that die. We use a logistic regression model, and state that logit of the probability of the i-th group that moth dies. We have two parameters in this model: α and β. The intercept α should be interpreted as log odds of a male moth dying if it is not exposed to the insecticide (ie, the dose is zero), and β is the increase in log odds of dying for every unit increase in dose.

Example: Lethality of insecticide We can calculate the probability of dying for each dose based on the estimated parameters. For dose 16, the probability of death is

Example: Lethality of insecticide We can also get the estimates and standard errors shown in the table below: Then we can compute the 95% confidence interval for α by Likewise, the 95% confidence interval for β is 0.29723 ±1.96 · 0.06254 = (0.1747, 0.4198).

Example: Lethality of insecticide We may test the hypotheses We reject the null hypothesis H0 and conclude that the log odds for moths that receive dose 0 are significantly different from zero. This means that the odds for moths that receive dose 0 are significantly different from 1. We also reject the null hypothesis H1 and conclude that there is a significant effect of the insecticide, and furthermore, that the proportion of dead moths increases with increasing dose.