ALISON BOWLING THE GENERAL LINEAR MODEL. ALTERNATIVE EXPRESSION OF THE MODEL.

Slides:



Advertisements
Similar presentations
Sociology 680 Multivariate Analysis Logistic Regression.
Advertisements

Logistic Regression Psy 524 Ainsworth.
Logistic Regression.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Logistic Regression Multivariate Analysis. What is a log and an exponent? Log is the power to which a base of 10 must be raised to produce a given number.
Some Terms Y =  o +  1 X Regression of Y on X Regress Y on X X called independent variable or predictor variable or covariate or factor Which factors.
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
Lecture 19: Tues., Nov. 11th R-squared (8.6.1) Review
PSY 1950 General Linear Model November 12, The General Linear Model Or, What the Hell ’ s Going on During Estimation?
An Introduction to Logistic Regression
Multiple Regression Dr. Andy Field.
Generalized Linear Models
Statistical hypothesis testing – Inferential statistics II. Testing for associations.
Simple Linear Regression
7.1 - Motivation Motivation Correlation / Simple Linear Regression Correlation / Simple Linear Regression Extensions of Simple.
Biostatistics Case Studies 2015 Youngju Pak, PhD. Biostatistician Session 4: Regression Models and Multivariate Analyses.
Chapter 12 Examining Relationships in Quantitative Research Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Analysis of Covariance, ANCOVA (GLM2)
Linear Regression 1 Oct 2010 CPSY501 Dr. Sean Ho Trinity Western University Please download from “Example Datasets”: Record2.sav ExamAnxiety.sav.
Soc 3306a Lecture 9: Multivariate 2 More on Multiple Regression: Building a Model and Interpreting Coefficients.
Regression Analyses. Multiple IVs Single DV (continuous) Generalization of simple linear regression Y’ = b 0 + b 1 X 1 + b 2 X 2 + b 3 X 3...b k X k Where.
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Logistic (regression) single and multiple. Overview  Defined: A model for predicting one variable from other variable(s).  Variables:IV(s) is continuous/categorical,
Linear correlation and linear regression + summary of tests
Week 5: Logistic regression analysis Overview Questions from last week What is logistic regression analysis? The mathematical model Interpreting the β.
Forecasting Choices. Types of Variable Variable Quantitative Qualitative Continuous Discrete (counting) Ordinal Nominal.
Department of Cognitive Science Michael J. Kalsher Adv. Experimental Methods & Statistics PSYC 4310 / COGS 6310 Regression 1 PSYC 4310/6310 Advanced Experimental.
ANCOVA. What is Analysis of Covariance? When you think of Ancova, you should think of sequential regression, because really that’s all it is Covariate(s)
General Linear Model.
1 STA 617 – Chp10 Models for matched pairs Summary  Describing categorical random variable – chapter 1  Poisson for count data  Binomial for binary.
Multiple Regression  Similar to simple regression, but with more than one independent variable R 2 has same interpretation R 2 has same interpretation.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc.. Chap 14-1 Chapter 14 Introduction to Multiple Regression Basic Business Statistics 10 th Edition.
Introduction to Multiple Regression Lecture 11. The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & 2 or more.
ALISON BOWLING MAXIMUM LIKELIHOOD. GENERAL LINEAR MODEL.
Dependent Variable Discrete  2 values – binomial  3 or more discrete values – multinomial  Skewed – e.g. Poisson Continuous  Non-normal.
Multiple Regression Learning Objectives n Explain the Linear Multiple Regression Model n Interpret Linear Multiple Regression Computer Output n Test.
ALISON BOWLING MODERATION AND MEDIATION IN REGRESSION.
ANCOVA.
Jump to first page Inferring Sample Findings to the Population and Testing for Differences.
Venn diagram shows (R 2 ) the amount of variance in Y that is explained by X. Unexplained Variance in Y. (1-R 2 ) =.36, 36% R 2 =.64 (64%)
Roger B. Hammer Assistant Professor Department of Sociology Oregon State University Conducting Social Research Logistic Regression Categorical Data Analysis.
Logistic Regression and Odds Ratios Psych DeShon.
Nonparametric Statistics
Biostatistics Regression and Correlation Methods Class #10 April 4, 2000.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 18 Multivariate Statistics.
Week 7: General linear models Overview Questions from last week What are general linear models? Discussion of the 3 articles.
STATISTICAL TESTS USING SPSS Dimitrios Tselios/ Example tests “Discovering statistics using SPSS”, Andy Field.
Instructor: R. Makoto 1richard makoto UZ Econ313 Lecture notes.
LOGISTIC REGRESSION. Purpose  Logistical regression is regularly used when there are only two categories of the dependent variable and there is a mixture.
Nonparametric Statistics
BINARY LOGISTIC REGRESSION
Logistic Regression APKC – STATS AFAC (2016).
REGRESSION G&W p
CHAPTER 7 Linear Correlation & Regression Methods
B&A ; and REGRESSION - ANCOVA B&A ; and
Generalized Linear Models
Correlation, Regression & Nested Models
Analysis of Covariance, ANCOVA (GLM2)
Multiple Regression.
Linear Regression Prof. Andy Field.
Generalized Linear Models
Jeffrey E. Korte, PhD BMTRY 747: Foundations of Epidemiology II
Nonparametric Statistics
Soc 3306a: ANOVA and Regression Models
Soc 3306a Lecture 11: Multivariate 4
Introduction to Logistic Regression
Logistic Regression.
Presentation transcript:

ALISON BOWLING THE GENERAL LINEAR MODEL

ALTERNATIVE EXPRESSION OF THE MODEL

PREDICTORS (IVS) Continuous (covariates) E.g. age, weight, time Dichotomous E.g. male vs female, employed vs unemployed, control vs experiment, low dose vs placebo, high dose vs placebo Dichotomous variables are usually Dummy coded. Reference group = 0e.g. male Comparison group = 1 e.g. female

GLM APPROACH TO ANOVA GroupLowHigh Placebo00 Low Dose Viagra 10 High Dose Viagra 01

REGRESSION ANALYSIS

INTERPRETING THE COEFFICIENTS

GLM

ANOVA OUTPUT The GLM Univariate procedure runs a General Linear Model, with the IV automatically dummy coded so that the group with the highest code is treated as the reference category. The intercept is the mean of the High dose group The dose = 1 (placebo) coefficient is the difference between the mean of the high dose and placebo group, and is significant (p =.008) The dose = 2 (low) coefficient is the difference between the mean of the high and low doses (NS).

WHY IS THIS IMPORTANT? Enables us to build sophisticated models including both continuous and categorical predictors Enhances understanding covariance Necessary to build regression models in which the assumptions are violated.

BRIEF REVISION OF MULTIPLE REGRESSION Multiple regression with two or more continuous predictors When the predictors are correlated, the coefficients represent the effect each predictor in the model, taking into account the other predictors. i.e. the effect of a predictor after the correlation(s) with the other predictors are partialled out. Field (2013) album sales.sav DV: Album sales Predictors: Advertising budget, No of plays on radio, Attractiveness of the band.

BIVARIATE SCATTERPLOTS

CORRELATIONS

HIERARCHICAL REGRESSION Order of entry: 1.Advertising budget 2.Airplay 3.Attractiveness

COEFFICIENTS

MODEL

COGNITION AND ANTI-SACCADE DATA (PETER LINDSAY) DV: Percentage of anti-saccade errors Predictors: Visuospatial/constructional, Delayed memory. Predictors are correlated

HIERARCHICAL REGRESSION Delayed memory does not improve the prediction of errors, after controlling for visuospatial

CHECKING RESIDUALS FOR NORMALITY Residuals are skewed – DV is a proportion, and therefore likely to violate assumptions.

ANALYSIS OF COVARIANCE

HIERARCHICAL REGRESSION

ANCOVA The effect of Dose is the effect of Viagra, after controlling for the covariate.

ASSUMPTIONS AND DATA ISSUES Main assumption of the model Residuals ( not DV ) are normally distributed Data issues (relate to the data or mathematics) Mulitcollinearity Outliers Non-linearity Etc. If the DV is continuous, unbounded and measured on an interval or ratio scale, the assumptions are most likely met. Not otherwise.

WHAT TO DO WHEN THE ASSUMPTIONS ARE VIOLATED

COMMON LINK FUNCTIONS Logit (log odds) for proportions Logistic regression Poisson (log) for count data Negative binomial for count data.

GENERALISED LINEAR MODELS Parameter estimation Linear models use Ordinary Least Squares (OLS) to estimate parameters. This is done by minimising the sum of the squared residuals R 2 is the measure of goodness-of-fit of the model Generalised linear models use Maximum Likelihood as the method of estimation. Negative Log Likelihood (-2LL) is one of several measures of goodness of fit.

MORE SOPHISTICATED MODELS Mixed models These may be used as an alternative method of analysing repeated measures data. Includes random effects in the model Models the variance of the intercept and/or the slope Generalised Linear mixed models More sophisticated still Applies mixed model methodology to Generalised linear models. All of these use Maximum Likelihood.