General Linear Model General Linear Model Generalized Linear Model Generalized Linear Model Generalized Linear Mixed Model.

Slides:



Advertisements
Similar presentations
Properties of Least Squares Regression Coefficients
Advertisements

Forecasting Using the Simple Linear Regression Model and Correlation
Random effects as latent variables: SEM for repeated measures data Dr Patrick Sturgis University of Surrey.
10-3 Inferences.
Assumptions. “Essentially, all models are wrong, but some are useful” George E.P. Box Your model has to be wrong… … but that’s o.k. if it’s illuminating!
EPI 809/Spring Probability Distribution of Random Error.
Multilevel modeling in R Tom Dunn and Thom Baguley, Psychology, Nottingham Trent University
… or, as Uncle Ben would say
Statistical Tools for Evaluating the Behavior of Rival Forms: Logistic Regression, Tree & Forest, and Naive Discriminative Learning R. Harald Baayen University.
Simple Linear Regression
LECTURE 3 Introduction to Linear Regression and Correlation Analysis
Psychology 202b Advanced Psychological Statistics, II
Linear Regression.
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
PSY 1950 Fixed and Random Effects October 20, 2008.
Clustered or Multilevel Data
Lecture 16 – Thurs, Oct. 30 Inference for Regression (Sections ): –Hypothesis Tests and Confidence Intervals for Intercept and Slope –Confidence.
Pertemua 19 Regresi Linier
Correlation Coefficients Pearson’s Product Moment Correlation Coefficient  interval or ratio data only What about ordinal data?
Chapter 7 Forecasting with Simple Regression
Basic Analysis of Variance and the General Linear Model Psy 420 Andrew Ainsworth.
Multiple Linear Regression A method for analyzing the effects of several predictor variables concurrently. - Simultaneously - Stepwise Minimizing the squared.
Analysis of Clustered and Longitudinal Data
Introduction to Multilevel Modeling Using SPSS
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Chapter 11 Simple Regression
Hypothesis Testing in Linear Regression Analysis
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 25 Categorical Explanatory Variables.
BPS - 3rd Ed. Chapter 211 Inference for Regression.
Issues with Mixed Models. Model doesn’t converge… OR.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Ch4 Describing Relationships Between Variables. Section 4.1: Fitting a Line by Least Squares Often we want to fit a straight line to data. For example.
Introduction to Multilevel Modeling Stephen R. Porter Associate Professor Dept. of Educational Leadership and Policy Studies Iowa State University Lagomarcino.
Lecture 2 Forestry 3218 Lecture 2 Statistical Methods Avery and Burkhart, Chapter 2 Forest Mensuration II Avery and Burkhart, Chapter 2.
Regression. Types of Linear Regression Model Ordinary Least Square Model (OLS) –Minimize the residuals about the regression linear –Most commonly used.
Lecture 4 Introduction to Multiple Regression
Mixed Effects Models Rebecca Atkins and Rachel Smith March 30, 2015.
REGRESSION DIAGNOSTICS Fall 2013 Dec 12/13. WHY REGRESSION DIAGNOSTICS? The validity of a regression model is based on a set of assumptions. Violation.
ECON 338/ENVR 305 CLICKER QUESTIONS Statistics – Question Set #8 (from Chapter 10)
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
Introduction to Biostatistics and Bioinformatics Regression and Correlation.
Random effects structure for confirmatory analysis: Why it’s important to Christoph Scheepers University of Glasgow.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 18 Random Effects.
FIXED AND RANDOM EFFECTS IN HLM. Fixed effects produce constant impact on DV. Random effects produce variable impact on DV. F IXED VS RANDOM EFFECTS.
Review ~ Data & Displays Chapters 1-6 Key Terms: –Data : Categorical versus Quantitative –Frequency Table/Contingency Table/Marginal Distribution/Conditional.
Introduction to Multiple Regression Lecture 11. The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & 2 or more.
Statistics 3: mixed effect models Install R library lme4 to your computer: 1.R -> Packages -> Install packages 2.Choose mirror 3.Choose lme4 4.Open the.
Lecture 10 Introduction to Linear Regression and Correlation Analysis.
Introduction to Multilevel Analysis Presented by Vijay Pillai.
Multivariate Statistics Latent Growth Curve Modelling. Random effects as latent variables: SEM for repeated measures data Dr Patrick Sturgis University.
BPS - 5th Ed. Chapter 231 Inference for Regression.
WELCOME TO BIOSTATISTICS! WELCOME TO BIOSTATISTICS! Course content.
Regression and Correlation of Data Correlation: Correlation is a measure of the association between random variables, say X and Y. No assumption that one.
Bivariate Regression. Bivariate Regression analyzes the relationship between two variables. Bivariate Regression analyzes the relationship between two.
Linear Mixed Models in JMP Pro
Comparing Theory and Measurement
HLM with Educational Large-Scale Assessment Data: Restrictions on Inferences due to Limited Sample Sizes Sabine Meinck International Association.
Simple Linear Regression - Introduction
Multiple Regression A curvilinear relationship between one variable and the values of two or more other independent variables. Y = intercept + (slope1.
Sampling Distribution
Sampling Distribution
BASIC REGRESSION CONCEPTS
Basic Practice of Statistics - 3rd Edition Inference for Regression
Joe Brehm, Mariel Boldis, Steven Bristow, and Janyne Little
Simple Linear Regression
Fixed, Random and Mixed effects
Checking Assumptions Primary Assumptions Secondary Assumptions
An Introductory Tutorial
Nazmus Saquib, PhD Head of Research Sulaiman AlRajhi Colleges
Much of the meaning of terms depends on context.
Presentation transcript:

General Linear Model General Linear Model Generalized Linear Model Generalized Linear Model Generalized Linear Mixed Model

General Linear Model General Linear Model Generalized Linear Model Generalized Linear Model Generalized Linear Mixed Model

GLMM LMM LMEM HLM Generalized Linear Mixed Model Multilevel Model

Tagliamonte & Baayen (2012: 7 of preprint) Tagliamonte, S. A., & Baayen, R. H. (2012). Models, forests, and trees of York English: Was/were variation as a case study for statistical practice. Language Variation and Change, 24(02),

The Beauty of Mixed Models Account for clusters without averaging Different distributions (generalized LMM) Interpretation at the trial-level Everything in one model Excellent for individual differences studies (cf. Drager & Hay, 2012; Dan Mirman’s work) More Power!! (see e.g., Barr et al., 2013)

Problems of Mixed Models Issues surrounding p-values People misuse them … in a way that doesn’t improve Type I error rate (Schielzeth & Forstmeier, 2009; Barr et al., 2013) Sometimes take A LOT of time Some models don’t converge

response ~ intercept + slope * fixed effect + error The Linear Model structural part systematic part deterministic part probabilistic part stochastic part random part

response ~ intercept + slope * fixed effect + error structural part systematic part deterministic part probabilistic part stochastic part random part The Linear Mixed Effects Model

Important terminology - repeatable- non-repeatable - systematic influence- random influence - exhaust the population- sample the population - generally of interest- often not of interest - can be continuous- have to be categorical or categorical Fixed effectRandom effect “Fixed-effects factors are those in which the populations to which we wish to generalize are precisely the levels represented in our analysis.” assumed to be constant across experiments Structural Part Stochastic Part

Crawley (2013: 681)

Subjects as a fixed effect? NO… why:  not repeatable  not systematic  often, not of interest  small subset of population

Repetitions as a fixed effect? Yes… why:  repeatable  systematic [  often, not of interest]  “exhausts the population”

Rep 1 Rep 2 Rep 3 Item #1 Subject Common experimental data Item...

Germa n French English Spanish Italian Swedish Norwegian Finnish Hungarian Turkish Romanian

library(lme4) lmer(y ~ x + (1|subject), mydata) In R:

Random intercepts versus Random slopes

RT (ms) Subjects Random intercepts

Random slopes

Experiment time RT (ms) Random intercepts

Experiment time RT (ms) Random intercepts and slopes

Random intercept vs. slope models Random intercept model = the fixed effect is evaluated against an error term that captures subject- or item-specific variability in the response Random slope model = the fixed effect is evaluated against an error term that captures subject- or item-specific variability in how the fixed effect affects the response In R: (1|subject) In R: (1+pred|subject)

ndom-regression-coefficients-using.html

Random intercept examples Some people are fast responders, some people are slow responders (their “intercepts” for response time are different) Some people are very sensitive / accurate listeners, some are less sensitive (their “intercepts” for accuracy are different) Some people have high or low voices with respect to their gender (their “intercepts” for pitch are different)

Random slope examples Some people speed up during a long experiment, some slow down Some people become more accurate during a long experiment, some less Some people raise their pitch more for focus than others

An example RT ~

An example RT ~ Condition + (1|Subject)

An example RT ~ Condition + + (1+Condition|Subject)

An example RT ~ Condition + + (1+Condition|Subject) + (1|Item)

An example RT ~ Condition + + (1+Condition|Subject) + (1+Condition|Item)

An example RT ~ Condition + TrialOrder + + (1+Condition|Subject) + (1+Condition|Item)

An example RT ~ Condition + TrialOrder + + (1+Condition+ TrialOrder|Subject) + (1+Condition|Item)

Model specification for random effects (1|subject)random intercept (0+fixedeffect|subject)random slope (1+fixedeffect|subject)… with correlation term

Assumptions Absence of Collinearity Normality of Errors Homoskedasticity of Errors No influential data points Independence