Part V The Generalized Linear Model Chapter 16 Introduction.

Slides:



Advertisements
Similar presentations
Assumptions underlying regression analysis
Advertisements

1 1 Chapter 5: Multiple Regression 5.1 Fitting a Multiple Regression Model 5.2 Fitting a Multiple Regression Model with Interactions 5.3 Generating and.
Tests of Significance for Regression & Correlation b* will equal the population parameter of the slope rather thanbecause beta has another meaning with.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Chap 9: Testing Hypotheses & Assessing Goodness of Fit Section 9.1: INTRODUCTION In section 8.2, we fitted a Poisson dist’n to counts. This chapter will.
Chap 8: Estimation of parameters & Fitting of Probability Distributions Section 6.1: INTRODUCTION Unknown parameter(s) values must be estimated before.
Count Data Harry R. Erwin, PhD School of Computing and Technology University of Sunderland.
458 Fitting models to data – II (The Basics of Maximum Likelihood Estimation) Fish 458, Lecture 9.
Stat 112 – Notes 3 Homework 1 is due at the beginning of class next Thursday.
Final Review Session.
PSY 1950 General Linear Model November 12, The General Linear Model Or, What the Hell ’ s Going on During Estimation?
Log-linear and logistic models Generalised linear model ANOVA revisited Log-linear model: Poisson distribution logistic model: Binomial distribution Deviances.
Chapter 5. Operations on Multiple R. V.'s 1 Chapter 5. Operations on Multiple Random Variables 0. Introduction 1. Expected Value of a Function of Random.
Assumption and Data Transformation. Assumption of Anova The error terms are randomly, independently, and normally distributed The error terms are randomly,
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Regression Model Building Setting: Possibly a large set of predictor variables (including interactions). Goal: Fit a parsimonious model that explains variation.
Severity Distributions for GLMs: Gamma or Lognormal? Presented by Luyang Fu, Grange Mutual Richard Moncher, Bristol West 2004 CAS Spring Meeting Colorado.
Generalized Linear Models
Basic Analysis of Variance and the General Linear Model Psy 420 Andrew Ainsworth.
Statistical hypothesis testing – Inferential statistics II. Testing for associations.
Review of Lecture Two Linear Regression Normal Equation
General Linear Model & Classical Inference Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM M/EEGCourse London, May.
Chapter 12 Correlation and Regression Part III: Additional Hypothesis Tests Renee R. Ha, Ph.D. James C. Ha, Ph.D Integrative Statistics for the Social.
A Primer on the Exponential Family of Distributions David Clark & Charles Thayer American Re-Insurance GLM Call Paper
Selecting the Correct Statistical Test
Inference for regression - Simple linear regression
Overview of Meta-Analytic Data Analysis
Overall agenda Part 1 and 2  Part 1: Basic statistical concepts and descriptive statistics summarizing and visualising data describing data -measures.
Things that I think are important Chapter 1 Bar graphs, histograms Outliers Mean, median, mode, quartiles of data Variance and standard deviation of.
Copyright © Cengage Learning. All rights reserved. 13 Linear Correlation and Regression Analysis.
Chapter 26: Comparing Counts AP Statistics. Comparing Counts In this chapter, we will be performing hypothesis tests on categorical data In previous chapters,
Lecture 6 Generalized Linear Models Olivier MISSA, Advanced Research Skills.
 Combines linear regression and ANOVA  Can be used to compare g treatments, after controlling for quantitative factor believed to be related to response.
Today: Quizz 8 Friday: GLM review Monday: Exam 2.
Part IV The General Linear Model. Multiple Explanatory Variables Chapter 13.3 Fixed *Random Effects Paired t-test.
Chapter 3: Generalized Linear Models 3.1 The Generalization 3.2 Logistic Regression Revisited 3.3 Poisson Regression 1.
Generalized Minimum Bias Models
Lecture 3: Inference in Simple Linear Regression BMTRY 701 Biostatistical Methods II.
ALISON BOWLING THE GENERAL LINEAR MODEL. ALTERNATIVE EXPRESSION OF THE MODEL.
General Linear Model & Classical Inference London, SPM-M/EEG course May 2014 C. Phillips, Cyclotron Research Centre, ULg, Belgium
Today: Lab 9ab due after lecture: CEQ Monday: Quizz 11: review Wednesday: Guest lecture – Multivariate Analysis Friday: last lecture: review – Bring questions.
Introduction to Statistics Harry R. Erwin, PhD School of Computing and Technology University of Sunderland.
General Linear Models; Generalized Linear Models Hal Whitehead BIOL4062/5062.
Lecture 8 Simple Linear Regression (cont.). Section Objectives: Statistical model for linear regression Data for simple linear regression Estimation.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Chapter 23 Inference for One- Sample Means. Steps for doing a confidence interval: 1)State the parameter 2)Conditions 1) The sample should be chosen randomly.
1 GLM I: Introduction to Generalized Linear Models By Curtis Gary Dean Distinguished Professor of Actuarial Science Ball State University By Curtis Gary.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 13 Multiple Regression Section 13.3 Using Multiple Regression to Make Inferences.
Multiple Regression BPS chapter 28 © 2006 W.H. Freeman and Company.
Chapter 17.5 Poisson ANCOVA. Classic Poisson Example Number of deaths by horse kick, for each of 16 corps in the Prussian army, from 1875 to 1894 The.
I271B The t distribution and the independent sample t-test.
B AD 6243: Applied Univariate Statistics Data Distributions and Sampling Professor Laku Chidambaram Price College of Business University of Oklahoma.
11 Chapter 5 The Research Process – Hypothesis Development – (Stage 4 in Research Process) © 2009 John Wiley & Sons Ltd.
Soc 3306a Lecture 7: Inference and Hypothesis Testing T-tests and ANOVA.
Statistics……revisited
Instructor: Dr. Amery Wu
Chapter 17.1 Poisson Regression Classic Poisson Example Number of deaths by horse kick, for each of 16 corps in the Prussian army, from 1875 to 1894.
© 2013 Pearson Education, Inc. Active Learning Lecture Slides For use with Classroom Response Systems Introductory Statistics: Exploring the World through.
Remembering way back: Generalized Linear Models Ordinary linear regression What if we want to model a response that is not Gaussian?? We may have experiments.
Beginning Statistics Table of Contents HAWKES LEARNING SYSTEMS math courseware specialists Copyright © 2008 by Hawkes Learning Systems/Quant Systems, Inc.
Dependent Variable Discrete  2 values – binomial  3 or more discrete values – multinomial  Skewed – e.g. Poisson Continuous  Non-normal.
Variance Stabilizing Transformations. Variance is Related to Mean Usual Assumption in ANOVA and Regression is that the variance of each observation is.
The general linear model and Statistical Parametric Mapping I: Introduction to the GLM Alexa Morcom and Stefan Kiebel, Rik Henson, Andrew Holmes & J-B.
Objectives (BPS chapter 12) General rules of probability 1. Independence : Two events A and B are independent if the probability that one event occurs.
Approaches to quantitative data analysis Lara Traeger, PhD Methods in Supportive Oncology Research.
B&A ; and REGRESSION - ANCOVA B&A ; and
Correct statistics in ecological research
UNIT-3. Random Process – Temporal Characteristics
A protocol for data exploration to avoid common statistical problems
Generalized Additive Model
Presentation transcript:

Part V The Generalized Linear Model Chapter 16 Introduction

t-test ANOVA Simple Linear Regression Multiple Linear Regression ANCOVA GENERAL LINEAR MODELS ε ~ Normal R: lm()

t-test ANOVA Simple Linear Regression Multiple Linear Regression ANCOVA Poisson Binomial Negative Binomial Gamma Multinomial GENERALIZED LINEAR MODELS Inverse Gaussian Exponential GENERAL LINEAR MODELS ε ~ Normal Linear combination of parameters R: lm() R: glm()

Generalized Linear Model (GzLM) Introduction Assumptions of GLM not always met using biological data

Generalized Linear Model (GzLM) Introduction

Assumptions of GLM not always met using biological data – Transformations typically recommended – We can randomize… Assumes parameter estimates (means, slopes, etc.) are correct – But a few large counts or many zeros will influence skew our estimates

Generalized Linear Model (GzLM) Introduction

Assumptions of GLM not always met using biological data – Transformations typically recommended – We can randomize… Assumes parameter estimates (means, slopes, etc.) are correct – But a few large counts or many zeros will influence skew our estimates – Best to use an appropriate error structure under the Generalized Linear Model framework

Generalized Linear Model (GzLM) Introduction Poisson error structure

Generalized Linear Model (GzLM) Introduction Binomial error structure

Generalized Linear Model (GzLM) Advantages Assumptions more evident Decouples assumptions Improves quality Greater flexibility

Generalized Linear Model (GzLM) Advantages Assumptions more evident Decouples assumptions Improves quality Greater flexibility

Part V The Generalized Linear Model Chapter 16.1 Goodness of Fit

Goodness of Fit - The Chi-square statistic Have to learn a new concept to apply GzLM: – Goodness of Fit Chi-square statistic G-statistic

Classic Chi-square Statistic Example Gregor Mendel’s Peas Purple: White:

χ 2 = df = 1 p = Classic Chi-square Statistic Example Gregor Mendel’s Peas

χ 2 = df = 1 p = Classic Chi-square Statistic Example Gregor Mendel’s Peas Deviation from genetic model (3:1) not significant

Goodness of Fit - The G-statistic Can deal with complex models Based in likelihood

Goodness of Fit - The G-statistic Smaller deviation  smaller G-statistic G-statistic   p-value = 0.53

Improvement in Fit - ΔG Next time we will… – Compare G values (ΔG) to assess improvement in fit of one model over another