STA 216 Generalized Linear Models Meets: 2:50-4:05 T/TH (Old Chem 025) Instructor: David Dunson 219A Old Chemistry, 684-8025 Teaching.

Slides:



Advertisements
Similar presentations
Handling attrition and non- response in longitudinal data Harvey Goldstein University of Bristol.
Advertisements

Missing data – issues and extensions For multilevel data we need to impute missing data for variables defined at higher levels We need to have a valid.
MCMC for Poisson response models
Generalised linear mixed models in WinBUGS
Non response and missing data in longitudinal surveys.
Latent normal models for missing data Harvey Goldstein Centre for Multilevel Modelling University of Bristol.
Log-linear and logistic models Generalised linear model ANOVA revisited Log-linear model: Poisson distribution logistic model: Binomial distribution Deviances.
Bayesian Estimation in MARK
Departments of Medicine and Biostatistics
1. Analyzing Non-Normal Data with Generalized Linear Models 2010 LISA Short Course Series Sai Wang, Dept. of Statistics.
Multivariate Methods Pattern Recognition and Hypothesis Testing.
Bayesian modeling for ordinal substrate size using EPA stream data Megan Dailey Higgs Jennifer Hoeting Brian Bledsoe* Department of Statistics, Colorado.
Machine Learning CMPT 726 Simon Fraser University CHAPTER 1: INTRODUCTION.
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Course outline and schedule Introduction Event Algebra (Sec )
Machine Learning CMPT 726 Simon Fraser University
Log-linear and logistic models
End of Chapter 8 Neil Weisenfeld March 28, 2005.
Collaborative Ordinal Regression Shipeng Yu Joint work with Kai Yu, Volker Tresp and Hans-Peter Kriegel University of Munich, Germany Siemens Corporate.
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Course outline and schedule Introduction (Sec )
Arizona State University DMML Kernel Methods – Gaussian Processes Presented by Shankar Bhargav.
Cumulative Geographic Residual Test Example: Taiwan Petrochemical Study Andrea Cook.
Space-time Modelling Using Differential Equations Alan E. Gelfand, ISDS, Duke University (with J. Duan and G. Puggioni)
Generalized Linear Models
April 6, 2010 Generalized Linear Models 2010 LISA Short Course Series Mark Seiss, Dept. of Statistics.
Introduction to Multilevel Modeling Using SPSS
Bayes Factor Based on Han and Carlin (2001, JASA).
Simple Linear Regression
General information CSE : Probabilistic Analysis of Computer Systems
The horseshoe estimator for sparse signals CARLOS M. CARVALHO NICHOLAS G. POLSON JAMES G. SCOTT Biometrika (2010) Presented by Eric Wang 10/14/2010.
Chapter 3: Generalized Linear Models 3.1 The Generalization 3.2 Logistic Regression Revisited 3.3 Poisson Regression 1.
Lecture 8: Generalized Linear Models for Longitudinal Data.
Modeling Correlated/Clustered Multinomial Data Justin Newcomer Department of Mathematics and Statistics University of Maryland, Baltimore County Probability.
Generalized Linear Models All the regression models treated so far have common structure. This structure can be split up into two parts: The random part:
Different Distributions David Purdie. Topics Application of GEE to: Binary outcomes: – logistic regression Events over time (rate): –Poisson regression.
Forecasting Choices. Types of Variable Variable Quantitative Qualitative Continuous Discrete (counting) Ordinal Nominal.
Generalized Linear Models (GLMs) & Categorical Data Analysis (CDA) in R Hong Tran, April 21, 2015.
Bayesian Multivariate Logistic Regression by Sean O’Brien and David Dunson (Biometrics, 2004 ) Presented by Lihan He ECE, Duke University May 16, 2008.
Statistical Decision Theory Bayes’ theorem: For discrete events For probability density functions.
Introduction to logistic regression and Generalized Linear Models July 14, 2011 Introduction to Statistical Measurement and Modeling Karen Bandeen-Roche,
1 STA 617 – Chp10 Models for matched pairs Summary  Describing categorical random variable – chapter 1  Poisson for count data  Binomial for binary.
Lecture 2: Statistical learning primer for biologists
by Ryan P. Adams, Iain Murray, and David J.C. MacKay (ICML 2009)
Qualitative and Limited Dependent Variable Models ECON 6002 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s notes.
Recitation4 for BigData Jay Gu Feb MapReduce.
Stochastic Loss Reserving with the Collective Risk Model Glenn Meyers ISO Innovative Analytics Casualty Loss Reserving Seminar September 18, 2008.
How does Biostatistics at Roche typically analyze longitudinal data
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
1 Fighting for fame, scrambling for fortune, where is the end? Great wealth and glorious honor, no more than a night dream. Lasting pleasure, worry-free.
STA 216 Generalized Linear Models Instructor: David Dunson 211 Old Chem, (NIEHS)
Anders Nielsen Technical University of Denmark, DTU-Aqua Mark Maunder Inter-American Tropical Tuna Commission An Introduction.
Week 7: General linear models Overview Questions from last week What are general linear models? Discussion of the 3 articles.
Institute of Statistics and Decision Sciences In Defense of a Dissertation Submitted for the Degree of Doctor of Philosophy 26 July 2005 Regression Model.
A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation Yee W. Teh, David Newman and Max Welling Published on NIPS 2006 Discussion.
Efficiency Measurement William Greene Stern School of Business New York University.
Introduction We consider the data of ~1800 phenotype measurements Each mouse has a given probability distribution of descending from one of 8 possible.
Bayesian Semi-Parametric Multiple Shrinkage
Bayesian data analysis
Generalized Linear Models
Role of a Statistical Editor in Addiction Journals
STA 216 Generalized Linear Models
Introduction to logistic regression a.k.a. Varbrul
How to handle missing data values
Quantitative Methods What lies beyond?.
STA 216 Generalized Linear Models
OVERVIEW OF BAYESIAN INFERENCE: PART 1
Where did we stop? The Bayes decision rule guarantees an optimal classification… … But it requires the knowledge of P(ci|x) (or p(x|ci) and P(ci)) We.
What is Regression Analysis?
Quantitative Methods What lies beyond?.
Do whatever is needed to finish…
Non response and missing data in longitudinal surveys
Presentation transcript:

STA 216 Generalized Linear Models Meets: 2:50-4:05 T/TH (Old Chem 025) Instructor: David Dunson 219A Old Chemistry, Teaching Assistant: Dawn Barnard 112 Old Chemistry,

STA 216 Syllabus  Topics to be covered: GLM Basics: components, exponential family, model fitting, frequent inference: analysis of deviance, stepwise selection, goodness of fit GLM Basics: components, exponential family, model fitting, frequent inference: analysis of deviance, stepwise selection, goodness of fit Bayesian Inference in GLMs (basics): priors, posterior, comparison with frequentist approach, posterior computation, MCMC strategies (Gibbs, Metropolis-Hastings) Bayesian Inference in GLMs (basics): priors, posterior, comparison with frequentist approach, posterior computation, MCMC strategies (Gibbs, Metropolis-Hastings) Binary & categorical response data: Binary & categorical response data: Basics: link functions, form of posterior, approximations, Gibbs sampling via adaptive rejectionBasics: link functions, form of posterior, approximations, Gibbs sampling via adaptive rejection Latent variable models: Threshold formulations, probit models, discrete choice models, logistic regression & generalizations, data augmentation algorithms (Albert & Chib + other forms)Latent variable models: Threshold formulations, probit models, discrete choice models, logistic regression & generalizations, data augmentation algorithms (Albert & Chib + other forms) Count Data : Poisson & over-dispersed Poisson log-linear models, prior distributions, applications Count Data : Poisson & over-dispersed Poisson log-linear models, prior distributions, applications

STA 216 Syllabus  Topics to be covered (continued): Bayesian Variable Selection : problem formulation, mixture priors, stochastic search algorithms, examples, approximations Bayesian Variable Selection : problem formulation, mixture priors, stochastic search algorithms, examples, approximations Bayesian hypothesis testing in GLMs : one- and two-sided alternatives, basic decision theoretic approaches, mixture priors, computation, order restricted inference Bayesian hypothesis testing in GLMs : one- and two-sided alternatives, basic decision theoretic approaches, mixture priors, computation, order restricted inference Survival analysis : censoring definitions, form of likelihood, parametric models, discrete-time & continuous time formulations, proportional hazards, priors for hazard functions, computation Survival analysis : censoring definitions, form of likelihood, parametric models, discrete-time & continuous time formulations, proportional hazards, priors for hazard functions, computation Missing data : problem formulation, selection & pattern mixture models, shared variable approaches, examples Missing data : problem formulation, selection & pattern mixture models, shared variable approaches, examples Multistate & stochastic modeling : motivating examples (epidemiologic studies with periodic observations of a disease process), discrete time approaches, joint models, computation Multistate & stochastic modeling : motivating examples (epidemiologic studies with periodic observations of a disease process), discrete time approaches, joint models, computation

STA 216 Syllabus  Topics to be covered (continued): Correlated data (basics) : mixed models for longitudinal, frequentist alternatives (marginal models, GEEs, etc) Correlated data (basics) : mixed models for longitudinal, frequentist alternatives (marginal models, GEEs, etc) Generalized linear mixed models (GLMM): definition, examples, normal linear case - induced correlation structure, priors, computation, multi-level models, covariance selection Generalized linear mixed models (GLMM): definition, examples, normal linear case - induced correlation structure, priors, computation, multi-level models, covariance selection Generalized additive models : definition, frequentist approaches for inference & computation (Hastie & Tibshirani), Bayesian approaches using basis functions, priors, computation Generalized additive models : definition, frequentist approaches for inference & computation (Hastie & Tibshirani), Bayesian approaches using basis functions, priors, computation Factor analytic models : Underlying normal formulations, mixed discrete & continuous outcomes, generalized factor models, joint models for longitudinal and event time data, covariance selection, model identifiability issues, computation Factor analytic models : Underlying normal formulations, mixed discrete & continuous outcomes, generalized factor models, joint models for longitudinal and event time data, covariance selection, model identifiability issues, computation

 Student Responsibilities: Assignments: Outside reading and problems sets will typically be assigned after each class (10%) Assignments: Outside reading and problems sets will typically be assigned after each class (10%) Mid-term Examination: An in-class closed-book mid term examination will be given (30%) Mid-term Examination: An in-class closed-book mid term examination will be given (30%) Project: Students will be expected to write-up and present results from a data analysis project (30%) Project: Students will be expected to write-up and present results from a data analysis project (30%) Final Examination: The final examination be out of class (30%) Final Examination: The final examination be out of class (30%)

Comments on Computing  Course will have an applied emphasis  Students will be expected to implement frequentist & Bayesian analyses of real and simulated data examples  It is not required that students use a particular computing package  However, emphasis will be given to R/S-PLUS & Matlab, with code sometimes provided