1 What are Mixed Models? Why are they Used? An Introduction Ed Stanek.

Slides:



Advertisements
Similar presentations
A Gentle Introduction to Linear Mixed Modeling and PROC MIXED
Advertisements

Bayes rule, priors and maximum a posteriori
ECON 251 Research Methods 11. Time Series Analysis and Forecasting.
Data: Crab mating patterns Data: Typists (Poisson with random effects) (Poisson Regression, ZIP model, Negative Binomial) Data: Challenger (Binomial with.
Random Assignment Experiments
Chapter 10 Estimation and Hypothesis Testing II: Independent and Paired Sample T-Test.
Estimating the Effects of Treatment on Outcomes with Confidence Sebastian Galiani Washington University in St. Louis.
Analysis of Clustered and Longitudinal Data Module 3 Linear Mixed Models (LMMs) for Clustered Data – Two Level Part A 1 Biostat 512: Module 3A - Kathy.
Comparison of Repeated Measures and Covariance Analysis for Pretest-Posttest Data -By Chunmei Zhou.
Some Terms Y =  o +  1 X Regression of Y on X Regress Y on X X called independent variable or predictor variable or covariate or factor Which factors.
INTERPRET MARKETING INFORMATION TO TEST HYPOTHESES AND/OR TO RESOLVE ISSUES. INDICATOR 3.05.
1 When are BLUPs Bad Ed Stanek UMass- Amherst Julio Singer USP- Brazil George ReedUMass- Worc. Wenjun LiUMass- Worc.
© 2000 Prentice-Hall, Inc. Chap Multiple Regression Models.
Multiple Regression Models. The Multiple Regression Model The relationship between one dependent & two or more independent variables is a linear function.
© 2003 Prentice-Hall, Inc.Chap 14-1 Basic Business Statistics (9 th Edition) Chapter 14 Introduction to Multiple Regression.
Clustered or Multilevel Data
Stat 217 – Week 10. Outline Exam 2 Lab 7 Questions on Chi-square, ANOVA, Regression  HW 7  Lab 8 Notes for Thursday’s lab Notes for final exam Notes.
Mixed models Various types of models and their relation
1 Simple Linear Regression Chapter Introduction In this chapter we examine the relationship among interval variables via a mathematical equation.
1 Introduction to Biostatistics (PUBHLTH 540) Estimating Parameters Which estimator is best? Study possible samples, determine Expected values, bias, variance,
Saturday May 02 PST 4 PM. Saturday May 02 PST 10:00 PM.
7/2/ Lecture 51 STATS 330: Lecture 5. 7/2/ Lecture 52 Tutorials  These will cover computing details  Held in basement floor tutorial lab,
STAT 101 Dr. Kari Lock Morgan Exam 2 Review.
Dr. Mario MazzocchiResearch Methods & Data Analysis1 Correlation and regression analysis Week 8 Research Methods & Data Analysis.
Data. General 63 female responses, 46 male responses.
Chapter 10. Resource Allocation
T-tests and ANOVA Statistical analysis of group differences.
Regression and Correlation Methods Judy Zhong Ph.D.
Inference for Distributions
GEO7600 Inverse Theory 09 Sep 2008 Inverse Theory: Goals are to (1) Solve for parameters from observational data; (2) Know something about the range of.
Multilevel Modeling 1.Overview 2.Application #1: Growth Modeling Break 3.Application # 2: Individuals Nested Within Groups 4.Questions?
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
G Lecture 5 Example fixed Repeated measures as clustered data
Exam I review Understanding the meaning of the terminology we use. Quick calculations that indicate understanding of the basis of methods. Many of the.
Section Inference for Experiments Objectives: 1.To understand how randomization differs in surveys and experiments when comparing two populations.
Statistics for clinicians Biostatistics course by Kevin E. Kip, Ph.D., FAHA Professor and Executive Director, Research Center University of South Florida,
Bayesian Analysis and Applications of A Cure Rate Model.
Agenda for Wednesday Sept 5 th Pretest Root words Notebook set-up Learning Targets Scientific Method.
Outline 1) Descriptive Statistics 2) Define “association”. 3) Practice reading Table 1 for evidence of confounding, effect modification. 4) Practice reading.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 13 Multiple Regression Section 13.3 Using Multiple Regression to Make Inferences.
Reasoning in Psychology Using Statistics
Name the United States Coins Count the Pennies 10 ¢
Population Pharmacokinetic Characteristics of Levosulpiride and Terbinafine in Healthy Male Korean Volunteers Yong-Bok Lee College of Pharmacy and Institute.
Not in FPP Bayesian Statistics. The Frequentist paradigm Defines probability as a long-run frequency independent, identical trials Looks at parameters.
Statistics: Unlocking the Power of Data Lock 5 Exam 2 Review STAT 101 Dr. Kari Lock Morgan 11/13/12 Review of Chapters 5-9.
The Scientific Method An approach to acquiring knowledge.
Business Statistics for Managerial Decision Farideh Dehkordi-Vakil.
General Linear Model.
Chapter 6: Analyzing and Interpreting Quantitative Data
XIAO WU DATA ANALYSIS & BASIC STATISTICS.
Lecture 1: Basic Statistical Tools. A random variable (RV) = outcome (realization) not a set value, but rather drawn from some probability distribution.
1 Statistics 262: Intermediate Biostatistics Regression Models for longitudinal data: Mixed Models.
Armando Teixeira-Pinto AcademyHealth, Orlando ‘07 Analysis of Non-commensurate Outcomes.
Synthesis and Review 2/20/12 Hypothesis Tests: the big picture Randomization distributions Connecting intervals and tests Review of major topics Open Q+A.
Biostatistics Case Studies Peter D. Christenson Biostatistician Session 3: Missing Data in Longitudinal Studies.
G Lecture 71 Revisiting Hierarchical Mixed Models A General Version of the Model Variance/Covariances of Two Kinds of Random Effects Parameter Estimation.
Gibbs Sampling and Hidden Markov Models in the Event Detection Problem By Marc Sobel.
Lec. 19 – Hypothesis Testing: The Null and Types of Error.
Jump to first page Bayesian Approach FOR MIXED MODEL Bioep740 Final Paper Presentation By Qiang Ling.
Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Chapter 4 Prediction and Bayesian Inference 4.1 Estimators versus predictors 4.2 Prediction for one-way ANOVA models –Shrinkage estimation, types of predictions.
Introduction. We want to see if there is any relationship between the results on exams and the amount of hours used for studies. Person ABCDEFGHIJ Hours/
Descriptive and Inferential Statistics Descriptive Statistics – consists of the collection, organization, and overall summery of the data presented. Inferential.
Applied statistics Usman Roshan.
POSC 202A: Lecture Lecture: Substantive Significance, Relationship between Variables 1.
Descriptive vs. Inferential
Name the United States Coins
CS639: Data Management for Data Science
Introduction to Regression
Correlation and Simple Linear Regression
Presentation transcript:

1 What are Mixed Models? Why are they Used? An Introduction Ed Stanek

2 Example and Context Seasons Study –Purpose: To evaluate seasonal changes in cholesterol –Subjects: Volunteer’s age from HMO –Design: Every 3 months, measure SC, diet, etc Quarterly Diet Assessment –Three 24-hour phone interviews by dietician –data coded and run through nutrient data bank –output- kcal/day, protein, vitamins, alcohol, etc.

3 Questions, Problems Design an Intervention Study on Alcohol Analyze the Study Results Predict Alcohol Consumption for a Subject First, we describe Alcohol Consumption using Season’s Study Data

4 Describing the 24-Hr Alcohol Data 1 Beer = 13.2 grams of Alcohol Quantile Estimate 100% Max % % % % Q % Median 0 25% Q1 0 10% 0 5% 0 1% 0 0% Min 0 (Based on over hour diet recalls)

5 Table 2. List of Reports of More than 10 Beers/day ID QUARTER day BEER Sunday Monday Tuesday Thursday Sunday Saturday Sunday Tuesday Wednesday Wednesday Friday Saturday Wednesday Wednesday Thursday Wednesday Friday Friday Saturday Wednesday Wednesday Tuesday 12.6 (Source: sne02p12.sas)

6

7

8

9

10 A Descriptive Model for a subject-day Average Beers/Day or For a Population: or

11 A Descriptive Model for Selected subject on a selected day Beers on j-th selected day for i-th selected subject: This is a “mixed” model. Average Beers/day for i-th selected subject: This is a Random Effect

12 In the Population: Also:

13 To summarize, the mixed model is given by: Beers on jth selected day for ith selected subject where Note that

14 Use the Mixed Model to Summarize Beers/day PROC MIXED; CLASS id; MODEL beer= /solution; RANDOM id; RUN; Results: Covariance Parameter Estimates Cov Parm Estimate ID 0.97 Residual 0.94 Solution for Fixed Effects Standard Effect Estimate Error Intercept (Source: sne02p15.sas)

15 Gender Specific Results Beers Per Day EstimateVariance nMeanStd ErrSubjectDay Male Female

16 Design a Study to Reduce Alcohol Consumption in Men by 25% Assume: completely randomized study 80% power to detect alternative hypothesis or where and If M is large, then

17 Subj. VarDay VarMmnnm

18 With m=3 Recalls, for the i-th subject, we’ll observe: where and

19 Compound Symmetry: Intra-class Correlation: Design effect:

20 Analyze Study Results Beers on jth selected day for ith selected subject in Treatment Group k where Use Proc Mixed.

21 Predicting a Random Effect A model for the Random Effect: How would you predict the mean for a realized selection? For ID 294 in Seasons Study

22 BLUP : Shrinkage factor: Regression to the mean For ID=294, rather than Beers/day

23 Promise of Prediction Predict response for a realized Subject a clinic a class-room a town, or region a family Not simply predicting response for the ‘average’

24 Link with Bayesian Thinking Assume a prior distribution for Random Effects. Express the joint distribution of Data and Random effects The posterior distribution is found by conditioning on the data. The mean of the posterior distribution is the Bayes predictor.

25 New Insights To Predict 30-day average Beer Drinking Example: For ID 294 in Seasons Study No need to predict these 3 days. Just predict the remaining 27 days in the month! New Predictor:

26 Basic Problem Realized Random Effect = Latent Value for Realized Unit PROBLEM: Units are not ‘identifiable’ in typical Mixed Model Example: pick a coin (dime, nickel, penny), flip once, and observed Head (or tail). Can this be used to predict Prob(Dime=Head)?

27 Summary and Conclusions Mixed Models are Fundamental For Random Effects –There are Problems with the theory. –Problems with interpretation –These problems are not yet solved!! Stay Tuned!