SJS SDI_101 Design of Statistical Investigations Stephen Senn 10 Random Effects.

Slides:



Advertisements
Similar presentations
SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors.
Advertisements

SJS SDI_61 Design of Statistical Investigations Stephen Senn 6. Orthogonal Designs Randomised Blocks II.
SJS SDI_81 Design of Statistical Investigations Stephen Senn 8 Factorial Designs.
SJS SDI_111 Design of Statistical Investigations Stephen Senn 11 Nested Factors.
SJS SDI_51 Design of Statistical Investigations Stephen Senn 5. Orthogonal Designs Randomised Blocks.
SJS SDI_181 Design of Statistical Investigations 18 Sample Size Determination Stephen Senn.
SJS SDI_151 Design of Statistical Investigations Stephen Senn Introduction to Sampling.
SJS SDI_21 Design of Statistical Investigations Stephen Senn 2 Background Stats.
Overview of Lecture Partitioning Evaluating the Null Hypothesis ANOVA
Lecture 2 ANALYSIS OF VARIANCE: AN INTRODUCTION
1 Correlation and Simple Regression. 2 Introduction Interested in the relationships between variables. What will happen to one variable if another is.
Introduction Describe what panel data is and the reasons for using it in this format Assess the importance of fixed and random effects Examine the Hausman.
Order Statistics The order statistics of a set of random variables X1, X2,…, Xn are the same random variables arranged in increasing order. Denote by X(1)
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Mixed Designs: Between and Within Psy 420 Ainsworth.
Randomized Block and Repeated Measures Designs. Block Designs In the Types of Studies presentation we discussed the use of blocking to control for a source.
Multiple Regression and Model Building
Topic 12: Multiple Linear Regression
Lecture 10 F-tests in MLR (continued) Coefficients of Determination BMTRY 701 Biostatistical Methods II.
SPH 247 Statistical Analysis of Laboratory Data 1April 2, 2013SPH 247 Statistical Analysis of Laboratory Data.
1 Chapter 4 Experiments with Blocking Factors The Randomized Complete Block Design Nuisance factor: a design factor that probably has an effect.
Chapter 4 Randomized Blocks, Latin Squares, and Related Designs
Lecture 9 Today: Ch. 3: Multiple Regression Analysis Example with two independent variables Frisch-Waugh-Lovell theorem.
Log-Linear Models & Dependent Samples Feng Ye, Xiao Guo, Jing Wang.
The Simple Linear Regression Model: Specification and Estimation
Linear Modelling III Richard Mott Wellcome Trust Centre for Human Genetics.
Chapter 5 Introduction to Factorial Designs
Basics of ANOVA Why ANOVA Assumptions used in ANOVA Various forms of ANOVA Simple ANOVA tables Interpretation of values in the table Exercises.
ANOVA: ANalysis Of VAriance. In the general linear model x = μ + σ 2 (Age) + σ 2 (Genotype) + σ 2 (Measurement) + σ 2 (Condition) + σ 2 (ε) Each of the.
Basics of ANOVA Why ANOVA Assumptions used in ANOVA
Lesson #32 Simple Linear Regression. Regression is used to model and/or predict a variable; called the dependent variable, Y; based on one or more independent.
Clustered or Multilevel Data
Linear regression models in matrix terms. The regression function in matrix terms.
Review for Final Exam Some important themes from Chapters 9-11 Final exam covers these chapters, but implicitly tests the entire course, because we use.
Variance and covariance Sums of squares General linear models.
Biostatistics-Lecture 9 Experimental designs Ruibin Xi Peking University School of Mathematical Sciences.
Psy B07 Chapter 1Slide 1 ANALYSIS OF VARIANCE. Psy B07 Chapter 1Slide 2 t-test refresher  In chapter 7 we talked about analyses that could be conducted.
1 MADE WHAT IF SOME OLS ASSUMPTIONS ARE NOT FULFILED?
 Combines linear regression and ANOVA  Can be used to compare g treatments, after controlling for quantitative factor believed to be related to response.
MANOVA Multivariate Analysis of Variance. One way Analysis of Variance (ANOVA) Comparing k Populations.
Design of Engineering Experiments Part 4 – Introduction to Factorials
23-1 Analysis of Covariance (Chapter 16) A procedure for comparing treatment means that incorporates information on a quantitative explanatory variable,
Correlation and Regression Used when we are interested in the relationship between two variables. NOT the differences between means or medians of different.
Repeated Measurements Analysis. Repeated Measures Analysis of Variance Situations in which biologists would make repeated measurements on same individual.
Psych 5500/6500 Other ANOVA’s Fall, Factorial Designs Factorial Designs have one dependent variable and more than one independent variable (i.e.
The Completely Randomized Design (§8.3)
DOX 6E Montgomery1 Design of Engineering Experiments Part 9 – Experiments with Random Factors Text reference, Chapter 13, Pg. 484 Previous chapters have.
ERCIM May 2001 Analysis of variance, general balance and large data sets Roger Payne Statistics Department, IACR-Rothamsted, Harpenden, Herts AL5 2JQ.
Statistical models in R - Part II  R has several statistical functions packages  We have already covered a few of the functions  t-tests (one- and two-sample,
Exercise 1 You have a clinical study in which 10 patients will either get the standard treatment or a new treatment Randomize which 5 of the 10 get the.
PSYC 3030 Review Session April 19, Housekeeping Exam: –April 26, 2004 (Monday) –RN 203 –Use pencil, bring calculator & eraser –Make use of your.
1 Psych 5510/6510 Chapter 14 Repeated Measures ANOVA: Models with Nonindependent ERRORs Part 3: Factorial Designs Spring, 2009.
Statistics for Differential Expression Naomi Altman Oct. 06.
Ch14: Linear Least Squares 14.1: INTRO: Fitting a pth-order polynomial will require finding (p+1) coefficients from the data. Thus, a straight line (p=1)
1 G Lect 13a G Lecture 13a Power for 2 way ANOVA Random effects Expected MS Mixed models Special case: one entry per cell.
IE241: Introduction to Design of Experiments. Last term we talked about testing the difference between two independent means. For means from a normal.
1 Statistics 262: Intermediate Biostatistics Regression Models for longitudinal data: Mixed Models.
The Mixed Effects Model - Introduction In many situations, one of the factors of interest will have its levels chosen because they are of specific interest.
ANOVA Overview of Major Designs. Between or Within Subjects Between-subjects (completely randomized) designs –Subjects are nested within treatment conditions.
G Lecture 71 Revisiting Hierarchical Mixed Models A General Version of the Model Variance/Covariances of Two Kinds of Random Effects Parameter Estimation.
Two-Sample-Means-1 Two Independent Populations (Chapter 6) Develop a confidence interval for the difference in means between two independent normal populations.
> xyplot(cat~time|id,dd,groups=ses,lty=1:3,type="l") > dd head(dd) id ses cat pre post time
Mixed models and their uses in meta-analysis
Chapter 5 Introduction to Factorial Designs
Random Effects & Repeated Measures
Correlation and Simple Linear Regression
Joanna Romaniuk Quanticate, Warsaw, Poland
Correlation and Simple Linear Regression
Linear Hierarchical Modelling
Simple Linear Regression and Correlation
Presentation transcript:

SJS SDI_101 Design of Statistical Investigations Stephen Senn 10 Random Effects

SJS SDI_102 More Than one Random Term So far only one term has been considered to be random –disturbance term It is possible to have models in which more than one source of variation is taken to be random We now consider such models

SJS SDI_103 The Example of Clinical Trials So far we have always taken patient effects to be fixed Suppose however we ran a parallel group trial Some patients have one treatment some have another Patients and treatments are confounded If we treat patient effects as fixed, cannot estimate treatments

SJS SDI_104 Solution We treat patient effects as random This is done implicitly in parallel group trials as follows ij is effect for patient j of treatment group i. If we declare this to be random we can form a new disturbance term as follows

SJS SDI_105 So What? We do not even need to model this explicitly We just have a model in which we say response = treatment + noise, without worrying about what terms the noise is made up of. However for more complicated designs such distinctions may be useful

SJS SDI_106 Cross-over Trials We shall now take a simple example AB/BA cross-over We shall, however ignore period effects to make it even simpler Just consider the following –Treatment effects –Patient effects –Within-patient error

SJS SDI_107 Model Here all the i and ij terms are assumed independent of each other.

SJS SDI_108 Consequences The variance covariance structure of the Y ij then has the following block diagonal form

SJS SDI_109 Variance-Covariance Matrix Here is is assumed that measurements in successive rows of Y are on the same patient

SJS SDI_1010 Alternative Representation

SJS SDI_1011 Estimation 1 If we now write this as a linear model with only one error term, we must now have We can no longer use ordinary least squares but must use generalised least squares instead.

SJS SDI_1012 Estimation 2 We are not going to cover the details of GLS. However, as it turns out, the estimator here is exactly the same as in the model in which we treat the patient effects as fixed rather than random. This equivalence does not generally hold. It does hold for certain balanced designs

SJS SDI_1013 Illustration Exp_5 This experiment was an AB/BA cross-over We previously analysed this using a fixed effects model for the patient effect We now analyse this treating the patient effect as random To do this we use the SPlus lme function (lme = linear mixed effect)

SJS SDI_1014 Exp_5 Random Effects Analysis with SPlus > fit4 <- lme(pef ~ treat, random = ~ 1 | patient) > summary(fit4) Linear mixed-effects model fit by REML Data: NULL AIC BIC logLik Random effects: Formula: ~ 1 | patient (Intercept) Residual StdDev: Fixed effects: pef ~ treat Value Std.Error DF t-value p-value (Intercept) <.0001 treat

SJS SDI_1015 Question In this balanced case, the estimator is the same for the random effect model as for the fixed effect model Show that the variance is the same whether patient is treated as a fixed or a random effect

SJS SDI_1016 An Example Where this Equivalence Does not Apply In Exp_5, treating the patient effect as fixed or random produces the same result This is not the case for all designs We now consider an example where this does not apply Exp_12, an incomplete blocks design, is a case in point

SJS SDI_1017 Exp_12 Analysis with SPlus Random effects: Formula: ~ 1 | patient numeric matrix: 1 rows, 2 columns. (Intercept) Residual StdDev: Fixed effects: FEV1 ~ treat Value Std.Error DF t-value p-value (Intercept) <.0001 treatF treatP <.0001 Compare these with fixed effects solution Value Std. Error t value Pr(>|t|) treatF treatP

SJS SDI_1018 Notes The estimates are no longer the same The variances are (logically) no longer the same either The variances for the random effects approach are (slightly) smaller

SJS SDI_1019 Fixed effects Any effect we nominate as fixed has to be eliminated when estimating any other effect If we nominate patient as fixed then patient must be eliminated in estimating the treatment effect In Exp_12 each patient effect appears twice. –Once in period one, once in period 2 A patient effect can only be eliminated by forming the difference between period 1 and period 2 –Analysis uses such differences

SJS SDI_1020 Random Effects An effect that is random does not have to be eliminated –on average it is zero Nominating an effect as random increases the range of possible unbiased estimators The minimum variance estimator may or may not be the same as in the fixed effects case

SJS SDI_1021 A Further Source of Information If the patient effect is random, the totals for patients vary randomly from patient to patient These totals do not all reflect the same effects By comparing F12 + F24 with F12 + P we can estimate the difference between F24 and P This is a further source of information In general referred to as inter-block information This has been recovered by S-PLUS

SJS SDI_1022 Other Sorts of Random Effects In example considered main effect of block was random More unusual is to have a true random treatment effect (but this can happen) Quite common is to have block by treatment interactions that are considered random We consider an example of the former in the next lecture We consider an example of the latter here

SJS SDI_1023 Exp_14 Shumaker and Metzler Trial to compare two formulations of phenytoin –T = test, R = reference So-called bioequivalence study Four period cross-over Each of 26 subjects received each formulation twice

SJS SDI_1024 Data from Shumaker and Metzler, 1998 Drug Information Journal,32, Area under the concentration time curve (AUC) for Phenytoin. Data are log-transformed

SJS SDI_1025 Subject by Formulation Interaction Heuristic Explanation We can estimate the treatment effect twice independently for each subject –for example by comparing period 2 and 1 and period 3 and 4 We can see whether these estimates differ more between subjects than within This enables us to estimate whether there is an interaction

SJS SDI_1026

SJS SDI_1027 Exp_14 Two Fits > aov.1 <- aov(lAUC ~ Subject + Formulation) > summary(aov.1) Df Sum of Sq Mean Sq F Value Pr(F) Subject Formulation Residuals > aov.2 <- aov(lAUC ~ Subject * Formulation) > summary(aov.2) Df Sum of Sq Mean Sq F Value Pr(F) Subject Formulation Subject:Formulation Residuals

SJS SDI_1028 Different Philosophy MS residuals in first fit includes subject by treatment interaction MS residuals in second does not Hence F test in first uses such variation from subject to subject to assess precision of overall treatment estimate Second F test excludes it

SJS SDI_1029 Questions In this example the MS for residuals is actually higher when the subject by formulation interaction is fitted Is this phenomenon to be expected in general? What does it imply? Can you think of an explanation in this case?