Experimental design.

Slides:



Advertisements
Similar presentations
Analysis by design Statistics is involved in the analysis of data generated from an experiment. It is essential to spend time and effort in advance to.
Advertisements

Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Multiple Comparisons in Factorial Experiments
Randomized Experimental Design
Experimental design in environmental assessment  Environmental sampling and analysis (Quinn & Keough, 2003)
Design Supplemental.
Experiments with both nested and “crossed” or factorial factors
STT 511-STT411: DESIGN OF EXPERIMENTS AND ANALYSIS OF VARIANCE Dr. Cuixian Chen Chapter 14: Nested and Split-Plot Designs Design & Analysis of Experiments.
ANOVA lecture Fixed, random, mixed-model ANOVAs
N-way ANOVA. Two-factor ANOVA with equal replications Experimental design: 2  2 (or 2 2 ) factorial with n = 5 replicate Total number of observations:
Designs with Randomization Restrictions RCBD with a complete factorial in each block RCBD with a complete factorial in each block –A: Cooling Method –B:
ANOVA: ANalysis Of VAriance. In the general linear model x = μ + σ 2 (Age) + σ 2 (Genotype) + σ 2 (Measurement) + σ 2 (Condition) + σ 2 (ε) Each of the.
Experimental Design.
Spotting pseudoreplication 1.Inspect spatial (temporal) layout of the experiment 2.Examine degrees of freedom in analysis.
Lecture 24: Thurs. Dec. 4 Extra sum of squares F-tests (10.3) R-squared statistic (10.4.1) Residual plots (11.2) Influential observations (11.3,
Review: The Logic Underlying ANOVA The possible pair-wise comparisons: X 11 X 12. X 1n X 21 X 22. X 2n Sample 1Sample 2 means: X 31 X 32. X 3n Sample 3.
Nested and Split Plot Designs. Nested and Split-Plot Designs These are multifactor experiments that address common economic and practical constraints.
DOCTORAL SEMINAR, SPRING SEMESTER 2007 Experimental Design & Analysis Further Within Designs; Mixed Designs; Response Latencies April 3, 2007.
Principles of Experimental Design
Biostatistics-Lecture 9 Experimental designs Ruibin Xi Peking University School of Mathematical Sciences.
Adaptive management AM is about learning to manage DYNAMIC systems more effectively There are two kinds of AM: –Passive (certainty equivalent): assumes.
Chapter 4 Hypothesis Testing, Power, and Control: A Review of the Basics.
Magister of Electrical Engineering Udayana University September 2011
Chapter 13 Notes Observational Studies and Experimental Design
1 Experimental Statistics - week 6 Chapter 15: Randomized Complete Block Design (15.3) Factorial Models (15.5)
Introduction ANOVA Mike Tucker School of Psychology B209 Portland Square University of Plymouth Drake Circus Plymouth, PL4 8AA Tel: +44 (0)
1 Design of Engineering Experiments Part 10 – Nested and Split-Plot Designs Text reference, Chapter 14, Pg. 525 These are multifactor experiments that.
Much of the meaning of terms depends on context. 1.
The success or failure of an investigation usually depends on the design of the experiment. Prepared by Odyssa NRM Molo.
The Randomized Complete Block Design
Statistical Aspects of a Research Project Mohd Ridzwan Abd Halim Jabatan Sains Tanaman Universiti Putra Malaysia.
Psychology 301 Chapters & Differences Between Two Means Introduction to Analysis of Variance Multiple Comparisons.
Problems with the Design and Implementation of Randomized Experiments By Larry V. Hedges Northwestern University Presented at the 2009 IES Research Conference.
Experimental design. Experiments vs. observational studies Manipulative experiments: The only way to prove the causal relationships BUT Spatial and temporal.
Repeated Measurements Analysis. Repeated Measures Analysis of Variance Situations in which biologists would make repeated measurements on same individual.
Chapter 14 Inference for Regression AP Statistics 14.1 – Inference about the Model 14.2 – Predictions and Conditions.
Research & Experimental Design Why do we do research History of wildlife research Descriptive v. experimental research Scientific Method Research considerations.
IE341 Midterm. 1. The effects of a 2 x 2 fixed effects factorial design are: A effect = 20 B effect = 10 AB effect = 16 = 35 (a) Write the fitted regression.
Blocks and pseudoreplication
Constrained ordinations Dependence of multivariate response on one or many predictors.
Intermediate Applied Statistics STAT 460 Lecture 17, 11/10/2004 Instructor: Aleksandra (Seša) Slavković TA: Wang Yu
Control of Experimental Error Blocking - –A block is a group of homogeneous experimental units –Maximize the variation among blocks in order to minimize.
Generalized linear MIXED models
10 Experimental Research: One-Way Designs What types of evidence allow us to conclude that one variable causes another variable? How do experimental research.
Single-Factor Studies KNNL – Chapter 16. Single-Factor Models Independent Variable can be qualitative or quantitative If Quantitative, we typically assume.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 14 Comparing Groups: Analysis of Variance Methods Section 14.3 Two-Way ANOVA.
C82MST Statistical Methods 2 - Lecture 1 1 Overview of Course Lecturers Dr Peter Bibby Prof Eamonn Ferguson Course Part I - Anova and related methods (Semester.
Randomized block designs  Environmental sampling and analysis (Quinn & Keough, 2002)
Intermediate Applied Statistics STAT 460 Lecture 18, 11/10/2004 Instructor: Aleksandra (Seša) Slavković TA: Wang Yu
IE241: Introduction to Design of Experiments. Last term we talked about testing the difference between two independent means. For means from a normal.
Quadrats, ANOVA. Quadrat shape ? ? ? ? ? ? ? 1. Edge effects best worst.
1 Robust Parameter Design and Process Robustness Studies Robust parameter design (RPD): an approach to product realization activities that emphasizes choosing.
ANOVA Overview of Major Designs. Between or Within Subjects Between-subjects (completely randomized) designs –Subjects are nested within treatment conditions.
Producing Data 1.
Copyright ©2011 Brooks/Cole, Cengage Learning Gathering Useful Data for Examining Relationships Observation VS Experiment Chapter 6 1.
(Rancangan Petak Terbagi)
Design of Experiments.
Analysis of Variance Harry R. Erwin, PhD
12 Inferential Analysis.
Lecture 2: Replication and pseudoreplication
Chapter 1 – Ecological Data
Random Effects & Repeated Measures
Nested Designs and Repeated Measures with Treatment and Time Effects
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Independent variables correlate with each other
12 Inferential Analysis.
Experimental design.
A protocol for data exploration to avoid common statistical problems
Design of Experiments.
Principles of Experimental Design
Presentation transcript:

Experimental design

Experiments vs. observational studies Manipulative experiments: The only way to proof the causal relationships BUT Spatial and temporal limitation of manipulations Side effects of manipulations

Laboratory, field, natural trajectory (NTE), and natural snapshot experiments (Diamond 1986) NTE/NSE - Natural Trajectory/Snapshot Experiment

Observational studies (e. g Observational studies (e.g. for correlation between environment and species, or estimates of plot characteristics) Random vs. regular sampling plan

Regular design - biased results, when there is some regular structure in the plot (e.g. regular furrows), with the same period as is the distance in the grid - otherwise, better design providing better coverage of the area, and also enables use of special permutation tests.

Manipulative experiments frequent trade-off between feasibility and requirements of correct statistical design and power of the tests To maximize power of the test, you need to maximize number of independent experimental units For the feasibility and realism, you need plots of some size, to avoid the edge effect

Important - treatments randomly assigned to plots Completely randomized design Typical analysis: One way ANOVA often, chessboard arrangement or similar regular pattern

Randomized complete blocks

ANOVA, TREAT x BLOCK interaction is error term

If the block has strong explanatory power, the RCB design is stronger

If the block has no explanatory power, the RCB design is weak

Latin square design

Most frequent errors - pseudoreplications

Fertilization experiment in three countries COUNTRY FERTIL NOSPEC 1 CZ 0.000 9.000 2 CZ 0.000 8.000 3 CZ 0.000 6.000 4 CZ 1.000 4.000 5 CZ 1.000 5.000 6 CZ 1.000 4.000 7 UK 0.000 11.000 8 UK 0.000 12.000 9 UK 0.000 10.000 10 UK 1.000 3.000 11 UK 1.000 4.000 12 UK 1.000 3.000 13 NL 0.000 5.000 14 NL 0.000 6.000 15 NL 0.000 7.000 16 NL 1.000 6.000 17 NL 1.000 6.000 18 NL 1.000 8.000

Country is a fixed factor (i. e Country is a fixed factor (i.e., we are interested in the three plots only) Summary of all Effects; design: (new.sta) 1-COUNTRY, 2-FERTIL df MS df MS Effect Effect Error Error F p-level 1 2 2.16667 12 1.055556 2.05263 .171112 2 1 53.38889 12 1.055556 50.57895 .000012 12 2 26.05556 12 1.055556 24.68421 .000056 Country is a random factor (i.e., the three plots arew considered as random selection of all plots of this type in Europe - [to make Brussels happy]) Summary of all Effects; design: (new.sta) 1-COUNTRY, 2-FERTIL df MS df MS Effect Effect Error Error F p-level 1 2 2.16667 12 1.05556 2.05263 .171112 2 1 53.38889 2 26.05556 2.04904 .288624 12 2 26.05556 12 1.05556 24.68421 .000056

Nested designs („split-plot“)

Two explanatory variables, Treatment and Plot, Plot is random factor nested in Treatment. Accordingly, there are two error terms, effect of Treatment is tested against Plot, effect of Plot against residual variability: F(Treat)=MS(Treat)/MS(Plot) F(Plot)=MS(Plot)/MS(Resid) [often not of interest]

Split plot (main plots and split plots - two error levels)

ROCK is the MAIN PLOT factor, PLOT is random factor nested in ROCK, TREATMENT is the within plot (split-plot) factor. Two error levels: F(ROCK)=MS(ROCK)/MS(PLOT) F(TREA)=MS(TREA)/MS(PLOT*TREA)

Following changes in time Non-replicated BACI (Before-after-control-impact)

Analysed by two-way ANOVA factors: Time (before/after) and Location (control/impact) Of the main interest: Time*Location interaction (i.e., the temporal change is different in control and impact locations)

In fact, in non-replicated BACI, the test is based on pseudoreplications. Should NOT be used in experimental setups In impact assessments, often the best possibility (The best need not be always good enough.)

Replicated BACI - repeated measurements Usually analysed by “univariate repeated measures ANOVA”. This is in fact split-plot, where TREATment is the main-plot effect, time is the within-plot effect, individuals (or experimental units) and nested within a treatment. Of the main interest is interaction TIME*TREAT