Overview: 2005 Protocol Comparison Test Brett Roper National Aquatic Ecologist, USDA Forest Service (435) 755-3566.

Slides:



Advertisements
Similar presentations
I OWA S TATE U NIVERSITY Department of Animal Science Using Basic Graphical and Statistical Procedures (Chapter in the 8 Little SAS Book) Animal Science.
Advertisements

Topic 12: Multiple Linear Regression
A. The Basic Principle We consider the multivariate extension of multiple linear regression – modeling the relationship between m responses Y 1,…,Y m and.
Regression and correlation methods
Topic 32: Two-Way Mixed Effects Model. Outline Two-way mixed models Three-way mixed models.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture #19 Analysis of Designs with Random Factor Levels.
Experimental design and analyses of experimental data Lesson 2 Fitting a model to data and estimating its parameters.
Analysis of Variance Compares means to determine if the population distributions are not similar Uses means and confidence intervals much like a t-test.
EPI 809/Spring Probability Distribution of Random Error.
Simple Linear Regression and Correlation
Statistical Analysis Professor Richard F. Gunst Department of Statistical Science Lecture 16 Analysis of Data from Unbalanced Experiments.
John M. Buffington Research Geomorphologist US Forest Service Rocky Mountain Research Station Boise, Idaho, USA PNAMP Protocol Comparison Meeting February.
Creating Graphs on Saturn GOPTIONS DEVICE = png HTITLE=2 HTEXT=1.5 GSFMODE = replace; PROC REG DATA=agebp; MODEL sbp = age; PLOT sbp*age; RUN; This will.
Comparison of Repeated Measures and Covariance Analysis for Pretest-Posttest Data -By Chunmei Zhou.
Some Terms Y =  o +  1 X Regression of Y on X Regress Y on X X called independent variable or predictor variable or covariate or factor Which factors.
Multiple regression analysis
Chapter 11: Inferential methods in Regression and Correlation
HIERARCHICAL LINEAR MODELS USED WITH NESTED DESIGNS IN EDUCATION, PSYCHOLOGY USES RANDOM FACTORS EXPECTED MEAN SQUARE THEORY COMBINES INFORMATION ACROSS.
Be humble in our attribute, be loving and varying in our attitude, that is the way to live in heaven.
ANalysis Of VAriance (ANOVA) Comparing > 2 means Frequently applied to experimental data Why not do multiple t-tests? If you want to test H 0 : m 1 = m.
1 Review of Correlation A correlation coefficient measures the strength of a linear relation between two measurement variables. The measure is based on.
Purpose to compare average response among levels of the factors Chapters 2-4 -predict future response at specific factor level -recommend best factor.
Scientific motivation of the CHaMP project: How CHaMP data can be used to answer fish and habitat management questions Chris Jordan – NOAA-Fisheries Brice.
Topic 28: Unequal Replication in Two-Way ANOVA. Outline Two-way ANOVA with unequal numbers of observations in the cells –Data and model –Regression approach.
1 Experimental Statistics - week 7 Chapter 15: Factorial Models (15.5) Chapter 17: Random Effects Models.
© 2002 Prentice-Hall, Inc.Chap 14-1 Introduction to Multiple Regression Model.
 Combines linear regression and ANOVA  Can be used to compare g treatments, after controlling for quantitative factor believed to be related to response.
1 Experimental Statistics - week 10 Chapter 11: Linear Regression and Correlation.
23-1 Analysis of Covariance (Chapter 16) A procedure for comparing treatment means that incorporates information on a quantitative explanatory variable,
Topic 7: Analysis of Variance. Outline Partitioning sums of squares Breakdown degrees of freedom Expected mean squares (EMS) F test ANOVA table General.
1 Experimental Statistics - week 10 Chapter 11: Linear Regression and Correlation Note: Homework Due Thursday.
6-3 Multiple Regression Estimation of Parameters in Multiple Regression.
Regression For the purposes of this class: –Does Y depend on X? –Does a change in X cause a change in Y? –Can Y be predicted from X? Y= mX + b Predicted.
Testing Multiple Means and the Analysis of Variance (§8.1, 8.2, 8.6) Situations where comparing more than two means is important. The approach to testing.
A forum for coordinating state, federal, and tribal aquatic monitoring programs in the Pacific Northwest Pacific Northwest Aquatic Monitoring Partnership.
6-1 Introduction To Empirical Models Based on the scatter diagram, it is probably reasonable to assume that the mean of the random variable Y is.
The Completely Randomized Design (§8.3)
March 28, 30 Return exam Analyses of covariance 2-way ANOVA Analyses of binary outcomes.
6-3 Multiple Regression Estimation of Parameters in Multiple Regression.
What have we learned from the John Day protocol comparison test? Brett Roper John Buffington.
1 Experimental Statistics - week 14 Multiple Regression – miscellaneous topics.
Topic 30: Random Effects. Outline One-way random effects model –Data –Model –Inference.
PSYC 3030 Review Session April 19, Housekeeping Exam: –April 26, 2004 (Monday) –RN 203 –Use pencil, bring calculator & eraser –Make use of your.
By: Corey T. Williams 03 May Situation Objective.
Simple Linear Regression. Data available : (X,Y) Goal : To predict the response Y. (i.e. to obtain the fitted response function f(X)) Least Squares Fitting.
1 Experimental Statistics - week 9 Chapter 17: Models with Random Effects Chapter 18: Repeated Measures.
Topic 24: Two-Way ANOVA. Outline Two-way ANOVA –Data –Cell means model –Parameter estimates –Factor effects model.
1 Experimental Statistics Spring week 6 Chapter 15: Factorial Models (15.5)
Experimental Statistics - week 3
Today: March 7 Data Transformations Rank Tests for Non-Normal data Solutions for Assignment 4.
One-Way Analysis of Variance Recapitulation Recapitulation 1. Comparing differences among three or more subsamples requires a different statistical test.
PCWA Study Plan Physical Habitat Characterization Study Plan –Geomorphology Study Plan –Riparian Habitat Mapping Study Plan –Aquatic Habitat Characterization.
1 Chapter 5 : Volatility Models Similar to linear regression analysis, many time series exhibit a non-constant variance (heteroscedasticity). In a regression.
1 Statistics 262: Intermediate Biostatistics Regression Models for longitudinal data: Mixed Models.
1 Experimental Statistics - week 13 Multiple Regression Miscellaneous Topics.
Pacific Northwest Side-by-Side Aquatic Habitat Protocol Comparison Test Steve Lanigan, Brett Roper, John Buffington, Eric Archer, Scott Downie, Phil Kaufmann,
Experimental Statistics - week 9
ANOVA and Multiple Comparison Tests
1 Experimental Statistics - week 8 Chapter 17: Mixed Models Chapter 18: Repeated Measures.
1 Experimental Statistics - week 12 Chapter 11: Linear Regression and Correlation Chapter 12: Multiple Regression.
1 Experimental Statistics - week 11 Chapter 11: Linear Regression and Correlation.
Sports Medicine Example. Background Does Sports Med Fellowship have an impact? Study Design –Compare people with fellowship to those without on ABFM exams.
Lesson 10 - Topics SAS Procedures for Standard Statistical Tests and Analyses Programs 19 and 20 LSB 8:16-17.
Today: Feb 28 Reading Data from existing SAS dataset One-way ANOVA
Generalized Linear Models
Sampling Distribution
Sampling Distribution
Experimental Statistics - Week 4 (Lab)
Experimental Statistics - week 8
Presentation transcript:

Overview: 2005 Protocol Comparison Test Brett Roper National Aquatic Ecologist, USDA Forest Service (435)

Analysis For Means, STD, CV proc glm data= ***; class stream; model BW = stream; run; To decompose variance proc mixed data=***; classes stream; model BW =; random stream; run; To determine stream means and difference among streams proc mixed data=***; classes stream ; model BW = stream; lsmeans stream /pdiff adjust=tukey; ods output diffs=ppp lsmeans=mmm; ods listing exclude diffs lsmeans; run; %include 'c:\BBRfile\stats\sasmacros\pdmix800.sas'; %pdmix800(ppp,mmm,alpha=0.1,sort=yes); run; No analysis yet to determine significant differences among groups

Proc GLM statement Source DF Squares Mean Square F Value Pr > F Model <.0001 Error Corrected Total R-Square Coeff Var Root MSE grad Mean Proc Mixed statement Covariance Parameter Estimates Cov Parm Estimate Stream Residual

Output of the PDMIX statement for gradient from one group Standard Letter Obs Stream Estimate Error Group 1 Myrtle A 2 Whisky B 3 Indian C 4 Crawfish C 5 WF Lick D 6 Tinker DE 7 Potamus DE 8 Trail EF 9 Big F 10 Crane F 11 Camus F 12 Bridge F

Group 1 = Group What should the results of an aquatic habitat protocol comparison look like?

What is a good attribute For categorization – Very little  Rosgen large classes For status and trend –Minimum S:N of around 2, % stream ≈ 70% (I would prefer S:N of 4 and stream ≈ 80% Coefficient of variation ≈ 20%

Attributes Gradient Bankfull Width Wetted Width Width-to-Depth Sinuosity Entrenchment % Pool Residual Pool Depth %Fines Median Particle Size D 84 Large Wood Large wood volume

Gradient Group 1Group 2Group 3Group 4Group 5Group 6 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups

Myrtle Crane

Gradient; Results Can be shared? (R 2)

Bankfull Width Group 1Group 2Group 3Group 4Group 5Group 6 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups

truth GRP 1 GRP 2 GRP 3 GRP 4 GRP 5 GRP 6 truth Group Group Group Group Group Group Correlations among all stream width groups and the truth (remember these are mean values compared to the truth)

Wetted Width Group 2Group 4Group 5Group 7Group 8 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups 85765

Width to Depth Group 1Group 2Group 3Group 4Group 5Group 6 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups

Width to Depth Big Crawfish

Sinuosity Group 1Group 2Group 3Group 5 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups

Entrenchment Group 1Group 2Group 3Group 4Group 6 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups

Entrenchment Big Crawfish

Percent Pool Group 1Group 2Group 3Group 4Group 5Group 7Group 8 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups

Myrtle Crane Lets look at Percent Pool

Can data be shared? Some yes Some No. (R 2)

Residual Pool Depth ResPoDepRPD RESIDPDRPDAvgRPDmRPD Group 1Group 2Group 3Group 4Group 5Group 7Group 8 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups

Median Particle Size (54.4 mm) Group 1Group 2Group 3Group 5Group 7 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups 44433

D84 (155.1 mm) Group 1Group 2Group 3Group 5Group 7 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups

% Fines Group 1Group 2Group 3Group 4Group 5Group 6Group 7 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups

Bank Stability stab2pct100-unstabBNK100-pcterosionPctStab Group 1Group 2Group 4Group 7 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups 2441

Large Wood >=3m_Cnt1 00mLWD3x30LWDlwdpiece1LWD_L Group 1Group 2Group 3Group 4Group 7Group 8 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups646425

Large Wood (volume) LWD_Cat1- 2_allLen_Vol100m LWD_Cat1_allLen_ Vol100mVLWDlwdvol1 Group 1Group 2Group 3Group 4 Mean RMSE CV Stream Error Total S:N %Observer %Stream Groups 4431

How I summarized A: S:N >9, stream variability 90%, CV < 20% B: S:N >4, stream variability 80%, CV < 20% C: S:N > 2, Stream variability 70% or CV around 20% D: S:N close to 2, stream variability more than 50%, or CV around 20%. F: Anything lower.

GRP 1 GRP 2 GRP 3 GRP 4 GRP 5 GRP 6 GRP 7 GRP 8 GradientA(1)AABAB BF WidthA(1)AACCB Wetted Width A AA(1) AA WDDFC(1)FFF SinuosityDCA(1) B EntrenchmentFFF(1)F F % PoolFFFBF DA(1) Res Pool DepthAAABA(1) CB D50B(1)CC F F D84BBA(1) B C FinesB(1)FFCBFF Bank StabilityDB A(1) F LWD #A(1)CBB DC LWD VolumeB(1)CFF

Preliminary Observations Some attributes everyone does passable at: gradient, bankfull width, wetted width, residual pool depth. –For these attributes it is likely that cross walks can be determined not only with e ach other but with the truth. Only one attribute that nobody does well at; entrenchment. –Although nobody does well with this one it may not matter since it will only be used for classification; but if that is true why not as a group agree on an AML. For remaining attributes – width to depth, sinousity, % pool, D 50 D 84, fines, bank stability, and large wood volume – some groups have better (more consistent within the group) protocols than others.

Some thoughts on why certain attributes were done better when there was variation in the protocols Ratio things (Sinuosity, width-to-depth, and entrenchment) were done better with laser level. Extensive training resulted in more consistent sediment (fines and particle distributions, and large wood (counts and volume). Pools were best done with a fixed length.

How do we decide what to measure Bankfull width vs wetted width Bankfull width has hydrologic meaning, can be measured if the stream is dry. Not affect by season. Wetted with more consistently measured, is a measure of summer aquatic habitat (nice to know a stream is dry)

What’s next? LiDAR Determine what steps should be taken to standardize protocols. –Continue efforts to develop crosswalks. –Should data quality control recommendations be made. –Seek consensus on the best protocol(s) to use. Determine which attributes provide useful data. Proposal was submitted for BPA funding for follow up work. Publication of the John Day basin protocol test results.

Questions ?