SARMMM 9/8/05 # 1 DEVELOPMENTS IN TREND DETECTION IN AQUATIC SURVEYS N. Scott Urquhart STARMAP Program Director Department of Statistics Colorado State.

Slides:



Advertisements
Similar presentations
Sampling Design, Spatial Allocation, and Proposed Analyses Don Stevens Department of Statistics Oregon State University.
Advertisements

Introduction Describe what panel data is and the reasons for using it in this format Assess the importance of fixed and random effects Examine the Hausman.
Designs for estimating variability structure and implications for detecting watershed restoration effectiveness David P. Larsen –Western Ecology Division,
TWG 2/27/03 # 1 A FEW THOUGHTS on MONITORING STUDIES for COLORADO RIVER in THE GRAND CANYON N. Scott Urquhart STARMAP Program Director Department of Statistics.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
VARYING RESIDUAL VARIABILITY SEQUENCE OF GRAPHS TO ILLUSTRATE r 2 VARYING RESIDUAL VARIABILITY N. Scott Urquhart Director, STARMAP Department of Statistics.
Mean, Proportion, CLT Bootstrap
Trend analysis: considerations for water quality management Sylvia R. Esterby Mathematics, Statistics and Physics, University of British Columbia Okanagan.
San Diego Chapter ASA # 1 USES OF POWER IN DESIGNING LONG-TERM ENVIRONMENTAL SURVEYS N. Scott Urquhart Department of Statistics Colorado State University.
KSU Monitoring Designs # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.
Hypothesis Testing Steps in Hypothesis Testing:
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
11 Simple Linear Regression and Correlation CHAPTER OUTLINE
CHAPTER 24: Inference for Regression
Econ 140 Lecture 41 More on Univariate Populations Lecture 4.
EPA & Ecology 2005 # 1 AN ACADEMICIAN’S VIEW OF EPA’s ECOLOGY PROGRAM ESPECIALLY ITS ENVIRONMENTAL MONITORING AND ASSESSMENT PROGRAM (EMAP) N. Scott Urquhart,
Sampling Distributions
Statistics: Data Analysis and Presentation Fr Clinic II.
Hypothesis Testing: Type II Error and Power.
WFM 5201: Data Management and Statistical Analysis
October, A Comparison of Variance Estimates of Stream Network Resources Sarah J. Williams Candidate for the degree of Master of Science Colorado.
"Developing statistically-valid and -defensible frameworks to assess status and trends of ecosystem condition at national scales" "Developing statistically-valid.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Correlation and Regression Analysis
Introduction to Regression Analysis, Chapter 13,
Time Series and Forecasting
Elec471 Embedded Computer Systems Chapter 4, Probability and Statistics By Prof. Tim Johnson, PE Wentworth Institute of Technology Boston, MA Theory and.
1 of 27 PSYC 4310/6310 Advanced Experimental Methods and Statistics © 2013, Michael Kalsher Michael J. Kalsher Department of Cognitive Science Adv. Experimental.
Psy B07 Chapter 1Slide 1 ANALYSIS OF VARIANCE. Psy B07 Chapter 1Slide 2 t-test refresher  In chapter 7 we talked about analyses that could be conducted.
AM Recitation 2/10/11.
Inference for regression - Simple linear regression
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 12-1 Chapter 12 Simple Linear Regression Statistics for Managers Using.
Hypothesis Testing in Linear Regression Analysis
Copyright © Cengage Learning. All rights reserved. 8 Tests of Hypotheses Based on a Single Sample.
Model Checking Using residuals to check the validity of the linear regression model assumptions.
CORRELATION & REGRESSION
Correlation.
Business Forecasting Used to try to predict the future Uses two main methods: Qualitative – seeking opinions on which to base decision making – Consumer.
BPS - 3rd Ed. Chapter 211 Inference for Regression.
Sampling Uncertainty in Verification Measures for Binary Deterministic Forecasts Ian Jolliffe and David Stephenson 1EMS September Sampling uncertainty.
+ Chapter 12: Inference for Regression Inference for Linear Regression.
Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
VI. Evaluate Model Fit Basic questions that modelers must address are: How well does the model fit the data? Do changes to a model, such as reparameterization,
From Theory to Practice: Inference about a Population Mean, Two Sample T Tests, Inference about a Population Proportion Chapters etc.
NPS Temporal Conference # 1. NPS Temporal Conference # 2 DESIGNING PANEL SURVEYS SPECIFICALLY RELEVANT TO NATIONAL PARKS IN THE NORTHWEST N. Scott Urquhart.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
TODAY we will Review what we have learned so far about Regression Develop the ability to use Residual Analysis to assess if a model (LSRL) is appropriate.
Chapter 7 Probability and Samples: The Distribution of Sample Means
1 11 Simple Linear Regression and Correlation 11-1 Empirical Models 11-2 Simple Linear Regression 11-3 Properties of the Least Squares Estimators 11-4.
EMIS 7300 SYSTEMS ANALYSIS METHODS FALL 2005 Dr. John Lipp Copyright © Dr. John Lipp.
Section 6-3 Estimating a Population Mean: σ Known.
Analyzing Expression Data: Clustering and Stats Chapter 16.
ANOVA, Regression and Multiple Regression March
Statistics for Political Science Levin and Fox Chapter Seven
Copyright © 2009 Pearson Education, Inc. 8.1 Sampling Distributions LEARNING GOAL Understand the fundamental ideas of sampling distributions and how the.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Ch16: Time Series 24 Nov 2011 BUSI275 Dr. Sean Ho HW8 due tonight Please download: 22-TheFed.xls 22-TheFed.xls.
Chapter 9: Introduction to the t statistic. The t Statistic The t statistic allows researchers to use sample data to test hypotheses about an unknown.
Implications of Model Specification and Temporal Revisit Designs on Trend Detection Leigh Ann Starcevich (OSU) Kathryn M. Irvine (USGS) Andrea M. Heard.
VARYING DEVIATION BETWEEN H 0 AND TRUE  SEQUENCE OF GRAPHS TO ILLUSTRATE POWER VARYING DEVIATION BETWEEN H 0 AND TRUE  N. Scott Urquhart Director, STARMAP.
BPS - 5th Ed. Chapter 231 Inference for Regression.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Regression.
CHAPTER 29: Multiple Regression*
Basic Training for Statistical Process Control
Basic Training for Statistical Process Control
Gerald Dyer, Jr., MPH October 20, 2016
Hypothesis Tests for Two Population Standard Deviations
TROUBLESOME CONCEPTS IN STATISTICS: r2 AND POWER
STATISTICS HYPOTHESES TEST (I)
Presentation transcript:

SARMMM 9/8/05 # 1 DEVELOPMENTS IN TREND DETECTION IN AQUATIC SURVEYS N. Scott Urquhart STARMAP Program Director Department of Statistics Colorado State University

SARMMM 9/8/05 # 2 PATH FOR TODAY  Review a model I have used to project power of EMAP-type revisit or temporal designs  Recent developments  Impact of removing planned revisits – Grand Canyon  Power of differences in trend – Oregon plan & others  Generalize model to allow distribution of trends  Each part has different collaborators

SARMMM 9/8/05 # 3 A SIMPLE MODEL for a SURVEYED ECOLOGICAL RESPONSE  Consistent with annual or less frequent observation  Represent the response time series by an annual departure  Represent space by a site effect only  Allow sites to be visited in panels  Regard trends across time as a contrast over the panel by annual response means

SARMMM 9/8/05 where i INDEXES PANELS 1, 2,..., s (all sites in a panel have the same revisit pattern) j INDEXES TIME PERIODS ( years in EMAP) k INDEXES SITES WITHIN A PANEL 1, 2,..., n i and (uncorrelated): A STATISTICAL MODEL

SARMMM 9/8/05 A STATISTICAL MODEL - continued  Consider the entire table of the panel by time-period means,  Without regard to, as yet, whether the design prescribes gathering data in any particular cell  Ordered by panel within time period (column wise) With this ordering, we get

SARMMM 9/8/05  Now let X denote a regressor matrix containing a column of 1’s and a column of the numbers of the time periods. The second element of contains an estimate of trend. STATISTICAL MODEL - continued

SARMMM 9/8/05 STATISTICAL MODEL - continued  But this estimate of  cannot be used because it is based on values which, by design, will not be gathered.  Reduce X, Y and  to  X*, Y*, and  *, where these represent that subset of rows and columns from X, Y, and  corresponding to where data will be gathered. Then

SARMMM 9/8/05 A STANDARDIZATION  Note that can be rewritten as  Consequently power, a measure of sensitivity, can be examined relative to

SARMMM 9/8/05  Trend: continuing, or monotonic, change. Practically, monotonic trend can be detected by looking for linear trend.  We will evaluate power in terms of ratios of variance components and where this denominator depends on the ratios of variance components and the revisit or temporal design. TOWARD POWER

SARMMM 9/8/05 # 10 POWER REFERENCE  Urquhart, N. S., S. G. Paulsen and D. P. Larsen. (1998). Monitoring for policy-relevant regional trends over time. Ecological Applications 8:

SARMMM 9/8/05 # 11 DESIGN and POWER of VEGETATION MONITORING STUDIES for THE RIPARIAN ZONE NEAR THE COLORADO RIVER in THE GRAND CANYON COOPERATORS Mike Kersley, University of Northern Arizona, and Steven P. Gloss, Program Manager-Biological Resources Grand Canyon Monitoring & Research Center, USGS

SARMMM 9/8/05 # 12 POWER TO DETECT TREND IN VEGETATION COVER, ZONE = 15, VARYING % TREND 1%, 2%, 3% 5% PER YEAR

SARMMM 9/8/05 # 13 TODAY’S PATH  Bit of historical background  Distribution of sample sites along river  Inquiry about your stat backgrounds  Variation and its structure  Power  Responses  Zone  Responses to some questions asked during oral presentation  How the sample sites were selected  How the power was calculated Available Info – Probably not for today

SARMMM 9/8/05 # 14 VIEW DOWN TRANSECT AT MILE 12.3

SARMMM 9/8/05 # 15 MARKING TRANSECT AT MILE 12.3

SARMMM 9/8/05 # 16 MIKE & SCOTT AT THE END!

SARMMM 9/8/05 # 17 CLIFF AT MILE (PARTIAL HEIGHT)

SARMMM 9/8/05 # 18 LOCATION OF SITES BY RIVER MILE Revisit Sites 2002 Sites 2001 Sites

SARMMM 9/8/05 # 19 RESPONSE SIZE AND VARIATION  Data 2001 & 2002, including revisit sites Vegetation cover Other responses, but not discussed here  Analysis model River Width (fixed) Year (random) – proxy for roughness of immediate terrain Station = river mile (random) Residual = Year by Station interaction/remainder

SARMMM 9/8/05 # 20 MEAN and STANDARD DEVIATION of VEGETATION COVER vs ZONE (RIVER FLOW LEVEL)

SARMMM 9/8/05 # 21 STRUCTURE OF VARIANCE  The common formulas for estimating (computing) variance assume UNCORRELATED data.  Reality: This rarely is true.  Examples - Data from the same SITE, but different years are correlated Data from the same YEAR, but different years are correlated  Total variance = var(site) + var(year) + var(residual)  Subsequent figures show this

SARMMM 9/8/05 # 22 COMPONENTS of VARIANCE of VEGETATION COVER SITE, YEAR, and RESIDUAL

SARMMM 9/8/05 # 23 SAMPLE SIZE ASSUMPTIONS FOR POWER  25 revisit sites  Revisited annually  30 sites to be visited on a three-year rotating cycle  “Augmented Rotating Panel Design”

SARMMM 9/8/05 # 24 POWER TO DETECT TREND IN VEGETATION COVER, ZONE = 15, VARYING % TREND 1%, 2%, 3% 5% PER YEAR

SARMMM 9/8/05 # 25 RESPONSE TO A QUESTION  “What would be the effect of revisiting sites only in alternating years after the first?”  Response 1: My greatest concern would be retaining the skills and knowledge of those doing the evaluations. (Changing personnel would almost certainly change response definitions in subtle, but unrecognized ways.)  Response 2: Power to detect trend would be delayed somewhat. (Actually a bit more than I initially thought!)  This is illustrated in the next two slides.

SARMMM 9/8/05 # 26 ALTERNATE REVISIT PLAN and SAMPLE SIZES ASSUMPTIONS FOR POWER  25 revisit sites  Revisited annually, for first three years (as planned), then in alternating years  30 sites to be visited on a three-year rotating cycle  A revisit plan with no specific name

SARMMM 9/8/05 # 27 POWER TO DETECT TREND (2%PER YEAR) IN COVER by ZONE and REVISIT PLANS: CURRENT = n ; ALTERNATE = l

SARMMM 9/8/05 # 28 OBSERVATIONS RELATIVE TO POWER UNDER THE BIANNUAL REVISIT PLAN  The loss of power for biannual revisits compared to the augmented serially alternating design has some noteworthy characteristics:  Power is the order of a quarter to a third for all years less than a decade.  The time required to get to a given level of power is extended by 3-5 years in the biannual revisit design.  The "years" on the x-axis represents the starting point for ANY comparison  Power accrues from accumulating data, elapsed time, and accumulating trend  Detection of moderate trends requires a commitment to the continuing acquisition consistent and comparable data.  These power evaluations DO NOT relate to comparing years 10 to 11, or any specific two years.

SARMMM 9/8/05 # 29 MODEL ADAPTATION  Have a set of panels for the “untreated” sites, another for the “treated” sites.  Change X*, but not Y*or  *:

SARMMM 9/8/05 # 30 POWER TO DETECT DIFFERENCES IN TREND (BETWEEN “TREATED and “UNTREATED”) COOPERATORS Phil Larsen, WED (Part of a presentation for the American Fisheries Society next week) Oregon Plan Team

SARMMM 9/8/05 # 31 SOURCE OF ESTIMATES OF VARIANCE COMPONENTS  Data source  Response is log of large woody debris  Log 10 (LWD+0.1)  Variance components values were selected as low and high  All plans assume annual revisit  Number of sites in each set = 5, 10, 15, 20, 25

SARMMM 9/8/05 # 32 ALL POWER CURVES – SET #1 (8/16/05)

SARMMM 9/8/05 # 33 POWER CURVES FOR DETECTING DIFFERENCES IN TREND (LOW VALUES OF VARIANCE COMPONENTS)

SARMMM 9/8/05 # 34 POWER CURVES FOR DETECTING DIFFERENCES IN TREND (HIGH VALUES OF VARIANCE COMPONENTS)

SARMMM 9/8/05 # 35 POWER CURVES FOR DETECTING DIFFERENCES IN TREND (LOW vs HIGH VALUES OF VARIANCE COMPONENTS, n = 10 EACH)

SARMMM 9/8/05 # 36 POWER CURVES n = 20 ALWAYS REVISIT SAME SITES versus AUGMENTED SERIALLY ALTERNATING FOR HIGH VALUES OF VARIANCE COMPONENTS

SARMMM 9/8/05 # 37 POWER CURVES FOR HIGH VALUES OF VARIANCE COMPONENTS; AUGMENTED ROTATING PANEL DESIGN

SARMMM 9/8/05 # 38 TOWARD POWER TO DETECT REGIONAL TREND WHEN TREND VARIES BY SITE COOPERATORS Phil Larsen, WED, EPA Tim Gerrodette, National Marine Fisheries Service, Southwest Science Center, La Jolla, CA Dawn Van Leeuwen, New Mexico State Univ Will use Oregon Plan data

SARMMM 9/8/05 # 39 INITIAL SIMPLIFYING CONDITIONS  Every site in a region is revisited every year, and  Some relevant response is evaluated.

SARMMM 9/8/05 # 40

SARMMM 9/8/05 # 41

SARMMM 9/8/05 # 42

SARMMM 9/8/05 # 43

SARMMM 9/8/05 # 44 WHERE NEXT WITH RANDOM SLOPES?  Model adapts to matrices and varied revisit plans  should be incorporated into power calculations  Estimate magnitude of  Montana Bull Trout  Various Oregon Plan responses  Develop web-based software  This is where Tim Gerrodette enters – This generalizes something he did earlier