Optimization of a Large-scale Water Quality Monitoring Network.

Slides:



Advertisements
Similar presentations
Risk Analysis Fundamentals and Application Robert L. Griffin International Plant Protection Convention Food and Agriculture Organization of the UN.
Advertisements

EMS Checklist (ISO model)
Introduction to Monitoring and Evaluation
[Organisation’s Title] Environmental Management System
WMO Competency Standards: Development and Implementation Status
Campus Improvement Plans
Software Quality Assurance Plan
Information Risk Management Key Component for HIPAA Security Compliance Ann Geyer Tunitas Group
TITLE OF PROJECT PROPOSAL NUMBER Principal Investigator PI’s Organization ESTCP Selection Meeting DATE.
Environmental Management Systems An Overview With Practical Applications.
IS Audit Function Knowledge
PPA 502 – Program Evaluation
Regulatory Body MODIFIED Day 8 – Lecture 3.
Lecture(3) Instructor : Dr. Abed Al-Majed Nassar
DITSCAP Phase 2 - Verification Pramod Jampala Christopher Swenson.
Purpose of the Standards
WMO UNEP INTERGOVERNMENTAL PANEL ON CLIMATE CHANGE NATIONAL GREENHOUSE GAS INVENTORIES PROGRAMME WMO UNEP IPCC Good Practice Guidance Simon Eggleston Technical.
Protection Against Occupational Exposure
PERFORMANCE AUDIT REPORT ON MANAGEMENT OF PRIMARY HEALTH CARE (A CASE STUDY ON HEALTH CENTERS) 8/16/20151 Dr. Anna Nswilla CDHSMoHSW.
How to Develop a Project Evaluation Plan Pat Gonzalez Office of Special Education Programs
Internal Auditing and Outsourcing
Strengths 1.Describes clearly the intrinsic value of the Delta and its economy and documents the many public-good services provided by the Delta 2.Provides.
What is Business Analysis Planning & Monitoring?
1 of 39 DQO Implementation Process: Flow Chart and Wall Charts 30 minutes DQO Training Course Day 2 Module 8 Presenter: Sebastian Tindall.
1 Module 4: Designing Performance Indicators for Environmental Compliance and Enforcement Programs.
Performance Measurement and Analysis for Health Organizations
Copyright 2002 Prentice-Hall, Inc. Chapter 1 The Systems Development Environment 1.1 Modern Systems Analysis and Design.
What is an Inventory Program for? Dr. Emilio Moceo Ph.D Director of Studies Meet international obligations and expectations Inform international, national,
PPMT CE-408T Engr. Faisal ur Rehman CED N-W.F.P UET P.
TMDL Science Needs and the Role of Research TMDL Science Needs and the Role of Research Douglas J. Norton USEPA Office of Water October 2005 Douglas J.
Water Supply Planning Initiative State Water Commission November 22, 2004.
S7: Audit Planning. Session Objectives To explain the need for planning To explain the need for planning To outline the essential elements of planning.
Space, Relativity, and Uncertainty in Ecosystem Assessment of Everglades Restoration Scenarios Michael M. Fuller, Louis J. Gross, Scott M. Duke-Sylvester,
Support of the Framework for Monitoring Office of Management and Budget March 26, 2003.
Audit Planning. Session Objectives To explain the need for planning To outline the essential elements of planning process To finalise the audit approach.
1 Designing Effective Programs: –Introduction to Program Design Steps –Organizational Strategic Planning –Approaches and Models –Evaluation, scheduling,
Strengthening Science Supporting Fishery Management  Standards for Best Available Science  Implementation of OMB’s Peer Review Bulletin  Separation.
Welcome to Session 3 – Project Management Process Overview
Benefits of the Redesigned RMP to Regional Board Decision Making Karen Taberski Regional Water Quality Control Board San Francisco Bay Region.
4.3 Document control 4.4 Review of requests, tenders and contracts
Copyright © 2007 Pearson Education Canada 1 Chapter 24: Assurance Services: Internal Auditing and Government Auditing.
VI. Developing a VSMP Program General Stormwater Training Workshop.
Session 9 & 10. Definition of risk assessment and pre condition for risk assessment Establishment of clear, consistent agency objectives. Risk assessment.
Scientifically-Based Research What is scientifically-based research? How do evaluate it?
STRATEGIC ENVIRONMENTAL ASSESSMENT METHODOLOGY AND TECHNIQUES.
EPA Chesapeake Bay Trading and Offsets Workplan June 1, 2012.
Environmental Management Plan (EMP) Required for: Full EIA based on Palestinian EIA Policy Category A projects based on World Bank Policy.
SOFTWARE PROJECT MANAGEMENT
Global Fund Assessments Part II: Understanding Assessment Results Geneva – December 2005.
MICS Data Processing Workshop Multiple Indicator Cluster Surveys Data Processing Workshop Overview of the MICS Process.
Overview of EPA Quality System Requirements. Course Goals At the completion of this course, you will: Understand EPA's quality system requirements Understand.
Purchasing Forum – May The integration of the activities, plans, attitudes, policies, and efforts of the people of an organization working together.
UNDP Guidance for National Communication Project Proposals UNFCCC Workshop on the Preparation of National Communications from non-Annex I Parties Manila,
Optimization of a Large-scale Water Quality Monitoring Network Patricia Burke, Dr. Carlton Hunt, Dr. Steven Rust and Jen Fields.
Overview of the Final Report and Findings from the Review of Sampling Methods in Extrapolated New Base-Year Generation Studies May 11-12, 2004.
RECOVER PDT Workshop COMPREHENSIVE EVERGLADES RESTORATION PLAN April 18, 2002.
RMC Auditor Workshop Charleston, SC July 2015 Registration Management Committee Company Confidential RMC Auditor Workshop Charleston, SC
Watershed Monitoring *Background Watershed Stewardship Plan-2004 Gap Projects IRWMP-Dec Policies SFEI study-2007 Joint TC/WC meeting-June 2010 *Proposed.
Session 2: Developing a Comprehensive M&E Work Plan.
WORKSHOP ON ACCREDITATION OF BODIES CERTIFYING MEDICAL DEVICES INT MARKET TOPIC 9 CH 8 ISO MEASUREMENT, ANALYSIS AND IMPROVEMENT INTERNAL AUDITS.
ICAJ/PAB - Improving Compliance with International Standards on Auditing Planning an audit of financial statements 19 July 2014.
A risk assessment is the process of identifying potential hazards an organization may face and analyzing methods of response if exposure occurs.
Technology Services – National Institute of Standards and Technology Conformity Assessment ANSI-HSSP Workshop Emergency Communications December 2, 2004.
U.S. Department of Education Office of Special Education Programs Building the Legacy: IDEA General Supervision.
Selection Criteria and Invitational Priorities School Leadership Program U.S. Department of Education 2005.
EIAScreening6(Gajaseni, 2007)1 II. Scoping. EIAScreening6(Gajaseni, 2007)2 Scoping Definition: is a process of interaction between the interested public,
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 11. Reporting.
Integrated Regional Water Management Grant Program Implemented Jointly by Department of Water Resources and State Water Resources Control Board.
Internal Control Internal control is the process designed and affected by owners, management, and other personnel. It is implemented to address business.
Managing Project Work, Scope, Schedules, and Cost
Presentation transcript:

Optimization of a Large-scale Water Quality Monitoring Network

The Kissimmee-Okeechobee- Everglades System One of the most diverse ecosystems in the world It stretches 240 miles Integrating and managing the Everglades Construction Project Implementing the Comprehensive Everglades Restoration Plan

WQ Monitoring Network Assess effects of managed actions (e.g., lake draw downs, reservoir creation, CERP) Assess effects of upstream water bodies on downstream water bodies TMDL and PLRG data that feed various types of modeling (development, calibration, verification) Monitor nutrient concentrations and loadings at entry points (dairy outflows, agriculture, developments) Monitor water quality for degradation (short- and long- term trends) Compliance monitoring Special studies - research - finite

Network Components The District’s current water quality monitoring projects (or specific sites) generally fall into three of the following categories: Type I Mandate: Work is required by state or federal statute or permit which is very specific and does not allow for much District discretion in implementation. Examples: NPDES Permit for STA-1W, Non-ECP Permit, Everglades Forever Act Permit, Operation of the C&SF System, etc. Type II Mandate: Work is required by statute, permit, regulation or agreement and allows for some discretion. Examples: Minimum Flows and Levels, Water Supply Plans, Everglades Consolidated Report, Regulatory Programs, CERP Projects, etc. Type III Mandate: Project is not legally mandated, but has been authorized or requested by the Governing Board, Executive Office, or another agency. This type of mandate may include ongoing research that is used to establish criteria and set parameters to obtain future funding to address relevant concerns. The District has complete discretion in implementation. Examples: SWIM Projects, most local cooperative agreements, expert assistance program, and research type monitoring that supports specific projects and District directives.

Background Governing Board and District Management Team requested optimization of monitoring program. Contracted with Battelle Memorial Institute in December 2004 to: Evaluate previous optimization efforts of the regional water quality network; and Statistically optimize the remainder of the network not yet reviewed (~25%). Type II and III Levels only. Assembled team of District lead scientists and program/project managers to oversee technical aspects of the project.

Objectives Ensure that the District monitoring design process is scientifically defensible (right place, right time, right indicators). Produce a comprehensive optimization plan to identify improvements to the current monitoring design. Identify data gaps and/or streamlining opportunities using a statistical analysis process. Develop a blueprint for a District Monitoring Evaluation Tool that will help guide the management of current and future District monitoring efforts.

Ground Rules Applied the U.S. Environmental Protection Agency Data Quality Objectives Process (DQO). Utilized statistically rigorous methods to investigate temporal, spatial and parameter-driven aspects of monitoring projects. Incorporated constraining factors in terms of logistics, QA requirements and budget considerations. Detailed analysis of a large dataset (1.4 million records from 364 sampling locations).

Statistical Methodology Developed Station-parameter-frequency sets associated with the project being optimized: Specify statistical analysis procedures employed to support District use of the monitoring data, and specify the manner in which analysis results are used to make District decisions. Identified all available reports and statistical uses of project data. Identified use of project data in any management decisions. Specify acceptable levels of decision error and uncertainty in statistical analysis results. Select the statistical optimization methodology to be employed and document the rationale for the selection. Employed a 95% confidence interval Power set at 80% for detecting annual proportion change (APC)

Statistical Methodology Identify a critical data use – a way in which WQ monitoring data is used to answer a question or provide a baseline for answering future questions Specify the statistical analysis procedure that will be used to answer the question or estimate baseline entities (Parametric vs. Non-parametric) Select an optimization metric that is an indicator of how well the question can be answered or how precisely the baseline can be established based on the WQ monitoring data Assess effects of potential changes to monitoring plans in terms of corresponding changes in the optimization metric

Optimization Metrics Use: Establish a baseline average parameter concentration Use: Compare parameter concentration to a standard concentration Use: Estimate the average decrease in parameter concentration over a period of time Use: Detect the occurrence of a high parameter concentration event Metric: Standard deviation of the estimated average parameter concentration Metric: The minimum percentage exceedance that is detectable with high power Metric: Standard deviation of the estimated slope for parameter concentration vs. time Metric: Given that an event has occurred, probability that event will be detected

Statistical Tests Focused on key questions relating to the District water quality monitoring network:  Is the data being collected sufficient to assess the effectiveness of projects and/or practices implemented to control and improve water quality?  Spatial Optimizations: Spearman Rank Correlations  Temporal Optimizations: Monte Carlo Simulations using Seasonal Kendall Tau / Mann-Kendall trend analyses  Can the data effectively determine if sufficient progress is being made toward meeting the water quality goals and objectives of these initiatives?  Power Analysis procedures: Estimate Annual Proportion Change (APC) using two-sided t or z test  Ran models with frequency of collection > and < current

Products Defined project objectives and goals, described all data uses, and determined the management and policy decisions the data will support. Ensured data used for statistical analyses were appropriate, complete, and accurate. Defined geographic domains and whether the data for individual sites or geographic regions were to be evaluated Developed a Power Analysis Procedure For Trend Detection With Accompanying SAS Software (Dr. Steve Rust) Addressed seasonal trends and autocorrelation to ensure statistical results are not overstating the power of the monitoring to detect trends. Applied the power analysis to alternative monitoring designs.

Power Analysis Procedure For Trend Detection With Accompanying SAS Software Mixed model fitted to the data Fits data to form a basis for generating simulated water quality parameter data to support a Monte Carlo based power analysis procedure Generate multiple replicate simulated water quality time series data sets Perform a Seasonal Kendall’s Tau trend analysis procedure for each simulated time series data set Gives a point estimate of the slope vs. time for the log-transformed water quality parameter values Estimate the annual proportion change (APC) in water quality parameter values that is detectable with 80% power using a simple two-sided test based on the slope estimate performed at a 5% significance level Seasonal Kendall Tau Test for Trend

Results Projects are not isolated Complex array of end users Data often feed more than one report or mission All water quality monitoring projects had clearly defined objectives and data end users, except Project RAIN. High temporal variability and fixed seasonal effects evident within most projects. Substantial autocorrelation within the time series data for most parameters within a project (limits the ability to obtain truly independent samples). Understanding seasonal water flow into and from a project’s area is a key element of optimization Communication with stakeholders (program managers, data users, etc.) critical component to successful optimization efforts.

Recommendations The optimization process identified several parameters (Chlorophyll b and Chlorophyll c, and carotenoids) that are not used by District investigators or others. It was recommended that these parameters not be routinely measured in the Districts projects. Continue to pursue the elimination of Project RAIN from the network. Need to reach consensus on acceptable level of annual percent change by parameter/project. Precision and confidence levels need to be suitable to the monitoring objective and the type of data collected. If we need to be able to detect smaller changes (i.e., 5%) then many of projects can not achieve this due to autocorrelation and variability. (Critical as we construct CERP restoration projects – adaptive assessment will be used extensively – RECOVER) Use results of power analysis runs showing current and alternative monitoring designs to optimize projects for achievement of long term water quality goals and objectives.

Action Items District staff to evaluate the efficacy of Battelle’s project specific optimization recommendations, and implement with stakeholder approval where appropriate. -Developed Decision Matrix: Budgetary, QA/QC, Political, Unidentified Data Needs, etc. Develop a District-specific Monitoring Evaluation Tool to periodically evaluate current networks and to ensure future monitoring operations are efficient and cost effective. - Will utilize the Power Analysis Procedure for Trend Detection and accompanying SAS Software

Final Report and Power Analysis Procedure Available on Web Site Data and Reports/Technical Publications/ERA #441