A (prototype) Shiny app for QCing continuous stream sensor data

Slides:



Advertisements
Similar presentations
STANDARDIZING AND ENHANCING BENTHIC MACROINVERTEBRATE MONITORING TOOLS IN THE PUGET SOUND BASIN Deb Lester and Jo Wilhelm - King County Department of Natural.
Advertisements

U.S. Department of the Interior U.S. Geological Survey Welcome to the USGS Webinar: New Science and Online Management Tools to Help Guide Action on Nutrients.
Watershed Characterization System (WCS) and its Modeling Extensions
Water Quality Data Assessment of the Mullica River-Great Bay Estuary Alison Astalos, Mike Kennish Rutgers University, New Brunswick, NJ Introduction Methods.
Integrating Historical and Realtime Monitoring Data into an Internet Based Watershed Information System for the Bear River Basin Jeff Horsburgh David Stevens,
Alan F. Hamlet Dennis P. Lettenmaier Center for Science in the Earth System Climate Impacts Group and Department of Civil and Environmental Engineering.
CEE 795 Water Resources Modeling and GIS Learning Objectives: List the essential data needed for water resource modeling Identify sources of water resources.
Watershed Watch Network NJ Department of Environmental Protection Danielle Donkersloot Volunteer Monitoring Coordinator.
Data for Water Resource Management Module 14, part A – Data types and sources.
Disaster Recovery as a Cloud Service Chao Liu SUNY Buffalo Computer Science.
Evaluation of Macroinvertebrate Assemblages in the Marcellus Shale Region of the Susquehanna River Basin, Luanne Steffy Susquehanna River Basin.
KINEROS (KINematic runoff and EROSion model) Michael Schaffner Senior Service Hydrologist NOAA National Weather Service WFO Binghamton, NY Eastern Region.
ClimDB/HydroDB (ClimHy) Integration ClimHy has been migrated from AND to LNO and will remain status quo in 2011 – Public page (
Mountain Flash Flooding and Its Impacts Across The Blacksburg Weather Forecast Office County Warning Area Anthony Phillips Department of Geography Virginia.
Digital Watershed: Institute of Water Research Michigan State University A Nationwide Web Application Tool for Effective Watershed Management.
Roger Miller, Arkansas Department of Environmental Quality Barry Jackson, USGS Arkansas Water Science Center ARKANSAS EXCHANGE NETWORK FOR GROUNDWATER-QUALITY.
US EPA Update Advisory Committee on Water Information Michael Shapiro, Ph.D. Deputy Assistant Administrator U.S. EPA Office of Water.
TECHNICAL DOCUMENTATIONPARTNERS DOWNLOAD DATA Download water quality data in MS Excel, CSV, TSV, and KML formats. Learn how to use the portal and data.
E X P E R I E N C E Y O U R A M E R I C A Management of Air Quality Monitoring Data Debbie Miller National Park Service U.S. Department of the Interior.
What is a Watershed? Goals for this module Discuss the goals and objectives of the project Discuss the goals and objectives of the project Learn who.
Water Quality Data, Maps, and Graphs Over the Web · Chemical concentrations in water, sediment, and aquatic organism tissues.
BioData a new bioassessment database for the USGS Briefing for the CDI
Wetland Monitoring What Do We Need? Integration of Wetland Monitoring and Wetland Management Wetlands and Waterways Program Maryland Dept. of the Environment.
DEQ Water Supply Planning Integrating Monitoring, Modeling, and Scientific Study with Adaptive Management and Planning.
Webinar: AIR Now and Air Quality System (AQS) July 13, 2011.
A forum for coordinating state, federal, and tribal aquatic monitoring programs in the Pacific Northwest Pacific Northwest Aquatic Monitoring Partnership.
Getting Started in Volunteer Monitoring: Overview USDA-CSREES Southern Region Conference Lexington, Kentucky October 2005 Linda Green USDA-CSREES Volunteer.
Development of a Southeastern Reference Stream Monitoring Network Debbie Arnwine Water Resources, TDEC
Overview of the Colorado Basin River Forecast Center Lisa Holts.
Drought Response Plan Clarke County, Virginia Saving Water/Saving Money: Water Conservation in the Shenandoah Valley March 11, 2009 Alison Teetor Natural.
HYDROLOGIC DATA. BACKGROUND Analysis and synthesis of data is required to perform any hydrologic computation. The engineer needs to: Identify and define.
The Meadows Center Texas Stream Team Prepared in cooperation with the Texas Commission on Environmental Quality and U.S. EPA. The preparation of this presentation.
Response of benthic algae communities to nutrient enrichment in agricultural streams: Implications for establishing nutrient criteria R.W. Black 1, P.W.
BASINS 2.0 and The Trinity River Basin By Jóna Finndís Jónsdóttir.
Mike Phillips Illinois Valley Community College & group participants.
When is the onset of a phenophase? Calculating phenological metrics from status monitoring data in the National Phenology Database Jherime L. Kellermann.
September 2012 Developed by Agricultural and Biological Engineering Department at Purdue University and Department of Regional Infrastructures Engineering.
Introduction Acid deposition (AD) from air pollution is a chronic stress on forest ecosystems in the northeast and mid-Atlantic regions of the U. S. The.
Debra Harrington and Haizhi Chen FDEP Groundwater Protection June, 2005 HYDROPORT RETRIEVAL APPLICATION FOR ASSESSMENTS.
Purdue Status Report Summer Meeting 2012 Midwest Spatial Decision Support Interest Group EPA Region 5 July 9, 2012 Bernie Engel, Larry Theller, Youn Shik.
USGS Water Quality Programs and the Water Quality Monitoring Framework CONTACTS: Herb Buxton (609) Tim Miller
U.S. Environmental Protection Agency Central Data Exchange Pilot Project Promoting Geospatial Data Exchange Between EPA and State Partners. April 25, 2007.
Modeling Stream Flow of Clear Creek Watershed-Emory River Basin Modeling Stream Flow of Clear Creek Watershed-Emory River Basin Presented by Divya Sharon.
Michigan Disease Surveillance System Syndromic Surveillance Project January 2005.
Think about answering the questions: Who? What? Where? When? Why? How? Before your volunteers begin collecting data.
Using Regional Models to Assess the Relative Effects of Stressors Lester L. Yuan National Center for Environmental Assessment U.S. Environmental Protection.
National Water Quality Monitoring Conference Session E4 April 29, 2014 Jonathan Witt & Britta Bierwagen, ORD/USEPA Jen Stamp & Anna Hamilton, Tetra Tech,
SFS Sacramento May 23, 2016 Special Session Introduction: Traits-Based Vulnerability Assessment and Monitoring Under Climate Change Britta Bierwagen (EPA/ORD),
WATER RESOURCES DEPARTMENT
THE USE OF BENTHIC MACROINVERTEBRATE TRAITS TO ASSESS CLIMATE CHANGE RESPONSES AND VULNERABILITIES Anna Hamilton (Tetra Tech), Britta Bierwagen (US EPA),
Dodge County Water Monitoring Update
Dwane Young, U.S. EPA Office of Water
Micro CSI: A Microbial Citizen Science Initiative in Urban Watersheds
Dave Clark and Michael Kasch
Radon Efforts in Washington Tina Echeverria
National Hydro Data Programs
Drought Research and Outreach at CIG
Monitoring NJ Climate Variability & Change
Using Python to Interact with the EPA WATERS Web Services (part 2)
Data Sources for GIS in Water Resources by David R
Data Sources for GIS in Water Resources by David R
Community Tools and Support for Data Driven Education
Hydrologic Conditions: Surface and Ground Water Resources July 2012
Introduction to USA-NPN and Nature’s Notebook
Air Quality Monitoring Networks
Data Sources for GIS in Water Resources
Extremes at elevation – high flow events on Mount Mansfield
The Interoperable Watersheds Network
Flood Modeling Tools for Response and Alerting
ESRI User Conference Water Resources User Group, July 15, 2010
Presentation transcript:

A (prototype) Shiny app for QCing continuous stream sensor data David Gibbs (EPA ORISE fellow) Jen Stamp & Erik Leppo (Tetra Tech) EPA R User Group Meeting Washington, D.C. September 13, 2017 The views expressed in this presentation are those of the author and do not necessarily reflect the views or policies of the U.S. EPA. Office of Research and Development National Center for Environmental Assessment

The problem How to detect climate change effects in streams? Climate change occurs on top of natural variation Detecting climate change effects in streams takes years, if not decades Effects on stream invertebrate communities can be complex

Regional Monitoring Networks (RMNs) Voluntary participation by states, tribes, EPA regions, and river basin commissions Capitalizes on existing monitoring locations and programs, USGS gages Started in 2012 in Northeast

The RMN goal Detect potentially small, climate-related temperature and hydrological trends at a regional scale, in a decision-relevant timeframe, in the context of routine biomonitoring

The RMN approach Long-term monitoring of reference sites (minimal disturbance) Wadeable streams, medium-to-high gradient, <100 km2 watersheds, cold water taxa (higher hydrologic and biologic sensitivity) (for the eastern US) Standardized measurement protocols Continuous stream temperature and water level, annual macroinvertebrate sampling Data regionally pooled to increase statistical power and shorten time for trend detection Site map does not reflect most recent changes to site locations.

Continuous stream measurements Continuous stream and air temperature and water level sensors take measurements every 30 minutes 3-4 months between data retrieval at each site Continuous sensors record episodic or flash events Many states are new to continuous monitoring Temperature (C)

How to QC all these RMN data? One sensor taking one measurement every 30 minutes will record over 17,000 measurements in one year It’s a lot to handle– too much to check manually Automated QC scripts can help Checks for: unreasonable values, rapid changes, and flat values Consistency across partners, users, years RMNs are using an R-based QC process Currently using Tetra Tech’s R script partners run on their computer Moving to web interface using R Shiny

Prototype Shiny app demonstration

Continuous water temperature example sites Water temperature across years Dunnfield Creek, NJ Water and air temperature Dunnfield Creek, NJ Summer invertebrate sampling Spring invertebrate sampling Over many years, trends should emerge in these plots Data from New Jersey Department of Environmental Protection

Next steps Do you have any ideas, suggestions, best practices, etc.? Get app to work online (issue with downloading output files) Make app available online to monitoring partners Improve QC tool functionality: input file format checking, error messages, etc. Add other tools: macroinvertebrate metrics, water metrics 90 days before macroinvertebrate sampling date, etc. Do you have any ideas, suggestions, best practices, etc.? Contact: gibbs.david@epa.gov

For more information, e-mail: gibbs.david@epa.gov jen.stamp@tetratech.com bierwagen.Britta.@epa.gov Acknowledgements Britta Bierwagen (EPA Office of Research & Development Regional Monitoring Network partners Photos from West Virginia DEP