1. National Center for Supercomputing Applications University of Illinois at Urbana–Champaign Great Lakes to Gulf Virtual Observatory Marcus Slavenas September 2nd, 2015

2. Outline Motivation / Funding Architecture Front End Interface Data – Sources and Parsing Questions

3. Motivation and Funding Hypoxic Zone Aggregate Sources for: Scientists Decision Makers

4. Software Architecture Long Term Archive Geospatial Database Mongodb: Raw Data Postgres: Geospatial Cache Clowder: Web service (API) Data Manage Geodashboard: Visualize Search Retrieve Parsed DataRaw Data

5. http://gltg.ncsa.illinois.edu

6. Explore the Data Explore Data By: Sources Reaches Watershed

7. Explore Data Time Scale Binning Nitrate Load Cumulative Load

8. Calculations Gap Filling Load Calculation

9. Compare

10. Search Location Time Source Parameter

11. Search – River Reaches and Watershed

12. Raw Data Archive

13. Raw Files - Provenance Trail

14. CURRENT DATA SOURCES US Geological Survey Nitrate, Discharge -> Load (More Coming) ~Real Time U.S. Army Corps of Engineers Long Term Monitoring Program Quarterly National Oceanic and Atmospheric Administration Temperature ~Real Time Water Quality Portal (USGS, USEPA, USDA) Mostly for historical data Great Rivers Ecological Observation Network Water Quality and Environmental Data ~Real Time MORE…

15. Extract Transform Load (ETL) Python Scripting Extract 1.Through Web Service 2.From Files Generalization Transform All data parsed to similar format JSON/GEOJSON Load Through Clowder Web Service

16. Datapoint ISO 8601 With timezone Open JSON document GeoJSON Geolocation

17. Data Storage Structure/Format DatapointStreamSensor/Site

18. Provenance Trail

19. Questions? Contact Michael Brennan Marcus Slavenas Live Site https://gltg.ncsa.illinois.edu