Ocean Sciences CUAHSI-Hydrologic Information Systems CUAHSI – Consortium of Universities for the Advancement of Hydrologic Science, Inc Formed in 2001 as a legal entity 100 member universities (May 2005) Program office in Washington (5 staff) Rick Hooper is Executive Director Earth Sciences Atmospheric Sciences NSF Geosciences Directorate UCAR CUAHSI Unidata HIS

CUAHSI Hydrologic Information Systems

Project co-PI Collaborator CUAHSI Hydrologic Information System

Environmental Cyberinfrastructure Part of NSF Cyberinfrastructure program CUAHSI Hydrologic Information Systems is one of several pilot projects – CUAHSI, CLEANER, ORION, NEON, GEON, …..

Cyberinfrastructure Components

Workflow Sequencing using ModelBuilder

HIS Goals Data Services for Hydrologists – get me the data I want quickly and painlessly Support for Observatories – data structure for Digital Watersheds Advancement of Hydrologic Science – flux coupler, HydroObjects Hydrologic Education – how to get data into the classroom

Digital Watershed Hydrologic Observation Data Geospatial Data Remote Sensing Data Weather and Climate Data (NetCDF) (GIS) (Relational database or delimited ascii) (EOS-HDF) Digital Watershed

CUAHSI HIS Overview HIS User Assessment Hydrology Data Portal Digital Watershed Hydrologic Analysis

HIS User Assessment First survey done for HIS White Paper (2003) HIS Symposium in March – 4 institutional surveys and a survey of participants CUAHSI Web Surveyor – developed by David Tarboton and Christina Bandaragoda (75 responses from 38 institutions) Summary paper circulated by yesterday

Please rank these four HIS service categories for helping you. Conclusion: Data services are the highest priority Value Score (counting 4 for first, 4 for second, 2 for third and 1 for fourth).

% of time spent preparing data

Which operating systems do you use for your research? If you use more than one operating system, select all that apply.

Please indicate one dataset that you believe would most benefit from increased ease of access through a Hydrologic Information System (HIS). Conclusion: EPA STORET Water Quality, Streamflow and Remote Sensing Data are perceived to be able to benefit from improved access. I am surprised USGS streamflow is up there. Is this an indication of importance over difficulty?

How we use software (Austin Symposium)

Which of the following data analysis difficulties are most important for HIS to address? Conclusion: High priorities are: - Data formats - Metadata - Irregular time steps Value Score (counting 3 for first, 2 for second and 1 for third).

How we use software (Web Surveyor) Programming (85% of respondents): Fortran, C/C++, Visual Basic Data Management (93%): Excel, MS Access GIS (93%): ArcGIS Mathematics/Statistics (98%): Excel, Matlab, SAS, variety of other systems Hydrologic models (80%): Modflow, HEC models A general, simple, standard, and open interface that could connect with many systems is the only way to accommodate all these

CUAHSI HIS Overview HIS User Assessment Hydrology Data Portal Digital Watershed Hydrologic Analysis

Hydrologic Observations Database A relational database stored in Access, PostgreSQL, SQL/Server, …. Stores observation data made at points Access data through web interfaces Fill using automated data harvesting Streamflow Flux tower data Precipitation & Climate Groundwater levels Water Quality Soil moisture data

Hydrologic Observations Data Model Review conducted by David Tarboton with 22 responses – redesign of this model is now being done Relationships

Proposed CUAHSI Observations Database Schema (for details see chap 6 at HISStatusSept15.pdf)

Example: Lake Water Chemistry

Data Access and Viewing System in ArcMap

CUAHSI Data Portal

Plot from the Hydrology Data Portal Produced using a CUAHSI Hydrology Web Service: getDailyStreamflowChartgetDailyStreamflowChart

CUAHSI Hydrology Web Services for NWIS

Documentation: getDailyStreamflowChart

Applications and Services Web Services Library Web application: Data Portal Your application Excel, ArcGIS, Matlab Fortran, C/C++, Visual Basic Hydrologic model ……………. Your operating system Windows, Unix, Linux, Mac Internet

Utah State University Streamflow Analyst

CUAHSI HIS Overview HIS User Assessment Hydrology Data Portal Digital Watershed Hydrologic Analysis

Digital Watershed How can hydrologists integrate observed and modeled data from various sources into a single description of the environment?

Digital Watershed Hydrologic Observation Data Geospatial Data Remote Sensing Data Weather and Climate Data (NetCDF) (GIS) (Relational database or delimited ascii) (EOS-HDF) Digital Watershed A digital watershed is a synthesis of hydrologic observation data, geospatial data, remote sensing data and weather and climate data into a connected database for a hydrologic region

Created first for the Neuse basin Digital Watershed: An implementation of the CUAHSI Hydrologic Data Model for a particular region

Neuse Atmospheric Water Daily precipitation data from NCDC gages Nexrad daily rainfall rasters Land surface – atmosphere fluxes from North American Regional Reanalysis of climate

Neuse Surface Water Streamflow, water quality hydrologic observational data GIS: River network, water bodies, watersheds, monitoring points Land cover, soils, MODIS remote sensing (Praveen Kumar) MODIS Terrain and Land Cover

ArcIMS Web Server displaying data compiled in Neuse HO Planning Study

Neuse Basin: Coastal aquifer system * From USGS, Water Resources Data Report of North Carolina for WY 2002 Section line Beaufort Aquifer

Neuse Groundwater Geovolumes of hydrogeologic units from US Geological survey (GMS)

Create a 3 dimensional representation Geovolume Each cell in the 2D representation is transformed into a 3D object Geovolume with model cells

Page 3 Drexel University, College of Engineering Data Centers NCDC USGS NWIS NCEP NWS NGDC Sensor Arrays Numerical Models Prediction HSPF Air-Q MM5 Individual Samples METADATA The Demands

ISO Units/Conversion Page 21 Drexel University, College of Engineering Ontology Examples Hydrologic Metadata We currently have ISO Temporal ObjectsUSGS Hydrologic Unit CodeISO Geospatial Hydrologic Processes Sedimentation ARCHydro What we need is Many More Upper Hydrologic Ontology Michael Piasecki is our expert in this subject!

CUAHSI HIS Overview HIS User Assessment Hydrology Data Portal Digital Watershed Hydrologic analysis

Hydrologic Analysis Hydrologic Process Modeling Statistics and Hypothesis Testing Visualization Data Mining and Knowledge Discovery Digital Watershed

Data Driven Discovery Tools Praveen Kumar is our expert on this subject!

Data Files FebJan 4-D Data Model Space, L Time, T Variables, V D Geostatistics Time Series Analysis Multivariate analysis D Image to Knowledge Data to Knowledge

Hydrologic Flux Coupler Hydrologic Fluxes and Flows Digital Watershed (Atmospheric, surface and subsurface water) We want to do water, mass, energy and water balances

Neuse Observatory Prototype Study

HydroVolumes Take a watershed and extrude it vertically into the atmosphere and subsurface A hydrovolume is “a volume in space through which water, energy and mass flow, are stored internally, and transformed”

Watershed Hydrovolumes Geovolume is the portion of a hydrovolume that contains solid earth materials USGS Gaging stations Hydrovolume

Stream channel Hydrovolumes

Atmospheric science – hydrology Weather and climate fields are the drivers – continuous in space and time across the nation Local watersheds are the reactors – each behaving according to its location and characteristics

GeoTemporal Reference Frame A defined geospatial coordinate system for (x,y,z) A defined time coordinate system (UTC, Eastern Standard Time, ….) A set of variables, V Data values v(x,y,z,t) Space (x,y,z) Time, t Variables, V v – data values Data Cube

Continuous Space-Time Model -- NetCDF Space, L Time, T Variables, V D Coordinate dimensions {X} Variable dimensions {Y}

Space, FeatureID Time, TSDateTime Variables, TSTypeID TSValue Discrete Space-Time Data Model

Geospatial Time Series Value Time Shape Time Series Properties (Type) A Value-Time array A time series that knows what geographic feature it describes and what type of time series it is

Neuse Water Balance Precipitation Evaporation Streamflow Define the fluxes and flows associated with each hydrovolume Groundwater recharge

Coupling Table – Connects fluxes and flows with hydrovolumes A geospatial time series object A geospatial time series object vector Hydrovolume object Coupling FeatureID SourceSinkID TSTypeID Direction FeatureIDSourceSinkIDTSTypeIDDirection TSTypeIDVariable 1Daily Streamflow 2Daily Precipitation 3Daily Evaporation 4Daily Subsurface Recharge

Monthly Fluxes and Flows P, E, R Q

Net Inflow and Cumulative Storage Net Inflow Storage This water balance does not close very well – we need better data! Monthly water balance for one watershed hydrovolume for 2001

HydroObjects Class Library HydroObjects API Remote and local Data sources ArcGIS Excel Matlab Custom Models Web Services Backbone of a Hydrologic Information System

Hydrology Data Portal is a common data window on point observation data sources CUAHSI web services library supports the data portal and local applications on your computer Digital watershed is a data fusion of point observations, GIS, remote sensing and weather and climate grids Hydrologic Flux Coupler key to integrating atmospheric, surface and subsurface water Conclusions In production In developmentIn research