CUAHSI Hydrologic Information System Status Review, July 28, 2004

Agenda Review the work of the five project partners –CUAHSI (Rick Hooper, Jon Duncan) –San Diego Supercomputer Center (John Helly, ….) –University of Texas (David Maidment, …) –University of Illinois (Praveen Kumar ….) –Drexel University (Michael Piasecki…) Involving the collaborators: V. Lakshmi, X. Liang, Y. Liang, U. Lall, L. Poff, K. Reckhow, D. Tarboton, I. Zaslavsky, C. Zheng HIS review meetings –SDSC (August 12-13) – technical detail –Logan (August 23) – user needs assessment

Agenda Review the work of the five project partners –CUAHSI (Rick Hooper, Jon Duncan) – meeting with NSF today –San Diego Supercomputer Center (John Helly, ….) –University of Texas (David Maidment, …) –University of Illinois (Praveen Kumar,...) –Drexel University (Michael Piasecki,…)

Agenda Review the work of the five project partners –CUAHSI (Rick Hooper, Jon Duncan) – Neuse HO report status –San Diego Supercomputer Center (John Helly, ….) –University of Texas (David Maidment, …) –University of Illinois (Praveen Kumar ….) –Drexel University (Michael Piasecki…)

Agenda Review the work of the five project partners –CUAHSI (Rick Hooper, Jon Duncan) – Neuse HO report status –San Diego Supercomputer Center (John Helly, ….) –University of Texas (David Maidment, …) –University of Illinois (Praveen Kumar ….) –Drexel University (Michael Piasecki…)

UT Update General issues Landscape characterization for HO Design Flux algebra for surface water systems XML for interchange of groundwater objects

Science Tools Corporation work with NASA and other institutions integrating databases for scientific purposes Chief Scientist is Richard Troy – he wants to explore potential of working with CUAHSI Commercial system that operates over Oracle, SQL/Server,… Company is based in Oakland, CA

GenScn A tool for generation and analysis of model simulation scenarios for watersheds Incorporated in EPA Basins system Produced by AquaTerra in Decatur, GA Handles lots of different time series types

Suwannee River Watershed Data Contact from Wendy Graham (former Vice- Chair of HIS Committee) Offering data for consideration in HIS data model How to discuss this in Logan?

UT Update General issues Landscape characterization for HO Design Flux algebra for surface water systems XML for interchange of groundwater objects

Landscape Characterization for HO Design Idea suggested by Larry Band at the end of our call on July 14 –have a set of rules for defining subdivisions of the landscape using orders of magnitude of catchment size, type of land use, etc –need to work with LIDAR as well as regular DEM –define points at outlets of these catchments as potential gage sites

EDNA-Elevation Derivatives for National Application

Pfaffstetter Basins 9 basins divided into 99 basins divided into 999 basins

from Larry Band In this case the emphasisis on first retrieving all catchments of a certain size (or range of > sizes) developed by specifying threshold areas or perhaps other > criteria for identifying first order catchments. Likely this would > actually be area as we are less interested in knowing precisely where > channelized flow begins as identifying characteristics of catchments > of specified drainage areas. In response to a set of scientific > questions or hypotheses dealing with scaling issues, we may specify we > need to gauge X streams for each of 5 orders of magnitude of drainage > area that satisfy a set of selection criteria. You're correct that > the procedure would select the set of candidate sites, from which a > final set would need to be chosen. > > The rules can be quite simple, such as 1. all catchments with > 20% > impervious cover (assuming we have an impervious surface layer), or > more complex such as 2. all catchments with > 80% forest in a > specified riparian buffer. It could also include topographic > characteristics including extent and development of floodplain using > some of the indices John Gallant has recently introduced. You're also > correct that this can be a complex problem specifically with lidar > data due to the size of the dataset and also the lack of elevation > data in open water, and the potential apparent drainage disruption due > to infrastructure. My impression is that most or at least many > hydrologists who can carry out this type of activity with standard USGS DEM would have difficulty > handling the lidar data. Most software packages cannot handle the > data volumes. I raised this as a question regarding whether this > would be an efficient use of the HIS groups time and abilities, or > whether this is too specific an application and should be left to the > individual HO. Their ability to handle these and similar problems may > be a good attribute to consider in the proposals.

UT Update General issues Landscape characterization for HO Design Flux algebra for surface water systems XML for interchange of groundwater objects

Mass Balancing ET Rain Flow In Flow Out A South Florida Basin What volume of water is stored within this basin?

Process Hydrologic Data Model Select Time Series Related to Basin Horizontal Inflow Horizontal Outflow #1 Horizontal Outflow #2 Vertical Inflow Vertical Outflow Add to Calculate a Net Flow Net Horizontal Inflow Net Vertical Inflow Net Total Inflow Integrate To Calculate A Storage Cumulative Horizontal Storage Cumulative Vertical Storage Cumulative Total Storage

Daily Averaged Vertical Fluxes

Daily Averaged Horizontal Flow Rates

Daily Averaged Net Flow Rates

Cumulative Storage Since Nov. 1, 2001

Complications to Process Units Conversions Discrete-Continuous Time Dimensions Conversions Need spatial and temporal integration Need unit conversions Need a spatiotemporal referencing system (TGIS) Extracting time series Need ability to query a large database to extract relevant time series for one or more discrete watersheds

UT Update General issues Landscape characterization for HO Design Flux algebra for surface water systems XML for interchange of groundwater objects

Creating a 3D model of the subsurface Stratigraphy from the North Carolina database (tabular), imported into ArcGIS

Importing borehole data to GMS Data is imported from GIS into GMS (Groundwater Modeling System)

Solid model Solids are generated in GMS using the Horizons method Contacts are assigned horizons (from bottom to top) and then solids are created by interpolating a surface for each horizon extruding downward.

Solid model in GIS The solid model is read back into ArcGIS through an XML file

Transfer of the solid model via XML Solids can be represented as a set of vertices and triangles Each vertex has a x, y, and z coordinates Each triangle is constructed of three vertices

Storing solids in an XML file Solids represented as a set of vertices and triangles Vertices Triangles

Full process Stratigraphy information in a spatial database Interpolation in external software (for example GMS) Store solids in XMLBack to spatial database

Agenda Review the work of the five project partners –CUAHSI (Rick Hooper, Jon Duncan) – Neuse HO report status –San Diego Supercomputer Center (John Helly, ….) –University of Texas (David Maidment, …) –University of Illinois (Praveen Kumar ….) – Praveen is overseas… –Drexel University (Michael Piasecki…)

The Modelshed Framework Update July 28, 04

What is a Modelshed? A volumetric spatial (GeoVolume?) model unit, registered in three dimensions by a GIS, with which time-varying data, model fluxes, spatial relationships and descriptive metadata are associated

What can the Modelshed Framework do? Store data for diverse spatio-temporal applications & phenomena A generalized 4D data model for environmental science Addresses issues of scale, heterogeneity, and resolution Build on top of existing data models (e.g. ArcHydro) to leverage existing data structures and tools Establish new relationships Models environmental fluxes Connects raster data and numerical models with object-relational data models

Modelshed UML

Timeseries UML

Flux UML

AreaLink UML

OrthogonalLink UML

Applications: Helping Raster & Vector Talk How can continuous data in rasters be related to database objects? –Summarize the data using statistics, aggregated by overlapping Modelshed areas –Statistics are stored as indexed data records –Modelsheds can be physically meaningful, like watersheds –This process can be automated for a large number of rasters

Applications: Helping Raster & Vector Talk

Applications: Automating data management with the Modelshed Tools The ModelShed Tools automate some database tasks: –Adding new descriptive indexes –Building the index of raster datasets –Automatically processing a timeseries of raster datasets based on areas in the database, and ingesting the statistical data into the database –Building AreaLink tables ModelShed Tools are an extension to ArcGIS 8, and use ArcGIS Spatial Analyst geoprocessing routines

Dynamic Features Supports database features that move and change in time The full range of Modelshed features are still supported, including vertical indexing, flux links, and area links. A parallel UML structure for static and dynamic features

Dynamic Features in Time

Applications 2: ILRDB A prototype geodatabase of the Illinois River Basin using the Modelshed geodata model Combining base hydrography from the NHD / ArcHydroUSA database with supercomputer- generated regional climate data, remote sensing data, land use data, and multi-layer soils data A proof of concept for study using a much more extensive multi-disciplinary integrated database

Illinois River Basin Database (ILRDB)

Studying the relationships between large-scale phenomena and hydrology using the ILRDB Climate simulation precipitation and humidity data is modeled along with NDVI vegetation and surface hydrology Query-based analysis is used to analyze the relationships between these datasets

Agenda Review the work of the five project partners –CUAHSI (Rick Hooper, Jon Duncan) – Neuse HO report status –San Diego Supercomputer Center (John Helly, ….) –University of Texas (David Maidment, …) –University of Illinois (Praveen Kumar ….) – Praveen is overseas… –Drexel University (Michael Piasecki…)

Drexel Progress CUAHSI July

Controlled Vocabulary for the Neuse River Basin ONTOLOGIES Stream Gauges Datums Site Types Counties Agencies Soil Types * Municipal Wells * Units * * In progress hsi/2004/07/neuse-station.owl

MTF and MIF files based on ISO Example for municipal wells… end of this week. Controlled vocabularies will be used to annotate the values MTF Available in the Web : Version 01 based on ISO:

Agenda Review the work of the five project partners –CUAHSI (Rick Hooper, Jon Duncan) –San Diego Supercomputer Center (John Helly, ….) –University of Texas (David Maidment, …) –University of Illinois (Praveen Kumar ….) –Drexel University (Michael Piasecki…) Involving the collaborators: V. Lakshmi, X. Liang, Y. Liang, U. Lall, L. Poff, K. Reckhow, D. Tarboton, I. Zaslavsky, C. Zheng HIS review meetings –SDSC (August 12-13) – technical detail –Logan (August 24) – user needs assessment

Agenda Involving the collaborators: V. Lakshmi, X. Liang, Y. Liang, U. Lall, L. Poff, K. Reckhow, D. Tarboton, I. Zaslavsky, C. Zheng Development of concept papers for particular areas of HIS –LeRoy Poff: an assessment of needs for an HIS to support aquatic ecology…… –Manu Lall: a survey of methodology for statistical space- time interpretation of data…… –We have a draft of a written scopes for Manu’s paper and it has been reviewed by the group

Agenda HIS review meetings –SDSC (Thursday, Friday, August 12-13) – technical detail on HIS development especially on metadata definition –Logan (Monday, August 23) – Status report on HIS project and assessment of user needs for HIS in the hydrologic observatories CUAHSI will provide travel funds for HIS project PI’s and collaborators to travel to one of these meetings