GIS in Water Resources Consortium David R. Maidment, University of Texas at Austin Dean Djokic, Environmental Systems Research Institute (ESRI) Andrew Battin, Michael Plastino – OW Immediate Office Tommy Dewald, Tod Dabolt – OWOW Russ Kinerson, David Wells - OST GIS Water Resources CRWR

Overview What is the Consortium, why is EPA interested ? Activities of the Consortium –Arc Hydro Data Model –Arc Hydro Tools Directions for Consortium work

Who is in the GIS WATER Resource Consortium ? Led by University of Texas Center for Research in Water Resources and ESRI USGS (NHD, EROS Data Center), EPA, DHI, HEC, BYU, CDM, Dodson, LCRA, TNRCC, TWDB, City of Austin Many individuals in academia, government and industry

First Product of the Consortium ArcGIS Hydro Data Model Hydrography Hydrology

First Product of the Consortium ArcGIS Hydro Data Model Hydrography Hydrology

Why is EPA OW involved the GIS WATER Resource Consortium ? ArcHydro Data Model integrates –Mapping and linear referencing NHD capabilities –BASINS hydrologic modeling capabilities ArcHydro Tools can be incorporated into applications –BASINS data management and modeling tools –NHD indexing functions in the NHD Reach Indexing Tool (RIT) and Web-based Reach Indexing Tool

EPA interest in National Hydrography Dataset EPA helped USGS develop NHD Rich cartographic feature content for making maps A stream addressing system for linking water- related information to the national drainage network Upstream/downstream modeling along the drainage network 1 2 3

Watershed Monitoring WQ-12789… 3 75% - Impaired TMDL … 4 45% 100% Water 2 0% 35% Water Quality WQS … 5 0% 100% Standard 1 0% 100% Program Data Program Reach Begin End Layer System ID ID Position Position Indexing EPA and other program information to NHD NHD Reach Address Database (RAD)

Service Layer Data Layer Impaired / Assessed Waters Water Quality Standards User Layer “EnviroMapper For Water” Beaches SDWIS STORET, Nutrients No Discharge Zones “WebRIT / WATERS Locational Tool” “WATERS Query Tool” Reusable Mapping Capabilities Total WATERS NHD Navigate Integrated Geospatial Database NHD information in EPA Applications NHD Reach Address Database

EPA interest in BASINS Designed to meet modeling needs for Total Maximum Daily Loads (TMDLs) and other environmental programs Combines screening and detailed models with GIS data and interface tools Database and CDs contain wide variety of data needed for modeling

Flow Time Time Series Hydro FeaturesHydro Network Channel System Drainage System ArcGIS Hydro Data Model Integrates features of NHD and BASINS

What is a Geodatabase (Dean Djokic)

Geodatabase MS Access Oracle SQL Server Informix DB2 Feature IFeature : IRow IFeature IFeatureBuffer IFeatureBuffer : IRowBuffer IFeatureDraw IFeatureDraw : IUnknown ArcGIS Introduces A new geographic data model A new geographic database –Stored in an RDBMS –Many new capabilities ArcObjects –COM objects that access geographic data –Work with Geodatabases and existing file formats

Geodatabase Overview ArcGIS – “new” GIS technology Applications Data management Data model Customization Internet Data Model Data Model Applications DataManagement

Geodatabase Terms Geodatabase –Persistent store of geographic information in a DBMS Geodatabase Object Model –Collection of ArcInfo objects Geodatabase Access Components –Components (objects) to work with data in a geodatabase

Key Capabilities Features Geometric Networks Relationships Validation Rules Subtypes Default Values Versions Custom Features Data Management GUI (Arc Catalog) CASE tools

Features are geographic objects –Object with a geometry attribute –Vector model for geographic entities –Features (rows) belong to FeatureClasses (tables) Feature location is an attribute of type geometry –Point, Multipoint, Line, Polygon Features Feature (row) ShapeOID 524X,Y,Z,M,... Stream Type Channel... FeatureClass (table)

Feature DataSets Same Spatial Reference Similar conceptually to an ARC/INFO coverage FeatureDataSet FeatureClass Feature (row) ShapeOID 524X,Y,Z,M,... Stream Type Channel... FeatureClass (table) Object Class

Relationships Association between two Object Classes –Spatial and / or non-spatial –Peer-to-peer associations or composite relationships –Cardinality: 1-1, 1-n, n-1, n-m,... –Notification –Validation Rules optional –Subtypes

Geometric Networks A network relationship between Feature Classes Solve network problems: –Connectivity traces –Cycle detection –Set flow directions –Directed tracing –Isolation tracing –Custom solvers Solvers in ArcMap (COM) Build Network topology in ArcCatalog/CASE

Geodatabase Model Feature Geographic Object Row in DBMS Table Geodatabase Collection of FeatureDataSets Like a workspace FeatureDataSet Collection of FeatureClasses Like a Coverage FeatureClass Collection of Features Like a Coverage FeatureClass

Extensible Data Model Stream Basin Feature GageConfluence ComplexEdge SimpleJunction NetworkFeature JunctionFeature EdgeFeature Row Measurement

Questions and Discussion

What is Arc Hydro? (David Maidment)

What is Arc Hydro? An data infrastructure for storing and integrating hydro data within ArcGIS –A set of hydro objects built on top of ArcObjects –A set of standardized attributes –A vocabulary for describing data (glossary) –A toolset for implementing the data model

Hydrologic Information System Analysis, Modeling, Decision Making Arc Hydro Geodatabase

Flow Time Time Series HydrographyHydro Network Channel System Drainage System Arc Hydro Components

Arc BASINS Data Model

Arc Hydro Extension for EPA Basins Arc Basins – –Builds on core Arc Hydro landscape representation –Provides additional feature datasets and tables to store Basins data Basins feature classes Arc Hydro Feature classes

Arc Basins as one geodatabase

Streams Drainage Areas Hydrography Channels Terrain Surfaces Rainfall Response Digital Orthophotos Data Model Based on Inventory

Data Model Based on Behavior Follow a drop of water from where it falls on the land, to the stream, and all the way to the ocean.

Integrating Data Inventory using a Behavioral Model Relationships between objects linked by tracing path of water movement

Arc Hydro Framework dataset for USA at 1:500,000 scale Built from USGS and National Weather Service data MonitoringPoints are USGS stream gaging stations Arc Hydro USA

Streams WatershedsWaterbody Monitoring Points Arc Hydro Framework Input Data

Arc Hydro Framework

Hydrologic Cataloging Units (HUCS) Guadalupe Basin (4 HUC’s) H ydrologic U nit C ode = HUC’s cover continental US average area ~ 1 county

Arc Hydro Framework Dataset for the Guadalupe Basin

HydroNetwork through Canyon Lake Generic Junction (for topological connection of edges) Flowlines through water body

HydroJunction has Waterbody Relationship

Network Tracing Upstream Tracing Downstream Tracing

National Hydro Data Programs National Elevation Dataset (NED) National Hydrography Dataset (NHD) Watershed Boundary DatasetElevation Derivatives for National Application (EDNA)

Scales of representation of Drainage Systems Basins – drainage areas for water resources management Catchments – subdivision of Basin into elementary drainage areas by physical rules Digital Elevation Model – land surface terrain grid cells Watersheds – subdivision of Basin for a particular hydrologic purpose

NWS forecast Watersheds (flooding) EPA TMDL Segments (water quality) TNRCC water availability points (water supply) Guadalupe HydroNetwork Watersheds of the Guadalupe Basin

Catchments, DrainageLines and DrainagePoints

Catchments Subdivided at Watershed Outlet

Tracing on Catchments Upstream Tracing Downstream Tracing (Each catchment knows the next downstream catchment)

Regional Analysis HydroNetwork to provide connectivity of flow through large regions Digital elevation model for terrain analysis within basins

HydroID and HydroCode

National Water Information System Web access to USGS water resources data Arc Hydro NWIS data retrieval tool

TSDateTime FeatureID TSType TSValue Arc Hydro Time Series Object

Streamflow Time Series Arc Hydro Time Series Table

Time Series Extracted to Excel (In Excel, use Data/Get External Data to query Geodatabase) Geodatabase view Excel view

Coupling Spatial and Temporal Data 1 hour Nexard Rainfall on the Guadalupe Basin October 13, 2001

EDNA Catchments Average area = 7.5 km 2 EDNA = Elevation Derivatives for National Application

Intersection of Nexrad and Catchments Atmospheric Water Soil Water Surface Water Surface Water Balance

Modflow Groundwater Cells Average area = 2.6 km 2 Modflow Model of the Edwards-Trinity aquifer

Intersection of Nexrad and Modflow Cells Atmospheric Water Groundwater Balance

Intersection of Nexrad, Catchments and Modflow Atmospheric Water Soil WaterSurface Water Groundwater

Arc Hydro Tools (Dean Djokic)

Arc Hydro Tools A set of tools that “exercises” the Arc Hydro model Key field (property) management. –HydroID & related IDs –Length measures

Arc Hydro Tools Core functions (in addition to standard ArcGIS functionality) –DEM-based watershed delineation (local, global) –Network generation –Attribute and network tracing and summary operations

Arc Hydro Tools Principles A toolbar with packaged menus and buttons Developed using consistent development methodology “Easy” addition of new functionality

Arc Hydro Tools Version 1.0 Raster processing –DEM processing –Watershed delineation Vector processing –Arc Hydro attributes –Network analysis Time Series and Application Utilities Buttons

Questions and Discussion

Role of the Geography Network (Dean Djokic)

Geography Network Overview Provides a framework for sharing and discovering geographic data & services GN Components –User Communities –Content Providers –Web Site (content catalog)

User Communities Content Providers AddressMatchingAddressMatching BusinessBusiness NetworkRoutingNetworkRouting OtherServicesOtherServices FeatureStreamingFeatureStreaming DynamicMappingDynamicMapping Demo-graphicsDemo-graphics StreetsStreets ParcelsParcels BoundariesBoundaries WaterWater Zip Codes PoweredByArcIMS/ArcSDEPoweredByArcIMS/ArcSDE GN Components WebUsersWebUsers NGSMapMachineNGSMapMachine APMapShopAPMapShop ESRIBISESRIBIS OtherOther GISUsersGISUsers ArcGISArcGIS JavaApps.JavaApps. OtherOther DesktopApps.DesktopApps. geographynetwork.comgeographynetwork.com ServiceDirectoryServiceOrdering ServiceDelivery Web Site (Clearinghouse)

GN User Communities GIS Users –Users Needing GIS Data and other Content Web Users –Groups Sharing Common Interests Application Developers –Building “Solutions” for End-Users

GN Content Providers Government Data Providers –USGS, EPA, NIMA, UN, Texas, California Commercial Data Providers –GDT, ORBIMAGE, Meteorlogix, Tele Atlas Potentially ALL GIS Users –Any Organization Publishing Data, Services

Types of GN Content dynamic services Live Data and Maps (“Map Services”) –Image and Feature Services Downloadable Data –“Clip and Ship” Data Services GIS Web Services –Tools for Developers Applications –Custom Built Web Applications

Live Data and Maps

Downloadable Data

GIS Web Services

Applications

Types of GN Content static maps and data Offline Data –Geographic Data for Your GIS Clearinghouses –Web Sites offering Data and Maps Static Map Images –Finished Map Graphics (e.g. TIF, JPG) Map Files –Published Map Documents (e.g. PMF)

Building Your Own GN Several Organizations at All Levels of Government Interested in Building GN’s –UN, NIMA, BLM, EPA, Texas, Delaware –ESRI Distributors Building Local GN’s ArcIMS 4 is “Out-of-the-Box” GN Toolkit –Publish Metadata –Search Metadata –Publish Maps –Distribute Data

Steps to Building a GN Configure Your ArcIMS System Develop and Publish Map Services Develop and Publish Metadata Customize and Deploy Web Site

Integrating Arc Hydro with other Media Data Models and Modeling Tools (David Maidment)

Water Balance in the Landscape Atmospheric Water Soil WaterSurface Water Groundwater Precipitation Evaporation Runoff Recharge Baseflow

Atmospheric Water Soil WaterSurface Water Groundwater Vertical and Horizontal Water Balance

Decoupling and connecting hydrologic systems

Source:

Integration of Data and Models (XML as a data transfer package mechanism) Model 2 Model 1 Data Model 3 Model 4 Model 5 Model 6

Model Integration !? Integration of data, data models, and analyses in a functional system GIS HSPF SWAT EPANet SWMM MIKE 11 RAS Other …

Integration Issues (direct interfacing) GIS HSPFSWAT EPANet SWMM MIKE 11 RAS Other … N N * (N - 1) Bi-directional

Integration Issues (intermediary interfacing) GIS HSPFSWAT EPANet SWMM MIKE 11 RAS Other … N 2 * N Bi-directional XML

Why XML-Based Spatial Data Exchange Semantic tags for spatial data are user specified Easy customization of data structure for different systems Data structure is extensible Good for data distribution on Internet (multi-platform) Existing technologies for XML management (parsers, editors, viewers, components, checkers, converters, …) – economy of development

System Design of the XML-Based Exchange System Architecture –A central exchange mechanism accompanied by customizable XML structures Three components –Central data exchange mechanism embedded in GIS (ArcMap-based) –Customizable control XML structure for import –Customizable control XML structure for export

GIS External Data Analysis Package Customizable Export XML Structure Customizable Import XML Structure Import Data as XML Document Export GIS Data as XML Document Import Engine Export Engine Import Export Central Exchange Mechanism

Central XML-Driven Spatial Data Exchange Mechanism GIS Import Engine –Transform data from various XML data exchange structures into spatial data in a user-defined data model An intermediate XML to XML conversion might be required –Input data exchange structure and geodatabase design are managed by import control XML GIS Export Engine –Transform spatial data from a user-defined data model into various XML data exchange structures –Output data exchange structure and geodatabase design are managed by export control XML

Anatomy of an Interface

A Close Look of Export Process Determine Data Structure Output Data XML Structure Export GIS Data System reads export control XML Determines output data structure Generates output

Control XML in Export Process Sample Control XML Sample Output Data

Export Workflow

Data Import Process Read in data Read control XML structure Validate import data structure against the control structure Generate spatial data Store spatial data in a geodatabase Import XML Structure I Import Data as XML Document Import Engine GIS Import XML Structure II Import Data as XML Document Spatial Data II Spatial Data I

A Close Look of Import Process Import New Import Data XML Schema GIS Data Transform Import Data XSL Style Sheet System reads input data and XSL style sheet Validates data structure against XSL style sheet Generates new import data Reads XML schema and validates input data values Generates GIS data Currently supported spatial data: point, line, polygon, TIN

Customizing Input XML Input format “never” correct Use XSLT to convert XML to XML (or ASCII if need be) Allows reduction in code on GIS side – easier maintenance.

Questions and Discussion

OW Goals for Consortium: USGS has migrated NHD and associated tools to ArcHydro Model EPA NHD Reach Address Database is in geodatabase and linked to USGS NHD in ArcHydro EPA NHD-based applications utilizeArc Hydro Tools EPA BASINS and other modeling applications utilize Arc Hydro Tools

OW Goals for Consortium: USGS has migrated NHD and associated tools to Arc Hydro Model Consortium supports USGS effort to move NHD into the ArcHydro Model Consortium supports USGS effort to migrate NHD data management tools to Arc Hydro Consortium helps maintain integration of USGS NHD in Hydro with Arc Hydro Data Model

OW Goals for Consortium: EPA NHD-based information resources [Reach Index Tool (RIT), WebRIT, NHD RAD…] utilize Arc Hydro Model/Tools Consortium supports linear referencing functions (point and linear events) against NHD in Hydro. Consortium supports ability to port NHD in Hydro into Oracle Spatial format. Consortium supports ability for applications to perform navigation in NHD in Hydro

OW Goals for Consortium: EPA BASINS and other modeling applications utilize Arc Hydro Tools Develop DEM editing and management tools Develop time series interfaces including English- Metric conversion tools Support for EPA effort to establish standard watershed delineation tool Develop watershed curve numbers for use in ArcHydo Develop stream cross section estimation (with USGS)

Potential EPA Goals for Consortium: Support ability to download data Modeling and other needs to download data from various sources –NHD in Arc Hydro from USGS –Water Program information addressed to NHD in EPA Reach Address Database –Other EPA Program information in EPA Enterprise Repository –Other Geospatial Information in Agency Integrated Geospatial Database Other federal and Geography Network geospatial data

Potential EPA Goals for Consortium: Integration of Arc Hydro Data Model with other media for integrated data modeling environment Account for movement of water between different media - atmospheric water, surface water and subsurface water Communication of data among Arc Hydro and other models using a hydrologic version of XML