CUAHSI Hydrologic Information System and the Virtual Observatory David R. Maidment Center for Research in Water Resources University of Texas at Austin NSF-NERC Workshop Washington DC March 1, 2010

CUAHSI Hydrologic Information System and the Virtual Observatory The cloud and web services CUAHSI water data services Building water data networks Ways of using water data services

CUAHSI Hydrologic Information System and the Virtual Observatory The cloud and web services CUAHSI water data services Building water data networks Ways of using water data services

HIS Team and Collaborators University of Texas at Austin – David Maidment, Tim Whiteaker, James Seppi, Fernando Salas San Diego Supercomputer Center – Ilya Zaslavsky, David Valentine, Tom Whitenack, Matt Rodriguez Utah State University – David Tarboton, Jeff Horsburgh, Kim Schreuders, Justin Berger University of South Carolina – Jon Goodall, Anthony Castronova Idaho State University – Dan Ames, Ted Dunsford, Jiri Kadlec

A Virtual Observatory for Catchments Modeling Weather and Climate Monitoring Remote Sensing Catchment Accessing and synthesizing data and models …… …… doing this in “the cloud”

What is “the cloud”? Networks of computers connected through the web ……. Everything is a service – Data, models, visualization, …… A service receives requests and provides responses using web standards (WSDL) It uses customized web languages – HTML (HyperText Markup Language) for text and pictures – WaterML for water time series (CUAHSI) – GML for geospatial coverages (OGC) ….. supporting a wide range of users

Text, Pictures in HTML How does the internet work? 7 …..this is how it works now This is how it got started ….. Web serversMosaic browser Text, Pictures in HTML Web serversFirefox, Internet Explorer Google, Yahoo, Bing Three key components linked by services and a common language Catalog User Server

What has CUAHSI Done? Taken the internet services model ….. ServerUser Catalog …..and implemented it for water observations data Time series data in WaterML HydroServer, Agency ServersHydroExcel, HydroDesktop,... HIS Central

CUAHSI Hydrologic Information System and the Virtual Observatory The cloud and web services CUAHSI water data services Building water data networks Ways of using water data services

Rainfall Water quantity Groundwater Water Observations Data Meteorology Soil water Water quality 10

Water Data Web Sites

Point Water Observations Time Series A point location in spaceA series of values in time 12

WaterML as a Web Language Discharge of the San Marcos River at Luling, TX June 28 - July 18, 2002 Streamflow data in WaterML language The US Geological Survey and other water agencies in the US have adopted WaterML

International Standardization of WaterML 14 OGC/WMO Hydrology Domain Working Group Design of WaterML 2.0 and testing in Interoperability Experiments Meets 4 times per year (2 in Europe, 2 in US) OpenMI conceptual model should be included + Hydrology Workshop at JRC, Ispra (formed in December 2008)

NCDC Integrated Station Hourly Data Hourly weather data up to 36 hours ago 13,628 sites across globe 34 variables Published by National Climate Data Center and populated with weather observations from national weather services

USGS Instantaneous Data Real time, instantaneous data over the last 60 days sites, nationally for the US 80 variables Published by USGS National Water Information System

Corps of Engineers Water Observations Time series at Corps gages 2210 sites, mainly in Mississippi Basin 80 variables 4954 series Published by Corps of Engineers, Rock Island District to support their WaterML plugin to HEC- DSS

Reynolds Creek Experimental Watershed 1 data service 84 sites 65 variables 372 series 17.8 million data Published by USDA- ARS as part of an Idaho Waters project

Iowa Tipping Bucket Raingages 19 Data Manager: Nick Arnold, IIHR

The CUAHSI Water Data Catalog services 15,000 variables 1.8 million sites 9 million series 4.3 billion data Values... All the data is accessible in WaterML

Hydro Portal: Interconnection of data portals based on the OGC Catalog Services for the Web standard Customization of ArcGIS GeoPortal Extension for WaterML web services data

Working Towards Common Semantics Using an Ontology to Reconcile Meanings of Variables A hierarchy of concepts Match variables to leaf concepts HydrosphereChemical Physical Biological Uses EPA Substance Registry System for Chemistry

CUAHSI Hydrologic Information System and the Virtual Observatory The cloud and web services CUAHSI water data services Building water data networks Ways of using water data services

WISKI Water Data Management System from the Kisters company based in Aachen, Germany Kisters has adopted the CUAHSI model for water data services

WISKI Data Systems in the UK and Ireland The technology to implement CUAHSI water data services in the UK is already deployed….

WISKI Data Systems in the UK and Ireland Surface water: 7696 Rainfall: Groundwater: Effluent sites: 3658 Water quality: 237 Areal: 257 (for calculation of areal rainfall) Secondary gauging sites: 43 (for summarizing gaugings) Reservoirs: ,000 sites

Inland Northwest Research Alliance (INRA) Water Research Consortium - coalition of eight universities working in cooperation with the US Department of Energy – Boise State University – Idaho State University – Montana State University – University of Alaska Fairbanks – University of Idaho – University of Montana – Utah State University – Washington State University ICEWATER – INRA Constellation of Experimental WATERsheds ICEWATER

ICEWATER Data Point Observations – Stream gages – Water quality sampling – Weather stations – Soil moisture – Snow monitoring – Groundwater level/quality Spatially Distributed Data – Land use/cover – Terrain – Hydrography

ICEWATER CI Architecture Each University establishes a HydroServer node A central portal provides support services

CUAHSI Hydrologic Information System and the Virtual Observatory The cloud and web services CUAHSI water data services Building water data networks Ways of using water data services

How do you access WaterML web services? Time series data in WaterML HydroServer, Agency ServersHydroExcel, HydroDesktop,... HIS Central Users

HydroExcel – one series at a time Soil water data from Dry Creek Watershed

HydroDesktop – an Open Source HIS A web-based collaborative software design and development environment was set up on CodePlex.com. This site includes a discussion forum, wiki, source code repository and versioning system, and bug/issue tracking system.

HydroDesktop A Hydrologic Information System integrates space, time and modeling MapWindow SQLite – an open source software development OpenMI

Pipistrelle : OpenMI Model Compositions Developed at Hydraulic Research Wallingford CUAHSI Components Database reader Database writer Map Window

A Social Networking System for Sharing Geospatial Data

A Question… …..what is the telescope you use to view it? Once you have a cloud…..

Some parting thoughts….. The Virtual Observatory is a great idea! WaterML is a standard for sharing water observations data We in CUAHSI HIS would be happy to collaborate with the VO team We would like to learn from what you do