1. Hydrologic Information System for the Nation Ilya Zaslavsky Spatial Information Systems Lab San Diego Supercomputer Center UCSD UCSD Seminar, February 23, 2009 http://his.cuahsi.org http://hiscentral.cuahsi.org http://hydroseek.net http://river.sdsc.edu/ucsddash http://wron.net.au/DemosII/Modules/ODMKMLGatway.aspx http://maxim.ucsd.edu/mattsmaps/storet.aspx

2. SDSC Spatial Information Systems Lab Research and system development Services-based spatial information integration infrastructure, CI projects Mediation services for spatial data, query processing, map assembly services Long-term spatial data preservation Spatial data standards and technologies for online GIS (SVG, WMS/WFS) Support of spatial data projects at SDSC and beyond services In Geosciences (GEON, CUAHSI, CBEO,…) In regional development (NIEHS SBRP, CRN…) In Neurosciences (BIRN, CCDB) http://spatial.sdsc.edu/lab/ Contact: zaslavsk@sdsc.edu

3. Consortium of Universities for the Advancement of Hydrologic Science, Inc. An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U.S. http://www.cuahsi.org/ 122 US Universities as of July 2008

4. What is the CUAHSI HIS? CUAHSI HIS: NSF support through 2012 (GEO), ~10 mil invested Partners: Academic: 11 NSF hydrologic observatories, CEO:P projects, LTER… Government: USGS, EPA, NCDC, NWS, state and local Commercial: Microsoft, ESRI, Kisters International: Australia, UK, Malaysia, Singapore An online distributed system to support the sharing of hydrologic data from multiple repositories and databases via standard water data service protocols; software for data publication, discovery, access and integration.

5. Observation Stations Ameriflux Towers (NASA & DOE)NOAA Automated Surface Observing System USGS National Water Information SystemNOAA Climate Reference Network Map for the US Build a common window on water data using web services

6. Water Data Web Sites

7. NWISWeb site output # agency_cd Agency Code # site_no USGS station number # dv_dt date of daily mean streamflow # dv_va daily mean streamflow value, in cubic-feet per-second # dv_cd daily mean streamflow value qualification code # # Sites in this file include: # USGS 02087500 NEUSE RIVER NEAR CLAYTON, NC # agency_cdsite_nodv_dtdv_vadv_cd USGS020875002003-09-011190 USGS020875002003-09-02649 USGS020875002003-09-03525 USGS020875002003-09-04486 USGS020875002003-09-05733 USGS020875002003-09-06585 USGS020875002003-09-07485 USGS020875002003-09-08463 USGS020875002003-09-09673 USGS020875002003-09-10517 USGS020875002003-09-11454 Time series of streamflow at a gaging station

8. http://his.cuahsi.org/odmdatabases.html CUAHSI Observations Data Model

9. Information communication Water web pagesWater web services HyperText Markup Language (HTML) Water Markup Language (WaterML)

10. Water Data Services Set of query functions Returns data in WaterML NWIS Daily Values (discharge), NWIS Ground Water, NWIS Unit Values (real time), NWIS Instantaneous Irregular Data, EPA STORET, NCDC ASOS, DAYMET, MODIS, NAM12K, USGS SNOTEL, ODM (multiple sites)

11. Test bed HIS Servers Central HIS servers ArcGIS Matlab IDL, R MapWindow Excel Programming (Fortran, C, VB) Desktop clients Customizable web interface (DASH) HTML - XML WSDL - SOAP Modeling (OpenMI) Global search (Hydroseek) WaterOneFlow Web Services, WaterML Controlled vocabularies Metadata catalogs Ontology ETL services HIS Lite Servers External data providers Deployment to test beds Other popular online clients ODM DataLoader Streaming Data Loading Ontology tagging (Hydrotagger) WSDL and ODM registration Data publishing ODMTools Server config tools HIS Central Registry & Harvester Hydrologic Information System Service Oriented Architecture

12. Central HIS Data Services Catalog

14. Semantic Tagging of Harvested Variables

15. Hydroseek http://www.hydroseek.net Supports search by location and type of data across multiple observation networks including NWIS, Storet, and academic data

16. Against the NIH Syndrome 2006: ► CUAHSI HIS web services are discussed on the BASINS mailing list as a new way to access hydrologic data. The list is mostly used by hydrologists and developers outside academia; ► NCDC develops ASOS web services following WaterML 2007: ► MOU with USGS; USGS is developing WaterML-compliant GetValues service; ► GLEON uses an early version of ODM to develop their own schema (VEGA); ► Phoenix LTER is developing ODM (in MySQL) and WaterML services (in Java); ► A Google Earth-based client for CUAHSI web services is developed at CSIRO, Australia; ► Deployment to 11 hydrologic observatory test beds, + CBEO (CEOP project) 2008: ► KISTERS develops WaterML-compliant web services over their database, for a client; ► MapWindow open source GIS develops WaterOneFlow parsers; ► Florida, Texas and Idaho use ODM and WaterOneFlow web services to provide access to state data repositories; New Jersey is considering the same; ► Another CEOP project, at UC-Davis, is implementing ODM (in Postgres) and web services (in Java); ► Stroud Water Research Center; WRON; AWI… many that we don’t know… ► Now SBRP: data from UCSD, UA, more?

17. Visualization and Analysis of Large Datasets ► Tiled wall (Falko Kuester) ► OLAP cubes for repositories (via Excel and online GIS) ► Google Earth client

18. Coming soon… ► All Hands Meeting of CUAHSI HIS at SDSC; April 6-7 2009 ► Meetings at BOM, CSIRO, global water initiative (second half of March) ► Open Geospatial Consortium: will adopt Hydrology Domain Working Group (end of March): focus on WaterML 2.0 ► Collaboration with World Meteorological Organization (joint charter between WMO’s CHy and OGC’s Hydrology DWG) ► Automated facilities for uploading/hosting observations data ► Integration with real-time (via DataTurbine), with hydrologic models (via OpenMI, CSDMS), animations, spatio-temporal interpolation ► Desktop HIS (this year)

19. Summary Generic method for managing and publishing observational data –Supports many types of point observational data –Overcomes syntactic and semantic heterogeneity using a standard data model and controlled vocabularies –Supports a national network of observatory test beds but can grow! WaterML is a standard language for consistently communicating water observations data from academic and government sources using web services National Water Metadata Catalog is the most comprehensive index of the nation’s water observations presently existing Join the Water Data Federation!

20. HIS in SBRP: Why and How WHY: –Capacity building for academic and non-profit groups –Re-use and integration of collected data; discover other data collected in your area; reduce duplication –Data support of partnerships –Emerging granting agency requirements E.g. NSF LTREB program ( http://www.nsf.gov/pubs/2007/nsf07588/nsf07588.htm ): " As part of the requirements for funding, projects must show how collected data will be shared broadly with the scientific community and the interested public.“ http://www.nsf.gov/pubs/2007/nsf07588/nsf07588.htm –Preserve contributions by different groups (beyond funding) –Publish data as part of publishing papers HOW: –HIS and SBRP communities have much in common –Understanding data models used in SBRP and how they relate to the models we implement; extending controlled vocabularies and the search ontology; publishing data in a standard format; linking applications with the services