1. Development of a Community Hydrologic Information System Support EAR 0622374 CUAHSI HIS Sharing hydrologic data http://his.cuahsi.org/ David Maidment (PI), David Tarboton, Dan Ames, Jon Goodall, Richard Hooper, and Ilya Zaslavsky

2. The way that data is organized can enhance or inhibit the analysis that can be done I have your information right here … Picture from: http://initsspace.com/

3. Data Models (x 1,y 1 ) Continuous surface

4. What are the basic attributes to be associated with hydrologic data values and how can these best be organized? Streamflow Flux tower data Precipitation & Climate Groundwater levels Water Quality Soil moisture data

5. What is HIS The CUAHSI Hydrologic Information System (HIS) provides web services, tools, standards and procedures that enhance access to more and better data for hydrologic analysis. http://his.cuahsi.org PrecipitationWater quantity Meteorology Water quality

6. Consortium of Universities for the Advancement of Hydrologic Science, Inc. An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U.S. http://www.cuahsi.org/ 110 US University members 6 affiliate members 12 International affiliate members (as of March 2009)

7. HIS Team and Collaborators University of Texas at Austin – David Maidment (PI), Tim Whiteaker, Ernest To, Bryan Enslein, Kate Marney San Diego Supercomputer Center – Ilya Zaslavsky, David Valentine, Tom Whitenack Utah State University – David Tarboton, Jeff Horsburgh, Kim Schreuders, Justin Berger Drexel University – Michael Piasecki University of South Carolina – Jon Goodall, Tony Castronova Idaho State University – Dan Ames, Jiří Kadlec, Ted Dunsford, Teva Veluppillai CUAHSI Program Office – Rick Hooper, David Kirschtel, Conrad Matiuk, Yoori Choi WATERS Network – Testbed Data Managers HIS Standing Committee USGS – Bob Hirsch, David Briar, Scott McFarlane NCDC – Rich Baldwin

8. Data Searching – What we used to have to do NWIS NARR NAWQA NAM-12 request request return return Searching each data source separately Michael Piasecki Drexel University

9. What HIS enables Searching all data sources collectively NWIS NAWQA NARR generic request GetValues GetValues ODM Michael Piasecki Drexel University

10. Services-Oriented Architecture for Water Data Data Discovery and Integration platform Data Publication platform Data Synthesis and Research platform Data Services Metadata Services Metadata Search HIS Central HydroDesktopHIS Server Service registration Catalog harvesting Service and data theme metadata Data carts Water Data Services Spatial Data Services

11. Base Station Computer(s) Telemetry Network Sensors Query, Visualize, and Edit data using ODM Tools Excel, text ODM Database ODM Data Loader Streaming Data Loader GetSites GetSiteInfo GetVariableInfo GetValues WaterOneFlow Web Service WaterML Discovery Hydroseek Access Analysis GIS Matlab Splus R IDL Java C++ VB Hydro Desktop HydroExcel Water Metadata Catalog Harvester Service RegistryHydrotagger HIS Central CUAHSI Water Data Services System USGS NWIS EPA STORET NCDCOthers

12. Set of query functionsReturns data in WaterML Slide from David Valentine WaterML and WaterOneFlow WaterML is an XML language for communicating water data WaterOneFlow is a set of web services based on WaterML

13. ISO Timevalue qualifier GetVariables GetValues

14. Direct analysis from your favorite analysis environment. e.g. Matlab % create NWIS Class and an instance of the class createClassFromWsdl('http://river.sdsc.edu/wateroneflow /NWIS/DailyValues.asmx?WSDL'); WS = NWISDailyValues; % GetValues to get the data siteid='NWIS:02087500'; bdate='2002-09-30T00:00:00'; edate='2006-10-16T00:00:00'; variable='NWIS:00060'; valuesxml=GetValues(WS,siteid,variable,bdate,edate,'');

15. What are the basic attributes to be associated with each single data value and how can these best be organized? Streamflow Flux tower data Precipitation & Climate Groundwater levels Water Quality Soil moisture data Observations Data Model (ODM) A relational database at the single observation level (atomic model) Stores observation data made at points Metadata for unambiguous interpretation Traceable heritage from raw measurements to usable information Standard format for data sharing Cross dimension retrieval and analysis Space, S Time, T Variables, V s t ViVi v i (s,t) “Where” “What” “When” A data value

16. Horsburgh, J. S., D. G. Tarboton, D. R. Maidment and I. Zaslavsky, (2008), A Relational Model for Environmental and Water Resources Data, Water Resour. Res., 44: W05406, doi:10.1029/2007WR006392. CUAHSI Observations Data Model http://his.cuahsi.org/odmdatabases.htmlhttp://his.cuahsi.org/odmdatabases.html

17. Stage and Streamflow Example

18. Lets explore the system http://his.cuahsi.org http://his.cuahsi.org

19. Hydroseek http://www.hydroseek.org http://www.hydroseek.org Supports search by location and type of data across multiple observation networks including NWIS and Storet Bora Beran, Drexel

20. HydroExcel http://his.cuahsi.org/hydroexcel.html

21. HIS Server Internet Map Server built using ArcGIS Web browser client Combine spatial data and observational data Self contained fully documented with local control of data Launch data visualization tools e.g. http://icewater.usu.edu/map and http://littlebearriver.usu.edu/http://icewater.usu.edu/maphttp://littlebearriver.usu.edu/

22. Loading data into ODM Interactive ODM Data Loader – Loads data from spreadsheets and comma separated tables in simple format Streaming Data Loader (SDL) – Loads data from datalogger files on a prescribed schedule – Interactive configuration SQL Server Integration Services (SSIS) – Microsoft application accompanying SQL Server useful for programming complex loading or data management functions ODM Data Loader SDL SSIS

23. Reducing Semantic Heterogeneity ODM Controlled Vocabulary System – ODM CV central database – Online submission and editing of CV terms – Web services for broadcasting CVs Variable Name Investigator 1:“Temperature, water” Investigator 2:“Water Temperature” Investigator 3:“Temperature” Investigator 4:“Temp.” ODM VariableNameCV Term … Sunshine duration Temperature Turbidity … From Jeff Horsburgh

24. Dynamic controlled vocabulary moderation system Local ODM Database Master ODM Controlled Vocabulary ODM Website ODM Controlled Vocabulary Moderator ODM Data Manager ODM Controlled Vocabulary Web Services ODM Tools Local Server XML http://his.cuahsi.org/mastercvreg.html From Jeff Horsburgh

25. HydroDesktop Harvesting and analyzing data from web services Add shapefiles to map Change symbology and labels Print and export map GIS toolbox GIS Search for data Download data Display time series Export data Hydrology http://hydrodesktop.codeplex.com

26. 26 HydroDesktop Building blocks Actual Data Dababase Metadata Cache Database Database Access Layer HIS Server Web Service s Web Service API HIS Central Web Service HydroDesktop Main Application Plug-in Interface Search plug-in Graph View plug-in Metadata plug-in MapWindow GIS Components

27. Databases: Structured data sets to facilitate data integrity and effective sharing and analysis. - Standards - Metadata - Unambiguous interpretation Analysis: Tools to provide windows into the database to support visualization, queries, analysis, and data driven discovery. Models: Numerical implementations of hydrologic theory to integrate process understanding, test hypotheses and provide hydrologic forecasts. Advancement of water science is critically dependent on integration of water information Databases Analysis Models ODM Web Services

28. Conclusions Data Storage in an Observations Data Model (ODM) Data Delivery through internet-based Water Data Services using a consistent data language, called WaterML Data Discovery through federated thematic keyword search services and a National Water Metadata Catalog Data Access and Analysis through a Client Application (HydroDesktop) The combination of these capabilities creates a common window on water observations data for the United States unlike any that has existed before.

29. Reports http://his.cuahsi.org/documents/HISOverview2009.pdf 2008 status report summarizes the conceptual framework, methodology, and application tools for HIS Shows how to develop and publish a CUAHSI Water Data Service 2009 status report details the expansions and updates

30. http://his.cuahsi.org