1. David R. Maidment (PI) David G Tarboton Ilya Zaslavsky Michael Piasecki Jon Goodall With support from collaborators, postdocs and graduate students: Rick Hooper, Jon Duncan, David Valentine, Tom Whitenack, Jeff Horsburgh, Bora Beran, Tim Whiteaker, Ernest To, Cedric David http://www.cuahsi.org/his.html CUAHSI Hydrologic Information System Update

2. Definition The CUAHSI Hydrologic Information System (HIS) is a geographically distributed network of hydrologic data sources and functions that are integrated using web services so that they function as a connected whole.

3. CUAHSI HIS Update Current Status of the Project HIS 1.0 Components –WaterOneFlow web services –Observations data model Digital Watershed

4. CUAHSI HIS Update Current Status of the Project HIS 1.0 Components –WaterOneFlow web services –Observations data model Digital Watershed

5. HIS Progress Phase 1 grant, 2.5 year grant completed Phase 2 grant, 5-yr, $4.5M to Maidment (Texas) Co-PI’s –Ilya Zaslavsky (San Diego Supercomputing Center) –David Tarboton (Utah State) –Michael Piasecki (Drexel) –Jon Goodall (Duke) WATERS Testbeds serve as beta-testers for software First community-wide distribution in 12 – 18 months (dependant on establishing support services)

6. Project co-PI in Phase 2 Collaborator in Phase I CUAHSI HIS Components (in development) http://www.cuahsi.org/his.html

7. Super Computer Centers: NCSA, TACC Domain Sciences: Unidata, NCAR LTER, GEON Government: USGS, EPA, NCDC, USDA Industry: ESRI, Kisters, Microsoft CUAHSI HIS HIS Team and its Cyberinfrastructure Partners HIS Team: Texas, SDSC, Utah, Drexel, Duke

8. HIS Team WATERS Testbed WATERS Network Information System

9. Super computer Centers: NCSA, TACC Domain Sciences: Unidata, NCAR LTER, GEON Government: USGS, EPA, NCDC, USDA Industry: ESRI, Kisters, OpenMI HIS Team WATERS Testbed WATERS Network Information System CUAHSI HIS HIS, WATERS and the CUAHSI Community

10. Super computer Centers: NCSA, TACC Domain Sciences: Unidata, NCAR LTER, GEON Government: USGS, EPA, NCDC, USDA Industry: ESRI, Kisters, OpenMI HIS Team WATERS Testbed WATERS Network Information System CUAHSI HIS International Partners CSIRO Land and Water Resources Water Resources Observations Network (WRON) European Commission Water database design and model integration (HarmonIT and OpenMI)

11. CUAHSI HIS Update Current Status of the Project HIS 1.0 Components –WaterOneFlow web services –Observations data model Digital Watershed

12. Rainfall & Snow Water quantity and quality Remote sensing Water Data Modeling Meteorology Soil water

13. Water Data Web Sites

14. NWISWeb site output # agency_cd Agency Code # site_no USGS station number # dv_dt date of daily mean streamflow # dv_va daily mean streamflow value, in cubic-feet per-second # dv_cd daily mean streamflow value qualification code # # Sites in this file include: # USGS 02087500 NEUSE RIVER NEAR CLAYTON, NC # agency_cdsite_nodv_dtdv_vadv_cd USGS020875002003-09-011190 USGS020875002003-09-02649 USGS020875002003-09-03525 USGS020875002003-09-04486 USGS020875002003-09-05733 USGS020875002003-09-06585 USGS020875002003-09-07485 USGS020875002003-09-08463 USGS020875002003-09-09673 USGS020875002003-09-10517 USGS020875002003-09-11454 Time series of streamflow at a gaging station USGS has committed to supporting CUAHSI’s GetValues function

15. Observation Stations Ameriflux Towers (NASA & DOE)NOAA Automated Surface Observing System USGS National Water Information SystemNOAA Climate Reference Network Map for the US

16. Water Quality Measurement Sites in EPA Storet Substantial variation in data availability from states Data from Bora Beran, Drexel University

17. Water Quality Measurement Sites from Texas Commission for Environmental Quality (TCEQ)

18. Geographic Integration of Storet and TCEQ Data in HIS

19. Observations Catalog Specifies what variables are measured at each site, over what time interval, and how many observations of each variable are available

20. CUAHSI Hydrologic Data Access System A common data window for accessing, viewing and downloading hydrologic information USGS NASANCDC EPANWS Observatory Data (being built using HIS Server in collaboration with ESRI)

21. HIS Server Supports data discovery, delivery and publication –Data discovery – how do I find the data I want? Map interface and observations catalogs Metadata based Search –Data delivery – how do I acquire the data I want? Use web services or retrieve from local database –Data Publication – how do I publish my observation data? Use Observations Data Model

22. HIS Server and Analyst HIS Server Implemented at San Diego Supercomputer Center and at academic departments and research centers Implemented by individual hydrologic scientists using their own analysis environments HIS Analyst Web Services Sustainable – industrial strength technology Flexible – any operating system, model, programming language or application Details of HIS Analyst are here http://www.cuahsi.org/his/webservices.html

23. Point Observations Information Model Data Source Network Sites Variables Values {Value, Time, Qualifier} USGS Streamflow gages Neuse River near Clayton, NC Discharge, stage (Daily or instantaneous) 206 cfs, 13 August 2006 A data source operates an observation network A network is a set of observation sites A site is a point location where one or more variables are measured A variable is a property describing the flow or quality of water A value is an observation of a variable at a particular time A qualifier is a symbol that provides additional information about the value http://www.cuahsi.org/his/webservices.html

24. Example: Matlab use of CUAHSI Web Services % create NWIS Class and an instance of the class createClassFromWsdl('http://water.sdsc.edu/wateroneflo w/NWIS/DailyValues.asmx?WSDL'); WS = NWISDailyValues; % Site Info for Site of Interest siteid='NWIS:02087500'; strSite=GetSiteInfoObject(WS,siteid,''); strSite.site.siteInfo.siteName ans = NEUSE RIVER NEAR CLAYTON, NC lat=strSite.site.siteInfo.geoLocation.geogLocation.lat itude long=strSite.site.siteInfo.geoLocation.geogLocation.lo ngitude lat = 35.6472222 long = -78.4052778

25. Variable and variableTimeInterval strSite.site.seriesCatalog(1).series(:).variable ans = variableCode: '00065' variableName: 'Gage height, feet' units: 'international foot' ans = variableCode: '00060' variableName: 'Discharge, cubic feet per second' units: 'cubic feet per second' strSite.site.seriesCatalog(1).series(:).variableTimeInt erval ans = beginDateTime: '1927-08-01T00:00:00' endDateTime: '2006-10-16T00:00:00' ans = beginDateTime: '1927-08-01T00:00:00' endDateTime: '2006-10-16T00:00:00'

26. getVariableInfo varcode='NWIS:00060'; varInfo=GetVariableInfoObject(WS,varcode,'') varInfo = variables: [1x1 struct] varInfo.variables.variable ans = variableCode: '00060' variableName: 'Discharge, cubic feet per second' units: 'cubic feet per second'

27. GetValues % GetValues to get the data siteid='NWIS:02087500'; bdate='2002-09-30T00:00:00'; edate='2006-10-16T00:00:00'; variable='NWIS:00060'; valuesxml=GetValues(WS,siteid,variable,bdate,edate,'');

28. Parse XML and Analyze % Parse the XML into a Matlab object to work with valuesobj=xml_parseany(valuesxml);... plot(date,flowval);datetick;

29. NWIS ArcGIS Excel NCAR Unidata NASA Storet NCDC Ameriflux Matlab AccessJava Fortran Visual Basic C/C++ Some operational services CUAHSI Web Services Data Sources Applications Extract Transform Load http://www.cuahsi.org/his/

30. Search multiple heterogeneous data sources simultaneously regardless of semantic or structural differences between them Objective NWIS NARR NAWQA NAM-12 request request return return What we are doing now ….. Michael Piasecki Drexel University

31. Semantic Mediator What we would like to do ….. NWIS NAWQA NARR generic request GetValues GetValues HODM Michael Piasecki Drexel University

32. CUAHSI HIS Update Current Status of the Project HIS 1.0 Components –WaterOneFlow web services –Observations data model Digital Watershed

33. Hydrologic Science Hydrologic conditions (Fluxes, flows, concentrations) Hydrologic Process Science (Equations, simulation models, prediction) Hydrologic Information Science (Observations, data models, visualization Hydrologic environment (Dynamic earth) Physical laws and principles (Mass, momentum, energy, chemistry) It is as important to represent hydrologic environments precisely with data as it is to represent hydrologic processes with equations

34. Data Cube Space, L Time, T Variables, V D “What” “Where” “When” A simple data model

35. Continuous Space-Time Model – NetCDF (Unidata) Space, L Time, T Variables, V D Coordinate dimensions {X} Variable dimensions {Y}

36. Space, FeatureID Time, TSDateTime Variables, TSTypeID TSValue Discrete Space-Time Data Model ArcHydro

37. Terrain Data Models Grid Contour and flowline TIN

38. CUAHSI Observations Data Model A relational database at the single observation level (atomic model) Stores observation data made at points Metadata for unambiguous interpretation Traceable heritage from raw measurements to usable information Streamflow Flux tower data Precipitation & Climate Groundwater levels Water Quality Soil moisture data

39. Ernest To Center for Research in Water Resources University of Texas at Austin 20061011 What are the basic attributes to be associated with each single observation and how can these best be organized? A data source operates an observation network A network is a set of observation sites Data Source and Network SitesVariablesValuesMetadata Depth of snow pack Streamflow Landuse, Vegetation Windspeed, Precipitation Data Delivery Controlled Vocabulary Tables e.g. mg/kg, cfs e.g. depth e.g. Non-detect,Estimated, A site is a point location where one or more variables are measured Metadata provide information about the context of the observation. A variable is a property describing the flow or quality of water A value is an observation of a variable at a particular time Data Discovery Hydrologic Observations Data Model See http://www.cuahsi.org/his/documentation.htmlhttp://www.cuahsi.org/his/documentation.html

40. 1 1 CouplingTable SiteID (GUID) HydroID (Integer) MonitoringPoint SiteID SiteCode SiteName Latitude Longitude … Hydrologic Observations Data Model 1 1 OR Independent of, but coupled to Geographic Representation HODM Arc Hydro

41. Variable attributes VariableName, e.g. discharge VariableCode, e.g. 0060 SampleMedium, e.g. water Valuetype, e.g. field observation, laboratory sample IsRegular, e.g. Yes for regular or No for intermittent TimeSupport (averaging interval for observation) DataType, e.g. Continuous, Instantaneous, Categorical GeneralCategory, e.g. Climate, Water Quality NoDataValue, e.g. -9999 m 3 /s L 3 /T Cubic meters per second

42. Stage and Streamflow Example

43. Daily Average Discharge Example Daily Average Discharge Derived from 15 Minute Discharge Data

44. Water Chemistry from a profile in a lake

45. ODM and HIS in an Observatory Setting e.g. http://www.bearriverinfo.org

46. WaterOneFlow Web Services Data accessthrough web services Data storage through web services Downloads Uploads Observatory data servers CUAHSI HIS data servers 3 rd party data servers e.g. USGS, NCDC GIS Matlab IDL Splus, R Excel Programming (Fortran, C, VB) Web services interface HDAS Website Portal and Map Viewer Information input, display, query and output services Preliminary data exploration and discovery. See what is available and perform exploratory analyses HTML -XML WSDL - SOAP

47. CUAHSI HIS Update Current Status of the Project HIS 1.0 Components –WaterOneFlow web services –Observations data model Digital Watershed

48. How can hydrologists integrate observed and modeled data from various sources into a single description of the environment?

49. Digital Watershed Hydrologic Observation Data Geospatial Data Weather and Climate Data Remote Sensing Data (NetCDF) (GIS) (Relational database) (EOS-HDF) Digital Watershed A digital watershed is a synthesis of hydrologic observation data, geospatial data, remote sensing data and weather and climate data into a connected database for a hydrologic region

50. NHDPlus for Region 17E

51. NHDPlus Reach Catchments ~ 3km 2 About 1000 reach catchments in each 8-digit HUC Average reach length = 2km 2.3 million reaches for continental US

52. Reach Attributes Slope Elevation Mean annual flow –Corresponding velocity Drainage area % of upstream drainage area in different land uses Stream order

53. http://www.daymet.org/

54. Project sponsored by the European Commission to promote integration of water models within the Water Framework Directive Software standards for model linking Uses model core as an “engine” http://www.openMI.org

55. OpenMI Conceptual Framework VALUES All values are referenced in a what-where-when framework, allowing different data resources or models to communicate data Space, L Time, T Variables, V D An application of the data cube to integrate simulation models Jon Goodall, Duke University

56. HIS as OpenMI Components water balance model NWIS Streamflow Daymet Precipitation To calculate storage, the model needs inflow and outflow To calculate storage, the model needs precipitation Goal: Link the National HIS web services with a simple water balance model using OpenMI as the mediator Trigger: Calculate storage

57. Watershed Hydrovolumes Geovolume is the portion of a hydrovolume that contains solid earth materials USGS Gaging stations Hydrovolume

58. Stream channel Hydrovolumes Need the capacity to represent Acoustic Doppler Current Profiler (ADCP) data (Iowa) Residence time distributions

59. Integration of surface water and groundwater data Describe the relationship between surface water features ( e.g. streams and waterbodies) with groundwater features (aquifers, wells). Enable the connection with the surface water data model Hydro networkAquifers In the future go to 3D...

60. Water OneFlow We need a “Water OneFlow” – a common window for water data and models Advancement of water science is critically dependent on integration of water information Federal Academic Local State Model Flow Precip