Presentation is loading. Please wait.

Presentation is loading. Please wait.

The CUAHSI Hydrologic Information System Service Oriented Architecture for Water Resources http://his.cuahsi.org/ CUAHSI HIS Sharing hydrologic data Support.

Similar presentations


Presentation on theme: "The CUAHSI Hydrologic Information System Service Oriented Architecture for Water Resources http://his.cuahsi.org/ CUAHSI HIS Sharing hydrologic data Support."— Presentation transcript:

1 The CUAHSI Hydrologic Information System Service Oriented Architecture for Water Resources
CUAHSI HIS Sharing hydrologic data Support EAR

2 Consortium of Universities for the Advancement of Hydrologic Science, Inc.
122 US Universities as of July 2008 An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U.S.

3 HIS Team and Collaborators
University of Texas at Austin – David Maidment, Tim Whiteaker, Ernest To, Bryan Enslein, Kate Marney San Diego Supercomputer Center – Ilya Zaslavsky, David Valentine, Tom Whitenack Utah State University – David Tarboton, Jeff Horsburgh, Kim Schreuders, Justin Berger Drexel University – Michael Piasecki, Yoori Choi University of South Carolina – Jon Goodall, Tony Castronova CUAHSI Program Office – Rick Hooper, David Kirschtel, Conrad Matiuk WATERS Network – Testbed Data Managers HIS Standing Committee USGS – Bob Hirsch, David Briar, Scott McFarlane NCDC – Rich Baldwin

4 Outline The Need – Hydrologic Information Science
General overview of CUAHSI HIS Accessing data using the CUAHSI HIS Hydroseek HydroExcel HydroGet Matlab

5 Next class Sharing and publishing data using CUAHSI HIS
HIS data publication system WaterML and WaterOneFlow web services Observations data model (ODM) Data loading Data editing and quality control Controlled vocabularies HIS central registration and tagging

6 The Need: Hydrologic Information Science
It is as important to represent hydrologic environments precisely with data as it is to represent hydrologic processes with equations Physical laws and principles (Mass, momentum, energy, chemistry) Hydrologic Process Science (Equations, simulation models, prediction) Hydrologic conditions (Fluxes, flows, concentrations) Hydrologic Information Science (Observations, data models, visualization Hydrologic environment (Dynamic earth)

7 Advancement of water science is critically dependent on integration of water information
Databases: Structured data sets to facilitate data integrity and effective sharing and analysis. - Standards - Metadata - Unambiguous interpretation Analysis: Tools to provide windows into the database to support visualization, queries, analysis, and data driven discovery. Models: Numerical implementations of hydrologic theory to integrate process understanding, test hypotheses and provide hydrologic forecasts. Models ODM Web Services Databases Analysis

8 What is the CUAHSI HIS? CUAHSI-HIS Central Servers ODM Database WaterOneFlow Web Services Network/WSDL Registry HydroSeek HydroTagger 3rd-Party Metadata Repositry etc. CUAHSI-HIS Servers WaterOneFlow Web Services DASH ODM Data Loader ODM SDL ODM Tools 3rd-Party Data Servers USGS NWIS NCDC ASOS NCEP NAM 12K NASA MODIS (with web service capability) 3rd-Party Analysis Software GIS Matlab Splus R IDL Java C++ VB Browser-based Data Discovery Tools Hydroseek Data Transmission Formats WaterML Other Data Access Toolbox HydroExcel HydroGet OpemMI Interface HydroObjects An internet based system to support the sharing of hydrologic data comprising databases connected using the internet through web services as well as software for data discovery, access and publication.

9 HIS Website – his.cuahsi.org
Download tools, research publications, contribute to the effort – it’s all here

10 Designed for You Whether you are a data consumer, data publisher, or developer, the HIS website is designed so you can quickly find what you need

11 Water quantity and quality
Water Data Water quantity and quality Soil water Rainfall & Snow Modeling Meteorology Remote sensing 11

12 Searching each data source separately
Data Searching – What we used to have to do Search multiple heterogeneous data sources simultaneously regardless of semantic or structural differences between them Searching each data source separately NWIS return request request return return request NAWQA NAM-12 return request return request request return request return return request NARR Michael Piasecki Drexel University 12

13 Searching all data sources collectively
What HIS enables Searching all data sources collectively GetValues NWIS GetValues GetValues GetValues generic request GetValues NAWQA GetValues NARR Michael Piasecki Drexel University GetValues ODM GetValues 13

14 New water data capabilities
Data Storage in an Observations Data Model (ODM) Data Access through internet-based Water Data Services using a consistent data language, called WaterML Data Indexing through a National Water Metadata Catalog Data Discovery through federated map and thematic keyword search system The combination of these capabilities creates a common window on water observations data for the United States unlike any that has existed before.

15 Outline The Need – Hydrologic Information Science
General overview of CUAHSI HIS Accessing data using the CUAHSI HIS Hydroseek HydroExcel HydroGet Matlab

16 Service Oriented Architecture for Water Resources Data
Data Access System for Hydrology (DASH) Website Portal and Map Viewer Preliminary data exploration and discovery. See what is available and perform exploratory analyses Downloads Uploads Analysis and Modeling applications HTML -XML 3rd party data servers e.g. USGS, NCDC Data access through web services GIS WaterOneFlow Web Services Matlab WSDL - SOAP IDL Data storage through web services Splus, R Hydrologic Information System Service Oriented Architecture Excel Programming (Fortran, C, VB) Observatory data servers CUAHSI HIS data servers Internet ODM ODM WaterML

17 Key HIS components Clients HydroSeek ODM Ontology Matlab HydroGet
HydroExcel ODM Ontology WSDL Registry CV Services ODM Tools

18 CUAHSI WaterOneFlow Web Services “Getting the Browser Out of the Way”
GetSites GetSiteInfo GetVariableInfo GetValues Standard protocols provide platform independent data access WaterML SQL Queries Data Consumer First, we have implemented the CUAHSI WaterOneFlow web services for ODM on top of our ODM database. This provides low level, machine access to the data in our ODM database via the web services anywhere an Internet connection is available. This allows users who know how to use the web services to access our data directly in their programming environment of choice (i.e., Visual Basic, Excel/VBA, MatLab, etc.). Additionally, applications that know how to consume the web services can also access our data directly. ODM Database Query Response

19 WaterOneFlow Set of query functions Returns data in WaterML
Ilya Zaslavsky and David Valentine, SDSC

20 Direct analysis from your favorite analysis environment. e.g. Matlab
% create NWIS Class and an instance of the class createClassFromWsdl(' WS = NWISDailyValues; % GetValues to get the data siteid='NWIS: '; bdate=' T00:00:00'; edate=' T00:00:00'; variable='NWIS:00060'; valuesxml=GetValues(WS,siteid,variable,bdate,edate,'');

21 HIS Implementation in WATERS Network Information System
National Hydrologic Information Server San Diego Supercomputer Center 11 WATERS Network test bed projects 16 ODM instances (some test beds have more than one ODM instance) Data from 1246 sites, of these, 167 sites are operated by WATERS investigators

22 Outline The Need – Hydrologic Information Science
General overview of CUAHSI HIS Accessing data using the CUAHSI HIS Hydroseek HydroExcel HydroGet Matlab

23 Hydroseek http://www.hydroseek.org Bora Beran, Drexel
Supports search by location and type of data across multiple observation networks including NWIS and Storet 23

24 HydroExcel

25 HydroGET: An ArcGIS Web Service Client

26 Tipping point, getting the browser out of the way
Web pages Web services Internet Internet Internet People interact with a remote information server People interact with a network of Information services

27 Information communication
Water web pages Water web services Water Markup Language (WaterML) HyperText Markup Language (HTML)

28 CUAHSI-HIS 3rd-Party Analysis Software
(with web service capability) 3rd-Party Analysis Software GIS Matlab Splus R IDL Java C++ VB Browser-based Data Discovery Tools DASH Hydroseek Data Access Toolbox HydroExcel HydroGet HydroLink HydroObjects CUAHSI-HIS Servers ODM Database WaterOneFlow Web Services DASH ODM Data Loader ODM SDL ODM Tools 3rd-Party Data Servers CUAHSI-HIS Central Servers USGS NWIS NCDC ASOS NCEP NAM 12K NASA MODIS etc. ODM Database WaterOneFlow Web Services Network/WSDL Registry HydroSeek HydroTagger 3rd-Party Metadata Repositry etc. Data Transmission Formats WaterML Other

29 Analyze data directly from web services in MATLAB

30 Things you need to know to use CUAHSI Water Data Services in MATLAB
createClassfromWSDL Using CUAHSI Water Data Services Getsites Getvariables Getvariableinfo Getvalues How to parse XML that is returned

31 Data Publication Pipeline
Summary Data Publication Pipeline Publisher Data Loader ODM on Server Point Observations Data from Agencies and Academic Investigators can be consistently communicated using web services Point Observations Data can be archived in a relational database Maps of point observation locations from different sources can be federated using a map server Map server + relational database + web services = Integrated hydrologic data access system WaterML DASH HydroSeek HISCentral Registry Public


Download ppt "The CUAHSI Hydrologic Information System Service Oriented Architecture for Water Resources http://his.cuahsi.org/ CUAHSI HIS Sharing hydrologic data Support."

Similar presentations


Ads by Google