Presentation is loading. Please wait.

Presentation is loading. Please wait.

CUAHSI Hydrologic Information System an introduction Ilya Zaslavsky Director, Spatial Information Systems Lab San Diego Supercomputer Center University.

Published byKaren Manning Modified over 9 years ago

Similar presentations

Presentation on theme: "CUAHSI Hydrologic Information System an introduction Ilya Zaslavsky Director, Spatial Information Systems Lab San Diego Supercomputer Center University."— Presentation transcript:

1 CUAHSI Hydrologic Information System an introduction Ilya Zaslavsky Director, Spatial Information Systems Lab San Diego Supercomputer Center University of California San Diego Presentation at DID Data Management, Kuala Lumpur, Malaysia, July 24, 2009

2 San Diego Supercomputer Center Founded in 1985, as one of the five original supercomputer centers, funded by the National Science Foundation 400 employees Advanced research in high- performance computing and networking R&D and cyberinfrastructure projects: in neuroscience, geology, astronomy, environmental sciences, molecular biology, hydrology SDSC building on UCSD campus

3 Consortium of Universities for the Advancement of Hydrologic Science, Inc. An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U.S. http://www.cuahsi.org/ 120+ US Universities

4 CUAHSI HIS: NSF support through 2012 (GEO) Partners: Academic: 11 NSF hydrologic observatories, CEO:P projects, LTER… Government: USGS, EPA, NCDC, NWS, state and local Commercial: Microsoft, ESRI, Kisters International: Australia, UK Standardization: OGC, WMO (Hydrology Domain WG, CHy); adopted by USGS, NCDC An online distributed system to support the sharing of hydrologic data from multiple repositories and databases via standard water data service protocols; software for data publication, discovery, access and integration. What is CUAHSI HIS?

5 Observation Stations Ameriflux Towers (NASA & DOE)NOAA Automated Surface Observing System USGS National Water Information SystemNOAA Climate Reference Network Map for the US Build a common window on water data using web services

6 Rainfall & Snow Water quantity and quality Remote sensing Water Data Modeling Meteorology Soil water

7 Sources of Observations Data

8 Point Water Observations Time Series A point location in spaceA series of values in time

9 Getting Water Data (the old way) Different Query PagesDifferent Query Responses

10 Web Pages and Web Services http://www.safl.umn.edu/ http://his.safl.umn.edu/SAFLMC/cuahsi_1_0.asmx Uses Hypertext Markup Language (HTML) Uses WaterML (a Markup Language for water data)

11 HTML as a Web Language Text and Pictures in Web Browser Texas Water Development Board HyperText Markup Language

12 WaterML as a Web Language Discharge of the San Marcos River at Luling, June 28 - July 18, 2002 Streamflow data in WaterML language

13 Point Observations Information Model Data Source Network Sites Variables Values {Value, Time, Metadata} Utah State Univ Little Bear River Little Bear River at Mendon Rd Dissolved Oxygen 9.78 mg/L, 1 October 2007, 5PM A data source operates an observation network A network is a set of observation sites A site is a point location where one or more variables are measured A variable is a property describing the flow or quality of water A value is an observation of a variable at a particular time Metadata provide additional information about the value GetSites GetSiteInfo GetVariableInfo GetValues WaterOneFlow Service

14 Site Codes Variable Codes Date Ranges WaterML and WaterOneFlow GetSites GetSiteInfo GetVariableInfo GetValues WaterOneFlow Web Service Client DEC UVM USGS Data Repositories Data EXTRACT TRANSFORM LOAD WaterML WaterML is an XML language for communicating water data WaterOneFlow is a set of web services based on WaterML

15 Standard Water Data Services Set of query functions Returns data in WaterML NWIS Daily Values (discharge), NWIS Ground Water, NWIS Unit Values (real time), NWIS Instantaneous Irregular Data, EPA STORET, NCDC ASOS, DAYMET, MODIS, NAM12K, USGS SNOTEL, ODM (multiple sites) Next Step: OGC-WMO Hydrology Domain Working Group: WaterML 2.0 https://lists.opengeospatial.org/mailman/listinfo/hydro.dwg http://external.opengis.org/twiki_public/bin/view/HydrologyDWG/WebHome Contact: Ilya Zaslavsky, co-chair

16 Test bed HIS Servers Central HIS servers ArcGIS Matlab IDL, R MapWindow Excel Programming (C#, VB..) Desktop clients Customizable web interface (DASH) HTML - XML WSDL - SOAP Modeling (OpenMI) Global search (Hydroseek) Water Data Web Services, WaterML Controlled vocabularies Metadata catalogs Ontology ETL services HIS Lite Servers External data providers Deployment to test beds Other popular online clients ODM DataLoader Streaming Data Loading Ontology tagging (Hydrotagger) WSDL and ODM registration Data publishing ODMTools Server config tools HIS Central Registry & Harvester Hydrologic Information System Service Oriented Architecture HIS Desktop

17 Central HIS Data Services Catalog

18

19 Semantic Tagging of Harvested Variables

20 Hydroseek http://www.hydroseek.net Supports search by location and type of data across multiple observation networks including NWIS, Storet, and academic data

21 Against the NIH Syndrome 2006: ► CUAHSI HIS web services are discussed on the BASINS mailing list as a new way to access hydrologic data. The list is mostly used by hydrologists and developers outside academia; ► NCDC develops ASOS web services following WaterML 2007: ► MOU with USGS; USGS is developing WaterML-compliant GetValues service; ► GLEON uses an early version of ODM to develop their own schema (VEGA); ► Phoenix LTER is developing ODM (in MySQL) and WaterML services (in Java); ► A Google Earth-based client for CUAHSI web services is developed at CSIRO, Australia; ► Deployment to 11 hydrologic observatory test beds, + CBEO (CEOP project) 2008-2009: ► KISTERS develops WaterML-compliant web services over their database; ► Workshops at state agencies ► MapWindow open source GIS develops WaterOneFlow parsers; ► Florida, Texas and Idaho use ODM and WaterOneFlow web services to provide access to state data repositories; New Jersey is considering the same; ► Another CEOP project, at UC-Davis, is implementing ODM (in Postgres) and web services (in Java); ► Stroud Water Research Center; WRON; CZO; … many that we don’t know… ► Now SBRP: data from UCSD, UA, more? ► Integration with streaming data middleware (Open Source Data Turbine)

22 The International Workshop on Hydrologic Data Management and Modeling in South East Asia July 20-24 University of Malaya Learning how the system works Publishing hydrologic data Setting up a server for SEA Already published: sample data from JPS (Malaysia) and from Indonesia

23 Data published as web service: http://svctag-2z3322s/jps/cuahsi_1_0.asmx These are results of GetValues for JPS:3116434, Streamflow data In HydroExcel

24 Charts of the same data In HydroExcel

25 Area of interest In HydroSeek

26 Finding JPS stations In HydroSeek

27 More information about JPS stations In HydroSeek, and data download

28 JPS data downloaded from HydroSeek

29 Zooming in on Indonesia

30 Looking for COD measurements In HydroSeek

31 Zooming in to stations

32 Summary CUAHSI HIS = Cyberinfrastructure for managing and publishing observational data –Supports many types of point observational data –Overcomes syntactic and semantic heterogeneity using a standard data model and controlled vocabularies –Supports a national network of observatory test beds –Maintains national registry of services (1.75 million stations – the largest in the world) WaterML is a standard language for consistently communicating water observations data from academic and government sources using web services; already adopted by several federal agencies. Joint WMO and OGC activity to enhance it. The system is already deployed at multiple locations It is free and open source

Download ppt "CUAHSI Hydrologic Information System an introduction Ilya Zaslavsky Director, Spatial Information Systems Lab San Diego Supercomputer Center University."

Similar presentations

Some notes on CyberGIS in hydrology Ilya Zaslavsky Spatial Information Systems Lab San Diego Supercomputer Center UCSD TeraGrid CyberGIS Workshop, February.

Some notes on CyberGIS in hydrology Ilya Zaslavsky Spatial Information Systems Lab San Diego Supercomputer Center UCSD TeraGrid CyberGIS Workshop, February.
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR 0622374 CUAHSI HIS Sharing hydrologic data Jeffery.

HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
Sharing Hydrologic Data with the CUAHSI Hydrologic Information System Support EAR 0622374 CUAHSI HIS Sharing hydrologic data David.

Sharing Hydrologic Data with the CUAHSI Hydrologic Information System Support EAR CUAHSI HIS Sharing hydrologic data David.
ICEWATER: INRA Constellation of Experimental Watersheds Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S. Horsburgh, Utah State.

ICEWATER: INRA Constellation of Experimental Watersheds Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S. Horsburgh, Utah State.
Development of a Community Hydrologic Information System David G Tarboton Jeffery S Horsburgh, David R. Maidment (PI), Tim Whiteaker, Ilya Zaslavsky, Michael.

Development of a Community Hydrologic Information System David G Tarboton Jeffery S Horsburgh, David R. Maidment (PI), Tim Whiteaker, Ilya Zaslavsky, Michael.
This work is funded by National Science Foundation Grant EAR 0622374 Accessing and Sharing Data Using the CUAHSI Hydrologic Information System CUAHSI HIS.

This work is funded by National Science Foundation Grant EAR Accessing and Sharing Data Using the CUAHSI Hydrologic Information System CUAHSI HIS.
CUAHSI HIS Data Services Project David R. Maidment Director, Center for Research in Water Resources University of Texas at Austin (HIS Project Leader)

CUAHSI HIS Data Services Project David R. Maidment Director, Center for Research in Water Resources University of Texas at Austin (HIS Project Leader)
This work was funded by the U.S. National Science Foundation under grant EAR 0622374. Any opinions, findings and conclusions or recommendations expressed.

This work was funded by the U.S. National Science Foundation under grant EAR Any opinions, findings and conclusions or recommendations expressed.
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR 0622374 CUAHSI HIS Sharing hydrologic data Jeffery.

HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.

Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.
CUAHSI Hydrologic Information System and the Virtual Observatory David R. Maidment Center for Research in Water Resources University of Texas at Austin.

CUAHSI Hydrologic Information System and the Virtual Observatory David R. Maidment Center for Research in Water Resources University of Texas at Austin.
Using GIS in Creating an End-to- End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David G. Tarboton, David R. Maidment, Ilya.

Using GIS in Creating an End-to- End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David G. Tarboton, David R. Maidment, Ilya.
Introducing the CUAHSI Hydrologic Information System Desktop Application (HydroDesktop) and Open Development Community Jiří Kadlec, Daniel Ames, Teva Velupillai.

Introducing the CUAHSI Hydrologic Information System Desktop Application (HydroDesktop) and Open Development Community Jiří Kadlec, Daniel Ames, Teva Velupillai.
Deployment and Evaluation of an Observations Data Model Jeffery S Horsburgh David G Tarboton Ilya Zaslavsky David R. Maidment David Valentine

Deployment and Evaluation of an Observations Data Model Jeffery S Horsburgh David G Tarboton Ilya Zaslavsky David R. Maidment David Valentine
CZO Integrated Data Management Web services, CZO data publication system prototype, demo Ilya Zaslavsky SDSC.

CZO Integrated Data Management Web services, CZO data publication system prototype, demo Ilya Zaslavsky SDSC.
HIS Team and Collaborators University of Texas at Austin – David Maidment, Tim Whiteaker, Ernest To, Bryan Enslein, Kate Marney San Diego Supercomputer.

HIS Team and Collaborators University of Texas at Austin – David Maidment, Tim Whiteaker, Ernest To, Bryan Enslein, Kate Marney San Diego Supercomputer.
GIS at SDSC Domains: –From geology, environmental science, hydrology, ocean biodiversity, regional development, Katrina response, archaeology, to neuroscience.

GIS at SDSC Domains: –From geology, environmental science, hydrology, ocean biodiversity, regional development, Katrina response, archaeology, to neuroscience.
SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.

SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.
CUAHSI HIS Service Oriented Architecture Support EAR 0622374 CUAHSI HIS Sharing hydrologic data Ilya Zaslavsky, David R. Maidment,

CUAHSI HIS Service Oriented Architecture Support EAR CUAHSI HIS Sharing hydrologic data Ilya Zaslavsky, David R. Maidment,
An End-to-End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David K. Stevens, David G. Tarboton, Nancy O. Mesner, Amber Spackman.

An End-to-End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David K. Stevens, David G. Tarboton, Nancy O. Mesner, Amber Spackman.

Similar presentations

Ads by Google