Data Interoperability in the Hydrologic Sciences The CUAHSI Hydrologic Information System David Tarboton, David Maidment, Ilya Zaslavsky, Dan Ames, Jon.

Slides:

Advertisements

Similar presentations

The CUAHSI Community Hydrologic Information System David Tarboton, David Maidment, Ilya Zaslavsky, Dan Ames, Jon Goodall, Richard Hooper, Jeffrey Horsburgh.

Advertisements

CUAHSI – Unidata Collaboration Opportunities Support EAR CUAHSI HIS Sharing hydrologic data David Tarboton.

USU NIDIS Drought Server Update Jeff Horsburgh, Kim Schreuders David Tarboton, Stephanie Reeder Avirup Sen Gupta.

GEOSS Water Services for Data and Maps Community Recommendations David K. Arctur, Project Lead, GEOSS AIP-6 Water SBA University.

Some notes on CyberGIS in hydrology Ilya Zaslavsky Spatial Information Systems Lab San Diego Supercomputer Center UCSD TeraGrid CyberGIS Workshop, February.

HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.

Sharing Hydrologic Data with the CUAHSI Hydrologic Information System Support EAR CUAHSI HIS Sharing hydrologic data David.

This work is funded by the Inland Northwest Research Alliance INRA Constellation of Experimental Watersheds: Cyberinfrastructure to Support Publication.

ICEWATER: INRA Constellation of Experimental Watersheds Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S. Horsburgh, Utah State.

SAN DIEGO SUPERCOMPUTER CENTER HYDROLOGIC METADATA CATALOG AND SEMANTIC SEARCH SERVICES IN CUAHSI HIS CUAHSI HIS Sharing hydrologic.

Development of a Community Hydrologic Information System Support EAR CUAHSI HIS Sharing hydrologic data David Maidment (PI),

Development of a Community Hydrologic Information System David G Tarboton Jeffery S Horsburgh, David R. Maidment (PI), Tim Whiteaker, Ilya Zaslavsky, Michael.

Linking HIS and GIS How to support the objective, transparent and robust calculation and publication of SWSI? Jeffery S. Horsburgh CUAHSI HIS Sharing hydrologic.

This work is funded by National Science Foundation Grant EAR Accessing and Sharing Data Using the CUAHSI Hydrologic Information System CUAHSI HIS.

CUAHSI HIS Data Services Project David R. Maidment Director, Center for Research in Water Resources University of Texas at Austin (HIS Project Leader)

Services-Oriented Architecture Updates David Maidment Part of a presentation made to the HIS Standing Committee, Washington DC, Nov 15, 2010.

Components of an Integrated Environmental Observatory Information System Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S.

This work was funded by the U.S. National Science Foundation under grant EAR Any opinions, findings and conclusions or recommendations expressed.

Crossing the Digital Divide

The HydroServer Platform for Sharing Hydrologic Data Support EAR CUAHSI HIS Sharing hydrologic data David G Tarboton, Jeffery.

Introduction to CUAHSI Water Web Services and Texas HIS David R. Maidment The University of Texas at Austin.

A Services-Oriented Architecture for Water Data in the United States Presented by David R. Maidment Center for Research in Water Resources University of.

HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.

Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.

CUAHSI Hydrologic Information System and the Virtual Observatory David R. Maidment Center for Research in Water Resources University of Texas at Austin.

Two NSF Data Services Projects Rick Hooper, President Consortium of Universities for the Advancement of Hydrologic Science, Inc.

Using GIS in Creating an End-to- End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David G. Tarboton, David R. Maidment, Ilya.

Integrating Historical and Realtime Monitoring Data into an Internet Based Watershed Information System for the Bear River Basin Jeff Horsburgh David Stevens,

Introducing the CUAHSI Hydrologic Information System Desktop Application (HydroDesktop) and Open Development Community Jiří Kadlec, Daniel Ames, Teva Velupillai.

Deployment and Evaluation of an Observations Data Model Jeffery S Horsburgh David G Tarboton Ilya Zaslavsky David R. Maidment David Valentine

Integrated Modeling & Data Access — CUAHSI HIS HydroModeler Jon Goodall, Assistant Professor Department of Civil and Environmental Engineering David Maidment.

HIS Team and Collaborators University of Texas at Austin – David Maidment, Tim Whiteaker, Ernest To, Bryan Enslein, Kate Marney San Diego Supercomputer.

CUAHSI HIS Service Oriented Architecture Support EAR CUAHSI HIS Sharing hydrologic data Ilya Zaslavsky, David R. Maidment,

An End-to-End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David K. Stevens, David G. Tarboton, Nancy O. Mesner, Amber Spackman.

A Services Oriented Architecture for Water Resources Data David R. Maidment Center for Research in Water Resources University of Texas at Austin EPA Storet.

Using HydroServer Organize, Manage, and Publish Your Data Support EAR CUAHSI HIS Sharing hydrologic data Jeffery S. Horsburgh.

Over-allocation to irrigation Bushfire recovery impacts Expanding plantations Drying and warming climate Uncapped groundwater extraction Expanding farm.

About CUAHSI The Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) is an organization representing 120+ universities.

Ocean Sciences What is CUAHSI? CUAHSI – Consortium of Universities for the Advancement of Hydrologic Science, Inc Formed in 2001 as a legal entity Program.

About CUAHSI The Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) is an organization representing 120+ universities.

Crossing the Digital Divide Presented by: Fernando R. Salas David Maidment, Enrico Boldrini, Stefano Nativi, Ben Domenico OGC Technical Meeting – Met/Occean.

Water Web Services David R. Maidment Center for Research in Water Resources University of Texas at Austin Open Waters Symposium Delft, the Netherlands.

CUAHSI Hydrologic Information System an introduction Ilya Zaslavsky Director, Spatial Information Systems Lab San Diego Supercomputer Center University.

Advancing an Information Model for Environmental Observations Jeffery S. Horsburgh Anthony Aufdenkampe, Richard P. Hooper, Kerstin Lehnert, Kim Schreuders,

Publishing Observations Data: from ODM to HIS Central.

Sharing Data Using the CUAHSI Hydrologic Information System David Tarboton Utah State University Support EAR CUAHSI HIS Sharing hydrologic data.

Hydrologic Information System for the Nation Ilya Zaslavsky Spatial Information Systems Lab San Diego Supercomputer Center UCSD BOM talk, Melbourne, March.

CUAHSI, WATERS and HIS by Richard P. Hooper, David G. Tarboton and David R. Maidment.

Overview of CUAHSI HIS Version 1.1 David R. Maidment Director, Center for Research in Water Resources University of Texas at Austin CUAHSI Biennial Science.

Water and Catchment Data Services David R. Maidment Center for Research in Water Resources University of Texas at Austin River Science Symposium Swansea,

The CUAHSI Hydrologic Information System Presented by Dr. Tim Whiteaker The University of Texas at Austin 22 February, 2011.

The CUAHSI Community Hydrologic Information System Jeffery S. Horsburgh Utah Water Research Laboratory Utah State University CUAHSI HIS Sharing hydrologic.

Bringing Water Data Together David R. Maidment Center for Research in Water Resources University of Texas at Austin Texas Water Summit San Antonio Tx,

The CUAHSI Observations Data Model Jeff Horsburgh David Maidment, David Tarboton, Ilya Zaslavsky, Michael Piasecki, Jon Goodall, David Valentine,

From Prototype to Service: A CUAHSI Datacenter for Hydroinformatics Richard Hooper Consortium of Universities for the Advancement of Hydrologic Science,

Hydroinformatics Lecture 15: HydroServer and HydroServer Lite The CUAHSI HIS is Supported by NSF Grant# EAR CUAHSI HIS Sharing hydrologic data.

Developing a community hydrologic information system David G Tarboton David R. Maidment (PI) Ilya Zaslavsky Michael Piasecki Jon Goodall

The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.

Hydroinformatics Lecture: HydroServer .NET/PHP

Using GIS in Creating an End-to-End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David G. Tarboton, David R. Maidment, Ilya.

The CUAHSI Community Hydrologic Information System

Developing a Community Hydrologic Information System

Sharing Hydrologic Data with the CUAHSI* Hydrologic Information System

The CUAHSI Hydrologic Information System and NHD Plus A Services Oriented Architecture for Water Resources Data David G Tarboton David R. Maidment (PI)

The CUAHSI Hydrologic Information System Service Oriented Architecture for Water Resources CUAHSI HIS Sharing hydrologic data Support.

Lecture 8 Database Implementation

CUAHSI HIS Sharing hydrologic data

Hydroinformatics Lecture 15: HydroServer (and HydroServer Lite)

HydroDesktop: A Key Component of the CUAHSI/CZO HIS for Hydrologic Data Discovery, Visualization, and Analysis Daniel P. Ames, Ph.D. P.E. Idaho State University.

David Tarboton, Dan Ames, Jeffery S. Horsburgh, Jon Goodall

Presentation transcript:

Data Interoperability in the Hydrologic Sciences The CUAHSI Hydrologic Information System David Tarboton, David Maidment, Ilya Zaslavsky, Dan Ames, Jon Goodall, Rick Hooper, Jeff Horsburgh, David Valentine, Tim Whiteaker, Tom Whitenack Kim Schreuders CUAHSI HIS Sharing hydrologic data Support EAR

Consortium of Universities for the Advancement of Hydrologic Science, Inc. An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U.S. Hydrologic Information System Hydrologic Measurement Facility Hydrologic Modeling Hydrologic Education Outreach

Partners: Academic: many research watersheds, CZO… Government: USGS, EPA, NCDC, NWS, state and local Commercial: Microsoft, ESRI, Kisters International: Australia, UK Standardization: OGC, WMO (Hydrology Domain WG); adopted by USGS, NCDC, Army Corps of Eng. An online distributed system to support the sharing of hydrologic data from multiple repositories and databases via standard web service protocols Software for data publication, discovery, access and integration What is the CUAHSI HIS? UT-Austin, SDSC/UCSD, Utah State U, Idaho State U, Drexel U, U of So. Carolina, CUAHSI PI: D. R. Maidment (UT-Austin)

HydroServer Publication of point observations and geospatial datasets Distributed data with local control for data publishers Data Discovery and Integration Data Publication Data Analysis and Synthesis HydroCatalog HydroDesktopHydroServer Bind Data Services Water Data Services Spatial Data Services Publish Metadata Services Service Registration Catalog Harvesting Find Metadata Search Service and Data Theme Metadata Data Carts

Ongoing Data Collection Data presentation, visualization, and analysis through Internet enabled applications Internet Applications Point Observations Data Historical Data Files GIS Data HydroServer ODM Database GetSites GetSiteInfo GetVariableInfo GetValues WaterOneFlow Web Service WaterML OGC WMS, WFS, WCS

A data source operates an observation network A network is a set of observation sites A site is a point location where one or more variables are measured A variable is a property describing the flow or quality of water A value is an observation of a variable at a particular time A qualifier is a symbol that provides additional information about the value Data Service Network {Value, Time, Qualifier} NWIS Daily Values NWIS Sites San Marcos River at Luling, TX Discharge, stage (Daily or instantaneous) 18,700 cfs, 3 July 2002 Sites Variables Observation Observations-Network Information Model

Observations Data Model (ODM) Soil moisture data Streamflow Flux tower data Groundwater levels Water Quality Precipitation & Climate A relational database at the single observation level Metadata for unambiguous interpretation Traceable heritage from raw measurements to usable information Promote syntactic and semantic consistency Cross dimension retrieval and analysis Horsburgh, J. S., D. G. Tarboton, D. R. Maidment, and I. Zaslavsky (2008), A relational model for environmental and water resources data, Water Resources Research, 44, W05406, doi: /2007WR

Set of query functions Returns data in WaterML WaterML and WaterOneFlow WaterML is an XML language for communicating water data WaterOneFlow is a set of web services based on WaterML

Manager Interface Browser Interface Service Interface Map Website Map Website Time Series Analyst Website HydroServer Website Capabilities Web Service HydroServer Capabilities Database Capabilities Configuration Tool Observation Data Model Observation Data Model WaterOneFlow Web Service Observation Data Model Spatial Data Services Geo Spatial Database Spatial Data File HydroServer View server portal Publish point dataPublish spatial data View spatial data View point data Configure server Publish metadata Load and Edit data ODM Tools and Data Loaders HydroServer

HIS Central - HydroCatalog Central metadata catalog supporting data discovery Data Discovery and Integration Data Publication Data Analysis and Synthesis HydroCatalog HydroDesktopHydroServer Bind Data Services Water Data Services Spatial Data Services Publish Metadata Services Service Registration Catalog Harvesting Find Metadata Search Service and Data Theme Metadata Data Carts

Map integrating NWIS, STORET, & Climatic Sites 65+ public web services 13,000+ variables million sites 23.3 million observation time series Referencing 5+ billion data values HIS Central HydroCatalog Content Available via HIS Central discovery services Available via GetValues requests Metadata for most services are harvested weekly

Data Publisher Interface Data Service Interface Search Client Interface Web Service Registry Website Metadata Harvester Metadata catalog database Search Web Service HydroCatalog Validation Services Monitoring Services Semantic Annotation Website Semantic Annotation Website Logging Service Validate WaterOneFlow Services Collect Metadata Register, View and Manage Services View and Manage Ontology Mappings Provide Client Search over Services and Observation Metadata Log service use Get Concepts and Mappings Monitor Service Hydrologic Ontology Interactively test WaterOneflow Services Ontology Web Service HydroCatalog A web service application programmers interface to the metadata catalog Semantic annotations and a domain ontology aid in discovery

HydroDesktop Discover, download, visualize, and analyze hydrologic data Data Discovery and Integration Data Publication Data Analysis and Synthesis HydroCatalog HydroDesktopHydroServer Bind Data Services Water Data Services Spatial Data Services Publish Metadata Services Service Registration Catalog Harvesting Find Metadata Search Service and Data Theme Metadata Data Carts

Thematic keyword search Integration from multiple sources Search on space and time domain HydroDesktop – Data Access and Analysis

User Interface User Interface HydroDesktop Core & Shared Libraries Table View Graph View HydroR Hydro Modeler Help Plugins Application Settings XML Export to CSV Fetch Basemap DotSpatial Library DotSpatial Library WaterOneFlow Web Service WaterOneFlow Web Service WaterML HydroCatalog Search & Ontology Web Service HydroCatalog Search & Ontology Web Service XML Search Project File Metadata Cache DB Data Repository DB Object Model Site Variable Series Method Site Variable Series Method Theme DataValue … Theme DataValue … Database Abstraction Layer Data Repository Manager Metadata Cache Manager Search Interact with user Interact with other programs Get from/ save to disk Other Libraries Other Libraries HydroDesktop

Data Visualization and Analysis in R

Collaborative Open Source Development HydroServer – HydroDesktop – HydroCatalog – Source Code Downloads Discussion Forums Issue Tracker

Toward a Standard SOA for Water Data Operationalizing the CUAHSI HIS Encourage broad implementation by software providers and broad uptake by data publishers Determine optimal web service interfaces and data encodings Catalog Desktop Server Bind???? Publish???? Find????

Open Geospatial Consortium Web Service Standards Map Services Web Map Service (WMS) Web Feature Service (WFS) Web Coverage Service (WCS) Catalog Services for the Web (CS/W) Observation Services Observations and Measurements Model Sensor Web Enablement (SWE) Sensor Observation Service (SOS) These standards have been developed over the past 10 years …. …. by 400 companies and agencies working within the OGC OGC Hydrology Domain Working Group evolving WaterML into an International Standard

Summary CUAHSI HIS – Cyberinfrastructure for managing and publishing observational data – Overcomes syntactic and semantic heterogeneity using a standard data model, transmission language, controlled vocabularies, and ontology – End-to-end infrastructure - from publication to discovery, access, and analysis – Supports a national network of academic partners, and links to many important federal water data repositories – Maintains national registry of services with searchable metadata – Already deployed at multiple locations, leveraged by other projects, free and open source New Developments – HydroDesktop and associated plugins for data discovery, download, and analysis – WaterML 2.0 is an emerging OGC standard language for communicating water observations data from academic and government sources – New OGC Concept Development Study to define best practices for web service interfaces and data encodings

Thank you! CUAHSI HIS Sharing hydrologic data Support EAR