Publication Alternatives: Hybrid Data Services Table Views Presented by Tim Whiteaker The University of Texas at Austin 4 June, 2009.

Slides:



Advertisements
Similar presentations
USU NIDIS Drought Server Update Jeff Horsburgh, Kim Schreuders David Tarboton, Stephanie Reeder Avirup Sen Gupta.
Advertisements

HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
Sharing Hydrologic Data with the CUAHSI Hydrologic Information System Support EAR CUAHSI HIS Sharing hydrologic data David.
ICEWATER: INRA Constellation of Experimental Watersheds Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S. Horsburgh, Utah State.
Hydrologic Data and Modeling: Towards Hydrologic Information Science David R. Maidment Center for Research in Water Resources University of Texas at Austin.
Development of a Community Hydrologic Information System David G Tarboton Jeffery S Horsburgh, David R. Maidment (PI), Tim Whiteaker, Ilya Zaslavsky, Michael.
Hydrologic Information Systems David Maidment, Tim Whiteaker, Dean Djokic, Norman Jones ESRI, Redlands CA Sept 4, 2007.
Linking HIS and GIS How to support the objective, transparent and robust calculation and publication of SWSI? Jeffery S. Horsburgh CUAHSI HIS Sharing hydrologic.
This work is funded by National Science Foundation Grant EAR Accessing and Sharing Data Using the CUAHSI Hydrologic Information System CUAHSI HIS.
CUAHSI HIS Data Services Project David R. Maidment Director, Center for Research in Water Resources University of Texas at Austin (HIS Project Leader)
SENSORS, CYBERINFRASTRUCTURE, AND EXAMINATION OF HYDROLOGIC AND HYDROCHEMICAL RESPONSE IN THE LITTLE BEAR RIVER OBSERVATORY TEST BED Jeffery S. Horsburgh.
Components of an Integrated Environmental Observatory Information System Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S.
This work was funded by the U.S. National Science Foundation under grant EAR Any opinions, findings and conclusions or recommendations expressed.
The HydroServer Platform for Sharing Hydrologic Data Support EAR CUAHSI HIS Sharing hydrologic data David G Tarboton, Jeffery.
Introduction to CUAHSI Water Web Services and Texas HIS David R. Maidment The University of Texas at Austin.
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.
Two NSF Data Services Projects Rick Hooper, President Consortium of Universities for the Advancement of Hydrologic Science, Inc.
Using GIS in Creating an End-to- End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David G. Tarboton, David R. Maidment, Ilya.
Introducing the CUAHSI Hydrologic Information System Desktop Application (HydroDesktop) and Open Development Community Jiří Kadlec, Daniel Ames, Teva Velupillai.
CZO Integrated Data Management Web services, CZO data publication system prototype, demo Ilya Zaslavsky SDSC.
HIS Team and Collaborators University of Texas at Austin – David Maidment, Tim Whiteaker, Ernest To, Bryan Enslein, Kate Marney San Diego Supercomputer.
An End-to-End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David K. Stevens, David G. Tarboton, Nancy O. Mesner, Amber Spackman.
A Services Oriented Architecture for Water Resources Data David R. Maidment Center for Research in Water Resources University of Texas at Austin EPA Storet.
Online Surveys A Look at Cardiff-TeleForm Denise H. Wells Planning and Research Central Piedmont Community College.
Christopher M. Pascucci Basic Structural Concepts of.NET Browser – Server Interaction.
About CUAHSI The Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) is an organization representing 120+ universities.
Ocean Sciences What is CUAHSI? CUAHSI – Consortium of Universities for the Advancement of Hydrologic Science, Inc Formed in 2001 as a legal entity Program.
4-1 INTERNET DATABASE CONNECTOR Colorado Technical University IT420 Tim Peterson.
About CUAHSI The Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) is an organization representing 120+ universities.
Data File Access API : Under the Hood Simon Horwith CTO Etrilogy Ltd.
Data Interoperability in the Hydrologic Sciences The CUAHSI Hydrologic Information System David Tarboton, David Maidment, Ilya Zaslavsky, Dan Ames, Jon.
CUAHSI Hydrologic Information System an introduction Ilya Zaslavsky Director, Spatial Information Systems Lab San Diego Supercomputer Center University.
CUAHSI WaterOneFlow Web Services By Tim Whiteaker CE 394K.2 Hydrology 1 February 2007.
Publishing Observations Data: from ODM to HIS Central.
James Seppi CE394K Hydrology, Spring 2010 University of Texas.
What is CUAHSI? Source:
CUAHSI, WATERS and HIS by Richard P. Hooper, David G. Tarboton and David R. Maidment.
Overview of CUAHSI HIS Version 1.1 David R. Maidment Director, Center for Research in Water Resources University of Texas at Austin CUAHSI Biennial Science.
Water Data in the Unified Modeling Language Xitian Cai Center for Research in Water Resources The University of Texas at Austin.
CUAHSI Hydrologic Information Systems David R. Maidment Center for Research in Water Resources University of Texas at Austin and Ilya Zaslavsky, David.
The CUAHSI Hydrologic Information System Presented by Dr. Tim Whiteaker The University of Texas at Austin 22 February, 2011.
The CUAHSI Community Hydrologic Information System Jeffery S. Horsburgh Utah Water Research Laboratory Utah State University CUAHSI HIS Sharing hydrologic.
Bringing Water Data Together David R. Maidment Center for Research in Water Resources University of Texas at Austin Texas Water Summit San Antonio Tx,
Hydrologic Information System GIS – the water environment Water Resources – the water itself CUAHSI HIS: NSF-supported collaborative project: UT Austin.
GBIF Data Access and Database Interoperability 2003 Work Programme Overview Donald Hobern, GBIF Programme Officer for Data Access and Database Interoperability.
Critical Zone Observatory Data Discovery Each CZO maintains its own data management system(s) using the data formats it prefers The three CZO’s have a.
12/6/2015B.Ramamurthy1 Java Database Connectivity B.Ramamurthy.
CUAHSI Hydrologic Information Systems David R. Maidment and Ernest To Center for Research in Water Resources, University of Texas at Austin Hydrosystems.
Designing a Query Tool for Time Series Data in ArcGIS Hydro Data Model By Reem Jihan Zoun.
The CUAHSI Observations Data Model Jeff Horsburgh David Maidment, David Tarboton, Ilya Zaslavsky, Michael Piasecki, Jon Goodall, David Valentine,
Storing and Publishing Water Observations Data Services Tim Whiteaker The University of Texas at Austin.
An Online Viewer for Geospatial Space- Time Themes James Seppi GISWR2009 University of Texas.
CHAPTER 7 LESSON C Creating Database Reports. Lesson C Objectives  Display image data in a report  Manually create queries and data links  Create summary.
Hydroinformatics Lecture 15: HydroServer and HydroServer Lite The CUAHSI HIS is Supported by NSF Grant# EAR CUAHSI HIS Sharing hydrologic data.
Using Python to Retrieve Data from the CUAHSI HIS Web Services Jon Goodall Hydroinformatics Fall 2014 This work was funded by National Science Foundation.
Developing a community hydrologic information system David G Tarboton David R. Maidment (PI) Ilya Zaslavsky Michael Piasecki Jon Goodall
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
Using GIS in Creating an End-to-End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David G. Tarboton, David R. Maidment, Ilya.
The CUAHSI Community Hydrologic Information System
Developing a Community Hydrologic Information System
Sharing Hydrologic Data with the CUAHSI* Hydrologic Information System
The CUAHSI Hydrologic Information System and NHD Plus A Services Oriented Architecture for Water Resources Data David G Tarboton David R. Maidment (PI)
The CUAHSI Hydrologic Information System Service Oriented Architecture for Water Resources CUAHSI HIS Sharing hydrologic data Support.
CUAHSI HIS Sharing hydrologic data
Data Acquisition, Management and Manipulation
Department of Civil, Architectural & Environmental Engineering
HydroDesktop: A Key Component of the CUAHSI/CZO HIS for Hydrologic Data Discovery, Visualization, and Analysis Daniel P. Ames, Ph.D. P.E. Idaho State University.
GIS in Water Resources: Lecture 1
GIS in Water Resources David R. Maidment
Presentation transcript:

Publication Alternatives: Hybrid Data Services Table Views Presented by Tim Whiteaker The University of Texas at Austin 4 June, 2009

Ingest Data From Different Sources Transform Data into Uniform Format with ODM Data Loader Load Newly Formatted Data into ODM Tables in MS SQL/Server Wrap ODM with WaterML Web Services for Online Publication Texas Parks and Wildlife Dept Texas Water Development Board Texas Instream Flow Program ODM Water Data Service TPWD ODM TWDB ODM TIFP ODM Observations Data Model (ODM) WaterML

TCOON METADATA ODM TCOON DataValues WaterML Metadata From: ODM Database in Austin TCOON Web Site in Corpus Christi TCOON Water Data Service Hybrid Water Data Service TCOON Metadata are Transferred from XML to the ODM Web Services can both Query the ODM for Metadata and use a Web Scraper for Data Values Calling the WSDL Returns Metadata and Data Values as if from the same Database GetSites GetSiteInfo GetVariableInfo Get Values from:

Hybrid Water Data Service GetSites GetSiteInfo GetVariableInfo GetValues Hybrid Data Service Architecture METADATA ODM ODM Web Service GetSites GetSiteInfo GetVariableInfo GetValues Remote Data Source Remote Data Source

TCOON Example

Use Data Query to get data

Form query, click button, get data…

…after completing this brief survey

Data returned as text with header Unique URL Header + Values

Deciphering the URL &elev=stnd stnlist=014&serlist=pwl&when=07/23/ /30/2008 &whentz=UTC0&-action=c&unit=metric&interval=360

Deciphering the URL &elev=stnd stnlist=014 &serlist=pwl &when=07/23/ /30/2008 &whentz=UTC0 &-action=c &unit=metric &interval=360

Steps to Building the Service Harvest Metadata into ODM Wrap with WaterOneFlow (private) Write Service to handle GetValues – Metadata from private service – Time series from TCOON website (via URL) TCOON DataValues TCOON METADATA ODM

Programming the Web Service Web Service with ODM Metadata WaterOneFlow Helper (WaterOneFlow helper is included with the ODM web service)

Metadata from Private Service GetSites in 3 lines of code!! Piggyback off your ODM service

Populating the TimeSeries Object The work is in GetValues

Building the URL Use Site, Variable, and Dates to make URL Default any other parameters

Retrieving Values from the Website Build the URL Scrape the website

Parsing the Website Response Process each line of text Assign to TimeSeries Object

Returning the TimeSeries Object

TCOON Hybrid Water Data Service GetSites GetSiteInfo GetVariableInfo GetValues TCOON Data Service Architecture METADATA ODM TCOON Metadata Web Service GetSites GetSiteInfo GetVariableInfo GetValues TCOON Website

Summary – Hybrid Data Services All methods except GetValues simply call the metadata service on ODM GetValues reads remote website on the fly Handy for dynamic data sources TCOON METADATA ODM TCOON DataValues WaterML TCOON Water Data Service

Table Views

Wear the ODM Hat Your Database WaterOneFlow Web Service ODM View

Example: The ‘NotODM’ Database Table names different Field names different

Creating the View Change field names Result

Saving the View Use an ODM Table Name

WaterOneFlow Can Read Views Not ODM WaterOneFlow Web Service ODM View No Programming Required!

When to Use Publication Alternatives Hybrid Service – You can get site locations and variable info, but do not wish to populate your database with time series values Table View – You already have a SQL Server database that maps fairly easily to ODM, and you see no need to duplicate the data by loading into a separate ODM database

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.