CUAHSI HIS Sharing hydrologic data http://his.cuahsi.org/ Sharing Hydrologic Data using the CUAHSI Hydrologic Information System Part I: Catalog and Server The CUAHSI HIS is Supported by NSF Grant# EAR 0622374

Introducing the “Knowing Generation” “Just type it in your phone, Daddy.”

What’s a Lobster?

SOA = Enabling the Knowing Generation

CUAHSI HIS SOA = Enabling Water Science Data Discovery Data Discovery and Integration platform Data Publication platform Data Synthesis and Research platform Data Services Metadata Services Metadata Search HIS Central HydroDesktop HydroServer Service registration Catalog harvesting Service and data theme metadata Data carts Water Data Services Spatial Data Services Like search portals Google, Yahoo, Bing Like browsers Like web servers Like HTML Welcome to our week for discussing HydroServer and HydroServer Lite as tools for publishing your data from an ODM using the Water One Flow web services and web based user interfaces. As you recall, the CUAHSI Hydrologic Information System is comprised of three components which follow the internet’s common Services Oriented Architecture (SOA). HydroServer and similar software tools plays an important role in the CUAHSI HIS SOA as the primary data provider in the system. It’s role is similar to that of a web server, though the HydroServer needs NO user interface to function on the HIS network since it’s primary role is to share data through web services.

HIS = Hydrologic Information System CUAHSI Consortium of Universities for the Advancement of Hydrologic Science, Inc. 111 US University members 7 affiliate members 19 International affiliate members An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U.S. HIS = Hydrologic Information System

BYU CEE Graduate Seminar 9/29/2011 What is HIS? The CUAHSI* Hydrologic Information System (HIS) provides web services, tools, standards and procedures that enhance access to more and better data for hydrologic analysis. http://his.cuahsi.org HIS helps you discover and access hydrologic data.

CUAHSI HIS Metadata Services Metadata Search Data Services The CUAHSI Hydrologic Information System (HIS) is an internet based system to support the sharing of hydrologic data. It is comprised of hydrologic databases and servers connected through web services as well as software for data publication, discovery and access. Data Discovery and Integration platform Data Publication platform Data Synthesis and Research platform Data Services Metadata Services Metadata Search HIS Central HydroDesktop HydroServer Service registration Catalog harvesting Service and data theme metadata Data carts Water Data Services Spatial Data Services Like search portals Google, Yahoo, Bing Like browsers Like web servers Like HTML Welcome to our week for discussing HydroServer and HydroServer Lite as tools for publishing your data from an ODM using the Water One Flow web services and web based user interfaces. As you recall, the CUAHSI Hydrologic Information System is comprised of three components which follow the internet’s common Services Oriented Architecture (SOA). HydroServer and similar software tools plays an important role in the CUAHSI HIS SOA as the primary data provider in the system. It’s role is similar to that of a web server, though the HydroServer needs NO user interface to function on the HIS network since it’s primary role is to share data through web services.

Remember the Observations Data Model… BYU CEE Graduate Seminar Remember the Observations Data Model… 9/29/2011 Sites Values and Time The DataValues table is at the center of the Observations Data Model, with other tables around it providing additional information using database relationships. Variables Horsburgh, J. S., D. G. Tarboton, D. R. Maidment and I. Zaslavsky, (2008), "A Relational Model for Environmental and Water Resources Data," Water Resour. Res., 44: W05406, doi:10.1029/2007WR006392.

Our approach thus far… ODM sits on a server and we connect to it through SQL, Python, etc. Internet ODM Database Python & SQL

Our approach thus far… Or… ODM sits on our computer, but we still use SQL, Python, etc. Through a local internet… ODM Database “Internet” Python & SQL

Web Services Translation layer HydroServer Approach ODM Database Web Services Server Internet XML Web Services Translation layer XML

HydroServer Goals A platform for organizing and publishing space-time hydrologic datasets that: Provides local control of data Makes data universally available Is autonomous – e.g., functional independent of the rest of HIS Put the data service as close to the data producer as possible. Share the data as widely and openly as possible. Some of the key goals of the HydroServer effort are given here. Serve as a useful data store regardless of the fate of CUAHSI HIS.

ODM 1.1.1

Publishing Data in an ODM Database WaterML and WaterOneFlow WaterML is an XML schema for communicating water data WaterOneFlow is a set of web services based on WaterML Set of query functions Returns data in WaterML Slide from David Valentine 15

For example: to get a site, send this “SOAP” request to the server: Specify the site and an optional authorization token

Get this response: Result returns in this string. We may look at a couple more examples online. Result returns in this string.

A vocabulary for asking for information about the data WaterOneFlow A vocabulary for asking for information about the data 18

Go to: http://worldwater.byu.edu/ Click “databases” Click Sandbox Click web services Click SOAP Services What are the services available? What do they do? Go back one page Click “REST Web Services Test” Try “Get Sites” Look at the output Try formatting the output using http://www.freeformatter.com/xml-formatter.html

WaterML An XML structure for transferring water time-series data (back to the client) 20

Capabilities Database Configuration Tool Add on Visualization Capabilities KEY HydroServer Functionality: Read ODM Share it with WebServices Capabilities Database Configuration Tool HydroServer Capabilities Database WaterOneFlow Services Add on GIS Services through ArcGIS Server Spatial Services HydroServer software can be found at hydroserver.codeplex.com WaterOneFlow WaterOneFlow WaterOneFlow ODM ODM ODM ODM Databases and Web Services ArcGIS Server Spatial Data Services

2 Flavors of HydroServer: HydroServer (.NET) http://hydroserver.codeplex.com Model implementation of the HydroServer CUAHSI HIS specification Runs on Windows servers Requires Microsoft SQL Server Uses ArcGIS Server Uses Streaming Data Loader, Data Loader and SQL tools to manage the database. These are the two flavors of HydroServer that we will discuss in this class. Both are free and open source. Both can be downloaded from the web and installed on your own server. Both can be registered on the CUAHSI HIS system.

2 Flavors of HydroServer Original HydroServer: http://hydroserver.codeplex.com Model implementation of the HydroServer CUAHSI HIS specification Runs on Windows servers Requires Microsoft SQL Server Uses ArcGIS Server Uses Streaming Data Loader, Data Loader and SQL tools to manage the database. HydroServer Lite: https://github.com/CUAHSI/HydroServerLite Simplified implementation of the CUAHSI HIS specification (all required services are supported). Runs on the free LAMP stack (Linux, Apache, MySQL, PHP) Uses front end web pages to load data in the database. These are the two flavors of HydroServer that we will discuss in this class. Both are free and open source. Both can be downloaded from the web and installed on your own server. Both can be registered on the CUAHSI HIS system.

HydroServer PHP (HydroServer Lite) https://github.com/CUAHSI/HydroServerLite Simplified implementation of the CUAHSI HIS specification (all required services are supported). Runs on the free LAMP stack (Linux, Apache, MySQL, PHP) Uses front end web pages to load data in the database. These are the two flavors of HydroServer that we will discuss in this class. Both are free and open source. Both can be downloaded from the web and installed on your own server. Both can be registered on the CUAHSI HIS system.

What is HydroServer Lite? PHP and MySQL mean easy/fast/cheap setup Focus on easy extends to user interfaces. Developer community at http://hydroserverlite.codeplex.com/ Let’s try it out: http://worldwater.byu.edu/ Browse data from any database, upload data using the “sandbox” database.

Can Citizen Science Data be Shared and Intermingled with “Real Data”?

Data Input WaterML2 Output Interactive Map Time Series Graph Open Source/ Light Weight PHP and MySQL WaterML HydroServer

HydroServers for the Developing World http://worldwater.byu.edu Custom PHP-based Catalog for Developing Countries

Internationalization Effort

Try it… Go to worldwater.byu.edu Databases Sandbox Create a new site Add some data.

Assignment Build your own HydroServer instance on worldwater.byu.edu Upload your own observations Write a brief report…