Share and Publish Your Data and Models with HydroShare David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry Band, Venkatesh Merwade,

Slides:



Advertisements
Similar presentations
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
Advertisements

CEE 795 Water Resources Modeling and GIS Learning Objectives: Perform raster based network delineation from digital elevation models Perform raster based.
Linking HIS and GIS How to support the objective, transparent and robust calculation and publication of SWSI? Jeffery S. Horsburgh CUAHSI HIS Sharing hydrologic.
Floodplain Mapping using HEC-RAS and ArcView GIS Eric Tate Francisco Olivera David Maidment
Geographic Information Systems : Data Types, Sources and the ArcView Program.
Some Potential Terrain Analysis Tools for ArcGIS David G. Tarboton
Update on the NFIE Presentation to the Subcommittee on Spatial Water Data By David R. Maidment Center for Research in Water Resources University of Texas.
From Topographic Maps to Digital Elevation Models Daniel Sheehan IS&T Academic Computing Anne Graham MIT Libraries.
GIS in Water Resources: Lecture 1
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
HydroShare: An online, collaborative environment for the sharing of hydrologic data and models David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames,
HydroShare: Advancing Collaboration through Hydrologic Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
HydroShare: An online collaborative environment for the sharing of hydrologic data and models IN11A-1510 We envision that HydroShare will enable more rapid.
Advancing an Information Model for Environmental Observations Jeffery S. Horsburgh Anthony Aufdenkampe, Richard P. Hooper, Kerstin Lehnert, Kim Schreuders,
A Simple Drainage Enforcement Procedure for Estimating Catchment Area Using DEM Data David Nagel, John M. Buffington, and Charles Luce U.S. Forest Service,
Digital Elevation Model Based Watershed and Stream Network Delineation Understanding How to use Reading
ArcHydro – Two Components Hydrologic  Data Model  Toolset Credit – David R. Maidment University of Texas at Austin.
OCI OCI Flexible file access control for iRODS Alva L. Couch, Ph.D. Tufts University with David Tarboton and Jeff Horsburgh:
Creating Watersheds and Stream Networks
EarthCube Building Block for Integrating Discrete and Continuous Data (DisConBB) David Maidment, University of Texas at Austin (Lead PI) Alva Couch, Tufts.
Towards a 3D National Hydrography Dataset Presentation made to the US Geological Survey By David R. Maidment Center for Research in Water Resources University.
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
Map-Based Flood Hydrology and Hydraulics David R. Maidment Jan 10, 1998.
Clearing your Desk! Software and Data Services for Collaborative Web Based GIS Analysis David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall,
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
Terrain Based Flood Inundation mapping
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
David Tarboton Digital Elevation Models, Flood Inundation Mapping and River Hydraulic Properties David Tarboton
USU, RENCI, BYU, UNC, UVA, CUAHSI, Tufts, Texas, Purdue, Caktus
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
Community Approaches to Hydrologic Data and Model Sharing using Cloud Resources David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall,
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
USU, RENCI, BYU, UNC, UVA, CUAHSI, Tufts, Texas, Purdue, SDSC
Water Information Sharing and HydroShare
Introduction to HydroShare Workshop CUAHSI Biennial Symposium, July 26
Sharing models as social objects through HydroShare
USU, RENCI, BYU, UNC, UVA, CUAHSI, Tufts, Texas, Purdue, SDSC
Hydrologic Terrain Processing Using Parallel Computing
Flow field representations for a grid DEM
Arc Hydro for EPA Basins
Water Information Sharing and HydroShare
Terrain Analysis Using Digital Elevation Models (TauDEM) in Hydrology
Automation of Input data preparation of TOPNET model using Python
Digital Elevation Model Based Watershed and Stream Network Delineation
River Channels CE 397 Flood Forecasting David R. Maidment
A Geographic Information System Tool for Hydrologic Model Setup
Digital Elevation Model Based Watershed and Stream Network Delineation
Welcome to GIS in Water Resources 2017
HydroShare: Advancing Collaboration through Hydrologic Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
Terrain Analysis Using Digital Elevation Models
GIS FOR HYDROLOGIC DATA DEVELOPMENT FOR DESIGN OF HIGHWAY DRAINAGE FACILITIES by Francisco Olivera and David Maidment Center for Research in Water Resources.
Advances in the mapping of flow networks from digital elevation data
Corps Water Management System (CWMS) Modernization
Terrain Analysis Using Digital Elevation Models (TauDEM)
OAC OAC OAC ACI ACI Water Information Sharing and HydroShare Advancing Hydrology through Collaborative.
Welcome to GIS in Water Resources 2018
Welcome to GIS in Water Resources 2009
GIS in Water Resources: Lecture 1
Welcome to GIS in Water Resources 2013
Welcome to GIS in Water Resources 2012
CE 384N GIS in water resources Flooding in Houston during Hurricane Harvey Yun Liu (Lorraine) 11/27/2018.
Channels, Watersheds, Flow Related Terrain Information
Digital Elevation Models and Hydrology
CE 384N GIS in water resources Flooding in Houston during Hurricane Harvey Yun Liu (Lorraine) 11/27/2018.
Extending ArcGIS using programming
Scour Analysis on the west fork of the Duchesne River
OAC OAC OAC ACI ACI The HydroShare domain-specific repository for archiving and active management.
Flood Inundation Mapping using Height Above Nearest Drainage Method
Flood Inundation Mapping
Presentation transcript:

Share and Publish Your Data and Models with HydroShare David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry Band, Venkatesh Merwade, Alva Couch, Rick Hooper, David Maidment, Pabitra Dash, Michael Stealey, Hong Yi, Tian Gan, Tony Castronova, Brian Miles, Zhiyu Li, Mohamed Morsy, Shaowen Wang, Yan Liu OCI OCI USU, RENCI, BYU, UNC, UVA, CUAHSI, Tufts, Texas, Purdue, Caktus, NCSA

Motivation – requires integration of information from multiple sources – is data and computationally intensive – requires collaboration and working as a team/community Data Analysis Models Advancing Hydrologic Understanding Grand challenge (NRC 2001): Better hydrologic forecasting that quantifies effects and consequences of land surface change on hydrologic processes and conditions Floods and Droughts

Enable more rapid advances in hydrologic understanding through collaborative data sharing, analysis and modeling Web Based Collaboration Environment

Data and models used by hydrologists are diverse… Time series Geographic rasters Geographic features Multidimensional space/time Model programs Model instances … From Jeff Horsburgh

At its heart, HydroShare is a system for sharing Resources and Collaborating Files and sets of files structured to represent a hydrologic process, model, or element in the hydrologic environment Standard data models enhance interoperability and support functionality “hydro value added” Tools (Web apps) that act on resources to visualize, modify and create new resources – Encode standard/best practices Access control and sharing model

Architecture Resource exploration Actions on Resources Distributed file storage Parallels the paradigm for how PC’s are used Organize and annotate your content Manage access Web software to operate on content you have access to (Apps) Extensibility HydroShare AppsDjango website iRODS “Network File System” API OAuth Anyone can set up a server/app platform (software service) to operate on HydroShare resources through iRODS and API SWATShare (Hubzero) CyberGIS Unidata - THREDDS, Hyrax Landlab ? HydroShare Data Store HydroShare Data Store CyberGIS Data Store CyberGIS Data Store

HydroShare Functionality Sharing and publication of data (DOI) Social discovery and added value Model sharing Model input data preparation Model execution Visualization and analysis (best of practice tools) Server/Cloud Computation Platform independence Big data Reproducibility Reduce needs for software installation and configuration Collaboration, Reproducibility, Credit, Transparency Clearing your desk!

Clearing your desk. The trend towards network (cloud) computing. Data Sources Functions and Tools Server Software as a Service Users Based on slide from Norm Jones Can we deliver Hydrologic Research and Analysis functionality as a service over the web?

supports web based visualization and analysis working with HydroShare Resources

Hydrologic Terrain Analysis (TauDEM) Raw DEM Pit Removal Flow Field Flow Related Terrain Information Watersheds are the most basic hydrologic landscape elements

TauDEM generalized terrain flow surfaces Dinfinity contributing area Distance to stream (vertical)Decaying accumulation hs hr vr vs Point of interest Ridge pr ps ss sr hs hr vr vs Stream pr ps ss sr Distance Down and Distance Up

Using TauDEM today requires Expertise in Hydrologic DEM analysis The software – ArcGIS licenses (for ArcGIS plugin) – The ability to install software – TauDEM command functions with MPI installation – Compilation for other platforms Sufficient Hardware (RAM and Disk) The data (uncompressed GeoTIFF, projected, consistent grid size and spatial reference)

TauDEM in CyberGIS Analysis submitted Analysis running Results data created Results Ready

An Example: TauDEM and Height above the Nearest Drainage (HAND) for flood inundation mapping WRF + NOAH-MP + RAPID/SPRNT produce flows at reach scale Need a way to obtain reach level hydraulic properties for inputs to these models Need a way to map from reach scale stage to flood inundation depth Exploit high resolution topography represented by a digital elevation model (DEM) Additional details are in:

Height above the nearest drainage (HAND) flood mapping Each stream reach has a water depth h w (e.g. from SPRNT) Each stream reach has an ID Each grid cell has the ID of the reach it connects to and the height above the nearest stream h s Evaluate approximating inundation using h w -h s If(h w (id) > h s (id)) Inundation depth = h w (id) - h s (id) Else Inundation depth = 0

h w =8 ft h w =9 ft h w =11 ft h w =12 ft h w =14 ft h w =10 ft h w =15 ft Reach based height above nearest drainage flood map example

Terrain based derivation of “reach scale” hydraulic properties For each Catchment For each height h Identify cells where h s < h T Cross Section Area Wetted Perimeter Top Width Wetted Bed Area L AsAs AbAb V Surface Area Volume Hydraulic Radius Approximates each cell as sloping plane ComidHARPTVAbAs A table with reach hydraulic parameters as keyed to hydrography Derived from DEM or LIDAR T P A h Depth

Reach Hydraulic Properties Example 1 m inundation3 m inundation Height (m)A s (m 2 )Vol (m 3 )AbAb L (m)A=V/L (m 2 )P=A b /L (m)T=A s /L (m)R=A/P (m)

Terrain Approximated Reach Average Hydraulic Properties Need to evaluate in Hydraulic Model (e.g. SPRNT) Hydraulic RadiusWetted Perimeter Cross-sectional Area Top Width

HAND Conclusions The height above nearest drainage approach suggested as way to rapidly approximate real time flood inundation Includes an approach to approximate reach scale hydraulic properties Need to evaluate versus more detailed (e.g. HEC-RAS) hydraulic model Need to evaluate with HRT (LIDAR) vs general (NED) DEM as input

Summary 1.A new, web-based system for advancing model and data sharing 2.Access multiple types of hydrologic data using standards compliant data formats and interfaces 3.Flexible discovery functionality 4.Model sharing and execution 5.Facilitate and ease access to use of high performance computing 6.Social media and collaboration functionality 7.Links to other data and modeling systems

– USU – RENCI/UNC – CUAHSI – BYU – Tufts – UVA – Texas – Purdue – SDSC – Caktus Thanks to the HydroShare team! OCI OCI