Hydrologic Information System for North Texas John A. McEnery, University of Texas at Arlington Paul W. McKee, National Weather Service Gregory P. Shelton,

Slides:



Advertisements
Similar presentations
Implementing Tableau Server in an Enterprise Environment
Advertisements

DVDZone2.com From Linux to Windows 2003 Gregory Bronchart [web-o-net] Fabrice Cornet [BrainSys]
USU NIDIS Drought Server Update Jeff Horsburgh, Kim Schreuders David Tarboton, Stephanie Reeder Avirup Sen Gupta.
A new Network Concept for transporting and storing digital video…………
Some notes on CyberGIS in hydrology Ilya Zaslavsky Spatial Information Systems Lab San Diego Supercomputer Center UCSD TeraGrid CyberGIS Workshop, February.
SAN DIEGO SUPERCOMPUTER CENTER NEAR REAL TIME VISUALIZATION OF USGS INSTANTANEOUS DATA: INTEGRATION OF OPEN SOURCE DATA TURBINE IN CUAHSI HIS Thomas Whitenack.
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
This work is funded by the Inland Northwest Research Alliance INRA Constellation of Experimental Watersheds: Cyberinfrastructure to Support Publication.
ICEWATER: INRA Constellation of Experimental Watersheds Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S. Horsburgh, Utah State.
Recent, Large Scale IT Business Innovations at Crutchfield Corporation.
Re-Architecting Search Solutions with SharePoint’s new Federation Features ITP314, CIO314, PM314, IA314.
Linking HIS and GIS How to support the objective, transparent and robust calculation and publication of SWSI? Jeffery S. Horsburgh CUAHSI HIS Sharing hydrologic.
This work is funded by National Science Foundation Grant EAR Accessing and Sharing Data Using the CUAHSI Hydrologic Information System CUAHSI HIS.
Hydrologic Information System for North Texas John A. McEnery, University of Texas at Arlington Paul W. McKee, National Weather Service Gregory P. Shelton,
Cloud Computing Ed Lazowska Bill & Melinda Gates Chair in Computer Science & Engineering University of Washington August 2010.
Implementation Considerations for FAST Search For SharePoint (FS4SP) Presenter : Shyam Narayan MOSSIG – February 2011 Meeting b:
Two NSF Data Services Projects Rick Hooper, President Consortium of Universities for the Advancement of Hydrologic Science, Inc.
Introducing the CUAHSI Hydrologic Information System Desktop Application (HydroDesktop) and Open Development Community Jiří Kadlec, Daniel Ames, Teva Velupillai.
GIS at SDSC Domains: –From geology, environmental science, hydrology, ocean biodiversity, regional development, Katrina response, archaeology, to neuroscience.
SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.
Microsoft Operations Manager Presented by: Alen Plicanic.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
Yes, yes it does! 1.Guest Clustering is supported with SQL Server when running a guest operating system of Windows Server 2008 SP2 or newer.
Using HydroServer Organize, Manage, and Publish Your Data Support EAR CUAHSI HIS Sharing hydrologic data Jeffery S. Horsburgh.
Precipitation Patterns, Supply Planning and Demand Curves: Assessing Water Supply Risks in a Changing Climate Erica Brown Association of Metropolitan Water.
Fast Track, Microsoft SQL Server 2008 Parallel Data Warehouse and Traditional Data Warehouse Design BI Best Practices and Tuning for Scaling SQL Server.
Russ Houberg Senior Technical Architect, MCM KnowledgeLake, Inc.
1© Copyright 2013 EMC Corporation. All rights reserved. EMC and Microsoft SharePoint Server Performance Name Title Date.
Introduction to Database using Microsoft Access 2013 Part 1 November 4, 2014.
National Weather Service North Central River Forecast Center Mississippi River Forecast Procedure.
Setting up a HydroServer Support EAR CUAHSI HIS Sharing hydrologic data Jeffery S. Horsburgh David G. Tarboton, Kimberly.
STEALTH Content Store for SharePoint using Windows Azure  Boosting your SharePoint to the MAX! "Optimizing your Business behind the scenes"
About CUAHSI The Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) is an organization representing 120+ universities.
Ocean Sciences What is CUAHSI? CUAHSI – Consortium of Universities for the Advancement of Hydrologic Science, Inc Formed in 2001 as a legal entity Program.
What is Workflow?  Workflow or Business Process Management (BPM) consists of Processes, States and Actions.  A Process (e.g. Customer Order fulfillment)
STEALTH Content Store for SharePoint using Caringo CAStor  Boosting your SharePoint to the MAX! "Optimizing your Business behind the scenes"
NLM Digital Repository Server Architecture January 18, 2011.
Publishing Observations Data: from ODM to HIS Central.
FLASH FLOOD PREDICTION James McDonald 4/29/08. Introduction - Relevance  90% of all national disasters are weather and flood related  Central Texas.
U.S. Department of the Interior U.S. Geological Survey StreamStats: System Design and Web Implementation 12/18/02 Jacque Coles - USGS Dean Djokic - ESRI.
Fusion Team Brief Missouri Basin River Forecasters’ Meeting Kansas City, MO Tuesday, 16 November 2010.
CLASS Information Management Presented at NOAATECH Conference 2006 Presented by Pat Schafer (CLASS-WV Development Lead)
Bringing Water Data Together David R. Maidment Center for Research in Water Resources University of Texas at Austin Texas Water Summit San Antonio Tx,
CE 394K.2 Surface Water Hydrology Lecture 1 – Introduction to the course Readings for today –Applied Hydrology, Chapter 1 –“Integrated Observatories to.
Microsoft’s Worldwide Marketing Database with Windows 2000 Datacenter Server Scaling Up to the Needs of the Worldwide Marketing Database with Windows.
Development of a Geographic Framework for an Integrated Flood Modeling System Oscar Robayo Tim Whiteaker August 10, 2004 University of Texas at Austin.
Sharing SRP Water Sample Data Using CUAHSI HIS Infrastructure Ilya Zaslavsky, Thomas Whitenack, Keith Pezzoli, Hiram Sarabia University of California at.
Hosting Websites and Web Applications with Microsoft ® SQL Server ® 2008.
GIS for Atmospheric Sciences and Hydrology By David R. Maidment University of Texas at Austin National Center for Atmospheric Research, 6 July 2005.
Storing and Publishing Water Observations Data Services Tim Whiteaker The University of Texas at Austin.
Name Title Company Method/ technology Recoverable Backup size supported Backup type(s) supported Systems Center Data Protection Manager.
NATIONAL WEATHER SERVICE JACKSON, MS NEW ORLEANS/BATON ROUGE, LA Pearl River Basin Watershed Town Hall March 17, 2015
SSMS SQL Server Management System. SQL Server Microsoft SQL Server is a Relational Database Management System (RDBMS) Relational Database Management System.
Configuring SQL Server for a successful SharePoint Server Deployment Haaron Gonzalez Solution Architect & Consultant Microsoft MVP SharePoint Server
Hydroinformatics Lecture 15: HydroServer and HydroServer Lite The CUAHSI HIS is Supported by NSF Grant# EAR CUAHSI HIS Sharing hydrologic data.
Ryan Kula CIST 3000 Report Presentation 05/01/2014.
WV DOT Scanning Project
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
Hydroinformatics Lecture: HydroServer .NET/PHP
DBMS Programs MS SQL Server & MySQL
FileCatalyst Performance
CUAHSI HIS Sharing hydrologic data
Data Acquisition, Management and Manipulation
HydroDesktop: A Key Component of the CUAHSI/CZO HIS for Hydrologic Data Discovery, Visualization, and Analysis Daniel P. Ames, Ph.D. P.E. Idaho State University.
KISTERS TimeSeries HUB
Microsoft Virtual Academy
Collaborative Adaptive Sensing of the Atmosphere (CASA WX)
National Weather Service Missouri Basin River Forecast Center Mid-West Electric Consumers Association Annual Meeting Water & Power Panel 11 December.
CS122B: Projects in Databases and Web Applications Winter 2019
Presentation transcript:

Hydrologic Information System for North Texas John A. McEnery, University of Texas at Arlington Paul W. McKee, National Weather Service Gregory P. Shelton, National Weather Service December 10, 2010

HRAP centers / MPE /U.S. & Mexico

SQL Database Scalability Considerations –Database Search Indexes written & applied to several data sets –Outcome: performance trade off –The positive: Substantially increased data retrieval time Data download time for registered sets of Daily and Hourly values now range between quick to nearly instantaneous!! –The negative: Substantially slower data entry. Nearly an hour to load a one hour set of values. Not a sustainable process.

SQL Database Scalability Considerations –Solution: Recent Values vs. Archive 2 separate sets Small dynamic set containing recent values (no indexes needed). This will receive current updates. Large static set with full 15/17 yr history of archive values. –Additional Solution: New platform at Arlington Regional Data Center (ARDC) Fail-over power back up 24/7 sys-op support Enterprise class data server

ARDC System GHz HT processing cores 96 Gb memory 12 TB integrated storage for faster IO functions MS Server 2008, SQL Server 2008 & ArcGIS Server

Update stream via Unidata Local Data Manager (LDM) LDM Connection became active and remained active November 22 nd. –Routed from WGRFC through NWS Southern Region Headquarters and then to UTA. –Extremely dedicated effort by Mike Thompson of NWS to coordinate the configuration for LDM.

UTA HIS Architecture Reservoir WaterShed Microsoft Server 2008 MS SQL Server 2008 CUAHSI ODM WaterOneFlow Services (2.83Ghz IC7 – 20 Gb SDRAM) QNAP NAS 16Tb External Storage NWS WGRFC CUAHSI Central WaterML C# Script XMRG Content Archive Values

UTA HIS Architecture Reservoir WaterDrop Linux Red Hat 5.0 LDM 6.8 Data Manager WaterShed Microsoft Server 2008 MS SQL Server 2008 CUAHSI ODM WaterOneFlow Services (2.83Ghz IC7 – 20 Gb SDRAM) QNAP NAS 16Tb External Storage NWS WGRFC / SRHCUAHSI Central WaterML C# Script XMRG Content Current Values

Student participants Kulsawasd Jitkajomwanich Brad Jewell Ryan Ramsey

Extension of Work Lower Mississippi RFC Arkansas Red Basin RFC

NWS RFC Service Areas

New Project Tarrant Regional Water District Implement a similar data system to stream multiple data sources. MPE, QPF, stream flow, lake levels. Purpose: Input for Fort Worth Floodway Model. Collaborators: TRWD, NWS, USGS, USACE.