Data Stewardship and Maintenance for the National Hydrography Dataset USGS/INEGI Cross-Border Integration Project Cross-Border Integration Project U.S.

Slides:



Advertisements
Similar presentations
NHD Update Process Improvement Project U.S. Department of the Interior U.S. Geological Survey Kevin McNinch, Dave Hughes, Paul Kimsey.
Advertisements

Updating the National Hydrography Data for the Twin Cities with Local Subsurface Drainage Information NHD Stewardship Conference Lakewood, Colorado April.
WRAP Hydro Data Model: Its Structure and application to find Input Parameters for the Water Rights Analysis Package Centre For Research In Water Resources.
U.S. Department of the Interior U.S. Geological Survey Action Plan for the Development of Watershed and Sub-Watershed Boundaries for northwestern Mississippi.
Coordination of Indiana GIS through dissemination of data and data products, education and outreach, adoption of standards, and building partnerships Simplifying.
The National Hydrologic Dataset Brian Brodeur GIS Program Director Mass DEP
Indiana 2011 – 2013 Statewide Local-Resolution National Hydrography Dataset (NHD) Project MINI – WORKSHOP Thanks to… Susan Phelps, AECOM ; Jeff Simley,
National Hydrography Data Use and Applications.
From a 1954 edition of Popular Mechanics - a predicted home computer of 2004.
U.S. Department of the Interior U.S. Geological Survey USGS National Hydrography Dataset Stewardship in West Virginia George Heleine USGS NHD POC Region.
Sub-Committee on Spatial Water Data 2005 Progress and 2006 Proposed Activities.
U.S. Department of the Interior U.S. Geological Survey NWIS Web Services Snapshot for ArcGIS Sally Holl and David Maltby Based on work by David McCulloch.
NHD Watershed: Tools and Applications
U.S. Department of the Interior U.S. Geological Survey Geographic Names In the United States Geographic Names In the United States The National Map & Other.
The NHD and the Future of Stream Mapping in West Virginia Jackie Strager Natural Resource Analysis Center Evan Fedorko Kevin Kuhn Kurt.
Managing Data Interoperability with FME Tony Kent Applications Engineer IMGS.
Developing Health Geographic Information Systems (HGIS) for Khorasan Province in Iran (Technical Report) S.H. Sanaei-Nejad, (MSc, PhD) Ferdowsi University.
The NHD and the Future of Stream Mapping in West Virginia Evan Fedorko West Virginia GIS Technical Center Jackie Strager Natural Resource.
GIS Tools for Watershed Delineation Public Policy Perspectives Teaching Public Policy in the Earth Sciences April 21, 2006 Gary Coutu Department of Geography.
U.S. Department of the Interior U.S. Geological Survey DEM Preparation Using the New England Method Streamstats Data Preparation Workshop Pete Steeves.
New Documents for the National Hydrography Dataset.
National Hydrography Dataset U.S. Department of the Interior U.S. Geological Survey Bill Smith NHD Maintenance Training.
Coordination of Indiana GIS through dissemination of data and data products, education and outreach, adoption of standards, and building partnerships Using.
State of New Jersey NHD / WBD Stewardship Conference NJ State Steward Report By: Craig Coutros, NJDEPApril 15, 2009.
Flow Time Time Series Hydro FeaturesHydro Network Channel System Drainage System ArcGIS Hydro Data Model.
Project Cooperators: Mark Olsen, MPCA Susanne Maeder, LMIC Tommy Dewald, USEPA/OW Building a Repository to Share Hydrologic Event Data Creating the Minnesota.
Indiana National Hydrography Dataset (NHD) Improvement and Application Workshop NHD Local-Resolution Development.
February, CONTEXT  CONSTITUTIONAL AMENDMENTS  Creation of the Statistical and Geographical Information System (SNIEG)  INEGI’s Autonomy (July.
Introduction to the National Hydrography Dataset InterMountain GIS 2014 NHD Workshop April 7, 2014 Many slides and figures in this presentation were adapted.
User Guide for NHD Maintenance/Revision Status Tracking U.S. Department of the Interior U.S. Geological Survey.
David Nail USGS Geospatial Liaison to Indiana March 13 th, 2007 Update on National Hydrography Data.
U.S. Department of the Interior U.S. Geological Survey USGS Geospatial Liaisons - Supporting NHD Stewardship NHD Workshop April 14, 2009.
Slide 1 National Hydrography Dataset Stewardship Conference April 24, 2007 By Cindy Clark Automated Geographic Reference Center April 24, 2007 Utah Hydrography.
U.S. Department of the Interior U.S. Geological Survey GNIS/ Vector Integration: Jerry Ornelas (NGTOC –Denver) NHD Stewardship Conference April 13-17,
The NHD and the Future of Stream Mapping in West Virginia Evan Fedorko West Virginia GIS Technical Center Jackie Strager (NRAC)
SSWD Advisory Committee on Water Information Status report: Subcommittee on Spatial Water Data Herndon, VA September 15, 2004.
Data Staging Data Loading and Cleaning Marakas pg. 25 BCIS 4660 Spring 2012.
1 Dwight Hughes Geographic Names Project U.S. Geological Survey U.S. Department of the Interior West Virginia Partnerships and the Geographic Names Information.
Meet Weekly or bi-monthly to discuss all aspects of Stewardship: Dave BrowerDan Wickwire Natural Resources Conservation Service Bureau of Land Management.
XML Extract Paul Kimsey - 3/20/2006 Modified - 4 August 2009.
U.S. Department of the Interior U.S. Geological Survey U.S. Department of the Interior U.S. Geological Survey Conflation Lessons In Iowa Using the NHDGeoConflationTool.
Project Folders Setup. Creating the Directory Structure for NHD Maintenance This Powerpoint will describe the ‘suggested’ method of creating a directory.
Evaluating the National Hydrography Dataset and Stewardship Options for Missouri.
U.S. Department of the Interior U.S. Geological Survey Processing ArcHydro Datasets with NHDPlus Version 2, Emphasizing StreamStats Data Development Webinar.
Oregon CUSP-NHD Integration Randy Dana Oregon Coastal Management Program FIT Funding Presentation April 29th, 2015, Portland, OR Proposal to Oregon Geographic.
Indiana NHD - Geographic Names Information System Updates March 1, 2011 Lacey Duncan Environmental Manager - DNR Water.
NHD Stewardship in Minnesota NHD Stewardship Conference Denver, Colorado April 24, 2007.
WBAreaComID Queries. By first converting the NHDFlowline feature class to a point feature class and then joining the flowline point feature class with.
Spatial Water Data Subcommitte Update to the FGDC CAG
U.S. Department of the Interior U.S. Geological Survey Horizontal Datum Shifts in NHD History and Action Plans in Place.
1 Center for Research in Water Resources The University of Texas at Austin Water Management Information System for the Rio Grande/Rio Bravo Basin Carlos.
Stewardship of the National Hydrography Dataset (NHD) 2010 West Virginia GIS Conference Huntington, West Virginia – June 9, 2010 Dave Arnold NHD Partner.
Indiana National Hydrography Dataset Improvement and Application Workshop Indiana State GIS Conference March 1, 2011.
U.S. Department of the Interior U.S. Geological Survey National Geospatial Technical Operations Center Carl Nelson 4/14/2009 Maintenance I and Maintenance.
WBAreaComID Queries Paul Kimsey 3/18/2007. Open Arc Toolbox.
Data Stewardship and Maintenance for the National Hydrography Dataset USGS/INEGI Cross-Border Integration Project Cross-Border Integration Project U.S.
Iowa Rivers Information System Inventory, Modeling, and Evaluation of Basin, In-Stream Habitat, and Fishery Resource Relationships Kevin Kane, Iowa State.
NHD/WBD Geodatabase Stewardship Conference April 16, 2009 Jeff Simley, USGS Karen Hanson, USGS Stephen Daw, USGS.
The Future of NHDPlus 2009 NHD Stewardship Conference Denver, CO April 14-17, NHD Stewardship Conference Denver, CO April 14-17, 2009 Tommy Dewald.
Locate Artificial Paths Outside Area / WB & StreamRivers Inside Area / WB.
U.S. Department of the Interior U.S. Geological Survey Stewardship of the National Hydrography Dataset Elizabeth McCartney National Geospatial Technical.
Indiana GIS Local Resolution NHD Applications for Surveyors ISPLS State Conference January 18, 2013 (12:45 pm – 3:30 pm)
Core elements of GIS Guidance and practical steps toward harmonisation By Albrecht Wirthmann, GISCO, Eurostat 2 nd.
U.S. Department of the Interior U.S. Geological Survey Populate Water Body/Area Com ID Tool National Hydrography Dataset By Elizabeth McCartney Reviewed.
XML2PersonalGDB. The XML2PGDB utility loads and validates transactions from an XML document into a copy of the original extract data. The updates can.
Bdsfbdsfb NHDPlus for Corpus Christi Bay Term Project Report Nishesh Mehta Nishesh Mehta 21 st November st November 2006.
Data Stewardship and Maintenance for the National Hydrography Dataset Gladys Conaway USGS National Geospatial Technical Operations Center III.
Hydrography for The Lower Rio Grande Valley A Comparison of Mapped versus Synthetic Streams By Jean Parcher GIS in Water Resources December 4, 2001.
Local Resolution NHD Photo-Based Revision for West Virginia
IGIC Waters Workgroup Update
Presentation transcript:

Data Stewardship and Maintenance for the National Hydrography Dataset USGS/INEGI Cross-Border Integration Project Cross-Border Integration Project U.S. Department of the Interior U.S. Geological Survey

Binational Watersheds The first prioirty is to complete the integration of watersheds between the U.S. and Mexico at the sub-basin level (US) and basin level (Mexico) to obtain the binational framework for the hydrographic network. At the second level of priority is the completion of the watersheds at the sub-watershed level or micro-cuencas for all the sub-basins that cross the international border. On the part of the USGS, the watershed boundaries at the sub- watershed level are at their final stage of review, Karen Hanson, the coordinator for the USGS, is in agreement to modify the boundaries to harmonize them with the Mexican side. To delineate the watershed boundaries at the sub-watershed level for the Mexican side of the border, the team will include members from INEGI (under the coordination of Victor Romero), the USGS (under the coordination of Karen Hanson) and the Texas Natural Resource Information System (Miguel Pavon).

Hydrography Network The INEGI team, under the coordination of Ruben Carrasco will prioritize to complete the phase II of the hydrography network for the networks in the border region, beginning in the west (Tijuana-San Diego) working towards the east (Matamoros-Brownsville). At the completion of phase II for each network file, these files will be made available on the ftp site for USGS Access. Each country will take the responsibility to adjust their water flow lines to the international border. In the case where an hydrological feature exists on one side of the border, but does not exist on the other side of the border, it should be taken into consideration that INEGI’s information is more current that the USGS information. Therefore, the USGS will take the responsibility to adjust their features to harmonize them with those of INEGI. The National Hydrography Dataset (NHD), under the coordination of Paul Kimsey of the USGS, will develop a crosswalk table to record the changes to the hydrography network during any update activities. This crosswalk table will include the unique code for each river segment or the reach code for the NHD.

Communication and Schedule: Project Communication – The two teams agreed that it is critical to have monthly conference calls to discuss progress and integration issues. Jean Parcher will arrange for the calls.

Final Products Every country will archive their hydrography network for the entire watershed at the sub-basin level in their appropriate database. Every country will archive their watersheds at the sub-watershed level in their appropriate database. By means of the crosswalk table, the revision of the hydrography networks will be recorded. The names of the binational watersheds will include the official names of each country. Final Comments The INEGI authorities appreciate the USGS visit, especially the emphasis towards exchanging opinions and experiences with these Binational projects. To reach the goals and objectives of this working meeting exceeded 30% more than was expected. It is of great importance to define what the needed resources for the project are and request those from INEGI. The opinion of the USGS concerning the technical issues of the project is requested.

Software Requirements The NHD toolsets are composed of a variety of editing and analysis tools that were developed in a variety of programming languages and environments by members of the NHD community. INSTALLATION OF SUPPORTING SOFTWARE, SOFTWARE COMPONENTS, AND PROGRAMMING LANGUAGE. For the NHD toolsets to function properly, a distinct set of supporting software must be installed--AND INSTALLED IN A DISTINCT ORDER. ADMINISTRATOR PRIVILEGES are required to perform the installation. The operating system must be Microsoft Windows XP. Documentation regarding the use of the tools is available for download from the NHD Stewardship website. Note: FME suite must also be installed to run ETL tools

Coordinating with Internal Projects and External Partners

State Partners that have Draft/Signed Stewardship Agreements must be coordinated with throughout the process.

The NHD Stewardship web site – Maintenance/Revision status page shows the status of subbasins that are currently checked out by NGTOC or external partners. Coordination will be required throughout the project to ensure that overlapping updates do not occur.

General Process Steps: ■Use FME-ETL tool to translate Bi-national waterbodies attribution to NHD ■Project Bi-national Waterbodies to AlbersEqArea ■Populate Metadata record ■Using NHD Geo Edit tool- Allocate Reach Codes for NHDWaterbody subtype LakePond ■Load Bi-national WaterBodies (MX side) to database Note: Bi-national waterbodies does not include Rio Grande River ■Load Rio Grande updates to database ■Check Out/Extract NHD Subbasins ■Check INEGI Hydro Network shapefiles for edge allignment with NHD data – updates required on MX side will be communicated with INEGI ■Receive updated (edge alligned) files from INEGI ■Edge allign NHD with INEGI data/ Add NHD content to match INEGI data ■ QC data – see NHD Maintenance.doc for details ■Load Updates to database ■Convert INEGI Hydro Network data to NHD using ETL ■Populate Metadata record – include URL to INEGI Process document ■NHDProcessingParameters table – set version to ‘newload’ ■Allocate Reach Codes ■Load Hydro Network updates (MX side) to database ■Extract Subbasins ■Using NHD TOOLS TOOLBOX, populate wbareacomid – Assign WaterBodyArea_ComID’s to Bi-national Waterbodies (ALL) ■Final QC - see NHD Maintenance.doc for details ■Load updates if necessary

Harmonized Cross-Border Subbasins

Project consists of 28 “Harmonized” Subbasins Available for download from NRCS Data Gateway (by State) Or T:\NationalGeospatialTechnicalOperationsCenter\VectorPrograms\Hydrography\ NHDMaintenance\WBD

INEGI will retain original hydrologic units for packaging hydro network Sub Cuencas. New harmonized Watershed Boundaries (WBD) may contain one or more Sub Cuencas to populate NHD Subbasin extent.

116 Sub Cuencas will be used to populate 28 cross-border NHD Subbasins

Integration of Binational Waterbodies to Populate Mexico Portion of Cross-Border Subbasins

The USGS U.S.-Mexico Border Environmental Health project was responsible for creating the Binational Waterbodies dataset. USGS will retain existing NHDArea and NHDWaterbody Features on the US side. INEGI has agreed that USGS will use Binational Waterbodies dataset on the MX side and that INEGI will update these features on the MX side in the future as resources allow.

Binational Waterbodies with features on US side removed Remaining features on MX side- 71 – Area features 24,511 Waterbody features

Process Steps: ■ Use FME-ETL tool to translate Binational Waterbodies attribution to NHD ■ Project Binational Waterbodies to AlbersEqArea ■ Populate Metadata record ■ Using NHD Geo Edit tool- Allocate Reach Codes for NHDWaterbody subtype LakePond ■ Load Binational WaterBodies (MX side) to database Note: Binational Waterbodies does not include Rio Grande River

FME tool for converting Binational Waterbodies (MX side). The entire border area (28 subbasins) will be loaded in one update. Note that there is a field to identify the ‘Count Start’. This will ensure that the ComID field will be populated with Unique ID’s which will allow for a crosswalk to permanent ComID’s in the database and will also allow for a crosswalk of ComID’s to Permanent ID’s (GUID) when the NHD model is migrated to the Common Vector Model Create XML Document(s) Load to database

Rio Grande River Revision

Rio Grande Revision--Combination of 2005, 2008 NAIP will be used for source imagery Sub Regions 1304, 1308, 1309 GNIS Name – ‘Grande, Rio’ will be changed to ‘Rio Grande’ Create XML Document(s) Load to database

Integrating INEGI Hydrographic Network with USGS National Hydrography Dataset Proof of Concept - Pilot NHD Subbasin INEGI Sub Cuenca RH09Bg

NHD Subbasin INEGI Sub Cuenca RH09Bg

NHD Subbasin INEGI Sub Cuenca RH09Bg

Process Steps: ■ Check Out/Extract NHD Subbasins ■ Check INEGI Hydro Network shapefiles for edge allignment with NHD data – updates required will be communicated with INEGI ■ Receive updated (edge alligned) files from INEGI ■ Edge allign NHD with INEGI data/ Add NHD content to match INEGI data ■ QC data – see NHD Maintenance.doc for details ■ Load Updates to database

Check out subbasin from NHD Stewardship web site Extract personal geodatabase

Edge Matching

Attribute allignment where feature exists in both datasets Perennial Intermittent

Edge Matching Spatial allignment where feature exists in both datasets

Edge Matching Content additions – USGS, National Hydrography Dataset Evidence of matching stream on US side

Edge Matching Content additions – INEGI Hydro Network evidence of matching stream on MX side INEGI will add stream

Edge Matching Content modifications – INEGI Hydro Network

Quality Control: USGS has implemented a thorough QC process that has been used to check all In-House, Partner, and Contract updates. This process will be used to check the updated NHD data. For detailed information see NHD Maintenance document Create XML Document(s) Load to database

Transforming INEGI Hydrographic Network into USGS National Hydrography Dataset Proof of Concept - Pilot NHD Subbasin INEGI Sub Cuenca RH09Bg

Process Steps: ■ Convert INEGI Hydro Network data to NHD using ETL ■ Populate Metadata record – include URL to INEGI Process document ■ NHDProcessingParameters table – set version to ‘newload’ ■ Allocate Reach Codes ■ Load Hydro Network updates (MX side) to database

FME tool for converting INEGI Hydro network (MX side). Note that there is a field to identify the ‘Count Start’. This will ensure that the ComID field will be populated with Unique ID’s which will allow for a crosswalk to permanent ComID’s in the database and will also allow for a crosswalk of ComID’s to Permanent ID’s (GUID) when the NHD model is migrated to the Common Vector Model

Note: Common Identifier (ComID) in current model will be retained as secondary identifier. Globally Unique Identifier (GUID) in NHD BP model will become the Permanent Identifier Crosswalking fields from INEGI Hydro network to NHDFlowline

Populate NHD Metadata – including URL to English version of INEGI process document Populate NHDProcessingParameters Version - Parameter Value = “new load”

Allocate reach Codes Create XML Document(s) Load to database

Final QC of NHD Cross-Border Subbasins

Process Steps: ■ Check Out and Extract Subbasin ■ Using NHD TOOLS TOOLBOX, populate wbareacomid – Assign WaterBodyArea_ComID’s to Binational Waterbodies (ALL) ■ Final QC - see NHD Maintenance.doc for details ■ Load updates if necessary

Check out subbasin from NHD Stewardship web site Extract personal geodatabase Note: The entire subbasin will be available for checkout at this point in the process

Populate WaterBodyAreaComID’s -Populate all values -Check all existing values and correct where necessary

Quality Control: USGS has implemented a thorough QC process that has been used to check all In-House, Partner, and Contract updates. This process will be used to check the updated NHD data. For detailed information see NHD Maintenance document Create XML Document(s) Load updates to database (if necessary)

Data maintenance and dissemination- INEGI will have access to NHD updates through data extracts National Map Viewer – URL TBD USGS will establish Area of Interest (AOI) for INEGI who will be notified by when updates occur within cross-border subbasins on the US side of the border. INEGI will make the Hydro Network available to USGS through and will notify USGS whenhttp://antares.inegi.org.mx/analisis/red_hydro updates occur within cross-border subbasins on the MX side of the border.