Automating parflow preprocessing steps for DEMs

Slides:



Advertisements
Similar presentations
Geoprocessing with GDAL and Numpy in Python Delong Zhao
Advertisements

Why python? Automate processes Batch programming Faster Open source Easy recognition of errors Good for data management What is python? Scripting programming.
Standard watershed and stream delineation recipe - Vector stream (ex. NHD data) fusion into DEM raster (burning in) - Sink removal - Flow direction - Flow.
The Collections Keeper A collections management system Brian J. Mullen.
Terrain Datasets: How good are they? Celso Ferreira¹, Francisco Olivera¹, Dean Djokic² ¹Texas A & M University ² Environmental Systems Research Institute.
CURVE NO. DEVELOPMENT STEP 8 Soils data, land use data, watershed data, and CN lookup table are used to develop curve numbers for use in the SCS Curve.
Introduction to EMF Server Communication and Cases Beta Testing November 4, 2009.
Josh Peschel Master of Science Candidate
Mark Finney, Fire Sciences Lab, Missoula, MT.
ESRM 250 & CFR 520: Introduction to GIS © Phil Hurvitz, KEEP THIS TEXT BOX this slide includes some ESRI fonts. when you save this presentation,
Kurt Menke, GISP GRASS GIS Geographic Resources Analysis Support System.
SWAT – Land Phase of the Hydrologic Cycle Kristina Schneider Kristi Shaw.
Advance Model Builder Features. Advance Features Using Lists (also Batching) Iteration Feedback Model Only Tools Inline Variable Substitution Preconditions.
First Screen : First window form will always remain open, for the user to select menu options. 1.
U.S. Department of the Interior U.S. Geological Survey Analysis of Resolution and Resampling on GIS Data Values E. Lynn Usery U.S. Geological Survey University.
Formetta et al., CAHMDA IV Lhasa July GEOtop/OMS3 - Model Integration and Case Study. Formetta G. et al., University of Trento (Italy) OR:
Internet and Distributed Representation of Agent Based Model by- Manish Sharma.
A Simple Drainage Enforcement Procedure for Estimating Catchment Area Using DEM Data David Nagel, John M. Buffington, and Charles Luce U.S. Forest Service,
Digital Elevation Model Based Watershed and Stream Network Delineation Understanding How to use Reading
CFR 250/590 Introduction to GIS, Autumn 1999 Data Conversion & Export © Phil Hurvitz, data_export.ppt 1 Overview Why export? Converting feature.
Sensor Placement Application and Snowpack Distribution Model from LiDAR Data Zeshi Zheng Graduate Students Systems Engineering UC Berkeley.
Expanding the Functionality of ArcGIS Through Tool Building
Onion creek catchment modeling using PIHM By, Harish Sangireddy PhD Candidate The University of Texas at Austin.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
ENG College of Engineering Engineering Education Innovation Center 1 Array Accessing and Strings in MATLAB Topics Covered: 1.Array addressing. 2.
MapWindow Plug-in of GRM Model Using Open Source Software It was possible to implement all the functions necessary to develop GRM modeling system and pre.
1 Overview Importing data from generic raster files Creating surfaces from point samples Mapping contours Calculating summary attributes for polygon features.
UW-GIS list-serve
Introduction to GIS. What is GIS? Geographic Information System Geographic implies of or pertaining to the surface of the earth Information implies knowledge.
Introduction to Matlab  Matlab is a software package for technical computation.  Matlab allows you to solve many numerical problems including - arrays.
July 10, 2007 NASA quarterly briefing Geoprocessing using GEOLEM and HSPF in the RPC Framework Vladimir Alarcon Chuck O’Hara.
 DEM from USGS ◦ Digitized version of 1:24,000 topo quadrangle ◦ Vertical accuracy  5m, 30m resolution  KML files, digitized from Google Earth.
Preparing input for the TOPKAPI (TOPographic Kinematic Approximation and Integration) model PRASANNA DAHAL.
David Tarboton Digital Elevation Models, Flood Inundation Mapping and River Hydraulic Properties David Tarboton
U.S. Department of the Interior U.S. Geological Survey Automatic Generation of Parameter Inputs and Visualization of Model Outputs for AGNPS using GIS.
Water Quality Master Planning A Barton Creek Model Katherine G. Osborne CE 394K.2 Surface Water Hydrology.
Waller Creek Sub-basin HMS Review Original project idea scrapped Difficult to find adequate GIS data No measured flow data to validate model results.
Mapping of soil moisture content by SWAT and GIS programming GEOG 593.
Mapping of soil moisture content by SWAT and GIS programming Yuri Kim Jessica Jahnke GEOG 593.
PYTHON FUNCTIONS. What you should already know Example: f(x) = 2 * x f(3) = 6 f(3)  using f() 3 is the x input parameter 6 is the output of f(3)
Intelligent Data Systems Lab. Department of Computer Science & Engineering Python Installation guide 컴퓨터의 개념 및 실습.
Tips. Iteration On a list: o group = ["Paul","Duncan","Jessica"] for person in group: print(group) On a dictionary: o stock = {'eggs':15, 'milk':3, 'sugar':28}
Extending ArcGIS using programming
Extending ArcGIS via programming
Hydrologic Terrain Processing Using Parallel Computing
Raster/Map Algebra/Hydrology
Computer Modeling/GIS Linkages
Extending ArcGIS using programming
STREAM NETWORK DELINEATION USING ARC HYDRO AND TauDEM: A comparison of approaches using The Upper Sevier and the Little Bear River Basins Alphonce C. Guzha.
Terrain Analysis for Water Quality Modeling
Lecture 22: Using ArcToolbox Tools in Python
GISWR 2014 Computation Skills
Functions (subprograms)
Automation of Input data preparation of TOPNET model using Python
Digital Elevation Model Based Watershed and Stream Network Delineation
AUTOMATED SESSION PLANNING. In the present world, everything has become automated. By, a click everything is being processed. But the preparation of the.
Marine and Coastal Biodiversity Management in Pacific Island Countries
Digital Elevation Model Based Watershed and Stream Network Delineation
Review- vector analyses
Terrain Analysis Using Digital Elevation Models (TauDEM)
TOPMODEL and the role of topography and variable contributing areas in runoff production Learning objectives Be able to describe the topographic wetness.
Raster-based spatial analyses
May 18, 2016 Spring 2016 Institute of Space Technology
Elaine B. Darby GIS – Fall 2005
Raster Data Analysis.
Using Script Files and Managing Data
Kevin Cole Faculty Advisor: Dr. Ivaylo Nedyalkov Objective
Extending ArcGIS using programming
Clip & Convert to ASCII Program Kelly Knapp Spring 2010
Presentation transcript:

Automating parflow preprocessing steps for DEMs John A Koudelka

Topics Background Methods Results Conclusions Photo: John A Koudelka

Background ParFlow Is an integrated watershed model that simulates surface and subsurface flow. Data Processing Soil Moisture – Little Washita Watershed. https://computation.llnl.gov/casc/parflow/simulations.html

Methods Manual Processing Steps Automation Python (Windows) 1. Raster to ASCII 2. ASCII – No Header 3. Dataset Metrics (cell size, # rows, # columns, No Data value, x and y origin) 4. ParFlow Fortran files - Remove Pits - Create Slope Files - Generate Solid File Automation Remove pits Create Slope Files Generate Solid File Python (Windows) Python (OS X)

Methods Manual ASCII No Header ASCII No Pits ARC/INFO GRID ASCII Datasets ASCII No Header ASCII No Pits ARC/INFO GRID ASCII Cell Size # Rows # Cols X origin Y origin ND Value Variables Raster To ASCII Remove Pits Create Slopes CreateSolid File Functions Remove Header X Slopes Y Slopes Solid File ParFlow Input

Methods Automated Raster To ASCII ASCII ARC/INFO GRID 1. X Slopes Y Slopes Solid File ParFlow Input Remove Pits Create Slopes CreateSolid File Cell Size # Rows # Cols X origin Y origin ND Value Remove Header ASCII No Pits ASCII No Header ASCII 2.

Methods Challenges GDAL User Distribution Logos From: Python – http://python.org/ GADL - http://www.gdal.org/ NumPy - http://numpy.scipy.org/

Results Processing Steps: Python Script 1 Python Script 2 import os #import numpy import subprocess   ## ****** GRAB DEM PARAMS ***** ## #export raster to ascii path="/Users/johnkoudelka/ParF/Data/LittleBear/preprocess" os.chdir(path) fileName='dem.txt' outFileName='pf_dem.txt' asciiFile=open("dem.txt") rLine=asciiFile.readline().strip().split(" ") ncols=rLine[9] nrows=rLine[9] xllcorner=rLine[5] yllcorner=rLine[5] cellSize=rLine[6] NDval=rLine[2] #create the modified ascii DEM pf_ascii=open(outFileName,'w') i=0 #write it while (i<int(nrows)): rLine=asciiFile.readline() pf_ascii.write(rLine +'\n’) i=i+1 Processing Steps: Python Script 1 Raster to ASCII conversion Python Script 2 Set header information to variables Write DEM without header information Execute modified Fortran codes Script 2 – Code Snieppet

Conclusions Automation Future work Fortran & Python Computing Platform GDAL Photo: John A Koudelka

The End Questions?