Flow Modeling on Massive Grids Laura Toma, Rajiv Wickremesinghe with Lars Arge, Jeff Chase, Jeff Vitter Pat Halpin, Dean Urban in collaboration with.

Slides:



Advertisements
Similar presentations
Watersheds and Stream Order
Advertisements

Lars Arge 1/43 Big Terrain Data Analysis Algorithms in the Field Workshop SoCG June 19, 2012 Lars Arge.
Lars Arge 1/13 Efficient Handling of Massive (Terrain) Datasets Lars Arge A A R H U S U N I V E R S I T E T Department of Computer Science.
An open source version of the Nonpoint-Source Pollution and Erosion Comparison Tool Climate Tools Café Webinar Dave Eslinger, Ph.D. 3 May, 2012.
Fort Bragg Cantonment Area Background The USGS is working with the U.S. Army at Fort Bragg to develop a Storm Water Pollution Prevention Plan (SWP3). The.
CEE 795 Water Resources Modeling and GIS Learning Objectives: Perform raster based network delineation from digital elevation models Perform raster based.
Modeling & Analyzing Massive Terrain Data Sets (STREAM Project) Pankaj K. Agarwal Workshop on Algorithms for Modern Massive Data Sets.
Exploring Earth’s Surface Chapter 1 Section 4. Standard  6.2 Topography is reshaped by the weathering of rock and soil and by the transportation and.
I/O-Algorithms Lars Arge January 31, Lars Arge I/O-algorithms 2 Random Access Machine Model Standard theoretical model of computation: –Infinite.
Terrain Datasets: How good are they? Celso Ferreira¹, Francisco Olivera¹, Dean Djokic² ¹Texas A & M University ² Environmental Systems Research Institute.
Celso Ferreira¹, Francisco Olivera², Dean Djokic³ ¹ PH.D. Student, Civil Engineering, Texas A&M University ( ² Associate.
From Topographic Maps to Digital Elevation Models Daniel Sheehan DUE Office of Educational Innovation & Technology Anne Graham MIT Libraries.
A GIS-Enabled Kinematic Wave Approach for Calculating the Transition between Sheet and Concentrated Flows Stacy L. Hutchinson 1, J.M. Shawn Hutchinson.
Forest Hydrology Issue: Interaction of forests, fish, and climate One of the dominant pathways by which land cover change affects freshwater fish habitat.
I/O-Algorithms Lars Arge Spring 2009 January 27, 2009.
I/O-Algorithms Lars Arge Spring 2007 January 30, 2007.
I/O-Algorithms Lars Arge Aarhus University February 16, 2006.
Hydrologic Analysis Francisco Olivera, Ph.D., P.E. Srikanth Koka
I/O-Algorithms Lars Arge Spring 2006 February 2, 2006.
By Jennifer VerWest. Differences between Flat and Average/Steep Terrain Flat Terrain Steep/Average Terrain.
DEM-Based Stream and Watershed Delineation
Flow Computation on Massive Grid Terrains
Lars Arge 1/14 A A R H U S U N I V E R S I T E T Department of Computer Science Efficient Handling of Massive (Terrain) Datasets Professor Lars Arge University.
Concept Course on Spatial Dr. A.K.M. Saiful Islam Application of GIS in Watershed Analysis Dr. A.K.M. Saiful Islam Institute of Water and Flood.
Efficient Algorithms for Large-Scale GIS Applications Laura Toma Duke University.
CS 350 Algorithms for GIS. What is GIS? Definitions  A powerful set of tools for collecting, storing, retrieving at will, transforming and displaying.
Massive Data Algorithmics Faglig Dag, January 17, 2008 Gerth Stølting Brodal University of Aarhus Department of Computer Science.
Flow modeling on grid terrains. Why GIS?  How it all started.. Duke Environmental researchers: computing flow accumulation for Appalachian Mountains.
Some Potential Terrain Analysis Tools for ArcGIS David G. Tarboton
From Elevation Data to Watershed Hierarchies Pankaj K. Agarwal Duke University Supported by ARO W911NF
Flow modeling on grid terrains. DEM Representations TIN Grid Contour lines Sample points.
I/O-Algorithms Lars Arge Spring 2008 January 31, 2008.
Remote Sensing and GIS in Water Dr. A.K.M. Saiful Islam Hands on training on surface hydrologic analysis using GIS Dr. A.K.M. Saiful Islam.
From Topographic Maps to Digital Elevation Models Daniel Sheehan IS&T Academic Computing Anne Graham MIT Libraries.
Why calculate slope and Aspect? Study the flow of water Identify the habitats of plants Identify potential sites for urban growth Drainage patterns on.
TerraStream: From Elevation Data to Watershed Hierarchies Thursday, 08 November 2007 Andrew Danner (Swarthmore), T. Moelhave (Aarhus), K. Yi (HKUST), P.
TerraFlow Flow Computation on Massive Grid Terrains Helena Mitasova Dept. of Marine, Earth & Atmospheric Sciences, NCSU, USA
FNR 402 – Forest Watershed Management
I/O-Algorithms Lars Arge Fall 2014 August 28, 2014.
DEM’s, Watershed and Stream Network Delineation DEM Data Sources Study Area in West Austin with a USGS 30m DEM from a 1:24,000 scale map Eight direction.
Geo-referenced Information Processing System. ISPRS Geoprocessing Technologies to collect and treat spatial information for a specific goal. Geoprocessing.
1 GIS in Hydrology Watershed management Definitions Algorithms Watershed delineation Automatically delineating watersheds Flow length Raster to vector.
Topographic Maps vs DEM. Topographic Map 1:24,000 Scale 20 ft contour 100 ft contour Stream Center Line.
Application of GIS and Terrain Analysis to Watershed Model Calibration for the CHIA Project Sam Lamont Robert Eli Jerald Fletcher.
Steps: 1. Pre-processing Fill depressions Flow direction Flow accumulations 2. Stream definition (fig. a) Number of cells – 150 Areas – Km 2 2.
Terracost: Hazel, Toma, Vahrenhold, Wickremesinghe Terracost: A Versatile and Scalable Approach to Computing Least-Cost-Path Surfaces for Massive Grid-Based.
Two modes: (1) stop and measure (SAM); (2) drive and measure (DAM). Can do: (1) 1-D transects. (2) 2-D maps. Mobile sensing of surface moisture: COSMOS.
Processing Elevation Data. Limitations of DEMs for hydro work Dates Static, does not evolve Matching to linear line work due to scale Processing errors.
L7 - Raster Algorithms L7 – Raster Algorithms NGEN06(TEK230) – Algorithms in Geographical Information Systems.
Stream and Watershed Delineation from DEM’s David Maidment, Ph.D. and Francisco Olivera, Ph.D. Center for Research in Water Resources University of Texas.
Efficient Algorithms for Large-Scale GIS Applications Laura Toma Duke University.
Introduction to GIS. What is GIS? Geographic Information System Geographic implies of or pertaining to the surface of the earth Information implies knowledge.
11.1 The Active River. Do you think a river can have a source? Describe where you would expect to find a river’s source. The source of a river is where.
General Introduction. Developed by USGS Freely available via Internet
Watershed Parameters for Water Rights in the Trinity River Basin Melissa Figurski CE 394K.
Water Availability Modeling in the State of Texas CE 394 K.2 - Surface Water Hydrology University of Texas at Austin David Mason.
TerraSTREAM: Terrain Processing Pipeline MADALGO – Center for Massive Data Algorithmics, a Center of the Danish National Research Foundation What TerraSTREAM.
Definition In scientific literature there is no universal agreement about the usage of the terms: digital elevation model (DEM) digital terrain model (DTM)
Digital Terrain Analysis for Massive Grids
CS 350 Algorithms for GIS.
Freshwater Aquatic Science 2012.
Digital Elevation Models and Hydrology
Global Hydrologic Data Development
GIS FOR HYDROLOGIC DATA DEVELOPMENT FOR DESIGN OF HIGHWAY DRAINAGE FACILITIES by Francisco Olivera and David Maidment Center for Research in Water Resources.
Advanced Topics in Data Management
May 18, 2016 Spring 2016 Institute of Space Technology
The Flow of Freshwater.
Environmental Modelling with RASTER DEMs: Hydrologic Features
Presentation transcript:

Flow Modeling on Massive Grids Laura Toma, Rajiv Wickremesinghe with Lars Arge, Jeff Chase, Jeff Vitter Pat Halpin, Dean Urban in collaboration with

Applications n Automatic estimation of terrain parameters u watersheds u drainage networks u topographic index n Surface saturation n Soil water content n Erosion, Deposition n Forest structure n Species diversity n Sediment transport

Modeling Flow n Terrain modeled by grid of elevations n Flow direction u direction water would flow from each cell u what does it mean on flat areas?

Massive Data n Remote sensing data available today u NASA-SRTM (whole Earth: 5TB) u USGS (entire US at 10m resolution) n Typical grid u East coast USA u 11,000 x 25,000 grid u 0.5 GB

Scalability n Current GIS software minimizes CPU time n I/O is bottleneck n Total time does not scale n ArcInfo u more than 3 days on East coast USA grid n TARDEM u 2 days on 1/4 East coast USA grid

Theoretical Results n I/O Model u disk much slower than CPU u count number of I/O operations (rather than CPU time) n I/O Efficient Algorithms u identifying flat areas u assigning flow directions on plateaus u identifying watersheds u filling depressions/sinks u assigning flow directions on terrains u flow accumulation

Speedup over ArcInfo ArcInfo runs with 750MB RAM; Our program runs with 512MB or 128MB RAM memory limit