Differential Leveling Conversion and Analysis Toolset Lisa Berry University of Redlands, MS GIS Program.

Slides:



Advertisements
Similar presentations
GIS for Aviation: Case for eTOD Management
Advertisements

Databases. A database program can be used to:  sort a file into a different order  Maintain contact with clients  search through the records for a.
Intro to Python Welcome to the Wonderful world of GIS programing!
Key-word Driven Automation Framework Shiva Kumar Soumya Dalvi May 25, 2007.
Why python? Automate processes Batch programming Faster Open source Easy recognition of errors Good for data management What is python? Scripting programming.
Use of GIS Systems in Official Statistics. Overview of Presentation  Overview of GIS systems  Current use within the ABS  Potential future applications.
Esri UC 2014 | Technical Workshop | Automating Cache Workflows and Tile Usage Heat Maps Eric J. Rodenberg.
GI Systems and Science January 30, Points to Cover  Recap of what we covered so far  A concept of database Database Management System (DBMS) 
A GIS Approach to Pedestrian Level of Service Natalia Domarad 14th TRB Transportation Planning Applications Conference Columbus, Ohio May 5-9, 2013.
Taking Core Products a Step Further USG Software and Customized Applications.
Geodatabase basic. The geodatabase The geodatabase is a collection of geographic datasets of various types used in ArcGIS and managed in either a file.
NR 322: Editing Spatial Data Jim Graham Fall 2008 Chapter 6.
Geographic Information Systems
19 th Advanced Summer School in Regional Science An introduction to GIS using ArcGIS.
Data Acquisition Lecture 8. Data Sources  Data Transfer  Getting data from the internet and importing  Data Collection  One of the most expensive.
Kurt Menke, GISP GRASS GIS Geographic Resources Analysis Support System.
Rebecca Boger Earth and Environmental Sciences Brooklyn College.
Introduction to the course January 9, Points to Cover  What is GIS?  GIS and Geographic Information Science  Components of GIS Spatial data.
Database Design IST 7-10 Presented by Miss Egan and Miss Richards.
NSF DUE ; Laura Johnson Cherie Aukland.
Intro. To GIS Lecture 4 Data: data storage, creation & editing
Advance Model Builder Features. Advance Features Using Lists (also Batching) Iteration Feedback Model Only Tools Inline Variable Substitution Preconditions.
Managing Data Interoperability with FME Tony Kent Applications Engineer IMGS.
Introduction to ArcGIS for Environmental Scientists Module 2 – Fundamentals Lecture 6 – Table Functions.
Technical Workshops | Esri International User Conference San Diego, California ArcMap: Tips and Tricks Miriam Schmidts Jorge Ruiz-Valdepena July 23 – 27,
© Paradigm Publishing Inc. 9-1 Chapter 9 Database and Information Management.
A Technical Discussion of the Tax Photo Geotagging Processes Guilford County GIS & Tax Appraisal Departments Street Level Photography Project Eric Funderburk,
Network Analysis with Python
Overview Cursors arcpy.da module Geometrys Arrays SpatialReferences
Introduction to ArcPy. Topics What is ArcPy? Accessing geoprocessing tools using ArcPy Writing scripts using ArcPy.
© Paradigm Publishing Inc. 9-1 Chapter 9 Database and Information Management.
Wendy Welch ADAPTING THE ARC HYDRO DATA MODEL AND TOOLS TO A HYDROGEOLOGIC FRAMEWORK KITSAP PENINSULA, KITSAP, MASON AND PIERCE COUNTIES, WASHINGTON.
Esri UC 2014 | Technical Workshop | Fundamentals of working with geographic data Miriam Schmidts.
Esri UC 2014 | Technical Workshop | Esri Roads and Highways: Integrating and Developing LRS Business Systems Tom Hill.
Esri Roads and Highways: An Introduction to Roadway Reporter
Daniel J. Abadi · Adam Marcus · Samuel R. Madden ·Kate Hollenbach Presenter: Vishnu Prathish Date: Oct 1 st 2013 CS 848 – Information Integration on the.
Introduction to GeoDatabase Lecture
INTRODUCTION TO GEOGRAPHICAL INFORMATION SCIENCE RSG620 Week 1, Lecture 2 April 11, 2012 Department of RS and GISc Institute of Space Technology, Karachi.
ATN GIS Support ArcGIS: ArcCatalog.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Building Map Books.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Automating Geodatabase.
ArcGIS: ArcCatalog. Agenda The ArcCatalog Interface General ArcCatalog ▫Navigating directories ▫Preview data ▫View metadata Advanced ArcCatalog ▫Modifying.
Introduction of Geoprocessing Lecture 9. Geoprocessing  Geoprocessing is any GIS operation used to manipulate data. A typical geoprocessing operation.
Desktop Mapping: Building Map Books Jeff Barrette Michael Grossman.
Access Lessons 1, 2 and 3 ©2009 M and K Solutions, LLC – All Rights Reserved.
DATA Spatial Data – where things are Non Spatial Data or Attribute Data – What things are Data in a computer database are managed and accessed through.
Juanita Cano City of Sacramento Spring 2014 Geography 375.
Definition: What is data? Data is anything in the form of 1.Charts 2.Tables 3.Text 4.Maps 5.Photos 6.Imageries, etc.
ESRI Education User Conference – July 6-8, 2001 ESRI Education User Conference – July 6-8, 2001 Introducing ArcCatalog: Tools for Metadata and Data Management.
Towards Unifying Vector and Raster Data Models for Hybrid Spatial Regions Philip Dougherty.
Esri UC 2014 | Technical Workshop | Python: Beyond the Basics David Wynne, Jon Bodamer.
Natura 2000 System Alberto Telletxea Bilbomática under EEA Contractor.
William Perry U.S. Geological Survey Western Ecological Research Center Geography 375 Final Project May 22, 2013.
Lecture 10: Geoprocessing with Python (II) Dr. Taysir Hassan Abdel Hamid Associate Professor, Information Systems Dept., Faculty of Computers and Information.
Introduction to Geodatabases
SIMULATION COMPONENT AND MODFLOW DATA MODEL. Simulation Component.
ArcGIS Workflow Manager: Advanced Workflows and Concepts
The University of Texas at Dallas
Final Project: Read from a csv file and write to a database table
Chapter 9 Database and Information Management.
Having Fun With Tables and Reports
Building Map Books in ArcGIS
Network Analyst – Automating Workflows with Geoprocessing
The Use of Looping Code in Map Production
Final Project Geog 375 Daniel Hewitt.
Desktop Mapping: Building Map Books
Esri Roads and Highways An Introduction
Presentation transcript:

Differential Leveling Conversion and Analysis Toolset Lisa Berry University of Redlands, MS GIS Program

Project Overview Masters of Science in GIS Partnered with: Image:

Problem Inability to spatially and temporally pinpoint height changes over time along transportation infrastructure in southern California Images: and

How to Measure this Change Elevation changes along the transportation infrastructure using differential leveling survey methods Image:

Differential Leveling Survey Methods Differences in height rather than actual elevation - Helps determine geodetic elevation Image from:

What is Differential Leveling? Measured between Benchmarks Difference in height between these benchmarks Images from: gallery.usgs.govImages from: gallery.usgs.gov, onlinemanuals.txdot.gov onlinemanuals.txdot.gov Differential Leveling Observation Run

Benchmark and Run Visualization Runs store differential height value Benchmarks (Points) Runs (Lines)

Spatial and Temporal Problem Finding regions of significant change

Blue Book Format National Geodetic Survey (NGS) Vertical Observation text files - Collects and validates geodetic leveling data

Blue Book Format 1 Survey per file - Line records store raw observations

Goals of Project Build a geodatabase to manage datasets for efficient analysis Tool to automate conversion into ArcGIS Tool to perform analysis between surveys Image: esri.com

What Needs to be in the Geodatabase? Types of survey information within file: Basic information about survey Latitude/Longitude of Benchmarks Differential height between benchmarks Date/Time of measurements Temperatures and instrument specifications

Methods ArcGIS Geodatabase schema Python and ArcPy methods - Conversion and analysis

Conversion Process Step 1: Creation of Geodatabase Schema

Conversion Process Step 2: Python Script Tool - Handling different line records

Python Script Line Record “key”

Conversion Process Step 3: Field type conversion within Python - Integer and date fields to match geodatabase schema +=

Writing to the Geodatabase Insert Cursor method Sparse/Convert Line Data Python List Insert Row to Table

Conversion Tool Interface Batch process surveys Pre-made Geodatabase schema (location)

Conversion Output

Pilot Dataset Results 9 Surveys 2700 Benchmarks and 4200 Runs Filling 2 Feature Classes and 2 additional tables 15 seconds

Analysis Tool Searches Feature Class for: - Same start and end benchmark - Significant difference in the differential leveling value Search Cursor Method - Comparing the table to itself

Analysis Tool Interface

Analysis Tool Result Join with Runs Feature Class - Spatial visualization of the runs with significant change

Overall Solution BeforeAfter

The Big Picture Image: aaroads.cahighways.org and

Conclusions Creation of geodatabase Automating the conversion process Creating a tool for analysis Allowing further analysis of datasets Runs Benchmarks Equipment Differences

Thank you Lisa Berry