Using QGIS, GRASS and PostGIS to answer some difficult questions

Slides:



Advertisements
Similar presentations
Geographic Information Systems GIS Software. 1. The Early GISs SURFACE II, by Kansa Geological Survey SYMAP, by Harvard Laboratory for Computer Graphics.
Advertisements

ampus GIS Program Site License Overview Presented by Kevin C. Remington & Wm. Lynn Shirley.
Building an online tool for spatial joins using open source software Karsten Vennemann Seattle.
ArcGIS Geodatabase Miles Logsdon Spatial Information Technologies, UW Garry Trudeau - Doonesbury.
So What is GIS??? “A collection of computer hardware, software and procedures that are used to organize, manage, analyze and display.
OPEN SOURCE GIS Comparing Quantum GIS to Open Jump.
What Geoprocessing? Geoprocessing is the processing of geographic information. Commonly used to describe a process when geographic objects are manipulated.
Geographical Information System GIS By: Yahia Dahash.
Intro. To GIS Lecture 6 Spatial Analysis April 8th, 2013
Kurt Menke, GISP GRASS GIS Geographic Resources Analysis Support System.
Rebecca Boger Earth and Environmental Sciences Brooklyn College.
Geographic Information Systems GIS Software. 1. The Early GISs ► SURFACE II, by Kansas Geological Survey ► SYMAP, by Harvard Laboratory for Computer Graphics.
Web-Based Tool and Why Cross Platform Support Multi-User No special software to install… just a browser Offload real work to server No worrying about versions.
Parcel Data Models for the Geodatabase
Cadastre software based on Open Source in Kyrgyzstan Alexander Solovov Solution developer.
Introduction to Spatial Analysis and Spatial Modeling
A Basic Introduction to Free and Open Source Software Presented by John Bocan.
9. Introduction to ArcObjects Most GIS analysis carried out within a GIS consists of a labor- intensive sequence of steps. Automating a GIS makes it possible.
Major parts of ArcGIS ArcView -Basic mapping, editing and Analysis tools ArcEditor -all of ArcView plus Adds ability to deal with topological and network.
The OpenGIS Consortium Geog 516 Presentation #2 Rueben Schulz March 2004.
GIS concepts, skills and tools
Presenter: Rich Lee Location Suitability Analysis New Burger stores in San Fernando Valley 2010 Fall 406 Final Project.
Practical Introduction to QGIS Impact HUB Seattle
School of Geography FACULTY OF ENVIRONMENT Introduction to ArcToolbox and Geoprocessing.
The FalconView Geodata Overlay
How do we represent the world in a GIS database?
Esri UC 2014 | Technical Workshop | Fundamentals of working with geographic data Miriam Schmidts.
Introduction to the Geodatabase. What is a Geodatabase? What are feature classes and feature datasets? What are domains Design a personal Geodatabase.
GDAL/OGR. GDAL/OGR GDAL/OGR : Frank Warmerdam Tools for reading, writing, and processing GDAL - Geospatial Data Abstraction Library GDAL - Geospatial.
DEV-05: Ratcheting up your OpenEdge™ Development Productivity Sunil S Belgaonkar Principal Software Engineer.
ArcGIS for the Military: MIL-STD-2525D Joint Military Symbology
BIT 285: ( Web) Application Programming Lecture 15: Tuesday, February 24, 2015 Microsoft Azure Instructor: Craig Duckett.
Intro to GIS | Summer 2012 Attribute Tables – Part 1.
Co-sponsored by the MIT Libraries and IS&T GIS Lab website: Advanced ArcGIS.
How To configure GDAL. 2 What is GDAL? GDAL is a translator library for raster and vector geospatial data formats that is released under an X/MIT style.
Uploading Data Matthew Hanson  GeoNode made up of several components  Web Framework – Django  OGC Server – GeoServer  Database – PostGIS.
Presented by: Shahab Spring Introduction Data Analytics Plugins Learning Resources.
Geocoding Chapter 16 GISV431 &GEN405 Dr W Britz. Georeferencing, Transformations and Geocoding Georeferencing is the aligning of geographic data to a.
Lecture 18: Spatial Analysis Using Rasters Jeffery S. Horsburgh CEE 5190/6190 Geographic Information Systems for Civil Engineers Spring 2016.
Key Terms Attribute join Target table Join table Spatial join.
Delft-FIAT.
GIS Institute Center for Geographic Analysis
Integration of Mobile GIS Technologies in the West Virginia Department of Environmental Protection Bond Forfeiture Program Sarah Clapham and Yueming.
Desktop ArcGIS GIS File Types
GIS On A Budget: Simple Applications for Real World Solutions
Harry Williams, Cartography
Introduction to ArcGIS API for Microsoft Silverlight
ArcGIS Topology Shapefiles, Coverages, Geodatabases
Introduction to Quantum GIS
Created by Kamila zhakupova
PHP / MySQL Introduction
Geographic Information Systems
Downloading and Preparing GIS Precipitation Data Layers
Preliminaries: -- vector, raster, shapefiles, feature classes.
A Survey of Open Source GIS
Geographic Data Primitives
Building an online tool for spatial joins using open source software
GIS Lecture: Geoprocessing
Spatial Databases SpatiaLite & PostGIS.
GIS Institute Center for Geographic Analysis
Vector Geoprocessing.
Web AppBuilder for ArcGIS
GIS Institute Center for Geographic Analysis
// Data visualisation: Generating maps with ESPON mapkit and open data
IGIC 2017 User Conference May 10, 2017.
Mapping packages Unfortunately none come with Anaconda (only geoprocessing is which does lat/long to Cartesian conversions). matplotlib.
ODK (Open Data Kit). What is Open Data Kit?  Many organizations are using mobile devices to collect data in the field. Open Data Kit is a suite of tools.
ArcGIS Pro: An Introduction Overview
Esri Roads and Highways An Introduction
Presentation transcript:

Using QGIS, GRASS and PostGIS to answer some difficult questions How Open Source GIS can help make your life easier and help you find beer on a Sunday

PostGIS An extension to PostgreSQL A decendent of InnoDB, like MS SQLServer Highly extendable Pre-made extensions like PostGIS add new fuctionality Make your own: aggregates, extensions, datatypes Interfaces for many programing languages such as PL/Sql, PL/Python, PL/Perl, PL/R, PL/C Open Source license with corporate support from EnterpriseDB and other devlopers available if needed Stores spatial data and allows SQL queries to be run against the data Supports vector and raster data, topology just added with 2.0 release 2D / 3D vector data types are available, M values available as well Vector data can be stored as Geometry or Geography

A simple spatial query Simple spatial query. This shows all of the USGS populated places that intersect Vanderburgh County’s boundary. First column is the name, the second column is a Hexadecimal representation of the point. That hexadecimal number represents the Geometry type, projection, and X/Y value of each point. Other databases have this capability, MS-SQL has since 2008, Oracle has spatial Capability at the full Enterprise license level.

QGIS Open Source GIS application Opens nearly any vector or raster dataset thanks to OGR/GDAL libraries Wide range of analysis tools both built in and available from 3rd party plugins Runs on all modern desktop platforms, a version is available for Android devices as well GRASS Developed in the 1980s by the Army Corps of Engineers Initially used to do environmental impact studies at Fort Hood Currently Open Source Used as analysis engine for many other OSGeo projects A bit tricky to use as a stand alone app due to somewhat non-intuitive interface Uses OGR/GDAL to import wide range of data formats However, only works directly on its own internal format GRASS's vector format uses topology Some of the best 3d analysis software available Great for hydrological modelling and viewshed analysis

Vector data types available through OGR GDAL / OGR Opens pretty much any GIS data format, raster or vector Libraries available to almost any GIS software, used by QGIS, GRASS, even ESRI software Can also be used as a stand alone via the command line, makes batch operations such as conversions or merges easier

Where's the beer?

Used the Brewer's Guild of Indiana website to get names and address of breweries around the state. Used a Ruby script to pull that information from the site and put it into a CSV file that could be imported into a Postgres Database

Geocode Query Took the addresses and ran them through the TIGER Geocoder extension. An extension to PostGIS, it consists of a data downloader and a geocoder The downloader sets up batch files that allow you to download TIGER data f or states you select. Data is downloaded as zipped shapefiles, by county per state. The script unzips the zip files, and uploads the shapefiles into your PostGIS database. The geocoder parses address and returns a normalized address, a confidence rating value (the lower the better), and a point geometry in NAD83 long / lat. Above query geocodes address from the brewery table, and reprojects the geometry as UTM16N, via EPSG code.

QGIS and the GRASS Plugin Using the QGIS's GRASS plugin Simplifies setup of GRASS projects Simplifies import of PostGIS data into GRASS

GRASS’ Vector to Raster Tool Take the imported vector layer, convert to raster Run raster through r.grow.distance

r.grow Output Run raster map through r.grow.distance Resulting dataset shows the greatest distance to a brewery is 58.3 miles.

Counting all Hoosiers Who Live Within Five Miles of a Microbrewery SELECT Round(Sum(c.pop10*(ST_Area(ST_Intersection(c.geom, z.the_geom))) / c.totarea)) FROM (SELECT ST_Union(ST_Buffer(b.geom,8046.72)) as the_geom FROM breweries.brewery b) as z, indiana.block_pop c WHERE ST_Intersects(z.the_geom, c.geom); Counting all Hoosiers Who Live Within Five Miles of a Microbrewery Query starts by creating a 5 mile buffer around each point and unions those buffers into a single multi polygon. Then it checks to see if a census block intersects the buffer. If it does then it takes a percentage of the area of a population block covered by the buffer and multiplies it by the population in that block to get a weighted average. So if a block has 100 people in it, and the buffer covers half of its area it returns a value of 50 for that block. It adds up all resulting population figures, rounds it off and returns a final value of 2,785,000

Multipolygon Buffer

QGIS Generated Contours QGIS can generate contours and TINs from raster sources

Current OSGeo Limitations Cartography / Layout Editing Versioned Editing Mr Sid support File Geodatabase support Layouts in QGIS can be difficult, but are improving with each release Creating polygon datasets is tricky with QGIS; miss many ESRI tools that make those tasks easier No versioned editing for PostGIS yet, some small projects are just getting off the ground Mr. Sid files are supported out of the box for Windows installs of QGIS, but require compiling against LizardTech supplied libraries for support on Mac/Linux FGDB support is similar to Mr. Sid, requires compling against ESRI supplied libraries. Some Windows installs support FGDB out of the box

Where to go for help PostGIS: Refractions Research http://refractions.net QGIS: QGIS Foundation http://qgis.org PostGIS In Action By Leo Hsu & Regina Obe http://postgis.us GIS StackExchange http://gis.stackexchange.com Philip Bernard Mapping & Spatial Solutions pb@mappingandspatial.com Where to go for help