W W W. R E F R A C T I O N S. N E T PostGIS Case Studies What is it, who is using it, and why?

Slides:



Advertisements
Similar presentations
Database Architectures and the Web
Advertisements

What’s New in ArcGIS Desktop
Kapil Oberai Scientist Indian Institute of Remote Sensing India Geospatial Forum 2012.
Network Management Overview IACT 918 July 2004 Gene Awyzio SITACS University of Wollongong.
ArcGIS Geodatabase Miles Logsdon Spatial Information Technologies, UW Garry Trudeau - Doonesbury.
Benefits and Concerns when Constructing an Enterprise-scale Geodatabase Larry Theller, presenter Agricultural and Biological Engineering Dept Purdue University.
Mapserver The Oregon Experience David Percy Geospatial Data Manager, Geology Department Portland State University Digital Mapping Techniques, 2006 Conference.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
ESRM 250/CFR 520 Winter 2010 Phil Hurvitz (with thanks to J. Lawler & P. Schiess) Introduction to GIS and ArcGIS 1 of 48.
ArcGIS Technology Update Introducing ArcGIS 10 Natalie Culpepper Account Executive ESRI -Atlanta.
Agenda Background & Overview Architecture Components Usage
Open Source Databases and GIS
Database Management COP4540, SCS, FIU An Introduction to database system.
Oracle Application Express Summary. © 2009 Oracle Corporation Oracle APEX Roadmap APEX Introduced Interactive Reports Basis for Audit Vault Reporting.
Intro. To GIS Lecture 4 Data: data storage, creation & editing
Boundless and the OpenGeo Suite Our world is open. Mature open source technology Store, publish and edit geospatial data Serve maps, build applications,
Open Source Geospatial software for the the Army Corps of Engineers Wetlands Regulatory program FOSS4G2007 Victoria, B.C. Canada Michael Smith Engineer.
IT – DBMS Concepts Relational Database Theory.
Introduction to Open Source GIS, GeoTec 2005
Databases Illuminated
CSC2012 Database Technology & CSC2513 Database Systems.
“Codd’s Rules for Spatial ORDBMS”
Cube Enterprise Database Solution presented to MTF GIS Committee presented by Minhua Wang Citilabs, Inc. November 20, 2008.
GIS technologies and Web Mapping Services
The Utilization of GIS Technology at Northeastern REMC Presented By: Steven Weber, GISP Northeastern REMC (260)
Enterprise Addressing System. Spatial Data for the Enterprise (Imagery, Demographic Data) Enterprise Addressing System.
The Worlds of Database Systems Chapter 1. Database Management Systems (DBMS) DBMS: Powerful tool for creating and managing large amounts of data efficiently.
WHAT THE MARKET-LEADING DBMS VENDORS DON’T WANT YOU TO KNOW Disruption is gathering steam.
1 CS 430 Database Theory Winter 2005 Lecture 1: Introduction.
DB Libraries: An Alternative to DBMS By Matt Stegman November 22, 2005.
Open Standards Open Source Open Data Cameron Shorter Geospatial Systems Architect Lisasoft/Terrapages GITA 2007 Geospatial Infrastructure Solutions Conference.
John Boland SCO Support 1 MySQL and SCAMP. 2 Overview  What is SCAMP?  What is MySQL?  Network Subscriptions  Downloading MySQL  Installation of.
material assembled from the web pages at
The OpenGIS Consortium Geog 516 Presentation #2 Rueben Schulz March 2004.
The FalconView Geodata Overlay
The 2000 Decennial Census School District Project: Using Census Data for the School District Mapping System **** Development and Implementation Tai A.
GIS On The Web: An Overview of ArcIMS. *The easy flow of geographic data can offer real-life solutions in many societal sectors, including municipal government,
Open Source GIS in Salmon Nation Equity, Ecology, and Economics Presented by Aaron Racicot – GIS Programmer November 16, 2005 A Citizen.
OpenSource GIS 2004 Ottawa, Canada A Survey of Open Source GIS “The View from 30,000 Feet” or “A Mile Wide and an Inch Deep” Paul Ramsey.
Company LOGO Permit Tracking System. CTPermits  Our Mission Statement: To offer the most cost-effective, intelligent, and achievable Data Technology.
PHP Features. Features Clean syntax. Object-oriented fundamentals. An extensible architecture that encourages innovation. Support for both current and.
Understanding our world.. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Editing Versioned Geodatabases.
Experts Workshop on the IPT, v. 2, Copenhagen, Denmark The Pathway to the Integrated Publishing Toolkit version 2 Tim Robertson Systems Architect Global.
Using Open Source GIS Technology overview Presented by Aaron Racicot – GIS Programmer January 25, 2006 A Citizen of Salmon Nation.
Esri UC 2014 | Technical Workshop | Editing Versioned Geodatabases : An Introduction Cheryl Cleghorn and Shawn Thorne.
+ Big Data IST210 Class Lecture. + Big Data Summary by EMC Corporation ( More videos that.
A radiologist analyzes an X-ray image, and writes his observations on papers  Image Tagging improves the quality, consistency.  Usefulness of the data.
22 Oct 2003: IGIC Quarterly IEM Access & Free GIS Daryl Herzmann Department of Agronomy Iowa State University.
Intro to GIS | Summer 2012 Attribute Tables – Part 1.
Database Systems Lecture 1. In this Lecture Course Information Databases and Database Systems Some History The Relational Model.
What is PostGIS? Spatial DataBlade for Postgresql Store, Query, and Manipulate Spatial data objects as first-class citizens in the Database. Follows the.
Making Friends with Your Public Works Department Using GIS Sherry Coatney Intergraph Corporation
Philadelphia, May 2–4, Philadelphia, May 2–4, Benjamin Lewis, Senior GIS Analyst,
PostGIS Charles Brady Dan Kroll. Examples InfoTerra InfoTerra is a Major Reseller of remote sensing and aerial photography. "GeoStore" is the data managing.
W W W. R E F R A C T I O N S. N E T Introduction to An Open Source Platform for GIS.
Enterprise Database Systems Introduction to SQL Server Dr. Georgia Garani Dr. Theodoros Mitakos Technological.
uses of DB systems DB environment DB structure Codd’s rules current common RDBMs implementations.
Live Customer Support Solution
An Introduction to database system
Database System Concepts and Architecture
9. Creating and Maintaining Geographic Databases
Open Source distributed document DB for an enterprise
Operational & Analytical Database
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Database Management System (DBMS)
PostGIS Introduction and Case Studies
A Survey of Open Source GIS
Spatial Databases SpatiaLite & PostGIS.
IT and Development support services
Presentation transcript:

W W W. R E F R A C T I O N S. N E T PostGIS Case Studies What is it, who is using it, and why?

W W W. R E F R A C T I O N S. N E T The Beginning PostGIS is an open source geospatial extension for PostgreSQL PostgreSQL is an open source relational database management system (RDBMS) A relational database management system is… ?

W W W. R E F R A C T I O N S. N E T What is an RDBMS?

W W W. R E F R A C T I O N S. N E T What is an RDBMS? System that provides for multi-user random access of potentially very large quantities of data. Modeling language (DDL) Query language (SQL) Transaction guarantees (ACID) –Atomicity, Consistency, Isolation, Durability

W W W. R E F R A C T I O N S. N E T What is an RDBMS?

W W W. R E F R A C T I O N S. N E T What is PostgreSQL? Second generation RDBMS Michael Stonebraker UC Berkeley –Database researcher –Ingres, Prove relational theory –Postgres, Extend and improve

W W W. R E F R A C T I O N S. N E T What is PostgreSQL? : Postgres –Original research project 1995: Postgres95 –SQL support : PostgreSQL –Open source team –MVCC, stability, performance : PostgreSQL –SQL92, complex SQL, schemas, optimizer, Win : PostgreSQL 8.1

W W W. R E F R A C T I O N S. N E T Why PostgreSQL? Feature parity –ACID guarantees –SQL 92, advanced query optimizer –Full text searching –Replication –Hot backup, write-ahead logs / PITR Better than MySQL As good as proprietary –Better in some respects

W W W. R E F R A C T I O N S. N E T Why PostgreSQL? “Enterprise”1 CPU / 1 Core2 CPU / 2 Core Oracle$40,000$140,000 IBM DB2$30,000$60,000 MS SQL Server$25,000$50,000 IBM Informix$50,000$100,000 PostgreSQL$0 Scalability

W W W. R E F R A C T I O N S. N E T What is PostGIS? GEOMETRY –POINT, LINESTRING, POLYGON, MULTIPOINT, MULTILINETRING, MULTIPOLYGON, GEOMETRYCOLLECTION Indexes –R-TREE –Linear-time algorithm Functions –OpenGIS “Simple Features for SQL” –Over 300 functions

W W W. R E F R A C T I O N S. N E T What is PostGIS? Open source –General Public License (GPL) –Open development and support Five year history –2001: First release, Mapserver support –2002: Improved functions, indexes –2003: GEOS support, many functions –2004: SFSQL conformance –2005: Lightweight geometries –2006: OpenGIS SFSQL compliance

W W W. R E F R A C T I O N S. N E T Why PostGIS? Integration –Mapserver –Geotools (Geoserver, uDig) –JUMP (OpenJUMP, Kosmo) –OGR (QGIS, Mapserver) –FME (ESRI Interoperability Extension) –Cadcorp SIS –Ionic Redspider –Python / Perl / PHP

W W W. R E F R A C T I O N S. N E T Why PostGIS? Simplicity –PostGIS Polygon POLYGON((0 0, 0 1, 1 1, 1 0, 0 0)) –Oracle Polygon MDSYS.SDO_GEOMETRY( 2003, NULL, NULL, MDSYS.SDO_ELEM_INFO_ARRAY(1,1003,1), MDSYS.SDO_ORDINATE_ARRAY(0,0, 0,1, 1,1, 1,0, 0,0))

W W W. R E F R A C T I O N S. N E T Why PostGIS? Price Functionality

W W W. R E F R A C T I O N S. N E T Case Studies GlobeXplorer –High performance, good value North Dakota State Water Commission –Good value, legacy integration Fleet Management Company –Good value, specialized features

W W W. R E F R A C T I O N S. N E TGlobeXplorer Consumer and end-user oriented image distribution service (1M-5M requests / day) Manage archive of images (multi-terabyte) and vectors (32M parcels and growing) Provide access via web services –WMS –Own web services –Desktop extensions

W W W. R E F R A C T I O N S. N E TGlobeXplorer Image Files Image Metadata Find Imagery Return Imagery Request Response

W W W. R E F R A C T I O N S. N E TGlobeXplorer The first transition -- physical scalability –Start-up in 1999 on Oracle 8i –Load created by application was overwhelming server –Informix offered to provide migration support –By 2001, completely migrated to the Informix “Spatial Blade”

W W W. R E F R A C T I O N S. N E TGlobeXplorer The second transition -- economic scalability –By 2004, 11 CPUs of Informix –Each CPU cost $30,000 to license –Doubling traffic could cost $330,000 in software alone, plus ongoing “annual maintenance” costs

W W W. R E F R A C T I O N S. N E TGlobeXplorer Image Files Informix Return Imagery Request Response PostGIS Find Imagery

W W W. R E F R A C T I O N S. N E TGlobeXplorer January 2004, began exploratory load testing PostGIS Spring 2004, created parallel services using PostGIS Summer 2004, migrated all services to PostGIS Winter 2004, completed migration of all production systems

W W W. R E F R A C T I O N S. N E TGlobeXplorer Since PostGIS, have moved into vector data too –All US roads –All US watersheds –All US floodplains –32 million parcels –Serving vector maps with UMN Mapserver Last Informix system (billing) being migrated this year

W W W. R E F R A C T I O N S. N E T Better performance Similar price GlobeXplorer Each software transition increased business value Similar performance Better price

W W W. R E F R A C T I O N S. N E T North Dakota Water Commission

W W W. R E F R A C T I O N S. N E T North Dakota Water Commission Regulates use of water resources Employs scientific experts (hydrologists) and decision makers Monitor water levels, water quality, and water usage –Generate a great deal of data –Water meters, water samples, etc

W W W. R E F R A C T I O N S. N E T North Dakota Water Commission 2001 plan to migrate to ESRI –ArcIMS, ArcSDE, ArcMap 2003 state budget cut back –Migration stopped –$500,000 less than originally planned New options needed –Mapserver –PostGIS / PostgreSQL

W W W. R E F R A C T I O N S. N E T

North Dakota Water Commission Data integrated –2,000,000 water level records –31,000 well sites –54,000 chemistry analyses Bonuses –Open source was easier to install and maintain –Spatial / attribute integration opening up analysis possibilities for hydrologists

W W W. R E F R A C T I O N S. N E T North Dakota Water Commission Similar performance Better price

W W W. R E F R A C T I O N S. N E T Fleet Management Company Refractions Research client Start-up company –Selected PostgreSQL early Started with fleet maintenance application –Download inspection and engine details to central PostgreSQL database daily –Popular with school bus fleets, stringent safety tracking requirement

W W W. R E F R A C T I O N S. N E T Fleet Management Company Added GPS capability to their devices Now gathering a GPS sample every six seconds from each vehicle Huge volumes of spatial data –One fleet = 100 vehicles * 8 hours * 60 minutes * 10 samples / minute = 480,000 samples per day Needed a database and reporting interface –Manage, query and display new real time location data

W W W. R E F R A C T I O N S. N E T Fleet Management Company Specialized Queries –How many times did the vehicle stop? Where? For how long? –What mileage did the vehicle cover in Sacramento in June? The whole fleet? –What was the maximum speed of the vehicle yesterday? Last week? –What route did the vehicle take yesterday? A week ago? A month ago?

W W W. R E F R A C T I O N S. N E T Fleet Management Company Specialized Requirements –Huge volumes of data PostGIS lightweight storage –Spatio-temporal data PostGIS four dimensional geometry PostGIS linear referencing PostgreSQL n-dimensional cube indexes –Specialized multi-key queries PostgreSQL GiST multi-key capability

W W W. R E F R A C T I O N S. N E T

Fleet Management Company Take GPS point stream and convert to 4-dimensional lines –Even smaller data footprint –Faster to map than points Use Mapserver and Ka-Map to create interactive mapping interface Use AJAX methods for all tabular results

W W W. R E F R A C T I O N S. N E T Fleet Management Company Better performance Same price +

W W W. R E F R A C T I O N S. N E TConclusion PostGIS is an essential part of a wide range of spatial systems use cases –High performance, simple query –Complex integration, legacy systems –High performance, complex query For many applications, moving to open source will be a move that increases business value –Either by lowering costs –Or by increasing functionality

W W W. R E F R A C T I O N S. N E TQuestions?