Using Postgres/PostGIS for WFSRI

Slides:



Advertisements
Similar presentations
Translating WFS Query to SQL/XML Query Vânia Vidal Fernando Lemos Fábio Feitosa Departamento de Computação Universidade Federal do Ceará
Advertisements

The Next Generation Network Enabled Weather (NNEW) SWIM Application Asia/Pacific AMHS/SWIM Workshop Chaing Mai, Thailand March 5-7, 2012 Tom McParland,
DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
Proposed update of Technical Guidance for INSPIRE Download services based on SOS Matthes Rieke, Dr. Albert Remke (m.rieke, 52°North.
1 OGC Web Services Kai Lin San Diego Supercomputer Center
Europe’s Information Society eContentplus OrléansWP6 1st Coordination and progress meeting Technical information OGC WMS – WFS – CSW.
Oracle Beehive Vivek Pavle Orabyte LLC Orabyte.
NDFD Technical Workshop (Nov 2, 2006) 1 GIS Web Services NDFD Technical Workshop November 2, 2006 John Schattel -
Advanced Topics COMP163: Database Management Systems University of the Pacific December 9, 2008.
Jeremy Boyd Director – Mindscape MSDN Regional Director
Web Feature Service and Web Map Service WATER FOR A HEALTHY COUNTRY FLAGSHIP SISS Workshop v2.3 Pavel Golodoniuc, Josh Vote 8 May 2013.
A Social blog using MongoDB ITEC-810 Final Presentation Lucero Soria Supervisor: Dr. Jian Yang.
DAT304 Leveraging XML and HTTP with Sql Server Irwin Dolobowsky Program Manager Webdata Group.
Information storage: Introduction of database 10/7/2004 Xiangming Mu.
Irwin/McGraw-Hill Copyright © 2000 The McGraw-Hill Companies. All Rights reserved Whitten Bentley DittmanSYSTEMS ANALYSIS AND DESIGN METHODS5th Edition.
Database Design for DNN Developers Sebastian Leupold.
DATABASE and XML Moussa Mané. Learning Objectives ● Learn about Native XML Databases ● Learn about the conversion technology available ● Understand New.
Database Solutions for Storing and Retrieving XML Documents.
OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.
Web Feature Service – What and How? Ian Painter - Snowflake Software.
David Blasby The Open Planning Project New York. Goals Explain what a WFS and WMS are, and when to use them Be able to create simple spatial web applications.
Deploying OGC Web Services GeoScience Victoria’s Experience Alistair Ritchie, Senior Information Geologist GeoScience Victoria.
An Introduction To Building An Open Standard Web Map Application Joe Daigneau Pennsylvania State University.
Physical Database Design Chapter 6. Physical Design and implementation 1.Translate global logical data model for target DBMS  1.1Design base relations.
ORACLE
AIXM Users’ Conference, March Implementing AIXM in Instrument Flight Procedures Automation Presenter: Iain Hammond MacDonald, Dettwiler &
Abierman-nanog-30may03 1 XML Router Configs BOF Operator Involvement Andy Bierman
The 2000 Decennial Census School District Project: Using Census Data for the School District Mapping System **** Development and Implementation Tai A.
How do you want that data? Spatial information models and web interfaces Simon Cox CSIRO Exploration and Mining 7 September 2005.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
1 Chapter Overview Performing Configuration Tasks Setting Up Additional Features Performing Maintenance Tasks.
Mike Jackson EPCC OGSA-DAI Architecture + Extensibility OGSA-DAI Tutorial GGF17, Tokyo.
XML and Database.
Geography Markup Language (GML). What is GML? – Scope  The Geography Markup Language is  a modeling language for geographic information  an encoding.
Review of Paper: Johan Hjelm “Position dependent services using metadata profile matching” Youyong Zou Apr.15,2001.
GLOBEX INFOTEK Copyright © 2013 Dr. Emelda Ntinglet-DavisSYSTEMS ANALYSIS AND DESIGN METHODSINTRODUCTORY SESSION EFFECTIVE DATABASE DESIGN for BEGINNERS.
Scalable Hybrid Keyword Search on Distributed Database Jungkee Kim Florida State University Community Grids Laboratory, Indiana University Workshop on.
CWIC Developers Meeting January 28 th 2014 Calin Duma CSW and OpenSearch from the CWIC Start client perspective.
Geography Markup Language (GML). GML What is GML? – Scope  The Geography Markup Language is  a modeling language for geographic information  an encoding.
ESG-CET Meeting, Boulder, CO, April 2008 Gateway Implementation 4/30/2008.
©2007 Really Strategies, Inc. CONFIDENTIAL 1 Native XML Content Management Philadelphia XML Users’ Group.
OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.
Your Data Any Place, Any Time Beyond Relational. Overview of Beyond Relational Applications Today Beyond Relational Feature Overview Whirlwind Feature.
Module 5: Managing Content. Overview Publishing Content Executing Reports Creating Cached Instances Creating Snapshots and Report History Creating Subscriptions.
Geographic Information Systems GIS Data Databases.
October 2014 HYBRIS ARCHITECTURE & TECHNOLOGY 01 OVERVIEW.
Databases (CS507) CHAPTER 2.
The Next Generation Network Enabled Weather (NNEW) SWIM Application
CS320 Web and Internet Programming SQL and MySQL
Using E-Business Suite Attachments
Chapter 2 Database System Concepts and Architecture
Database System Concepts and Architecture
CARA 3.10 Major New Features
IP Publishing From IP Data Base to IP list to IP catalog
Geographic Information Systems
9/22/2018.
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Chapter 2 Database Environment Pearson Education © 2009.
Database Systems Instructor Name: Lecture-3.
Jonathan Rosenberg dynamicsoft
CS3220 Web and Internet Programming SQL and MySQL
and perspectives for AIXM
Chapter 2 Database Environment Pearson Education © 2009.
Chapter 2 Database Environment Pearson Education © 2009.
Reportnet 3.0 Database Feasibility Study – Approach
NoSQL databases An introduction and comparison between Mongodb and Mysql document store.
Oracle and XML Mingzhu Wei /7/2019.
INTRODUCTION A Database system is basically a computer based record keeping system. The collection of data, usually referred to as the database, contains.
Geographic Information Systems
SDMX IT Tools SDMX Registry
Presentation transcript:

Using Postgres/PostGIS for WFSRI Kajal Claypool, Oliver Newell 19 Nov 2009 1 1

WFS Specification at a Glance Basic WFS: “Read-only” Disseminates geographic features and associated attributes for analysis and display Supported Operations: getCapabilities – retrieves a listing of services offered by a given server describeFeatureType – retrieves a description of the available feature types getFeature – retrieve a collection of features from a given feature type (Filtered or not) ** Supports OGC Filter Specification Transactional WFS (WFS-T) Supports Basic WFS + CRUD operations on geographic feature instances Insert Update Delete

NNEW – WFS Extension Subscription WFS Supports Transactional WFS + subscription capabilities Operations supported subscribe – sets up a subscription to receive a collection of features from a given feature type (Filtered or not) ** Supports OGC Filter Specification subscribeResponse – pushes filtered features from a given feature type to the subscriber ** cannot be invoked by the user.

NNEW WFSRI Architecture WFS Client Real Time Client Data Publisher <wfs:featureCollection> <wx:observationTime> <nawx:LightningFlash gml:id="id5" > <gml:TimeInstant gml:id="id6"> <gml:timePosition>2008-07-09T03:54:25Z</gml:timePosition> </wx:observationTime> </gml:TimeInstant> <nawx:strength uom="kA">-30.0</nawx:strength> <nawx:numStrokes>3</nawx:numStrokes> <nawx:geometry> <gml:Point gml:id="id7" srsName="urn:ogc:def:crs:EPSG::4326" srsDimension="2"> <gml:pos>38.611629486083984 -81.6015625</gml:pos> </gml:Point> </nawx:LightningFlash> </nawx:geometry> <wfs:featureCollection> <nawx:LightningFlash gml:id="id5" > <wx:observationTime> <gml:timePosition>2008-07-09T03:54:25Z</gml:timePosition> <gml:TimeInstant gml:id="id6"> </gml:TimeInstant> </wx:observationTime> <nawx:numStrokes>3</nawx:numStrokes> <nawx:strength uom="kA">-30.0</nawx:strength> <nawx:geometry> <gml:Point gml:id="id7" srsName="urn:ogc:def:crs:EPSG::4326" srsDimension="2"> <gml:pos>38.611629486083984 -81.6015625</gml:pos> </gml:Point> </nawx:geometry> </nawx:LightningFlash> WFS – Real Time Access XML Over HTTP WFS-Archiving Web Feature Service Data Store Partitioned For Optimal Performance Jan Feb Mar Dec Oct Asynchronous Access OGC Filter

NNEW WFS RI Capabilities Capability WFS 1.1 NNEW WFSRI 1.0 Comments getFeature Supports: Temporal subsetting Geographic subsetting Property –value filtering Does not support projections Does not support all NNEW WFSRI filtering requirements getCapabilities describeFeatureType WFS-T Insert only. There are no plans to support update/deletes in the NNEW WFSRI subscribe Supports all filtering capabilities of the getFeature subscribeResponse Supports transport of filtered data to JMS queue Data storage support Supports fast performance partitioning WFSRI 1.1 supports flexible creation of feature tables based on either a mapping file or an annotated schema. FeatureType Admin Allows creation of feature types Secure “write” for feature producer BASIC Txn Sub

Oracle Technologies Used Oracle Technology WFSRI Feature Description Oracle Advanced Queues (crucial for WFS Subscription) Supports WFSRI Architecture: subscribe, subscribeResponse, getFeature This feature is key for supporting equivalent spatial and temporal subsetting capabilities for request/response and subscriptions. Oracle Spatial Spatial support and filtering Provides the core capabilities for meeting NNEW WFSRI spatial subsetting requirements Oracle XML XML Storage and Xpath filtering Supports flexible storage of feature instances, allowing extraction of elements for fast query access. Access to everything in the XML message is granted through Xpath queries Oracle Timestamp Temporal subsetting Key for supporting NNEW WFSRI temporal subsetting requirements

Oracle Technologies Used Oracle Technology WFSRI Feature Description XML Indexing Performance Provides fast access for Xpath/Xquery queries Spatial Indexing Provides fast access for spatial queries (within, BBOX, overlap) Oracle Partitioning Performance/Archiving Oracle Security Haven’t really explored this beyond basic role based authorization and a “sandbox” environment for developers Could be leveraged heavily depending on the WFSRI security requirements.

Comparison with Postgres/PostGIS Feature Oracle Postgres/PostGIS Impact Queues/Subscription Support Oracle Advanced Queues (crucial for WFS Subscription) No equivalent support WFS Subscription can not be supported using the current RI architecture. Significant implementation effort would be required to support this using just JMS. Spatial Support Support Supports 2D and 3D geometries. Supports geodetic data Supports 2D geometries and some 3D geometries. PostGIS 1.5 is likely to have more spatial support.

Comparison with Postgres/PostGIS Feature Oracle Postgres/PostGIS Impact Spatial Filtering Supports ~400 functions. Geodetic support ~300 functions Equivalent support between Oracle and PostGis for 2D XML Storage Native storage Binary XML (post-process, optimized format) Data validation Native XML type as of Postgres 8.3 and 8.4 No validation support No real impact. Data validation is big difference, but WFSRI is not currently using Oracle validation due to issues with GML 3.2 XML Querying Supports Xpath and Xquery as well as SQL and embedded Xpath/Xquery Supports Xpath. No Xquery support. Suggest using text based searching which is inefficient! Performance for Xpath queries could be an issue Spatial Indexing Yes XML Indexing No Performance

Oracle vs Postgres/PostGIS Feature Oracle Postgres/PostGIS Impact Partitioning Yes together with partitioned indexes for better performance Base support -- implemented using tables. Unclear whether this would really perform well. Required for performance and archiving. Could be implemented with Postgres Partitioning. Performance impact unclear. Security extensive security features, from basic authentication and LDAP integration to Virtual Private Databases. Extensive auditing capabilities Basic authentication and some LDAP integration We are not currently using many of the Oracle security features other than basic authentication and authorization. This will likely expand in Version 2 and it is unclear how Postgres will match up with that.

Summary/Options Options: Using Postgres/PostGIS to support WFS-Subscription conformance is not feasible (would require many man-hours of work) Options: Redo the WFSRI architecture to have layered functionality WFSRI-Basic: Supports Read only access. Can be cross DBMS vendor WFSRI-Transaction: Supports WFSRI-Basic + Txn Insert. Can be cross DBMS vendor WFSRI-Subscription: Supports subscription capability in addition to WFSRI-T. Oracle implementation only! WFSRI-Hybrid: Supports WFS-T and JMS based subscription layer with no spatial and temporal subsetting for subscriptions.

Options Use GeoServer or Deegree open source WFS implementations for WFS-T and use JMS for subscriptions. WFSRI-hybrid constraints apply. Performance and other issues do exist for the open source implementation Use Oracle Express – Oracle’s free version Does not support Oracle Spatial but has a free version “Oracle Locator” Functionality equivalent to PostGIS Supports Advanced queues  can support WFSRI-Subscription but with 2D geometries only. Volumetric analysis will likely not be supported. Partitioning will not be supported Security is scaled down

References http://www.bostongis.com/PrinterFriendly.aspx?content_name=sqlserver2008_postgis_mysql_compare http://www.postgresql.org/ http://wiki.postgresql.org/wiki/Main_Page http://postgis.refractions.net/ http://wiki.postgresql.org/wiki/Performance_Optimization http://www.postgresonline.com/periodical.php?i_id=17 There is an accompanying video that also does a comparison between Oracle Spatial and PostGIS (http://blip.tv/file/2795843/) Interesting take: not one or the other but maybe both!