An open source spatial database schema and interface for the storage, representation and analysis of interdependent infrastructure networks Mr David Alderson.

Slides:



Advertisements
Similar presentations
Texas Digital Library Services Preservation Network.
Advertisements

Sensor Web, Grid Computing and Geospatial Web Services for Real Time Decision Support Sensor Web, Grid Computing and Geospatial.
21 Sep 2005LCG's R-GMA Applications R-GMA and LCG Steve Fisher & Antony Wilson.
Data Management Expert Panel - WP2. WP2 Overview.
Key-word Driven Automation Framework Shiva Kumar Soumya Dalvi May 25, 2007.
Integrate Autodesk® Topobase™ with other systems and get more value out of your data Sebastian BaumhekelClaudia Zeh Programmer/SW EngineerTechnical Consultant.
ORACLE Lecture 1: Oracle 11g Introduction & Installation.
OpenSource GIS 2004 Ottawa, Canada Building MapServer Applications with PostGIS Chris Hodgson & Paul Ramsey Refractions Research.
Graeme Scott – Technology Solution Professional Reduce Infrastructure Costs & Increase Productivity with SQL Server 2008.
Introducing FDO Toolbox Jackie Ng. Presentation Overview What is FDO? What is FDO Toolbox? Major Features of FDO Toolbox Demos.
Introduction to the UK Infrastructure Transitions Research Consortium (ITRC) David Alderson School of Civil Engineering and Geosciences Newcastle University.
Introduction to Database using Microsoft Access 2013 Part 1 November 4, 2014.
OMap By: Haitham Khateeb Yamama Dagash Under Suppervision of: Benny Daon.
Introduction to the UK Infrastructure Transitions Research Consortium (ITRC) Mr David Alderson Newcastle University 19 th July 2013.
Office of Research and Development National Exposure Research Laboratory, Atmospheric Modeling Division, Applied Modeling Research Branch October 8, 2008.
Developing Health Geographic Information Systems (HGIS) for Khorasan Province in Iran (Technical Report) S.H. Sanaei-Nejad, (MSc, PhD) Ferdowsi University.
Overview of the ODP Data Provider Sergey Sukhonosov National Oceanographic Data Centre, Russia Expert training on the Ocean Data Portal technology, Buenos.
Mobile Mapping Systems (MMS) for infrastructural monitoring and mapping are becoming more prevalent as the availability and affordability of solutions.
A National-Scale Infrastructure Database and Modelling Environment for the UK Mr David Alderson Dr Stuart Barr, Mr Craig Robson Dr Alexander Otto, Prof.
Computing for Bioinformatics Introduction to databases What is a database? Database system components Data types DBMS architectures DBMS systems available.
Overview of SQL Server Alka Arora.
Centre for Earth Systems Engineering Research Infrastructure Transitions Research Consortium (ITRC) David Alderson & Stuart Barr What is the aim of ITRC?
Ihr Logo Data Explorer - A data profiling tool. Your Logo Agenda  Introduction  Existing System  Limitations of Existing System  Proposed Solution.
MySQL GUI Administration Tools Rob Donahue Manager, Distributed Systems Development May 7th, 2001 Rob Donahue Manager, Distributed Systems Development.
Cadastre software based on Open Source in Kyrgyzstan Alexander Solovov Solution developer.
Carmen Maidantchik, Felipe Fink Grael, Kaio Karam, Kathy Pommès ATLAS detector construction/commissioning During the construction and commissioning activities,
GrIDS -- A Graph Based Intrusion Detection System For Large Networks Paper by S. Staniford-Chen et. al.
Schema Translation – OS Mastermap, but not as we know it Eddie Curtis, Snowflake Software, Greg Byrom, Richie Fyall GeoData Management Group Ordnance Survey.
Environmental Information System Framework for Pantex Plant
Introduction to Database Management. 1-2 Outline  Database characteristics  DBMS features  Architectures  Organizational roles.
I Copyright © 2004, Oracle. All rights reserved. Introduction Copyright © 2004, Oracle. All rights reserved.
Stephen Booth EPCC Stephen Booth GridSafe Overview.
WINDOWS AZURE PLATFORM ROADMAP Eric Nelson Slide 1.
NHD Products and Applications InterMountain GIS 2014 NHD Workshop April 7, 2014.
NISMOD-DB – Visualisation… Chart / Map Panel Chart Panel Control Panel.
Ensuring the delivery of secure low carbon energy David Green Chief Executive, UKBCSE.
SQL Azure Intro and What’s New Level: Introductory to Intermediate Andy Thiru SQL/BI Developer.
Patrick Revell Ordnance Survey Research
Pusan National University, Korea Joon-Seok Kim Taehoon Kim Ki-Joune Li.
Community Profiles: A Brief Overview of Transferring Technologies across Partnerships.
Exploring Spatial Data Infrastructure in an Open Source World Jacqueline Lowe UNC-Asheville National Environmental Modeling and Analysis Center Jacqueline.
The Global Land Cover Facility is sponsored by NASA and the University of Maryland.The GLCF is a founding member of the Federation of Earth Science Information.
WalkLite in Mobile GIS: A Schema to Extend and Symbolize SpatiaLite Dr. X. Chen Walkinfo Tech. Co. Ltd.
Index pgRouting on PostgreSQL Introduction Installation Template Creation and Use Topological Structure Core Features Public Transit Implementation (Application.
Dataset registration process Sergey Sukhonosov, Dr. Sergey Belov National Oceanographic Data Centre, Russia Training course on establishment of the ODP.
Implementation of a Relational Database as an Aid to Automatic Target Recognition Christopher C. Frost Computer Science Mentor: Steven Vanstone.
Multimodal Analysis Using Network Analyst. Outline Summarizing accessibility Summarizing accessibility Adding transportation modes to a network Adding.
Managing Enterprise GIS Geodatabases
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
An Open Source GIS Architecture Connected and Linked Data
Road Information System / Road Data Bank 10 April 2013 Lars Bergman M. Sc. In Civil Engineering Long Term Planning Swedish Transport Administration.
GROUP PresentsPresents. WEB CRAWLER A visualization of links in the World Wide Web Software Engineering C Semester Two Massey University - Palmerston.
Data Storage & Editing GEOG370 Instructor: Christine Erlien.
External Data Access 5/29/08. Current Problems No way to load, process & analyze live Atlas data via critical analysis & programming tools (SAS, R, Perl)
ODP V2 Data Provider overview. 22 Scope Data Provider provides access to data and metadata of the local data systems. Data Provider is a wrapper, installed.
C Copyright © 2009, Oracle. All rights reserved. Using SQL Developer.
LP – MUNICIPALITY OF PATRAS State of Implementation of project “Neighborhood Social Planning and Development” Acronym: ‘NEBSOC’ T. Roustanis Bari, 3-4/11/2014.
European Monitoring Platform for Mapping of QoS and QoE
Tools for Infrastructure System Resilience Evaluation
Taking CAD Drawings into GIS: Finally an easier way!
Efficiently Searching Schema in SQL Server
Avaya Professional Services (APS) Tools ProVision
Underground Injection Control
Mr David Alderson Dr Stuart Barr, Mr Craig Robson
What's New in eCognition 9
A gentle introduction to graph databases
QGIS, the data model, use and storage
What's New in eCognition 9
The Geodatabase : An Introduction
Presentation transcript:

An open source spatial database schema and interface for the storage, representation and analysis of interdependent infrastructure networks Mr David Alderson Dr Stuart Barr, Mr Tomas Holderness, Mr Craig Robson, Mr Alistair Ford ITRC Early Career Researcher Conference Clare College, Cambridge University 27 th November 2012

Overview Background Technology Schema Interface Applications Future steps… Summary Contacts and Links National Grid Gas National Grid Electricity

Background Store, model, represent and analyse various regional and national-scale spatial networks Robust storage solution for multi-scale data and networks Creation of attributed networks Represent dependencies Access to graph-theory based analyses and tools Combination of stable open source packages to provide solution for multiple network modelling tasks UK infrastructure networks Failure Link to other Newcastle

Technology Database PostgreSQL + spatial extension PostGIS pgAdmin – admin + backup PostgreSQL Procedural Language functions (PL/pgSQL) Python-compatible drivers SQL or.bat installers Python Wrapper Python (2.6.5+) GDAL + OGR NetworkX Python wrapper Spatial database Spatial database nx_pg nx_pgnet NetworkX

Database schema - introduction Tables Graphs Nodes Edges / Edge_Geometry Global Interdependency Interdependency / Interdependency_Edges

Database schema – functions Administrative functions: Create network tables Export to Gephi-compatible format, YAML, GraphML, GML, CSV Pre-processing functions: Connect a node to the nearest point on an edge based on an attribute matching Link node A and node B by an attribute Find the nearest point on each line segment to every node Connect edge end points to node Connect closest point along line segment Find junctions

Database schema – an example National Grid Electricity National Grid Gas Dependent / Interdependent links Initial interdependencies to consider 1 : Physical Geographic 1) Rinaldi, S.M., et al (2001) - Identifying, Understand and Analyzing Critical Infrastructure Interdependencies

The database – an example

The Python interface- overview Link PostGIS and NetworkX Modules provide read/write functions Single + Bulk feature upload Database connections db_conn = ogr.Open("PG: host=’localhost’ dbname=’a_spatial_database’ user=’postgres’ password=’password’") Build and store the topological network network = nx_pg.read_pg(lines, points) nx_pgnet.write(db_conn).pg_net(network)

Example – build a rail network Define input data in PostGIS OS Meridian 2 Rail Line, Stations Find junctions Link with stations Build network Data: Nodes: 7995 Stations: 2526 Junctions: 1416 Edges: 8484 Read->Build->Store~ 40s

TFL tube stations Substations Application – Modelling failure Understanding dependencies between transport (rail) and power supply Tube network: 466 edges, 437 nodes Power network: 119 edges, 99 nodes Compares two methods of simulating a targeted attack on substations Betweenness and degree recalculated on each iteration

Application – Modelling failure Degree: attacks on substations based upon degree: greater impact on tube network alone Betweenness: attacks on substations based upon betweenness: targetted attack using betweenness is more “effective” than using degree

Future steps… Continue UK infrastructure network construction Integration with other network modelling RESNET (Richard Dawson, Gaihua Newcastle) Distinction between schema and Python Extend to other databases Spatialite, MySQL, MS SQL Server Requires distinct Python drivers Future code release – GitHub Potential to look at “NO-SQL” OpenFlights UK Air

Summary Multiple spatial network modelling challenges Creation of a network data schema using open source tools Tools form part of a wider, open-source modelling framework Open source generalised transport cost model Regional and national-scale infrastructure network creation Representing infrastructure interdependencies Begin to investigate failure propagation Ordnance Survey Meridian 2 Road Network: A Roads ( edges) B Roads (81712 edges) Motorways (3837 edges) Roundabouts+ ( nodes)

More information… School of Civil Engineering and Geosciences, Newcastle University ( Centre for Earth Systems Newcastle ( Geospatial Engineering Newcastle ( New site: Geospatial Newcastle Blog ( blogs.ncl.ac.uk/geospatialengineering )

Thank you.