Workflow Enactment of Grid-Enabled Geospatial Web Services Gobe Hobona, David Fairbairn, Philip James UK e-Science All Hands Meeting - 12 th September.

Slides:



Advertisements
Similar presentations
Workflow Enactment of Grid-Enabled Geospatial Web Services
Advertisements

GEO AIP-2 Interim Design Review Test Facility Working Group Mauro Semerano (ElsagDatamat spa) ESA December 2008.
Page 1 CSISS LCenter for Spatial Information Science and Systems 03/19/2008 GeoBrain BPELPower Workflow Engine Liping Di, Genong Yu Center.
Agenda Session (75 minutes duration, Friday sessions are 90 minutes) Co-lead introduces the session (5 minutes) –repeat of one chart from opening plenary.
1 Service composition Roberto Lucchi joint work with Anders Friis-Christensen, Michael Lutz and Nicole Ostlaender European Commission – DG Joint Research.
Sensor Web, Grid Computing and Geospatial Web Services for Real Time Decision Support Sensor Web, Grid Computing and Geospatial.
® Copyright © 2009, Open Geospatial Consortium, Inc., All Rights Reserved. OWS-6 Grid Computing Activities Bastian Baranski Institute for Geoinformatics.
SEcurE access to GEOspatial services OGC-OGF Collaboration workshop Open Grid Forum 22 (OGF22) February, 2007 Chris Higgins (EDINA, University of Edinburgh)
Christopher Kunz | OGF28 | March 16th, 2010 GDI-Grid: The State of Affairs.
The Next Generation Network Enabled Weather (NNEW) SWIM Application Asia/Pacific AMHS/SWIM Workshop Chaing Mai, Thailand March 5-7, 2012 Tom McParland,
Experiences with Converting my Grid Web Services to Grid Services Savas Parastatidis & Paul Watson
The National Grid Service and OGSA-DAI Mike Mineter
INFSO-RI Enabling Grids for E-sciencE EGEE and the National Grid Service Mike Mineter
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
Spatial Data e-Infrastructure UK e-Science ALL HANDS MEETING September, Edinburgh, UK Higgins, C., Koutroumpas, M., Sinnott, R.O., Watt, J.,
Semantically-Assisted Geospatial Workflow Design Gobe Hobona, David Fairbairn, Philip James ACM GIS – 8 th November Seattle.
Advanced Information Systems Laboratory Department of Computer Science and Systems Engineering Müesteraner GI-Tage 03 GIS COTS.
GeoServer and OpenGeo –Chris Holmes. Geospatial Web Server –vector and raster data Open standards –WFS –WMS –WCS Gateway to the “GeoWeb” What is GeoServer?
Proposed update of Technical Guidance for INSPIRE Download services based on SOS Matthes Rieke, Dr. Albert Remke (m.rieke, 52°North.
INSPIRE Service Architecture
Copyright Information Here Junaid Arshad 1, Wei Jie 2, Andy Turner 1 University of Leeds 1, University of Manchester 2, UK Securing.
SAN DIEGO SUPERCOMPUTER CENTER Choonhan Youn Viswanath Nandigam, Nancy Wilkins-Diehr, Chaitan Baru San Diego Supercomputer Center, University of California,
WPS Application Development of geospatial web application for site selection for artificial recharge of groundwater CSIR-National Environmental Engineering.
Integrating SOA and the Application Development Framework Shaun O’Brien Principal Product Manager – Oracle JDeveloper / ADF.
Implementation of a Data Node in China's Spatial Information Grid Based on NWGISS Dengrong Zhang, Le Yu, Liping Di Institute of Spatial.
Nov Copyright Galdos Systems Inc. November 2001 Geography Markup Language Enabling the Geo-spatial Web.
RepoMMan Workflow for Fedora Aberystwyth October 2005 Robert Sherratt Richard Green Funded by the JISC Digital Repositories Programme.
Planned Title: Review of Evaluation of Geospatial Search Allan Doyle.
Grid Programming Environment (GPE) Grid Summer School, July 28, 2004 Ralf Ratering Intel - Parallel and Distributed Solutions Division (PDSD)
Nov Copyright Galdos Systems Inc. November 2001 Impact of GML on Data Development.
Semantic Mediation & OWS 8 Glenn Guempel
Charlie Crocker Vice President Farallon Geographics, Inc. An Overview of Internet Mapping Technology.
OGC Liaison Report WGISS-20 Allan Doyle, EOGEO
A Global Agriculture Drought Monitoring and Forecasting System (GADMFS) Meixia Deng and Liping Di.
Page 1 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Briefing on Open Geospatial Consortium (OGC)’s Web Services (OWS) Initiative.
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
Interoperability ERRA System.
© Crown copyright 2007 OGC MDWG Meteorology Domain Working Group Chris Little
Ign.fr 23/06/2014. ign.fr THE FRENCH GEOPORTAL GI STANDARDS APPROACH 23/06/2014.
Module 14: WCF Send Adapters. Overview Lesson 1: Introduction to WCF Send Adapters Lesson 2: Consuming a Web Service Lesson 3: Consuming Services from.
An Introduction To Building An Open Standard Web Map Application Joe Daigneau Pennsylvania State University.
The OpenGIS Consortium Geog 516 Presentation #2 Rueben Schulz March 2004.
Recent Advances in Geospatial Service Chaining Open Standards 2008 Composability within SOA Symposium April, 2008 Raj Singh, PhD OGC Director of Interoperability.
Jean François Doyon Tom Kralidis June 2003 Services Overview.
Orchestration of an OGSI-enabled scientific application using the Business Process Execution Language Ben Butchart Wolfgang Emmerich University College.
The Open Source Spatial Services Kit: Lowering the Cost of Deploying Services on the Geo-Web Presented by Ben Lewis Advanced Technology Solutions, Inc.
The ACGT Workflow Editing & Enactment Environment Giorgos Zacharioudakis Institute of Computer Science, Foundation for Research & Technology – Hellas (ICS-FORTH)
OGC/Grid activities in UK Chris Higgins (EDINA), Phil James (Uni of Newcastle), Andrew Woolf (CCLRC)
Managing and communicating uncertainty in geospatial web service workflows Richard Jones, Dan Cornford, Lucy Bastin, Matthew Williams Computer Science,
® © 2012 Open Geospatial Consortium Overview of Climate-Hydrologic Information Sharing Pilot (CHISP) to the OGC HDWG Lew Leinenweber Director, Interoperability.
Wrapping Scientific Applications As Web Services Using The Opal Toolkit Wrapping Scientific Applications As Web Services Using The Opal Toolkit Sriram.
Mapping, Data Dissemination, The Web & Interoperability Deborah Lee Soltesz and Trent Hare.
Service Composition for GIS Sai Ma, Minruo Li, Weichang Du Faculty of Computer Science, University of New Brunswick, Canada 2008 IEEE Congress on Services.
An open software framework for Web Service-based geo- processes Theodor Foerster FOSS4G 2006 – Lausanne, Switzerland.
Accessing and Using Fire-Related Data with the CAPITA DataFed.net* Services Framework Stefan Falke Rudolf Husar Kari Hoijarvi Washington University in.
RSISIPL1 SERVICE ORIENTED ARCHITECTURE (SOA) By Pavan By Pavan.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE User Forum, Manchester, 10 May ‘07 Nicola Venuti
EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.
GeoServer: Past, Present, Future Justin Deoliveira.
UK Climate Projections User Interface Centre for Environmental Data Archival RAL, UK Stephen Pascoe, Ag Stephens,
1 MESSAGE EXCHANGE FOR Web Service-Based Mapping Services AHMET SAYAR INDIANA UNIVERSITY COMMUNITY GRIDS LAB. COMPUTER SCIENCE DEPARTMENT August 17, 2005.
Open Geospatial Consortium Overview and why we are adopting the standards.
Development of Semantically Aware Workflow Engines for GEOspatial Web Service Orchestration Open Grid Forum 20 (OGF20) 7 th May, 2007 Gobe Hobona (University.
52°North WPS. 52°North WPS Agenda  Motivation  WPS basics  behind the scences look  new features.
GeoServer Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
Page 1Overview of the HMA Project, 8 March 2010 Overview of the HMA Project OGC TC Opening Plenary Pier Giorgio Marchetti European Space Agency.
ECMWF 24 th November 2008 Deploying secure OGC services in front of a heterogeneous data archive. Bryan Lawrence, Phil Kershaw, Dominic Lowe, and Stephen.
ESRIN, 15 July 2009 Slide 1 Web Service Security support in the SSE Toolbox HMA-T Phase 2 FP 14 December 2009 S. Gianfranceschi, Intecs.
OGC Testbed 13 Outcomes and Information on the OGC Testbed 14
Grid Systems: What do we need from web service standards?
Presentation transcript:

Workflow Enactment of Grid-Enabled Geospatial Web Services Gobe Hobona, David Fairbairn, Philip James UK e-Science All Hands Meeting - 12 th September Nottingham

Overview Background OGC Web Services Workflow Enactment SAW-GEO Architecture User interface – Geoportal Conclusions

Background Open Geospatial Consortium (OGC) ISO19119 and OGSA JISC Grid/OGC Collision Programme Security : SEE-GEO Workflow : SAW-GEO OGC Interoperability Experiments (OWS-4)

OGC Web Services Web Feature Services (WFS) Disseminates vector geospatial data Web Map Services (WMS) Generates geovisualisations/maps from any geo-data source Web Coverage Services (WCS) Disseminates raster geospatial data Web Processing Services (WPS) Runs geocomputational models or geospatial operations on user-supplied datasets

Sample OWS Request Messages <wfs:GetFeature service="WFS" version="1.0.0" outputFormat="GML2" xmlns:topp=" xmlns:wfs=" xmlns:ogc=" xmlns:gml=" xmlns:xsi=" xsi:schemaLocation=" topp:STATE_NAME topp:PERSONS the_geom , , <GetCoverage service="WCS" version="1.0.0" xmlns=" xmlns:nurc=" xmlns:ogc=" xmlns:gml=" xmlns:xsi=" xsi:schemaLocation=" nurc:Arc_Sample ….. 1 EPSG:4326 EPSG:32626 TIFF

Sample OWS Response Messages … , , …… , , , , Pennsylvania E7 …. NCOLS 522 NROWS 300 XLLCENTER YLLCENTER CELLSIZE E-4 NODATA_VALUE

Grid-enabling OWS SOAP-based proxy service Created from OGC XML schemas (XSD) Requests create temporary datasets Resource management at two levels Temporary datasets managed by proxy service Persistent data managed through OWS e.g. WFS-T Security limitations OWS currently do not offer message encryption Approach to wrap OWS in firewall and allow external access only through proxy service

Geospatial Data is Very Large Vector data Thousands of coordinates Multiple dimensions Raster data Thousands of pixels (very high resolution) Multispectral imagery (200+ band imagery) Solution Pass data by URL references and get client to stream data in

Load Experiment

Workflow Enactment Recognised by both ISO19119 and OGSA Several options for workflow enactment SCUFL, BPEL, Keppler etc Selected BPEL because OASIS Standard, i.e. WS-BPEL 2.0 Multi-vendor support including IBM, Sun Microsystems, ActiveEndpoints, Oracle etc Availability of open source enactors

WS-BPEL Overview Based on Activities Basic or Structured Variables Declaration Assignment Conditionals Loops Fault handlers

An Example Geospatial Workflow Based on OGC OWS-4 GeoProcessing Workflow Scenario client Workflow Enactor WPS 1 Generalise WPS 2 Clip WFS

Possible Applications for Geo-Workflows Emergency Management Where each activity depends on the result of a previous activity Geographic modelling Where several steps are needed before a final model is produced e.g. ESRI Model Builder Climate Change scenarios Where a number of possible routes for workflows are possible depending on the state of certain variables

Components Geoserver 52North WPS ActiveBPEL Open Source Engine Globus Toolkit (GT4) …or Apache Axis 2

SAW-GEO Architecture

Geoportal User Browser-based BPEL Upload Hot deployment AJAX-based SOAP client Workflow Monitoring ActiveBPEL Admin Console Offers views of deployed processes Exports a list of available services to the SOAP client as XML Red font: Developed for SAW-GEO

ActiveBPEL Workflow Engine

Discussion Importing OGC XSD into SOAP services offered high interoperability However, variations in how tiers interpreted the XSD varying namespaces cyclic imports Necessary to throw faults at SOAP tier from faults at OGC tiers, because BPEL can handle SOAP faults Variations in GML between workflow nodes, potentially requiring shim services when chaining OWS

Conclusions SOAP wrappers needed for Grid-enabling OGC web services OGC XSD appropriate for creating SOAP wrappers Geospatial data best passed through URL references to avoid overwhelming the workflow enactor BPEL can support Grid-enabled OGC web services

Future Work Experimental deployment on the Belfast e-Science Centre (BeSC) DEBUT system Investigate deployment on upcoming NGS GT4 infrastructure User Evaluation (November-December 2007) Volunteers needed – Please register on the website Integration with SEE-GEO