Managing and communicating uncertainty in geospatial web service workflows Richard Jones, Dan Cornford, Lucy Bastin, Matthew Williams Computer Science,

Slides:



Advertisements
Similar presentations
Page 1 CSISS LCenter for Spatial Information Science and Systems 03/19/2008 GeoBrain BPELPower Workflow Engine Liping Di, Genong Yu Center.
Advertisements

Agenda Session (75 minutes duration, Friday sessions are 90 minutes) Co-lead introduces the session (5 minutes) –repeat of one chart from opening plenary.
ESA Data Integration Application Open Grid Services for Earth Observation Luigi Fusco, Pedro Gonçalves.
Semantically-Assisted Geospatial Workflow Design Gobe Hobona, David Fairbairn, Philip James ACM GIS – 8 th November Seattle.
1 Intention of slide set Inform WSMOLX of what is planned for Choreography & Orhestration in DIP CONTENTS Terminology Clarification / what will be described.
Principles of Personalisation of Service Discovery Electronics and Computer Science, University of Southampton myGrid UK e-Science Project Juri Papay,
BiodiversityWorld GRID Workshop NeSC, Edinburgh – 30 June and 1 July 2005 Resource wrappers, web services, grid services Jaspreet Singh School of Computer.
UNCERTML - DESCRIBING AND COMMUNICATING UNCERTAINTY Matthew Williams
Funded by: © AHDS Sherpa DP – a Technical Architecture for a Disaggregated Preservation Service Mark Hedges Arts and Humanities Data Service King’s College.
1 Richard White Design decisions: architecture 1 July 2005 BiodiversityWorld Grid Workshop NeSC, Edinburgh, 30 June - 1 July 2005 Design decisions: architecture.
6/11/2015Page 1 Web Services-based Distributed System B. Ramamurthy.
1 An Introduction to OGSA-DAI Konstantinos Karasavvas 13 th September 2005.
Web-Enabling the Warehouse Chapter 16. Benefits of Web-Enabling a Data Warehouse Better-informed decision making Lower costs of deployment and management.
Processing of structured documents Spring 2003, Part 6 Helena Ahonen-Myka.
Graphical Modelling of Workflows: Foundation for Handling Uncertainty in the Model Web 76th OGC Technical Committee Bonn, Germany Benjamin Proß, IfGI/52°North.
1 1 Interoperating: MIT’s Fusion Center Prototype & JHU/APL’s Back End Attribute Exchange (Identity Management Testbed) January 2013.
Page 1 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Briefing on Open Geospatial Consortium (OGC)’s Web Services (OWS) Initiative.
Ontology-derived Activity Components for Composing Travel Web Services Matthias Flügge Diana Tourtchaninova
Jonas Eberle3rd June Process chaining capabilities based on OGC Web Processing Services Jonas Eberle, Anna Homolka Friedrich-Schiller-University.
Updating and Improving the INTAMAP web service Madhu Rani 2012 Intern 1.
THEME[ENV ]: Inter-operable integration of shared Earth Observation in the Global Context Duration: Sept. 1, 2011 – Aug. 31, 2014 Total EC.
XForms: A case study Rajiv Shivane & Pavitar Singh.
Adapting Legacy Computational Software for XMSF 1 © 2003 White & Pullen, GMU03F-SIW-112 Adapting Legacy Computational Software for XMSF Elizabeth L. White.
C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.
WPS Application Patterns at the Workshop “Models For Scientific Exploitation Of EO Data” ESRIN, October 2012 Albert Remke & Daniel Nüst 52°North Initiative.
T Network Application Frameworks and XML Web Services and WSDL Sasu Tarkoma Based on slides by Pekka Nikander.
THEME[ENV ]: Inter-operable integration of shared Earth Observation in the Global Context Duration: Sept. 1, 2011 – Aug. 31, 2014 Total EC.
EMBRACE Web Services Taavi Hupponen CSC – Center for Scientific Computing, Finland BOSC 2007.
1 OPeNDAP/ECHO Demo Integrating and Chaining services September, 2006 CEOS WGISS 22 Annapolis, MD.
International Telecommunication Union Geneva, 9(pm)-10 February 2009 ITU-T Security Standardization on Mobile Web Services Lee, Jae Seung Special Fellow,
Grid-enabling OGC Web Services Andrew Woolf, Arif Shaon STFC e-Science Centre Rutherford Appleton Lab.
Privacy issues in integrating R environment in scientific workflows Dr. Zhiming Zhao University of Amsterdam Virtual Laboratory for e-Science Privacy issues.
© DATAMAT S.p.A. – Giuseppe Avellino, Stefano Beco, Barbara Cantalupo, Andrea Cavallini A Semantic Workflow Authoring Tool for Programming Grids.
Digital Earth Communities GEOSS Interoperability for Weather Ocean and Water GEOSS Common Infrastructure Evolution Roberto Cossu ESA
Interoperability between Scientific Workflows Ahmed Alqaoud, Ian Taylor, and Andrew Jones Cardiff University 10/09/2008.
Web Services interoperability and standards. Infrastructure Challenge ● Applied bioinformatics need various computer resources ● The amount and size of.
UNCERTML - DESCRIBING AND COMMUNICATING UNCERTAINTY WITHIN THE (SEMANTIC) WEB Matthew Williams
Wrapping Scientific Applications As Web Services Using The Opal Toolkit Wrapping Scientific Applications As Web Services Using The Opal Toolkit Sriram.
Max Craglia (JRC) and Stefano Nativi (CNR) FP7-ENV-2011 Planning Meeting 24 September 2010, GEO Secretariat Outcome of EuroGEOSS Multi-disciplinary Interoperability:
Technology behind using Taverna in caGrid caGrid user meeting Stian Soiland-Reyes, myGrid University of Manchester, UK
State Key Laboratory of Resources and Environmental Information System China Integration of Grid Service and Web Processing Service Gao Ang State Key Laboratory.
Open Source Tools for Uncertainty Enabling the Model Web Benjamin Proß University of Münster FOSS4G, Denver, Sept 2011.
RSISIPL1 SERVICE ORIENTED ARCHITECTURE (SOA) By Pavan By Pavan.
S imple O bject A ccess P rotocol Karthikeyan Chandrasekaran & Nandakumar Padmanabhan.
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
Introduction Geospatial users workflow and needs Problem and research goals Contribution Publication Service: GEOSS Service Factory Prototype assessment.
Data Integration in Bioinformatics Using OGSA-DAI The BioDA Project Shirley Crompton, Brian Matthews (CCLRC) Alex Gray, Andrew Jones, Richard White (Cardiff.
A Cyberinfrastructure Framework for Discovery, Integration, and Analysis of Earth Science Data A Prototype System A. K. Sinha, Z. Malik, A. Rezgui, A.
Geoinformatics 2006 A Virtual Data Product Toolkit Based on Geospatial Web Service Orchestration Peisheng Zhao, Liping Di, Yaxing Wei Center for Spatial.
SEcurE access to GEOspatial services OGC-OGF Collaboration workshop Open Grid Forum 21 (OGF21) October, 2007 Chris Higgins (EDINA, University of Edinburgh)
Introduction to Web Services Presented by Sarath Chandra Dorbala.
Open Grid Services for Earth Observation Pedro Gonçalves.
Example projects using metadata and thesauri: the Biodiversity World Project Richard White Cardiff University, UK
EGEE is a project funded by the European Union under contract IST Introduction to Web Services 3 – 4 June
Semantics in Web Service Composition for Risk Management Michael Lutz European Commission – DG Joint Research Centre Ispra, Italy EcoTerm IV, Vienna,
W3C Multimodal Interaction Activities Deborah A. Dahl August 9, 2006.
DEVELOPING WEB SERVICES WITH JAVA DESIGN WEB SERVICE ENDPOINT.
GEOSS Architecture Implementation Pilot AIP-3 Engineering Use Cases Nadine Alameh & Josh Lieberman AIP-3 kickoff Frascati, Italy March
HMA-T Progress Meeting 26 November 2008 Slide 1 IMAA-CNR activity report HMA-T Progress Meeting 26 November 2008 S. Nativi, E. Boldrini, F. Papeschi IMAA-CNR.
Added Value to XForms by Web Services Supporting XML Protocols Elina Vartiainen Timo-Pekka Viljamaa T Research Seminar on Digital Media Autumn.
A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.
Overview on the work performed during EPIKH Training Faiza MEDJEK /INFN, CATANIA 1.
WEB SERVICES.
The GEMBus Architecture and Core Components
Unit – 5 JAVA Web Services
Chapter 9 Web Services: JAX-RPC, WSDL, XML Schema, and SOAP
Quoting and Billing: Commercialization of Big Data Analytics
Grid Systems: What do we need from web service standards?
4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy
Scientific Workflows Lecture 15
Presentation transcript:

Managing and communicating uncertainty in geospatial web service workflows Richard Jones, Dan Cornford, Lucy Bastin, Matthew Williams Computer Science, Aston University, Birmingham, United Kingdom Workshop on Workflows for Earth Observation Systems, Nottingham

The UncertWeb concept The “model web”. When chaining services of limited or unknown quality, uncertainty must be accounted for if rational decisions are to be made. “UncertWeb develops mechanisms, standards, tools and test-beds for accountable uncertainty propagation in web service chains.”

Uncertainty quantification Even more important when considering service chains. Quantification achieved by: – Standards for representing and communicating uncertainty. – Adding uncertain inputs and outputs to existing services. – Developing tools to assist users with uncertainty management. Computational issues will be non-trivial too!

UncertWeb and UncertML Standards for coupling models under uncertainty. – Develops UncertML to provide complete probabilistic model for uncertainty, and consider other (e.g. Fuzzy, Bayes Linear) representations. – Provide an API for using UncertML. – Take UncertML through the standardisation process (where? OGC?, W3C?, IETF?). Still some thinking to do as to whether UncertML should deal with encoding and / or be a controlled vocabulary.

Chaining UncertWeb services Chaining and discovery services under uncertainty. – Extend existing interoperable services to permit their use in the uncertainty-enabled model web. – Implement a framework for uncertainty-enabled model web services. – Develop uncertainty-enabled OGC Web Services. One concern is whether to stick to OGC services or move to standard W3C WS.

A prototype UncertWeb chain Convert a pressure measurement to sea level: Uncertainty is present in the elevation samples, the interpolation, and parameters in the conversion calculation. Monte Carlo used for uncertainty propagation.

A prototype UncertWeb chain

Output screenshots taken from web demo. Available at:

Uncertainty enabled services All intermediate services conform to the WPS standard. Current OWS do not explicitly support uncertainty. – Some recognition in metadata: quality. Uncertainty types encoded using UncertML, then used as WPS inputs and outputs. UncertWeb will develop profiles of WPS, SOS, CSW and WCS and produce implementations of these that can work with uncertain inputs and outputs. – Intention is to restrict what can be communicated to make it easier to interoperate within uncertainty-enabled services.

Introduction to BPEL Can specify peer-to-peer interaction between a number of services. Interactions for a workflow are specified in an XML-based script. Script deployed remotely on an orchestration engine. The chain is then exposed and can be consumed in a stateless manner.

BPEL advantages Orchestration takes place on a server, data does not need to pass through client. Deployed workflow available as a service. Workflow complexity is hidden to the consumer. Reproducibility supported as BPEL scripts define interactions completely.

Chaining under uncertainty? Issues raised by prototype: – WPS specification is vague on how WSDL and SOAP can be integrated into services, making the use of WPS with BPEL non-trivial. Can wrap standard requests with SOAP. Generic WSDL document can be used. – Chain creation difficult as there is a need for predefined execute documents. – Exceptions are difficult to catch. – Services accepting different types (of uncertainty) require an intermediate translation service. – Methods for propagation will be complex.

Other workflow tools In addition to BPEL, other tools are available for creating and orchestrating scientific workflows, with Taverna and Kepler being the most widely used. These tools differ from BPEL, as chains are orchestrated locally, and they provide a rich graphical user interface.

Other workflow tools However, they still suffer from problems due to the lack of detail on support for web service standards in the WPS specification. Suitability for the scenario: – Chains aren’t available as services. – Orchestration mainly done locally. – Generic WSDL documents for WPS make use difficult.

Applying UncertWeb Mechanisms applied to several use cases. Use cases for uncertainty propagation. – Biodiversity and climate change (links to EuroGEOSS). – Land-use response to climatic and economic change. – Short term uncertainty-enabled forecasts for local air quality. – Individual activity in the environment.

The future of UncertWeb UncertWeb only started 4 months ago. – Already have prototypes that demonstrate what can be achieved. Many challenges still to face. – Semantics, performance, standards (UncertML), user acceptance... Enhanced WPS with automatic generation of WSDL with fully-specified operations and message formats. – Ease service consumption. – Support BPEL graphical clients, Taverna and Kepler.

Summary BPEL was deemed suitable to orchestrate this uncertainty-enabled workflow. – Next challenge is taking these mechanisms to complex models and making workflow creation more accessible. UncertWeb will develop standards, profiles and implementations to create the uncertainty enabled model web. The research leading to these results has received funding from the European Union Seventh Framework Programme (FP7/ ) under grant agreement n° [248488].