OGC Web Processing Service 2.0 SWG Insights from last TC OGC Yves Coene, Spacebel s.a. Arnaud Cauchy, EADS Astrium Frascati – 23rd January 2013 Session 4: State of the art technology and standards, 12/10/2012

Insights from last TC OGC - Agenda Asynchronous execution model in OGC WPS2.0 - draft WPS-T(ransactional) – automatic deployment Session 4: State of the art technology and standards, 12/10/2012

Asynchronous Model Asynchronous Execution in WPS2.0 Session 4: State of the art technology and standards, 12/10/2012

Copyright © 2012 Open Geospatial Consortium Contexte & Rational Contexte: CR09-109 – methods for controlling, and checking the status of asynchronous process. CR10-200 - Addendum to CR 09-109 Rational usage of statusLocation attribute to return Process Instance Identifier URN Execute operation asynch or synch by nature Distinction between Process Identifier and Process Instance Identifier. Addendum : A proposal to complete CR09-109 Copyright © 2012 Open Geospatial Consortium

Copyright © 2012 Open Geospatial Consortium First Proposal - CR09-109 WPS Client WPS Server GetCapabilities GetCapabilities Identifier, Union of supports{} DescribeProcess Identifier DescribeProcess Identifier, supports{} Execute Identifier Execute statusLocation = Process Instance Identifier URN Abort Pause/Resume GetStatus processIdentifier = Process Instance Identifier URN Abort Pause/Resume GetStatus statusLocation= Process Instance Identifier URN Copyright © 2012 Open Geospatial Consortium

Copyright © 2012 Open Geospatial Consortium Latest Version WPS Client WPS Server GetCapabilities GetCapabilities Identifier, Union of supports{} DescribeProcess Identifier DescribeProcess Identifier, asynchSupported, [asynchSupports{}] Execute Identifier, [asynchMode] Execute ProcessInstanceIdentifier = Process Instance Identifier URN statusLocation = ExecuteResponse document URL Abort Pause/Resume GetStatus ProcessInstanceIdentifier = Process Instance Identifier URN Abort Pause/Resume GetStatus ProcessInstanceIdentifier = Process Instance Identifier URN statusLocation = ExecuteResponse document URL Copyright © 2012 Open Geospatial Consortium

Example of the ResponseDocument Example of Status element in ResponseDocument <wps:ExecuteResponse […] service="WPS" version="1.0.0" xml:lang="en-CA" serviceInstance=http://foo.bar/foo statusLocation="http://foo.bar/execute_response_url.xml"> […] <wps:Process wps:processVersion="1.0"> <ows:Identifier>RunTraj</ows:Identifier> <ows:Title>BADC Trajectory Service</ows:Title> </wps:Process> <wps:Status processInstanceIdentifier= “cb1557397169547d63c2d1388e8dd810” creationTime="2009-05-29T13:00:03.0Z" > <wps:ProcessTerminated terminationTime="2009-05-29T14:00:03.0Z"/> </wps:Status> <wps:ProcessOutputs> […] </wps:ProcessOutputs> </wps:ExecuteResponse> Copyright © 2012 Open Geospatial Consortium

Evolution of the asynchronous interface CR09-109 Addendum Proposal Execute Query No change asynchMode (O – Boolean). Request an execution either in synch.or asynch mode. Response Reuse statusLocation to store ProcessInstanceIdentifier ProcessInstanceIdentifier attribute statusLocation unchanged Abort/Pause/Resume/GetStatus ProcessIdentifier <ows:Identifier> URN from statusLocation Identifier attribute in processInstance element. revised version of WPS Execute response <ows:Identifier> URN from statusLocation processInstanceIdentifier new attribute in wps:Status element of the ResponseDocument DescribeProcess Support (M - List) – list of supported operation. If empty, asynchronous not supported asynchSupported (M - Boolean) asynchSupports (C – 1..n) list of supported operations GetCapabilities Union of supported asynch operation s No change Information in ProcessBrief Copyright © 2012 Open Geospatial Consortium

In summary Focus on asynchronous execution and instance control. Update of the Core plus Asynchronous extension Core execModelSupported: synchOnly asynchOnly synchAndAsynch Optional Default: synchOnly Ext. Asynch Control Session 4: State of the art technology and standards, 12/10/2012

WPS-T(ransactional) Automatic Deployment of web processes The ESA GSTP DREAM use case WPS-T(ransactional) Session 4: State of the art technology and standards, 12/10/2012

ESA GSTP DREAM Project GSTP General Support Technology Program in the frame of Earth Observation Program DREAM Decision Support and Real Time EO Data Management Duration 24 months, 2 Phases KO: January 2012 - Consortium of 14 actors Objectives – extract Define and prototype an end-to-end solution/system […] taking into account available infrastructure within EUSC and EMSA and the ESA PDGS […] Integrate novel and state-of-the art technologies […] available for EO data identification and EO data provision […] Copyright © 2013 Open Geospatial Consortium

Prototype for Ortho-imagery Quality Features: On-demand service to Assess the quality of an ortho-image, including Positional Accuracy Improve the position accuracy of an ortho-image In the context of multi-mission supports: multiple sensors How the data quality is illustrated in the client Shifts - vector layer Quality Mask – raster coverage Ortho-image to assess Copyright © 2013 Open Geospatial Consortium

The issue Data to process are here Reference Data are here Processes are here Ortho Raw Acquisition ESA/EUSC Cloud On-line Photogrammetry Web Services Ortho-rectification Ortho-image quality assessment Ref3D ASV GEO Infrastructure Copyright © 2013 Open Geospatial Consortium

Typical Approach – WPS – WCS/WFS Chaining According EO dataset size Download time is in hour (Pleiade scene up to 33 Gb) Execute request ProcessId=MyProcess Input=Data URL Ortho Raw Acquisition ESA/EUSC Cloud WCS WCS GetCoverage Gb On-line Photogrammetry Web Services Ortho-rectification Ortho-image quality assessment Ref3D Too big and/or forbidden to transfer ASV GEO Infrastructure Copyright © 2013 Open Geospatial Consortium

Tested solution in the prototype Raw Acquisition Ortho Cloud Processing Proxy On-line Photogrammetry Web Services Ortho-rectification Ortho-image quality assessment Ref3D ESA/EUSC Cloud ASV GEO Infrastructure Copyright © 2013 Open Geospatial Consortium

Architecture – Web Services On-line Photogrammetry Web Services Compute AOI WPS Processing Ref3D Database Reference Orthoimages DEM Compute RPC WPS Processing OGC WPS Compute Quality WPS Processing OGC WMS Raw Acquisition Ortho Cloud Processing Proxy On-line Photogrammetry Web Services Ortho-rectification Ortho-image quality assessment Ref3D ESA/EUSC Cloud ASV GEO Infrastructure Copyright © 2013 Open Geospatial Consortium

Architecture – Processing Proxy Cloud Processing Proxy OGC WPS Client OrthoRectify WPS Process AssessQuality Raw Image Handler Ortho-Image Producer OGC WPS Raw Acquisition Ortho Cloud Processing Proxy On-line Photogrammetry Web Services Ortho-rectification Ortho-image quality assessment Ref3D ESA/EUSC Cloud ASV GEO Infrastructure Copyright © 2013 Open Geospatial Consortium

Collaborative Processing in motion Cloud Processing Proxy On-line Photogrammetry Web Services OGC WMS OGC WPS OGC WMS OGC WPS Compute AOI WPS Processing Reference Orthoimages DEM (Ref3D) OrthoRectify WPS Process WPS Client Raw Image Handler Compute RPC WPS Processing Ortho-Image Producer AssessQuality WPS Process Compute Quality WPS Processing Mutliple Senors Raw Acquisitions Ortho-images Copyright © 2013 Open Geospatial Consortium

Collaborative Processing in motion Cloud Processing Proxy On-line Photogrammetry Web Services OGC WMS OGC WPS OGC WMS OGC WPS Compute AOI WPS Processing Reference Orthoimages DEM (Ref3D) OrthoRectify WPS Process WPS Client Raw Image Handler Compute RPC WPS Processing Ortho-Image Producer AssessQuality WPS Process Compute Quality WPS Processing Mutliple Senors Raw Acquisitions Ortho-images Copyright © 2013 Open Geospatial Consortium

Use Case for WPS-T Execute request ProcessId=MyProcess Input=MyData URL ResponseDocument Output = Result URL Proxy WPS Add Process Execute WPS Server Data Cloud Del Process Proxy Process Proxy Process Processing Cloud Copyright © 2013 Open Geospatial Consortium

Use Case for WPS-T Result URL Result URL WPS WPS Server Proxy Process Data Cloud Proxy Process Proxy Process Processing Cloud Copyright © 2013 Open Geospatial Consortium

Summary of WPS-T WPS-T: deployment and undeployment Note: TransactionMonitor(action={add, update, del}, process) ESA GSTP DREAM – Quality Assessment Service WPS based with mobile code as a use case for WPS-T Session 4: State of the art technology and standards, 12/10/2012

Thank You Q&A Session 4: State of the art technology and standards, 12/10/2012