EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE User Forum, Manchester, 10 May ‘07 Nicola Venuti A-WARE AWA RE A-WARE An easy Way to Access GRID REsources

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 2 Agenda Overview: Goals & Challenges Architecture Standards Technologies Workflow Life Cycle

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 3 Project Goals Simplify users’ –life (focus on problems) –way of perceiving the GRID Fill an existing gap –between middleware and portals Portals + A-WARE + UNICORE/GS aim to be a completely integrated solution Contribute to the standards

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 4 Research Challenges Workflow management of Grid atomic services invocations Workflow orchestration framework a ESB based mediation layer virtualising the distributed resources a Web-based workflow design application a repository to store workflows and associated metadata Unicore TSS service for gLite

Enabling Grids for E-sciencE EGEE-II INFSO-RI Architecture Portal / Clients User’s Services / Workflows ASB / WOS Fabric Layer

Enabling Grids for E-sciencE EGEE-II INFSO-RI Architecture (2) Non OGSA middlewares Os/Storage Unicore/GS GTK4 gLite Other LSF UAS interface OGSA interface Workflow repository Service (WRS) A-WARE Service Bus (ASB) Workflow Valitador / Modeler Service (WVMS) Other Workflow designer application (WDA) EnginFrame Portal A-WARE technology components Other clients (open source) Other clients (open source) UAS interface (BPEL) BPMN (BPEL) WSRFOGSABaseProfile Gridsphere JBI JSR 168 Workflow orchestrator service (WOS)

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 7 Standards BPMN - Business Process Modelling Notation –by OMG –standard abstract notation to define and communicate workflows / business processes –Used by WDA / Portal – BPEL (2.0) - Business Process Execution Language –by OASIS –is a XML-based, business process modeling language for formal specification of executable business processes. –2.0 is able to define both executable and abstract processes. Abstract BPEL captures behavioral aspects not requiring implementation and concrete operational details. –first adopted workflow language / engine – –

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 8 Standards WS / WSRF –by OASIS –standard WS protocols SOAP, WSDL used for intercommunication between components –WSRF: framework for modeling and accessing stateful resources using Web Services –A-WARE components expose a WS/WSRF interface – JBI (Java Business Integration) –by the Java Community Process JSR 208 –Java ESB (Enterprise Service Bus) specifications –ASB is based on it – Java Portlet –by the Java Community Process JSR 168 –It will be used for the open-source portal solution – SVG (Scalable Vector Graphics) –by W3C –is an XML markup language for describing two-dimensional vector graphics and graphical applications. –BPMN elements used by WDA/Portal in SVG –

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 9 Technologies Portal –first solution on EnginFrame Grid Portal –XML/XSL –new Java services –new AJAX –new GWT support feature – WDA (Workflow Designer Application) –Java Applet –JUNG (Java Universal Network/Graph Framework) –Supports BPMN notation and produces BPMNml description of a workflow

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 10 Technologies WRS (Workflow Repository Service) –Data and metadata storage, retrieval and query. –Both XML and unstructured format –Supports for native and hybrid XML databases:  XML DB eXist  IBM DB2 v.9 ASB (A-WARE Service Bus) –Apache ServiceMix - JBI implementation –Grid Component for interfacing the Grid Fabric Layer, UNICORE 5/6 atomic service –WOS as component on the ASB –other components (Registry, Mediator,…) WOS (Workflow Orchestration Service) –Apache ODE as BPEL engine.  Support for JBI infrastructure deployment  Support for BPEL 2.0

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 11 Workflow Life Cycle Try to generalize the workflow design approach Workflow Design –Graphical layout, tasks, split/join nodes, dataflow elements –1st level Grounding: Service Binding –2nd level Grounding: Data Mapping Deployment Submission Monitoring Interactive Tasks

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 12 Workflow Design: layout BPMN notation Dataflow Elements Tasks Cycle Elements

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 13 Workflow Design: BPMN description

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 14 Workflow Design : Abstract BPEL 2.0 <process name="processName" targetNamespace=" xmlns=" <receive createInstance="yes" name="ProcessInstantiation" operation="localPT" partnerLink="client" portType="localPT" variable="ProcessInstantiation_data_out" /> <invoke inputVariable="n0_task1_data_in" name="n0_task1" operation="n0_task1" outputVariable="n0_task1_data_out" partnerLink="local" portType="localPT" /> <invoke inputVariable="n1_task2_data_in" name="n1_task2" operation="n1_task2" outputVariable="n1_task2_data_out" partnerLink="local" portType="localPT" />

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 15 Workflow Design : Service Binding The abstract tasks are bounded to actual services provided by the ASB Workflow task list from BPMN ASB service discovery Bounded tasks

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 16 Workflow Design : Data Mapping Dataflow elements should be assigned mapping Input and Output of the actual services BPMN DataFlow Elements Tasks “from” and “to” involved in data mapping XML schema representation of involved messages selected XPATHs

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 17 Workflow Deployment Executable BPEL + WSDLs + deploy.xml produced by the Design phase are deployed into the ASB Dynamic hot deploy WSDLs deploy xml BPEL ASBASB deploy

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 18 Workflow/Service Submission WSDL of a service is retrieved from ASB Web form dynamically created from WSDL multiple cardinality of Elements

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE User Forum, Manchester, 10 May ‘07 19 What’s Next Now: –finalizing the first public prototype Next: –support for more complex BPMN/BPEL workflows –improve both UIs and ASB mediation-tier –improve monitoring and user interaction capabilities –support for gLite middleware –extend Workflow support to other languages/engines (Scufl, XPDL?)