1. 07/02/2012 WS-PGRADE/gUSE in use Lightweight introduction Zoltán Farkas zfarkas@sztaki.hu MTA SZTAKI LPDS

2. 07/02/2012 WS-PGRADE/gUSE in use 2 Outline Graph creation Concrete workflow creation Concrete workflow configuration Job types and corresponding properties Port properties Certificate handling Submission Log examination Submitted instance management Result evaluation Repository handling (export/import) Advanced features: Parameter study Embedded workflow support

3. 07/02/2012 WS-PGRADE/gUSE in use 3 Concrete Workflow Algorithms, executable Resource references, Inputs Graph Jobs, Edges, Ports Template Constraints, Comments, Form Generators Workflow Instance Running state, Outputs Repository Item Application OR Project OR, Workflow part (G,T,CW) Important high-level graph structures in WS- PGRADE Legend: a b a must reference b a b a may reference b

4. 07/02/2012 WS-PGRADE/gUSE in use 4 Workflow Graphs – The Graph Editor I. Create WF structure Add new jobs Add ports to jobs Define connections between jobs

5. 07/02/2012 WS-PGRADE/gUSE in use 5 Workflow Graphs – The Graph Editor II. Define very basic job and port properties

6. 07/02/2012 WS-PGRADE/gUSE in use 6 Concrete workflow creation Based on a graph, template or another WF Set the name Add an optional note (Type is always zen)

7. 07/02/2012 WS-PGRADE/gUSE in use 7 Concrete WF configuration I.

8. 07/02/2012 WS-PGRADE/gUSE in use 8 Concrete WF configuration II. Set job properties: Type: workflow, service, binary, cloud Type-dependent properties Set port properties: Internal filename (as opened by the job) Data source Port type

9. 07/02/2012 WS-PGRADE/gUSE in use 9 Concrete WF configuration III. Select job type (execution model) Set type-dependent properties

10. 07/02/2012 WS-PGRADE/gUSE in use 10 Concrete WF configuration IV. Set internal filename Set source (for non-channel ports)

11. 07/02/2012 WS-PGRADE/gUSE in use 11 Certificate handling I. Manage X.509 certificates: Upload to MyProxy server Get new proxy from a MyProxy server Manage proxies on MyProxy servers

12. 07/02/2012 WS-PGRADE/gUSE in use 12 Certificate handling - Upload Set information Click upload

13. 07/02/2012 WS-PGRADE/gUSE in use 13 Certificate handling - Download Set MyProxy access information Download Assign to grid

14. 07/02/2012 WS-PGRADE/gUSE in use 14 Submission Really simple: click Submit

15. 07/02/2012 WS-PGRADE/gUSE in use 15 Check submitted instance

16. 07/02/2012 WS-PGRADE/gUSE in use 16 Check finished jobs I.

17. 07/02/2012 WS-PGRADE/gUSE in use 17 Workflow instance management

18. 07/02/2012 WS-PGRADE/gUSE in use 18 Result evaluation Click “get Outputs” Examine the resulting zip file

19. 07/02/2012 WS-PGRADE/gUSE in use 19 Share your workflow! - Export Set type (application is OK) Add some fancy notes Click “Export”

20. 07/02/2012 WS-PGRADE/gUSE in use 20 Use others' workflows! - Import I. Select type Click refresh And...

21. 07/02/2012 WS-PGRADE/gUSE in use 21 Use others' workflows! - Import II. Override properties you like Click “Import”

22. 07/02/2012 WS-PGRADE/gUSE in use 22 Advanced part – Parameter Study features Parameter study helpers: Generator jobs Parametric input ports Collector jobs Input assignment options: Dot product Cross product

23. 07/02/2012 WS-PGRADE/gUSE in use 23 Generator-job-collector type PS Generator type job has at least one multiple output port. Output Number/Max Size: variable, number attribute, port specific. If the number of files produced by a single run is less than Output Number: the generated files will be encountered cyclically in further jobs. If the number of files exceed the Output Number the exceeding files will be not used *K=3 012012 Generator 1. run 2. run 3. run 1 run *K=2 01201 Generator 1. run 2. run 1 run *K=4 012012 Generator 1. run 2. run 3. run 1 run 303 4. run

24. 07/02/2012 WS-PGRADE/gUSE in use 24 Parametric input port Simply upload a ZIP file called paramInputs.zip containing files: 0, 1, …, N Set N during WF configuration:

25. Optional Conditions to Submit a Job: Collector Port-example Step 1 To set this option the input port must be “channel” Step 2 To access to the setting of this option the features of the Parametric Input must be in “View” state Step 3 To make the Port to be a Collector one the setting of “Waiting” must be “All”

26. 07/02/2012 WS-PGRADE/gUSE in use 26 Typical Parameter Sweep workflow

27. 07/02/2012 WS-PGRADE/gUSE in use 27 Example parameter study workflow Generator Parametric inputs Cross product Dot product Collector port

28. 07/02/2012 WS-PGRADE/gUSE in use 28 Advanced part – Embedded workflows A job can be a workflow! Rule: a concrete workflow created from a template may be embedded Port assignments have to be set:

29. 07/02/2012 WS-PGRADE/gUSE in use 29 Embedded workflow support Original Workflow Embedded Workflow To ensure the compatibility of interfaces the embedded workflow must be defined by a Template The dummy job whose execution will be substituted by the call of the embedded one

30. 07/02/2012 WS-PGRADE/gUSE in use 30 Questions?