1. EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks Interfacing gLite services with the Kepler scientific workflow René Météry, BT on behalf of Bernard Guillerminet, CEA 3 rd EGEE User Forum, Clermont-Ferrand February 11th 2008

2. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 2 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Content Introduction : –Fusion Modelling presentation –Kepler presentation –Kepler workflows Kepler / gLite : –gLite actors –new Kepler actors –gLite workflows Conclusion Perspective Contacts

3. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 3 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Fusion Modelling Presentation The EFDA Integrated Tokamak Taskforce (ITM) http://www.efda-taskforce-itm.org/ co-ordinates the development of a coherent set of validated simulation tools for the purpose of benchmarking on existing tokamak experiments http://www.efda-taskforce-itm.org/ Goal of ITM : Provide a comprehensive simulation package for ITER plasmas. Project structure : 7 sub-projects (IMP1..5 + ITER + ISIP)

4. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 4 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Fusion Modelling Presentation Architecture of the ITM platform : Portal Workflow/ Code Platform Grid HPC Local Cluster Local Data Ext. Data USER Portal more important in defining access to resources (certificates) Data access & application scheduling & Resource allocation through platform Visualization, monitoring & steering through platform ITM tools: standardized data structures, data access, interface definitions, Gateway (2008), Workflow (Kepler)

5. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 5 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Kepler Presentation Kepler is an open source scientific workflow (biology, ecology, astronomy, fusion) for the analysis and modeling of scientific data. http://kepler-project.org/ http://kepler-project.org/ Kepler is based on the Ptolemy II system which is a java-based component assembly framework with a graphical user interface. http://ptolemy.berkeley.edu/ptolemyII/ http://ptolemy.berkeley.edu/ptolemyII/ Kepler features : –An intuitive GUI (inherited from Ptolemy) for design and execution. –An actor-oriented workflow creation. –Database access and querying. –Data transformation. –Flexible execution. –Hierarchical design. –Etc…

6. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 6 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Kepler Presentation Workflow description : –directors : sequential, time-oriented, // processing,etc –actors : individual, composite –ports : multi, single, in, out –parameters : workflow, actor –relations Run Control Buttons Director Catalogue of Components

7. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 7 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Kepler Presentation Actor description: –A Java file containing the code executed :  5 Java classes : init() and wrapup() : called once. prefire(), fire() and postfire() : called at each step.  Template and coding rules provided to write new class. –A XML file containing tje graphical description :  Stored in a dedicated directory prefire fire() postfire() initialize() Iterations wrapUp()

8. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 8 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Kepler Workflows Basic non-grid fusion workflow example : Plot 3D Plot 2D in-memory Data server SOLOVIEV HELENA MISHKA

9. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 9 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 gLite actors (1/3) The actors created are the basis of the job lifecycle. Actor based on the VOMS service : –VomsProxyInit : Creation of a user VOMS proxy. API used : Java VOMS API.

10. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 10 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 gLite actors (2/3) Actors based on the WMProxy service : –GliteWMPJobListMatch : Listmatch of a job. –GliteWMPJobSubmit : Submission of a job. –GliteWMPJobGetOutput : Retrieving the output of a job. API used : Java WMProxy API.

11. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 11 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 gLite actors (3/3) Actors based on the LB service : –GliteWMPJobStatus : Current status of a job. –GliteWMPJobStatusLoop : Monitoring the status of the job until it reaches the “Done” status. API used : API generated from LB WSDL.

12. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 12 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 New Kepler actors The execution of the job lifecycle workflow needed actors that were not present in Kepler : –Importation of Directors and Actors from Ptolemy II : DDF –Creation of Actors : IfThenElse, NotEqual

13. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 13 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 gLite workflow (1/2) Proxy initialization and listmatch :

14. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 14 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Kepler’s gLite workflow (2/2) Submission, monitoring and output retrieval :

15. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 15 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Conclusion Kepler : –Not a complete documentation about actor and workflow. gLite : –Lack of support for the Fusion VO on testbed. –More documentation or example needed for services. Thanks to : CEA Saclay, Mario Reale, Vincenzo Ciaschini, Biomed VO, Gilda wiki, Nicolas Demesy.

16. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 16 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Perspective Current work and future work in the Euforia project: –Integration of the current gLite actors in the Kepler release :  Clean and comment slightly the actors’ code.  Make them more customizable.  Package them for a better integration. –Data Management actors :  Currently investigating G-DSE and DPM to find out which one fits the best the Fusion Modeling data model.  Develop and test new actors.  Integrate them to the Kepler release. –Investigate the creation of interactive job actors. –Investigate the creation of Unicore actors.

17. Interfacing gLite services with the Kepler scientific workflow, February 11 th 2008 17 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Contacts Rene Metery : mailto:rene.metery@c-s.fr mailto:rene.metery@c-s.fr Bernard Guillerminet : mailto:bernard.guillerminet@cea.fr mailto:bernard.guillerminet@cea.fr Thank you for your attention. Feel free to ask questions