EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interfacing gLite services with the Kepler scientific workflow René Météry, BT on behalf of Bernard Guillerminet, CEA 3 rd EGEE User Forum, Clermont-Ferrand February 11th 2008

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Content Introduction : –Fusion Modelling presentation –Kepler presentation –Kepler workflows Kepler / gLite : –gLite actors –new Kepler actors –gLite workflows Conclusion Perspective Contacts

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Fusion Modelling Presentation The EFDA Integrated Tokamak Taskforce (ITM) co-ordinates the development of a coherent set of validated simulation tools for the purpose of benchmarking on existing tokamak experiments Goal of ITM : Provide a comprehensive simulation package for ITER plasmas. Project structure : 7 sub-projects (IMP ITER + ISIP)

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Fusion Modelling Presentation Architecture of the ITM platform : Portal Workflow/ Code Platform Grid HPC Local Cluster Local Data Ext. Data USER Portal more important in defining access to resources (certificates) Data access & application scheduling & Resource allocation through platform Visualization, monitoring & steering through platform ITM tools: standardized data structures, data access, interface definitions, Gateway (2008), Workflow (Kepler)

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Kepler Presentation Kepler is an open source scientific workflow (biology, ecology, astronomy, fusion) for the analysis and modeling of scientific data. Kepler is based on the Ptolemy II system which is a java-based component assembly framework with a graphical user interface. Kepler features : –An intuitive GUI (inherited from Ptolemy) for design and execution. –An actor-oriented workflow creation. –Database access and querying. –Data transformation. –Flexible execution. –Hierarchical design. –Etc…

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Kepler Presentation Workflow description : –directors : sequential, time-oriented, // processing,etc –actors : individual, composite –ports : multi, single, in, out –parameters : workflow, actor –relations Run Control Buttons Director Catalogue of Components

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Kepler Presentation Actor description: –A Java file containing the code executed :  5 Java classes : init() and wrapup() : called once. prefire(), fire() and postfire() : called at each step.  Template and coding rules provided to write new class. –A XML file containing tje graphical description :  Stored in a dedicated directory prefire fire() postfire() initialize() Iterations wrapUp()

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Kepler Workflows Basic non-grid fusion workflow example : Plot 3D Plot 2D in-memory Data server SOLOVIEV HELENA MISHKA

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI gLite actors (1/3) The actors created are the basis of the job lifecycle. Actor based on the VOMS service : –VomsProxyInit : Creation of a user VOMS proxy. API used : Java VOMS API.

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI gLite actors (2/3) Actors based on the WMProxy service : –GliteWMPJobListMatch : Listmatch of a job. –GliteWMPJobSubmit : Submission of a job. –GliteWMPJobGetOutput : Retrieving the output of a job. API used : Java WMProxy API.

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI gLite actors (3/3) Actors based on the LB service : –GliteWMPJobStatus : Current status of a job. –GliteWMPJobStatusLoop : Monitoring the status of the job until it reaches the “Done” status. API used : API generated from LB WSDL.

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI New Kepler actors The execution of the job lifecycle workflow needed actors that were not present in Kepler : –Importation of Directors and Actors from Ptolemy II : DDF –Creation of Actors : IfThenElse, NotEqual

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI gLite workflow (1/2) Proxy initialization and listmatch :

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Kepler’s gLite workflow (2/2) Submission, monitoring and output retrieval :

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Conclusion Kepler : –Not a complete documentation about actor and workflow. gLite : –Lack of support for the Fusion VO on testbed. –More documentation or example needed for services. Thanks to : CEA Saclay, Mario Reale, Vincenzo Ciaschini, Biomed VO, Gilda wiki, Nicolas Demesy.

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Perspective Current work and future work in the Euforia project: –Integration of the current gLite actors in the Kepler release :  Clean and comment slightly the actors’ code.  Make them more customizable.  Package them for a better integration. –Data Management actors :  Currently investigating G-DSE and DPM to find out which one fits the best the Fusion Modeling data model.  Develop and test new actors.  Integrate them to the Kepler release. –Investigate the creation of interactive job actors. –Investigate the creation of Unicore actors.

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Contacts Rene Metery : Bernard Guillerminet : Thank you for your attention. Feel free to ask questions