EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks Interfacing gLite services with the Kepler.

Slides:



Advertisements
Similar presentations
Nimrod/K: Towards Massively Parallel Dynamic Grid Workflows David Abramson, Colin Enticott, Monash Ilkay Altinas, UCSD.
Advertisements

P. Kacsuk, G. Sipos, A. Toth, Z. Farkas, G. Kecskemeti and G. Hermann P. Kacsuk, G. Sipos, A. Toth, Z. Farkas, G. Kecskemeti and G. Hermann MTA SZTAKI.
EUFORIA FP7-INFRASTRUCTURES , Grant JRA3 B. Guillerminet on behalf of the JRA3 project 22 January 2008 Kick-Off Meeting January 2008.
1 Application Specific Module for P-GRADE Portal 2.7 Application Specific Module overview Akos Balasko MTA-SZTAKI LPDS
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
 Scientific workflow management system based on Ptolemy II  Allows scientists to visually design and execute scientific workflows  Actor-oriented.
INFSO-RI Enabling Grids for E-sciencE FloodGrid application Ladislav Hluchy, Viet D. Tran Institute of Informatics, SAS Slovakia.
Nicholas LoulloudesMarch 3 rd, 2009 g-Eclipse Testing and Benchmarking Grid Infrastructures using the g-Eclipse Framework Nicholas Loulloudes On behalf.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Simply monitor a grid site with Nagios J.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
ITPA/IMAGE 7-10 May 2007 Software and Hardware Infrastructure for the ITM B.Guillerminet, on behalf of the ITM & ISIP teams (P Strand, F Imbeaux, G Huysmans,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Voms & Voms-admin report Vincenzo Ciaschini.
INFSO-RI Enabling Grids for E-sciencE Supporting legacy code applications on EGEE VOs by GEMLCA and the P-GRADE portal P. Kacsuk*,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Security and Job Management.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Using gLite API Vladimir Dimitrov IPP-BAS “gLite middleware Application Developers.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks S. Natarajan (CSU) C. Martín (UCM) J.L.
EGEE-Forum – May 11, 2007 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks A gateway platform for Grid Nicolas.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks, An Overview of the GridWay Metascheduler.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks WMSMonitor: a tool to monitor gLite WMS/LB.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Security Token Service Valéry Tschopp - SWITCH.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks, Novelties and Features around the GridWay.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks VOMS SAML Vincenzo Ciaschini MWSG Zurich,
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IPv6 test methodology Mathieu Goutelle (CNRS.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status report on Application porting at SZTAKI.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE User Forum, Manchester, 10 May ‘07 Nicola Venuti
Enabling Grids for E-sciencE Astronomical data processing workflows on a service-oriented Grid architecture Valeria Manna INAF - SI The.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Services for advanced workflow programming.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Web Portal for Chemists M. Sterzel,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The GILDA t-Infrastructure Roberto Barbera.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Support for New and Existing Users Gergely.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Enabling the use of e-Infrastructures with.
Enabling Grids for E-sciencE Workload Management System on gLite middleware - commands Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
EGEE-II INFSO-RI Enabling Grids for E-sciencE MyProxy - a brief introduction.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Robin McConnell NA3 Activity Manager 28.
EUFORIA FP7-INFRASTRUCTURES , Grant Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Command Line Grid Programming Spiros Spirou Greek Application Support Team NCSR “Demokritos”
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Introduction to P-GRADE Portal hands-on Miklos Kozlovszky MTA SZTAKI
EGEE-II INFSO-RI Enabling Grids for E-sciencE P-GRADE overview and introduction: workflows & parameter sweeps (Advanced features)
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CharonGUI A Graphical Frontend on top of.
BalticGrid-II Project EGEE UF’09 Conference, , Catania Partner’s logo Framework for Grid Applications Migrating Desktop Framework for Grid.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Nagios Emir Imamagic /SRCE EGEE’09,
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite – UNICORE interoperability Daniel Mallmann.
INFSO-RI Enabling Grids for E-sciencE University of Coimbra GSAF Grid Storage Access Framework Salvatore Scifo INFN of Catania EGEE.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks LHCOPN Operations WS: Introduction & Objectives.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poznan, Poland EGEE’07, Budapest, Oct.
EGI-InSPIRE RI EGI Community Forum 2012 EGI-InSPIRE EGI-InSPIRE RI EGI Community Forum 2012 Kepler Workflow Manager.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks VOMS & Reliability Vincenzo Ciaschini & Andrea.
INFSO-RI Enabling Grids for E-sciencE gLite Information System: R-GMA Tony Calanducci INFN Catania gLite tutorial at the EGEE User.
© Geodise Project, University of Southampton, Workflow Support for Advanced Grid-Enabled Computing Fenglian Xu *, M.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks OpenSAML extension library and API to support.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poland EGEE’08 Conference, Istanbul, 24 Sep.
Enabling Grids for E-sciencE EGEE-III INFSO-RI Workflow management tool for Earth science applications Ladislav Hluchy, Viet Tran Institute of Informatics.
INFSO-RI Enabling Grids for E-sciencE GILDA t-Infrastructure Antonio Fuentes Bermejo
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Management Claudio Grandi.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GOCDB4 Gilles Mathieu, RAL-STFC, UK An introduction.
Scientific workflow in Kepler – hands on tutorial
a middleware implementation
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interfacing gLite services with the Kepler scientific workflow René Météry, BT on behalf of Bernard Guillerminet, CEA 3 rd EGEE User Forum, Clermont-Ferrand February 11th 2008

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Content Introduction : –Fusion Modelling presentation –Kepler presentation –Kepler workflows Kepler / gLite : –gLite actors –new Kepler actors –gLite workflows Conclusion Perspective Contacts

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Fusion Modelling Presentation The EFDA Integrated Tokamak Taskforce (ITM) co-ordinates the development of a coherent set of validated simulation tools for the purpose of benchmarking on existing tokamak experiments Goal of ITM : Provide a comprehensive simulation package for ITER plasmas. Project structure : 7 sub-projects (IMP ITER + ISIP)

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Fusion Modelling Presentation Architecture of the ITM platform : Portal Workflow/ Code Platform Grid HPC Local Cluster Local Data Ext. Data USER Portal more important in defining access to resources (certificates) Data access & application scheduling & Resource allocation through platform Visualization, monitoring & steering through platform ITM tools: standardized data structures, data access, interface definitions, Gateway (2008), Workflow (Kepler)

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Kepler Presentation Kepler is an open source scientific workflow (biology, ecology, astronomy, fusion) for the analysis and modeling of scientific data. Kepler is based on the Ptolemy II system which is a java-based component assembly framework with a graphical user interface. Kepler features : –An intuitive GUI (inherited from Ptolemy) for design and execution. –An actor-oriented workflow creation. –Database access and querying. –Data transformation. –Flexible execution. –Hierarchical design. –Etc…

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Kepler Presentation Workflow description : –directors : sequential, time-oriented, // processing,etc –actors : individual, composite –ports : multi, single, in, out –parameters : workflow, actor –relations Run Control Buttons Director Catalogue of Components

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Kepler Presentation Actor description: –A Java file containing the code executed :  5 Java classes : init() and wrapup() : called once. prefire(), fire() and postfire() : called at each step.  Template and coding rules provided to write new class. –A XML file containing tje graphical description :  Stored in a dedicated directory prefire fire() postfire() initialize() Iterations wrapUp()

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Kepler Workflows Basic non-grid fusion workflow example : Plot 3D Plot 2D in-memory Data server SOLOVIEV HELENA MISHKA

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI gLite actors (1/3) The actors created are the basis of the job lifecycle. Actor based on the VOMS service : –VomsProxyInit : Creation of a user VOMS proxy. API used : Java VOMS API.

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI gLite actors (2/3) Actors based on the WMProxy service : –GliteWMPJobListMatch : Listmatch of a job. –GliteWMPJobSubmit : Submission of a job. –GliteWMPJobGetOutput : Retrieving the output of a job. API used : Java WMProxy API.

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI gLite actors (3/3) Actors based on the LB service : –GliteWMPJobStatus : Current status of a job. –GliteWMPJobStatusLoop : Monitoring the status of the job until it reaches the “Done” status. API used : API generated from LB WSDL.

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI New Kepler actors The execution of the job lifecycle workflow needed actors that were not present in Kepler : –Importation of Directors and Actors from Ptolemy II : DDF –Creation of Actors : IfThenElse, NotEqual

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI gLite workflow (1/2) Proxy initialization and listmatch :

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Kepler’s gLite workflow (2/2) Submission, monitoring and output retrieval :

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Conclusion Kepler : –Not a complete documentation about actor and workflow. gLite : –Lack of support for the Fusion VO on testbed. –More documentation or example needed for services. Thanks to : CEA Saclay, Mario Reale, Vincenzo Ciaschini, Biomed VO, Gilda wiki, Nicolas Demesy.

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Perspective Current work and future work in the Euforia project: –Integration of the current gLite actors in the Kepler release :  Clean and comment slightly the actors’ code.  Make them more customizable.  Package them for a better integration. –Data Management actors :  Currently investigating G-DSE and DPM to find out which one fits the best the Fusion Modeling data model.  Develop and test new actors.  Integrate them to the Kepler release. –Investigate the creation of interactive job actors. –Investigate the creation of Unicore actors.

Interfacing gLite services with the Kepler scientific workflow, February 11 th Enabling Grids for E-sciencE EGEE-II INFSO-RI Contacts Rene Metery : Bernard Guillerminet : Thank you for your attention. Feel free to ask questions