Grid Interoperability 08/05/2018 05/10/2007 Dominique Boutigny Grid Interoperability Track: Comp_3 Workshop FJPPL'07

Introduction to the Grid model 08/05/2018 Introduction to the Grid model Nowadays the Grid concept is unavoidable for any application needing significant computing resources Grid allows to share CPU and storage from several sites operating heterogeneous hardware and software The software layer which allows sites to exchange computing tasks through the grid is called "Middleware" A grid can be CPU oriented (SETI / BOINC) Data oriented (Storage Resource Broker) Both (EGEE – W-LCG) D. Boutigny 05/10/2007

The W-LCG grid model T1 (11) T0 T3 (many) T2 (~100) Annecy ICEPP 08/05/2018 The W-LCG grid model Annecy ICEPP Marseille TRIUMF FZK CC-IN2P3 Nantes T3 (many) T1 (11) RAL ASCC CNAF Île de France T0 Brookhaven PIC T2 (~100) NIKHEF Lyon Fermilab NDGF Strasbourg Clermont D. Boutigny 05/10/2007

08/05/2018 Many kind of Grids The Global Grid Forum web site is mentioning ~45 major different grid organizations W-LCG is federating resources from 3 different Grids: EGEE (Europe + Asia + Canada) OSG (US) NorduGrid (Nordic countries) NAREGI (Japan - ?) Having 1 single grid is unrealistic One has to deal with several Grids and provide interoperability From the user point of view From the sites' point of view NAREGI (National Research Grid Initiative) is a Grid being developed in Japan D. Boutigny 05/10/2007

08/05/2018 Project presentation The LIA "Comp_3" project is proposing to work toward Grid Interoperability Was an accepted project for the 2006 call We propose to extend the project for 2007 Work will concentrate mainly on EGEE / NAREGI interoperability Crucial for ILC Will become important for LHC NAREGI is a huge effort in Japan, and will certainly become a piece of the W-LCG organization SRB / iRODS data grid (see later) Implementation Development Interoperability with EGEE / NAREGI NAREGI: 2003-2007 10 billion Yen Extended up to 2009 D. Boutigny 05/10/2007

Members Japan France S. Kawabata T. Sasaki G. Iwai K. Murakami Y. Iida 08/05/2018 Members Japan S. Kawabata T. Sasaki G. Iwai K. Murakami Y. Iida France D. Boutigny S. Reynaud F. Hernandez J.Y. Nief D. Boutigny 05/10/2007

Activities during the first year 08/05/2018 Activities during the first year 2 workshops 3 days in September 2006 in Lyon – 6 people from Japan 4 days in February 2007 at KEK – 5 people from France D. Boutigny 05/10/2007

08/05/2018 NAREGI at KEK Watase-san installed and is maintaining NAREGI middleware at KEK NAREGI is based on Grid standards defined at the OGF (Open Grid Forum) NAREGI beta-1 released in May 2006 and installed at KEK With some help from the NAREGI support team for the last stage Compute part (6 nodes) Data grid part (3 nodes) Tested at KEK with P152 (heavy ions) and Belle simulation Experience with middleware being built up D. Boutigny 05/10/2007

08/05/2018 D. Boutigny 05/10/2007

Next steps (from Watase-san presentation during last workshop) 08/05/2018 Next steps (from Watase-san presentation during last workshop) Release of NAREGI b2 in May 2007 Expectations Easy installation by apt-rpm Stable and Robust middleware Interoperation with EGEE/gLite Job submission, Data exchange, Information Customization of UI / VO portal with NAREGI Web service interface Various useful features for application GridFTP-APT: automatic parallel tuning for GridFTP GridMPI: MPI jobs linking over sites Bust job submission Try to install LHC data processing or simulation on NAREGI To prove usefulness even in HEP application Release of NAREGI v. 1.0 in April-May 2008 Expand NAREGI sites to Asia, EU and US in the collaboration for its complementary features D. Boutigny 05/10/2007

Interoperability between EGEE and NAREGI 08/05/2018 Interoperability between EGEE and NAREGI 2 possible approaches Implement the GIN (Grid Interoperability Now) layer in NAREGI Defined by the GIN group from the OGF Short term solution in order to get the Interoperability Now ! Pragmatic approach Work with longer term standards defined within the OGF Develop a Meta Scheduler compatible with many Grid implementations Based on SAGA (Simple API for Grid Applications) "Instead of interfacing directly to Grid Services, the applications can so access basic Grid Capabilities with a simple, consistent and stable API" and JSDL (Job Submission Description Language) D. Boutigny 05/10/2007

08/05/2018 GIN Pushed by KEK, NAREGI has done considerable efforts to implement the GIN layer Confirmed during our visit to NAREGI in February "Trying to identify islands of interoperation between production grids and grow those islands" Developing an interoperation island with EGEE Common framework for Authentication and VO management Cross job submission between gLite/EGEE and NAREGI Data transfer between gLite and Gfarm Grid resource information service around the world From NAREGI presentation in 02/07 D. Boutigny 05/10/2007

An example of interoperability 08/05/2018 An example of interoperability GIN-data: Data Management and Movement Interoperability between NAREGI and EGEE at the data level Work also on: GIN-auth GIN-jobs GIN-info GIN-ops EGEE NAREGI NAREGI Client SRM Client Gfarm API gLite Client SRM Client NAREGI Metadata Server LFC (Metadata Server) DPM (SRM Server) GridFTP Server Gfarm Server Storage Storage D. Boutigny 05/10/2007

The SAGA / JSDL approach 08/05/2018 The SAGA / JSDL approach This approach is being developed at CC-IN2P3 (Sylvain Reynaud) This interoperability tool is sharing several modules with a software layer which is being developed at CC-IN2P3 in order to easily interface our local batch system to any Grid Computing Element D. Boutigny 05/10/2007

WMS SRM job JSAGA job GridFTP gLite-CE gLite-CE WS-GRAM WS-GRAM 08/05/2018 job desc. JDL delegate selection & sandbox management job RSL selected resource sandbox planning JSAGA gLite plug-ins Globus plug-ins EGEE RUGBI job WMS SRM input data GridFTP gLite-CE gLite-CE WS-GRAM WS-GRAM firewall D. Boutigny 05/10/2007

Extensible via plug-ins 08/05/2018 Extensible via plug-ins ELIS@ (Enterprise grid with Local Infrastructure and Services for Applications) CoG-Core API internal (IS gsiftp, file, http security input/output sandbox Job submission task Execution environment control monitor (multi-users best path, File operation task Web service task … login/pwd PKI GSI (classic internal (IS, QoS, user preferences, RSS, job-list-match, infosite, Lavoisier) delegated, combined gsiftp, file, http, srm (1.1, 2.1.1), lfn, srb, mailto, worker, (gfarm?), tar, gzip) SAGA job desc. translator resource selection security input/output sandbox Job submission task Execution environment control monitor to/from JSDL (multi-users, parametric jobs, failure tolerance) best path, delegated File operation task Web service task … login/pwd PKI GSI (classic, VOMS, MyProxy, X509, (CAS?)) OpenPlast gatekeeper, WS-GRAM, ssh RSL (2&4) EGEE CREAM, WMS, (gLite-CE?) JDL OSG VDT-based CE, (Condor-G?) (VDL?) NAREGI GridVM, (Super Scheduler?) JSDL+ext. regional GRIA, (UNICORE?) local local, PBS, simulator OpenPlast gatekeeper, WS-GRAM, ssh RSL (2&4) D. Boutigny 05/10/2007

Next steps on NAREGI / EGEE interoperability 08/05/2018 Next steps on NAREGI / EGEE interoperability Continue work on both directions: GIN and SAGA / JSDL Try cross job submission on both Grid middleware Explore data exchange between NAREGI and EGEE D. Boutigny 05/10/2007

The Storage Resource Broker (SRB) 08/05/2018 The Storage Resource Broker (SRB) SRB is relatively light data grid system developed at SDSC Considerable experience has been gained at KEK, SLAC, RAL and CC-IN2P3 Heavily used for BaBar data transfer since years (up to 5 TB/day) Very interesting solution to store and share biomedical data (images) Advantages Easy and fast development of applications Extensibility Reliability Easiness of administration D. Boutigny 05/10/2007

Biomedical applications using SRB 08/05/2018 Biomedical applications using SRB MRI Siemens MAGNETOM Sonata Maestro Class 1.5 T DICOM DICOM Acquisition DICOM SRB Control PC push DICOM Export PC (DICOM server, SRB client) DICOM D. Boutigny 05/10/2007

iRODS (iRule Oriented Data Systems ) is the SRB successor 08/05/2018 From SRB to iRODS iRODS (iRule Oriented Data Systems ) is the SRB successor KEK and CC-IN2P3 are both involved in iRODS developments and tests Should bring many new functionalities D. Boutigny 05/10/2007

Definition of rules and micro-services 08/05/2018 From SRB to iRODS iRule Oriented Data Systems Definition of rules and micro-services Allows to fully customize the system in order to adapt it to the application D. Boutigny 05/10/2007

SRB-DSI Being developed by Iida-san 08/05/2018 SRB-DSI Being developed by Iida-san SRB-DSI is a software layer which allows the Grid world based on Globus to interoperate with SRB Globus world: data transfer based on GridFTP SRB: based on its own protocol Crucial to interoperate the LCG and SRB worlds D. Boutigny 05/10/2007

The SRB-DSI architecture 08/05/2018 The SRB-DSI architecture edg-gridftp-ls Scommand GridFTP SRB Protocol (Svr-Interconnection) globus-url-copy rac01 GridFTP rls09 rls10 rsr01 globus-gridftp-server SRB-DSI globus-gridftp-server SRB-DSI globus-gridftp-server SRB-DSI SRB (GSI_AUTH) SRB (GSI_AUTH) SRB (GSI_AUTH) MCAT srbServer srbServer srbServer POSIX I/O (LOCAL) HPSS API I/O POSIX I/O (LOCAL) “rls09-hpss-hsi” “rls10-hpss-vfs” “rsr01-ufs” External Disk Sub-sys hpssfsd HPSS API I/O Each DSI accesse to the following SRB resource gsiftp://rsr01 -> rsr01-ufs gsiftp://rls09 -> rls09-hpss-hsi gsiftp://rls10 -> rls10-hpss-vfs HPSS D. Boutigny 05/10/2007

Next step for SRB / LCG interoperability 08/05/2018 Next step for SRB / LCG interoperability In order to have LCG and SRB fully interoperable we need to develop an SRB / SRM interface This will be a common area of work for KEK and CC-IN2P3 in the near future Iida-san 8 month stay at CC-IN2P3 Then we will explore the possibility to make SRB an alternative for LCG storage SRB / iRODS is probably a good candidate to store user's files Grid wide  An idea to be explored D. Boutigny 05/10/2007