Extensions of the European Grid Infrastructure Federico Ruggieri – INFN IX International Conference on Science Arts and Culture ECSAC Veli Losinj - 29 August 2009

Outline A bit of history (my version, sorry !) The European Vision Regional Grid Infrastructures co-funded by the European Commission Commonalities and differences A common strategy for the future Conclusions

A bit of (my) short history of Grids In 1998 I. Foster & K. Kesselman - The Grid: Blueprint for a New Computing Infrastructure 1998 GRID presentation in CHEP’98 – Chicago Evaluation of Globus in INFN 2000 CERN invited to take the lead of European Project on Grids with LHC computing as the main user. In the 80’ and early 90’ the accent was on client-server and meta- computing First EU Project DataGRID and PPDG & GRIPHYN in US – 2006 EGEE Project in EU and OSG in US … etc.

Computing intensive science Many vital challenges require community effort –Fundamental properties of matter –Genomics –Climate change –Medical diagnostics Research is increasingly digital, with increasing amounts of data Computation ever more demanding e.g.: experimental science uses ever more sophisticated sensors Huge amounts of data Serves user communities around the world International collaborations

The European Vision The Research Network infrastructure provides fast interconnection and advanced services among Research and Education institutes of different countries’ –Projects: GEANT, SEEREN, EUMEDCONNECT, etc. The Research Grid infrastructure provides a distributed environment for sharing computing power, storage, instruments and databases through the appropriate software (middleware) in order to solve complex application problems –Projects: EGEE, SEE-GRID, EUMEDGRID etc. This integrated networking & grid environment is called electronic infrastructure (eInfrastructure) allowing new methods of global collaborative research - often referred to as electronic science (eScience) The creation of the eInfrastructure is a key objective of the European Research Area Network Infrastructure e-Science Collaborations Grid Infrastructure

Globalisation of Grid Infrastructures CNGrid Garuda EUAsiaGrid

Virtual Communities & Impact e-Infrastructures support wide geographically distributed communities → enhance international collaboration of scientists → promote collaboration in other fields. Grids and networks allow the access of many researchers to scientific resources (laboratories and data) → disparity can be reduced and larger participation and contributions to high quality research. The e-Infrastructures promote the usage of network connectivity and stimulate scientific and technical development of countries → contribute to fight the digital divide and brain drain.

Two (at least) scenarios Greenfield regions/countries –No previous Grid and e-Infrastructures activities –Scarce knowledge and/or experience in deploying/managing large e-Infrastructures. –Isolated spots of research activities with high computing demands. Advanced regions/countries –e-Infrastructures already started/deployed –Locally developed MW. –Fair to good knowledge and experience in e-Infrastructures –High quality research groups and institutions with world wide collaborations.

Consolidated Work-plan Train users and site administrators to use and operate an e- Infrastructure based on the EGEE middleware Disseminate, both “bottom-up” and “top-down”, the e- Infrastructure paradigm for long term sustainability of e-Science Seek, identify, and support e-Science communities and deploy their applications Set-up and manage a Pilot Grid Infrastructure

Instruments & methods National Grid Initiatives –Internal (national) Infrastructures sustainability is still an issue. Regional coordination –Difficult to shape the demand of collaboration with Europe in a Regional perspective (bilateral agreements always preferred). Coordination and interoperation with EGEE (in future with EGI). Stable Communication Networks co-operations still under development. –Synergistic approach with GEANT and EU NRENs and specific regional networks projects, i.e. ALICE, EUMEDCONNECT2, TEIN3, ORIENT

SEEGRID-SCI Before SEE-GRID-SCI During SEE-GRID-SCI

BalticGrid II

EELA II

EUAsiaGrid INFN (IT) CESNET (CZ) NCeSS (UK) HealthGrid (FR) AdMU (PH) ANU (AU) ASGC (TW) ASTI (PH) HAII (TH) IDA (SG) IAMI (VN) ITB (ID) NECTEC (TH) UPM (MY) MIMOS (MY)

EUMEDGRID MA-GRID INFN -Roma3 INFN -Catania INFN - CNAF ULAKBIM CYNET IUCC GRNET Univ. of Tunis Un. of Malta ERI/EUN CERIST NGI IUGAZA HIAST JUNet

GARUDA & The Department of Information Technology (DIT), Government of India has funded the Centre for Development of Advanced Computing (C-DAC) to deploy the nation-wide computational grid GARUDA. In Proof of Concept (PoC) phase which ended on March 2008, 17 cities across the country were connected with an aim to bring “Grid” networked computing to research labs and industry. From April 2008 the Foundation phase is in progress with an aim to include more users’ applications, providing Service Oriented architecture, improving network stability and upgrading grid resources.

CNGRID & The China National Grid (CNGrid) Project is supported by the "High Performance Computer and its Kernel Software " project, which is a key project in the National High-Tech R&D Program (the 863 program). CNGrid is equipped with independently developed grid oriented high performance computers(Lenovo DeepComp 6800, Dawning 4000A) and constructs an open grid environment by 8 nodes including Hongkong. There are 11 application grids from various industies in CNGrid, such as National Geological Application Grid.

GOS to gLite pipeline Gateway

gLite to GOS Pipeline Gateway

Training, training, …. Training ! First EUMEDGRID Grid School (Cairo, Egypt, April 2007) – 9 applications selected, all “gridified”, – 80 nodes, 4 grid sites, 6 Mb/s connection installed in a hotel

Workshops, conferences, events ! Jointly organised by EUMEDGRID, EUMEDCONNECT and GEANT2 Policy agenda for e-Infrastructures in the Mediterranean Countries More than 60 high level participants (Ministers, Politicians, EC Officers, Telecom Operators). High profile speakers (HRH Princess Sumaya of Jordan, Mr. Mashour Abudaka Minister, Palestine, Dr. Najib Abdul Wahed Deputy Minister of Higher Education for Scientific Research, Syria, etc.) and qualified participation of European Commission. Final panel expressed a strong support for the continuation of e-Infrastructures in the Mediterranean.

Dissemination, … dissemination ! e-Infrastructures across the Mediterranean iety/activities/internationalrel/dialog ue_coop/euromed/docs_euromed/ e_infrastructures_across_the_medi terranean_2008.pdf Combined effort of EUMEDGRID, EUMEDCONNECT and GEANT2 Distributed in the folder of the Ministerial event in Cairo.

Policy, policy,….policy ! »Building an Enabling Environment for the EUROMED Information Society« Cairo 27 February The Ministers stressed the fundamental need to ensure interconnection of research networks to support, inter alia, the creation of grid-enabled scientific e-Infrastructures able to make ICT Research and Development cooperation between Europe and the Mediterranean countries more efficient;

Networks, networks, …. Networks ! IUCC - Il GRNET - Gr TUBITAK - Tr MARWAN - Ma - It RED.ES - Es ARN - Dz EUN - Eg JUNET - Jo CYNET - Cy

Specific topics In Greenfield regions: –gLite and European approaches have been exported; –the Grid infrastructures have been promoted and are not yet sufficiently mature to be sustainable; In large, rapidly developing, countries: –they have already well defined Grid infrastructures (China, India); –different Middleware implementations (not only gLite and ARC); –Internal (national) sustainability should not be an issue. Interoperability and interoperations with European Infrastructures and sustainability are the main goals –presently addressed in the activities of short lived projects (2 years max.) with different speeds and time shifts due to the different EU calls where they have been approved; –coordination, alignment of results, common road-maps are difficult to achieve, although being strongly pursued by all the projects.

What’s next A new step forward - International Virtual Research Organisations highly need e-Infrastructures with coordinated management and support to create truly global communities in the future. Value for EU - Europe has decisively contributed to the advent of e-Infrastructures in emerging regions (Asia, LA, Mediterranean) and new candidate EU countries (SEE, Baltic). Their evolution towards sustainable regional e-Science infrastructures should be finalised. Possible objectives: –Enhance the collaboration / coordination and harmonisation of European and non-European e-Infrastructures in coherence with the EGI implementation. –Co-ordinate and support the dissemination towards politicians and stakeholders for long term sustainability of e-Infrastructures in the regions concerned. –Actively promote the adoption of standards and interoperable middleware solutions among the different regions.

CHAIN proposal EU partners: those managing past and existing initiatives of Regional Grid Infrastructures A number of non-EU partners as representatives of their regions (Maximum 10). The preferred choice will be to have a JRU or a single Organisation representing the whole region. Activities 1.Policy Development – coherent scheme of cooperation and interoperation of European and non-EU e-Infrastructures 2.Technical – export EGI supported solutions and promote interoperation with other non-EU e-Infrastructures. 3.Leverage on cross-region communities and applications, promote inter-regional, e-Infrastructures based, research infrastructures.

Timing EGEE III EELA II BalticGrid II EUAsiaGrid CHAIN EUMEDGRID-Support EUIndiaGrid2 EGI SEEGRID-SCI

Conclusions It’s a long road … to build stable e-Infrastructures, even in Europe. An unreasonable acceleration can’t be applied to other regions. On the other hand many of those regions need to accelerate in order to catch up the more developed countries. However, some rapidly developing countries have already made it and are willing to interoperate with similar Infrastructures in other regions of the world. World wide spread scientific communities have started to appreciate the opportunities of working together on large inter- regional e-Infrastructures. It’s time to produce a coherent, multi-region and multi-path road-map for the sustainability and interoperations of those Regional infrastructures towards EGI and among themselves.

Thank you !