last update: 02/06/ :09 Mirco Mazzucato Infn -Padova 1 eInfrastructures in Italy (and their EU and International integration) Roma – 9 December 2003 Mirco Mazzucato INFN-Padova

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-2 Summary  The eInfrastructures  Internet, Grid and WEB services on top of an increasingly powerful physical layer constituted by  Very high bandwidth networks, Cpu clusters, supercomputers, large tape storages, disk pools, commodity desktops…  The general case  The Italian eInfrastructure evolution  The national projects:  INFN Grid, ENEA, FIRB Grid.it, S-PACI...  The IG-BIGEST general initiative  The current challenges  Conclusions

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-3 Grids: origin and foundation  Italy started to develop the Grid technology and related eInfrastructures at the end of ’90s (INFN Condor, Grid project, ISUFI Lecce). Main motivations:  Modern fundamental Science, HEP in particular, but also Life sciences, Earth Observation, Economics, … have been evolving fast during the ’90s from local well consolidated laboratory practices towards:  global collaboration (eScience), involving real time working relations between distributed teams with top level expertise  Intensive usage, in the daily work, of IT resources including access and sharing of distributed data  Effective use of modelling practices for the steering of the research and innovation processes ,,,boosted by the decreasing costs of commodity IT resources: desktop, disks, networks.. and Open Source

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-4 The technical problem for Science  INFN (as other Research Institutions) has teams and IT resources distributed in 25 sites dynamically collaborating in a variety of national and international projects  The national Condor Pool started in 1996 and operational in 1998 covering all INFN sites, could not easily allow international data and resource sharing  Grids were identified as the enabling technology for large scale international resource and data sharing in a context of dynamical multi-institutional Virtual Organizations (VO) as the WEB has been in the past for the sharing of information  Grids were conceived as a new set of services complementing and adding functionalities rather than replacing already available tools for distributed computing and resource access.

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-5 The “Data” Issue  The modern scientific world and society are characterized by the large development of digital instruments which produces a large amount of distributed raw data  High Energy Physics detectors (LHC): 10 PByte/year in 2007  Earth Observation satellites: Envisat 500 TByte/year now  Mammography screening of the population in Italy: 200TB/year  Genomic and proteinomic databases quickly growing to PByte  WEB, Digital Libraries,Virtual Reality, CADS: now at TB  Distributed sensors……..: Millions, quickly growing  The economical and social progress of modern digital societies depend strongly on their capacity and efficiency in transforming these Raw Data into precious piece of knowledge:  Laws of nature, new drug discoveries, innovative technologies, early cancer diagnosis, early alarm for a new catastrophic event ….

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-6 The “modelling” issue  Progress in modern Sciences but also the Innovation processes in modern Industries, Business and Governments relies on the cycle:  Theoretical modelling of the problem  Simulation/Calculations of different options and input parameters  Selection of best solution  Virtual and practical realization of prototypes  Comparison, iteration or mass production  In all domains the extensive professional exploitation of the past accumulated knowledge through the systematic usage of modelling practices should steer the innovation process  To be confronted with current practices of systematic laboratory tests of all different hypothesis and parameters  This points towards the pervasive introduction and systematic usage of IT resources (CPU, Archives, networks..) in the daily work of all people involved in the production of new knowledge and beyond in all society

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-7 eInfrastructures: the new general enabling factor  The conbination of Internet with the new WEB and Grid Services on top of the modern fastly developing physical layer of networks, CPU farms, storage space.., can provide the general infrastructure (eInfrastructure) which enable all the above tasks:  Collaborative work in distributed VO  large volume data sharing  intensive usage of distributed CPU and Storage resources  General access to knowledge in the society  The Grid middleware can provide those additional common services that applications in all domains from Science to Industry and Business can use to access exactly those IT resource that they need at the most effective cost  As the TCP/IP protocol and the WEB daemons have provided in the past uniforn access to information to Science, Industry and all other domains  eInfrastructures becomes in this way one of the key enabling factors for the social and economical progress of modern knowledge based society

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-8 The INFN Grid project and the national eInfrastructure 1.Condor on WAN (started 1996, operational in 1998) Integrate ~ 20 sites CPU resources into a national pool 2.National testbed to evaluate Globus services in INFN-GRID, INFN special project, (February 2000-…) National Grid infrastructure driven by INFN experiments 4.DATAGRID, EU Project, 3 years duration ( ) European integration and new M/W services for HEP, Biology, EO 5.DataTAG, EU project, 2 years duration ( ) Optical networking and Interoperability with US Grid, GLUE, HICB, JTB.. 6.Grid.IT, National project 3 years ( ) MIUR special funds Towards a national production eInfrastructure 7.eBusiness, eIndustry, eGovernment, EScience and, Technology --> (BIGEST) Italian Grid Initiative Coordination of all national eInfrastructure activities 8.FP6: Italian grid infrastructure in EGEE..... The new production EU eInfrastructure for all Sciences and beyond

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-9 MIUR/HPCC Center of Excellence for High Perfomance Computing University of Calabria Director: Prof. Lucio Grandinetti The SPACI Consortium: a flexible, robust, secure and scalable IT infrastructure S outhern P artnership for A dvanced C omputational I nfrastructure ISUFI/CACT Center for Advanced Computing Technologies University of Lecce Director: Prof. Giovanni Aloisio DMA/ICAR Dept. of Mathematics and Applications University of Naples “Federico II” & ICAR (Section of Naples) Director: Prof. Almerico Murli 1.4 Tflops SPACI infrastructure part of the EGEE production Grid

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-10 To put the computing resources of the partecipating institutions into a grid To integrate the research activity of the three main sites and to estabilish a real collaboration in Italy between the Italian Public and Industrial Research To exchange experiences both in High Technology and Scientific Research among the researchers & students of the three main sites and other Universities & Research Centers in Europe and the USA SPACI – The Mission

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-11 Citrix Metafram e Citrix Nfuse ICA WEB(ICA) power3.frascati.enea.it boquad.frascati.enea.it dafne.casaccia.enea.it infocal.trisia.enea.it GEANT DataGrid at ESA\ESRIN grid0007 ENEA GRID GigaBit-Link CNR Tor Vergata ENEA infrastructure will be part of EGEE

last update: 02/06/ :09 Mirco Mazzucato Infn -Padova 12 From INFN Grid to an Italian Grid: The FIRB Grid.it Project FIRB: Fondo per gli Investimenti della Ricerca di Base(fondi MIUR da UMTS)

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-13 PISA NAPOLI COSENZA PERUGIA PADOVA GENOVA LECCE MILANO PALERMO ROMA TORINO MATERA PAVIA BARI BOLOGNA The Grid.it National Project CNR & University HPC, Parallel Programming, Grid computing, Scientific libraries, Data base and knowledge discovery, Earth Observation, Computational chemistry, Image processing, … R&D on next generation tools ASI Applications of Earth Observation CAGLIARI INFN & University Grid infratsructure( INFN-Grid, DataGrid, DataTag ), e-science applications: Astrophysics, Bioinformatics, Geophysics, … National eInfrastructure Funding: €8.1 M 3-Year Project Start-up: November 2002 UR INFN : €1.58M CNIT R&D on optical networking

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-14 The national Grid.it eInfrastructure  In Grid.it INFN is responsible for the R&D and creation of a national Grid Infrastructure and for studying and prototyping a national Grid Operation Service (GOS)  The generalization of the infrastructure support to other Sciences from INFN is a model successfully established in the past with the research network (INFNET -> GARR)  The GOS support several Italian Sciences applications and the operation of the Italian infrastructure also in the context of the new European Infrastructure project EGEE  The Italian eScience Grid.it infrastructure currently support:  Astrophysics  Biology  Computational Chemistry  Geophysics  Earth Observation  but other sciences are joining thanks to new MIUR funds (e.g. new S- PACI and other PON projects)

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-15 Status of the Grid.it eInfrastructure  Selected middleware for initial deployment in Grid.it infrastructure. Add new components later  ->LCG-1/2 -> EGEE M/W (based on OGSI)  Fully automated M/W Installation tools  Now sites can install/update with a click  Started to study and solve production Grid management issues  Provided initial set of management tools  Set up support to sites and to other institutions to use port/run their apps on the grid (Genius Portal…on a iPAQ)  Collaboration with LCG and EGEE in these domains in future

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-16 The Grid.it support site  Web site:

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-17 The Italian Grid for Business, Industry, Government, EScience&Technology (IG-BIGEST)  It is a national initiative aiming at coordinating all Italian efforts in Grids development or exploitation and at promoting the participation to EU FP6 and international grid projects  IG-BIGEST main objectives are  To support the creation of a general Italian and EU grid infrastructure for eScience integrating available EU national infrastructures and open to industry early test  -> EGEE project  To promote R&D on open Grid issues  ->New FP6 proposals  To support the development of specific grid environments on top of basic services enabling usage of Grid by major applications in e-Science, eIndustry and eGovernment  ->New FP6 and national application projects

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-18 Current achievements for the Italian and EU eInfrastructure  The national Grid infrastructure is now a reality costantly developed by a series of coordinated national projects  Garr (NREN) for the underline broadband Research Networking  INFN Grid, S-PACI, ENEA-Grid FIRB Grid.it for Grids and eInfrastructure  Integration at EU and international level is efficiently carried through a series of EU projects DataGrid, DataTAG, EGEE, international HEP LCG...  Grid infrastructures are now seen by many governments as a Science and society development enabling factor and large funds are made available in Europe, US (Cyber-infrastructure), Japan and other countries so technological development will continue fast  EGEE will make the Grid M/W adhering to standard spec. (OGSI-OGSA) robust and reliable and will provide a production eInfrastructure in Europe on top of the Geant nework  EGEE will provide also:  Support to the development of some research eInfrastrcture user communities  Coordination of national and regional technical operational structures

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-19 eInfrastuctures: the challenges  The general European structure at managerial and policy - administrative level to support the eInfrastructure developments in Europe is still very weak  Projects like EGEE have definite technical goals, are focused and ends  Cannot provide effective long term foundation for an EU eInfrastructure  Cannot provide longterm EU wide roadmaps integrated with national programs  Cannot guarantee long term support of M/W  This is even more true at international level  GGF can provide long term international standards but is not following the urgent policy agreements needed to integrate EU eInfrastructures, with US Cyber-Infratruscture, Japan and world wide Grids  Policies for resource sharing within comunities having common objectives (VO), security issues, accounting, business and cost models etc need now to be actively generally addressed in Europe and internationally

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-20 The new event “eInfrastructures (Internet and Grids) – The new foundation for knowledge-based Societies”  It offers an opportunity to start to discuss a framework of administrative- and policy-level mechanisms and rules to break down barriers related to deployment and use of eInfrastructures in Europe and world-wide  Some of the issues that need to be addressed include:  The harmonization of national, EU and International eInfrastructures dvelopment programs  The general long term support and coordinated world-wide evolution of the basic eInfrastructure services in order to guarantee continuous world-wide interoperability and usage  Existing GLUE schema, Intergrid Coordination Board, JointTechnical Board, are International Bodies which may provide input and feedback to eIRG  Security EU structures and shared EU and International sec. policies  Authorization, Accounting, Cost sharing and Business models for EU wide and international resource access and sharing  Bringing in all Research user communities  Bringing in general Industry, Business and Society applications

last update 02/06/ :09 Mirco Mazzucato INFN-Padova-21 Conclusions  EU eInfrastructures are a key element for the establishment of the European Research Area and for boosting in Europe the Scientific Research and Industrial/Commercial outreach, allowing the building up of critical mass in all domains  With the constitution of eIRG Europe can address the issue of putting in place a solid structural foundation at adminstrative and policy level for the eInfrastructure development and involve all Research comunities, Industries and the Society  eInfrastructures can enalarge access to knowledge creating a new market of IT resources and applications as the WEB did in the past  The EU eInfrastructure Reflection Group has been formed with delegates of Ministries of all EU countries following the recommendations of the previous workshop organized by the Greek Presidency.  It can provide harmonization of the adopted policies and input to the EU governments and EU commission for the development of the EU eInfrastructure together with international coordination  The White Paper that has been circulated as a first draft to stimulate discussions is now in the hands of this group  It will evolve according to the input and suggestions provided during the today workshop.  The eIRG will meet tomorrow to plan the next steps