– n° 1 The Grid Production infrastructure Cristina Vistoli INFN CNAF.

Slides:



Advertisements
Similar presentations
– n° 1 Review resources access policy, procedures, rules and challenges: The Italian experience and future challenges Antonia Ghiselli INFN-CNAF Workshop.
Advertisements

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Torsten Antoni – LCG Operations Workshop, CERN 02-04/11/04 Global Grid User Support - GGUS -
INFN Testbed1 status L. Gaido, A. Ghiselli WP6 meeting CERN, 11 December 2001.
Deployment Team. Deployment –Central Management Team Takes care of the deployment of the release, certificates the sites and manages the grid services.
Alessandro Italiano INFN – CNAF 26/09/2003 1/5 Status of the INFN - EDG testbeds Alessandro Italiano 7th DataGrid Conference.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Consistency of Accounting Information with.
– n° 1 VO Magic – Planck – Compchem in the production infrastructure.
1 Grid.it Enabling Platforms for High-Performance Computational Grids Oriented to Scalable Virtual Organizations Marco Vanneschi Dipartimento di Informatica,
Status of Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group
Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group
INFN Testbed status report L. Gaido WP6 meeting CERN - October 30th, 2002.
08/11/908 WP2 e-NMR Grid deployment and operations Technical Review in Brussels, 8 th of December 2008 Marco Verlato.
The EDG Testbed Deployment Details The European DataGrid Project
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
Certification and test activity IT ROC/CIC Deployment Team LCG WorkShop on Operations, CERN 2-4 Nov
THE INFN GRID PROJECT zScope: Study and develop a general INFN computing infrastructure, based on GRID technologies, to be validated (as first use case)
EGEE is a project funded by the European Union under contract IST Service Activity 1 M. Cristina Vistoli ROC Coordinator All activity meeting,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The GILDA t-Infrastructure Roberto Barbera.
FP6−2004−Infrastructures−6-SSA EUChinaGrid status report Giuseppe Andronico INFN Sez. Di Catania CERN – March 3° 2006.
INFSO-RI Enabling Grids for E-sciencE An overview of EGEE operations & support procedures Jules Wolfrat SARA.
Certification and test activity ROC/CIC Deployment Team EGEE-SA1 Conference, CNAF – Bologna 05 Oct
Condor on WAN D. Bortolotti - INFN Bologna T. Ferrari - INFN Cnaf A.Ghiselli - INFN Cnaf P.Mazzanti - INFN Bologna F. Prelz - INFN Milano F.Semeria - INFN.
EGEE is a project funded by the European Union under contract IST Roles & Responsibilities Ian Bird SA1 Manager Cork Meeting, April 2004.
ROC managers meeting, Barcelona, Luciano Gaido (thanks to Paolo Veronesi for the slides) ROC-IT status.
M. Cristina Vistoli EGEE SA1 Organization Meeting EGEE is proposed as a project funded by the European Union under contract IST Regional Operations.
INFN GRID Production Infrastructure Status and operation organization Cristina Vistoli Cnaf GDB Bologna, 11/10/2005.
EGEE is a project funded by the European Union under contract IST Service Activity 1 M.Cristina Vistoli ROC Coordinator All activity meeting,
LCG Workshop User Support Working Group 2-4 November 2004 – n o 1 Some thoughts on planning and organization of User Support in LCG/EGEE Flavia Donno LCG.
First South Africa Grid Training June 2008, Catania (Italy) GILDA t-Infrastructure Valeria Ardizzone INFN Catania.
II EGEE conference Den Haag November, ROC-CIC status in Italy
– n° 1 Grid di produzione INFN – GRID Cristina Vistoli INFN-CNAF Bologna Workshop di INFN-Grid ottobre 2004 Bari.
1/3/2006 Grid operations: structure and organization Cristina Vistoli INFN CNAF – Bologna - Italy.
Access to the GRID Access by means of an User Interface (UI). It could be: –A dedicated PC, installed in a similar way to the others grid elements –UI.
Scuola Grid - Martina Franca, Thursday 08 November Il Sistema di Supporto INFNGrid & GGUS ( Global Grid User.
INFN-Grid WS, Bari, 2004/10/15 Andrea Caltroni, INFN-Padova Marco Verlato, INFN-Padova Andrea Ferraro, INFN-CNAF Bologna EGEE User Support Report.
EGEE is a project funded by the European Union under contract IST NA4/NA2 activities Roberto Barbera TB INFN Grid,
1 The Life-Science Grid Community Tristan Glatard 1 1 Creatis, CNRS, INSERM, Université de Lyon, France The Spanish Network for e-Science 2/12/2010.
– n° 1 The Grid technology and infrastructure in Italy present and future Cristina Vistoli INFN CNAF, Bologna Italy.
Bob Jones EGEE Technical Director
Il Sistema di Supporto INFNGrid & GGUS (Global Grid User Support )
Workload Management Workpackage
Grid2Win Porting of gLite middleware to Windows XP platform
Job monitoring and accounting data visualization
Regional Operations Centres Core infrastructure Centres
BaBar-Grid Status and Prospects
The EDG Testbed Deployment Details
EGEE is a project funded by the European Union
EGEE tutorial introduction Luciano Gaido INFN -Torino
Giuseppe Andronico INFN Catania
Driven by the potential of Distributed Computing to advance Scientific Discovery
GILDA t-Infrastructure
SA1 Execution Plan Status and Issues
GILDA Project Valeria Ardizzone INFN Catania Italy
Ian Bird GDB Meeting CERN 9 September 2003
Brief overview on GridICE and Ticketing System
GRID activities INFN/CNAF
VOCE Peter Kaczuk, Dan Kouril, Miroslav Ruda, Jan Svec,
Presenter (on behalf of the authors): Cristina Vistoli
The Grid Production infrastructure
INFN – GRID status and activities
Grid2Win: Porting of gLite middleware to Windows XP platform
The INFN TIER1 Regional Centre
The CCIN2P3 and its role in EGEE/LCG
Operating the World’s largest grid infrastructure
BalticGrid Operations
LCG Operations Workshop, e-IRG Workshop
Pierre Girard ATLAS Visit
The GENIUS portal and the GILDA t-Infrastructure
Computing Coordination in Italy
Presentation transcript:

– n° 1 The Grid Production infrastructure Cristina Vistoli INFN CNAF

– n° 2 INFN-Grid – goals u Promote computational grid technologies research & development: Middleware and grid tools n Through european and national projects s DataGrid, DataTAG, Firb-GRID-it, EGEE, LCG, CoreGRID etc n Internal R&D activities u Deploy – operate - support INFN grid production infrastructure: Grid as “coordinated resource sharing” on a large scale for a multi-institutional and dynamic virtual organisation u Set up the national production grid Infrastructure open to the national research community n FIRB: Grid.it – astrophysic, geophysic, biomedicine, computational chemistry etc n Reserch community and industry

– n° 3 INFN-Grid – goals u Provide operation and support of the EGEE/LCG production infrastructure u Promote dissemination activity to ‘gridify’ scientific applications n GILDA testbed n Genius portal

– n° 4 INFN-GRID partecipation to EGEE u EGEE SA1 – infrastructure operation and support n ROC – Regional Operation Center n CIC - Core Infrastructure Center u EGEE JRA1 – IT-CZ cluster n Workload management system n Resource access - CE – accounting - policy n VOMS u EGEE NA4/NA3/NA2/NA5 n HEP application n Generic application n Dissemination

– n° 5 INFN-GRID partecipation to LCG u LHC Computing Grid main sites: T1 and n*T2 u LHC Experiments and applications support u Operation and deployment of the Grid infrastructure (national and international)

– n° 6 INFN-GRID participation to CoreGRID u The CoreGRID Network of Excellence (NoE) aims at strengthening and advancing scientific and technological excellence in the area of Grid and Peer-to-Peer technologies n Grid Information and Monitoring Services n Knowledge & Data Management

– n° 7 INFN-GRID partecipation to GRID.IT/FIRB u Set up the national production grid Infrastructure open to the national research community u Grid management and support tools - system n First tools in production n R&D on s Resource Utilization Policies s Data Management s Scientific Data Base grid integration s Middleware porting

– n° 8 TORINO PADOVA BARI PALERMO FIRENZE PAVIA GENOVA NAPOLI CAGLIARI TRIESTE ROMA PISA L’AQUILA CATANIA BOLOGNA UDINE TRENTO PERUGIA LNF LNGS SASSARI LECCE LNS LNL SALERNO COSENZA S.Piero FERRARA PARMA CNAF ROMA2 INFN VO CMS Atlas Alice LHCb Babar VIRGO grid.it resources and VO Italian – Grid ( Site/resource map) MILANO National Grid )

– n° 9 INFN-GRID Release u INFN-GRID is a customized release of LCG n All resources are fully managed via LCFGng; n INFN-GRID does not support the middleware installation without LCFGng; n Change with the next release based on SL3:YAIM and Quattor u INFN-GRID release is based upon the official LCG and it is 100% compatible;

– n° 10 INFN-GRID Release u Main differences from LCG to INFN-GRID 2.3.0: n Added support for DAG jobs; n Added support for AFS on the WorkerNodes; n Added support for MPI jobs via home syncronisation with ssh; n Documented installation of WNs on a private network; u Added full function VOMS support: n INFNGRID, CDF are completely managed via VOMS server.

– n° 11 INFN-GRID: Resources and supported VOs (**) Hyperthreaded

– n° 12 INFN-GRID: Production Grid service Service Resources are open to all VOs supported RB-BDII scope Italian Grid NEW! Resource Broker/UI DAG prod-rb-01.pd.infn.it

– n° 13 Grid.IT Production Grid: deployment portal u User documentation u site managers documentation u Software repository u Monitoring u Trouble tickets system u Knowledge base

– n° 14 EGEE/LCG: Production Grid services Service Resources are open to all VOs supported by INFN-GRID and EGEE/LCG RB: egee-rb-01.cnaf.infn.it support BIOMED VO RB-BDII scope all european resources EGEE/LCG RB/UI with DAG

– n° 15 Certification activity – TEST ZONE u The Central Management Team is responsible of the resource centers certification: checking the functionalities of a site before joining the site to the production grid. u Although all certification jobs are VO independent, the INFNGRID VO is used to perform these jobs; u In particular are checked: s GIIS' information consistence; s Local jobs submission (LRMS); s Grid submission with Globus (globus-job-run); s Grid submission with the ResorceBroker; s ReplicaManager functionalities; s MPI functionalities u In order to certificate a site the CMT uses dedicated grid services: n RB & BDII: gridit-cert-rb.cnaf.infn.it u In this way we avoid to have an uncertified site in the production grid services;

– n° 16 Periodic test u CMT and system managers, could notify advices about their resources via web inserting a “Downtime advices”. u The Calendar shows the snapshot of the Production Service Status. u We periodically submit certification jobs to the sites in order to pro-actively find ‘troubles’ before users find them.

– n° 17 Ticketing system u INFN-GRID ticketing system is used: s from users to ask questions or to communicate troubles; s from system manager to communicate about common grid tasks (ex: upgrading to a new grid release) s from CMT to system manager to notify a problem n Support Groups are “helper” groups and they exist to resolve the obvious problems arising with the grow of the grid: n Support Grid Services (RB, RLS, VOMS, GridICE, etc) Group; n Support VO Services Group (each for every VO); n Support VOApplications Group (each for every VO); n Support Site Group (each for every site) n Operative Groups Operative Central Management Team (CMT); n Operative Release & Deployment Team; Users -> Create a ticket Supporters/Operatives -> Open the ticket Users and/or Supporters/Operatives -> Update an open ticket Supporters/Operatives -> Close the ticket

– n° 18 Attivita’ in corso u Sistema di supporto: integrazione in EGEE e copertura supporto distribuito u Evoluzione di Gridice per job monitoring, application monitoring, SLA monitoring, urgente configurazione notifiche u Integrazione di DGAS in INFN-GRID  amministrazione sistema di accounting u Porting di INFN-GRID a SL : nuovo sistema di installazione e configurazione u Operation support infrastruttura EGEE/LCG a ‘rotazione’ tra IT/CERN/UK/FR u Training: corso base e avanzato u Allargamento infrastruttura a sedi non INFN: Spaci, Enea, etc u Amministrazione Policy u Pre-production service per definire il programma di migrazione a Glite u Middleware certification testbed u Operational requirements per il middleware

– n° 19 Useful links u INFN Grid n u INFN production GRID infrastructure n u INFN GRID development projects portal n u INFN GridICE n u INFN Support n u Contact n (management board) n (technical board) n (production grid management team)