The INFN-GRID RLS A. Cavalli - INFN-CNAF

Slides:



Advertisements
Similar presentations
DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.
Advertisements

EGEE is a project funded by the European Union under contract IST Grid Data Management Hands-on Simone Campana LCG Experiment Integration and.
DataGrid is a project funded by the European Commission under contract IST WP2 – R2.1 Overview of WP2 middleware as present in EDG 2.1 release.
1 CHEP 2000, Roberto Barbera Tests of data management services in EDG 1.2 ALICE Off-line Week,
EGEE is a project funded by the European Union under contract IST Using SRM: DPM and dCache G.Donvito,V.Spinoso INFN Bari
Grid Data Management Assaf Gottlieb - Israeli Grid NA3 Team EGEE is a project funded by the European Union under contract IST EGEE tutorial,
EGEE is a project funded by the European Union under contract IST Data Services Valeria Ardizzone EGEE NA4 Generic Applications INFN Catania.
E-science grid facility for Europe and Latin America Installation and configuration of a top BDII Gianni M. Ricciardi – Consorzio COMETA.
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America BDII Server Installation Vanessa.
CMS Stress Test Report Marco Verlato (INFN-Padova) INFN-GRID Testbed Meeting 17 Gennaio 2003.
GLite Information System(s) Antonio Juan Rubio Montero CIEMAT 10 th EELA Tutorial. Madrid, May 7 th -11 th,2007.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
Certification and test activity IT ROC/CIC Deployment Team LCG WorkShop on Operations, CERN 2-4 Nov
INFSO-RI Enabling Grids for E-sciencE BDII installation & configuration Giuseppe Platania INFN Catania EMBRACE Tutorial Clermont-Ferrand,
DDM Monitoring David Cameron Pedro Salgado Ricardo Rocha.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.
VOMS: Status & Plans Vincenzo Ciaschini, Valerio Venturi MWSG Meeting, CERN, Feb
EGEE is a project funded by the European Union under contract IST EGEE tutorial introduction Roberto Barbera University of Catania and INFN.
INFSO-RI Enabling Grids for E-sciencE Introduction Data Management Ron Trompert SARA Grid Tutorial, September 2007.
Certification and test activity ROC/CIC Deployment Team EGEE-SA1 Conference, CNAF – Bologna 05 Oct
E-infrastructure shared between Europe and Latin America gLite Information System(s) Manuel Rubio del Solar CETA-CIEMAT EELA Tutorial, Mérida,
INFSO-RI Enabling Grids for E-sciencE /10/20054th EGEE Conference - Pisa1 gLite Configuration and Deployment Models JRA1 Integration.
Data Management The European DataGrid Project Team
Oct HPS Collaboration Meeting Jeremy McCormick (SLAC) HPS Web 2.0 OR Web Apps and Databases (Oh My!) Jeremy McCormick (SLAC)
EGEE is a project funded by the European Union under contract INFSO-RI Grid accounting with GridICE Sergio Fantinel, INFN LNL/PD LCG Workshop November.
ROC managers meeting, Barcelona, Luciano Gaido (thanks to Paolo Veronesi for the slides) ROC-IT status.
EGEE is a project funded by the European Union under contract IST Experiment Software Installation toolkit on LCG-2
INFN GRID Production Infrastructure Status and operation organization Cristina Vistoli Cnaf GDB Bologna, 11/10/2005.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation Claudio Cherubino.
Replicazione e QoS nella gestione di database grid-oriented Barbara Martelli INFN - CNAF.
II EGEE conference Den Haag November, ROC-CIC status in Italy
First South Africa Grid Training Installation and configuration of BDII Gianni M. Ricciardi Consorzio COMETA First South Africa Grid Training Catania,
EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Guy Warner NeSC Training Team Induction to Grid Computing.
1/3/2006 Grid operations: structure and organization Cristina Vistoli INFN CNAF – Bologna - Italy.
Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.
Grid Data Management Assaf Gottlieb Tel-Aviv University assafgot tau.ac.il EGEE is a project funded by the European Union under contract IST
EGRID Project: Experience Report Implementation of a GRID Infrastructure for the Analysis of Economic and Financial data.
Servizi core INFN Grid presso il CNAF: setup attuale
INFNGRID Technical Board, Feb
Grid2Win Porting of gLite middleware to Windows XP platform
Oxana Smirnova, Jakob Nielsen (Lund University/CERN)
Classic Storage Element
EGEE tutorial introduction Luciano Gaido INFN -Torino
CE-Monitor Luigi Zangrando INFN-Padova
Installation and configuration of a top BDII
gLite Information System(s)
GILDA Project Valeria Ardizzone INFN Catania Italy
Technical Board Meeting, CNAF, 14 Feb. 2004
BDII Performance Tests
LFC Status and Futures INFN T1+T2 Cloud Workshop
Jean-Philippe Baud - Sophie Lemaitre IT-GD, CERN May 2005
lcg-infosites documentation (v2.1, LCG2.3.1) 10/03/05
The Information System in gLite
Grid2Win: Porting of gLite middleware to Windows XP platform
Presenter (on behalf of the authors): Cristina Vistoli
Job Application Monitoring e cosa offre JAM G. Donvito,G. Maggi,M
INFN – GRID status and activities
The GENIUS portal Roberto Barbera University of Catania and INFN
gLite Information System
Berkley Database Information Index (BDII) Server Installation & Configuration Giuseppe La Rocca INFN – Catania gLite Tutorial Rome, April 2006.
Data Management in Release 2
gLite Information System
gLite Information System(s)
EGEE Middleware: gLite Information Systems (IS)
The GENIUS portal and the GILDA t-Infrastructure
gLite Information System
BDII Server Installation and Configuration
Information System (BDII)
Site availability Dec. 19 th 2006
Information Services Claudio Cherubino INFN Catania Bologna
Presentation transcript:

The INFN-GRID RLS A. Cavalli - INFN-CNAF GRID Manager Tutorial Laboratori Nazionali di Frascati 22 Feb. 2005 – 25 Feb. 2005 The INFN-GRID RLS A. Cavalli - INFN-CNAF www.eu-egee.org EGEE is a project funded by the European Union under contract IST-2003-508833

The INFN-GRID RLS The service is run at CNAF Hosted VOs: babar, bio, cdf, compchem, gridit, inaf, infngrid, ingv, lcfgt, planck, theophys, virgo EDG RLS RLS host: datatag2.cnaf.infn.it Tomcat4 listening on port 8080 MySQL backend GRIS: testbed011.cnaf.infn.it Publishes RLS access points for each VO It’s a dedicated GRIS, to avoid possible problems with CE or SE GRIS, down for maintenance, etc. It’s included as stand-alone entry in the BDII lists as: INFN-RLS-INFO ldap://testbed011.cnaf.infn.it:2135/mds-vo-name=infn-rls-info,o=grid

The INFN-GRID RLS (II) On http://grid-it.cnaf.infn.it : Service information: Contact information: Ticketing System: On the Information System : Via ldap-browser or ldapsearch: ldapsearch –x –h ibm140.cnaf.infn.it –p 2170 –b “mds-vo-name=infn-rls- info,mds-vo-name=local,o=grid” ldapsearch –x –h testbed011.cnaf.infn.it –p 2135 –b “mds-vo-name=infn- rls-info,o=grid” SERVICE INFO & SUPPORT » Grid status » Grid services » Support » Ticketing System RLS AccessPointURLs BDII GRIS

The INFN-GRID RLS (III) http://grid-it.cnaf.infn.it

The INFN-GRID RLS (II) On http://grid-it.cnaf.infn.it : Service information: Contact information: Ticketing System: On the Information System : Via ldap-browser or ldapsearch: ldapsearch –x –h ibm140.cnaf.infn.it –p 2170 –b “mds-vo-name=infn-rls- info,mds-vo-name=local,o=grid” ldapsearch –x –h testbed011.cnaf.infn.it –p 2135 –b “mds-vo-name=infn- rls-info,o=grid” SERVICE INFO & SUPPORT » Grid status » Grid services » Support » Ticketing System RLS AccessPointURLs BDII GRIS

The INFN-GRID RLS (IV) http://grid-it.cnaf.infn.it » Support » Ticketing System

The INFN-GRID RLS (II) On http://grid-it.cnaf.infn.it : Service information: Contact information: Ticketing System: On the Information System : Via ldap-browser or ldapsearch: ldapsearch –x –h ibm140.cnaf.infn.it –p 2170 –b “mds-vo-name=infn-rls- info,mds-vo-name=local,o=grid” ldapsearch –x –h testbed011.cnaf.infn.it –p 2135 –b “mds-vo-name=infn- rls-info,o=grid” SERVICE INFO & SUPPORT » Grid status » Grid services » Support » Ticketing System RLS AccessPointURLs BDII GRIS

The INFN-GRID RLS (V) AccessPointURLs published by PlainGRIS-->BDII

RLS: Service Access Point URLs GlueServiceAccessPointURL: http://datatag2.cnaf.infn.it:8080/<VO_NAME>/edg-local-replica-catalog/services/edg-local-replica-catalog http://datatag2.cnaf.infn.it:8080/<VO_NAME>/edg-replica-metadata-catalog/services/edg-replica-metadata-catalog Published in MDS to give the access point to UI-RB-WN Can be used to check RLS by hand with a web browser: This message means: Tomcat up and infngrid LRC responding

RLS: Testing URLs Another web interface can help to check that service is up and well configured: http://datatag2.cnaf.infn.it:8080/<VO_NAME>/edg-local-replica-catalog/index.html http://datatag2.cnaf.infn.it:8080/<VO_NAME>/edg-replica-metadata-catalog/index.html Also this page means that Tomcat is alive and RMC or LRC for that VO is configured

RLS: testing and admin CLI (UI & WN) $ edg-lrc-admin -i ping -h datatag2.cnaf.infn.it --vo bio OK : schema version = 2.2.1 $ edg-rmc-admin -i ping -h datatag2.cnaf.infn.it --vo bio edg-lrc, edg-rmc These commands are equivalent to the “ping” function on the web page These ones are to low-level manage the RLS LRC/RMC DB All these java-based clients are going to be replaced by faster & improved ones with the new LCG File Catalog

RLS: MySQL tables The lower level to interact with the catalog: the mysql client mysql> show databases; +-------------------+ | Database | | edg_lrcdbbabar | | edg_lrcdbbio | | edg_lrcdbbiomed | | edg_lrcdbcdf | | edg_lrcdbcompchem | | edg_lrcdbgridit | | edg_lrcdbinaf | | edg_lrcdbinfngrid | | edg_lrcdbingv | | edg_lrcdblcfgt | | edg_lrcdbplanck | | edg_lrcdbtheophys | | edg_lrcdbvirgo | | edg_rmcdbbabar | | edg_rmcdbbio | | edg_rmcdbbiomed | | edg_rmcdbcdf | | edg_rmcdbcompchem | | edg_rmcdbgridit | | edg_rmcdbinaf | | edg_rmcdbinfngrid | | edg_rmcdbingv | | edg_rmcdblcfgt | | edg_rmcdbplanck | | edg_rmcdbtheophys | | edg_rmcdbvirgo | | mysql | | test | +-------------------+ 28 rows in set (0.00 sec)

RLS: MySQL tables (II) The RMC and LRC tables: mysql> use edg_rmcdbinfngrid; Database changed mysql> show tables; +-----------------------------+ | Tables_in_edg_rmcdbinfngrid | | alias | | alias_attr_desc | | alias_str_attr | | collection | | guid | | guid_attr_desc | | guid_str_attr | | schema_version | 8 rows in set (0.00 sec) mysql> use edg_lrcdbinfngrid; Database changed mysql> show tables; +-----------------------------+ | Tables_in_edg_lrcdbinfngrid | | attr_desc | | guid | | pfn | | pfn_str_attr | | rli_subscriber | | schema_version | 6 rows in set (0.00 sec)

RLS: MySQL tables (III) Low level operations on mysql can be a faster solution when big cleaning/maintenance activity has to be done. An example is the case of a broken SE which has lost all the data. The catalog has to be cleaned. SQL commands composed by pieces like this one could be used: delete from pfn where pfn_pfn regexp '.*grid007g.cnaf.infn.it.*'; which erases all the Physical File Names related with that SE from the pfn table. Until now this kind of problems have never happened with our RLS at Cnaf. We have just sometimes cleaned/modified single records for special reasons or small problems/tests.

FINAL CONSIDERATIONS Until now the amount of registrations and general activity of the supported VOs hasn’t been so heavy to urge us to replace MySQL with Oracle I have just started to look for MySQL “consistent backup” techniques. This seems possible with LOCKS and/or replication, although by default a dump or a backup can produce a bad copy if the DB is online and writing in. Hope LCG File Catalog will be an improvement we can migrate easily. Anyone who needs to set up a RLS service for any reason could take a look here: http://goc.grid.sinica.edu.tw/gocwiki : » Admin's Guides » Setting up a RLS service for a new VO