SEE-GRID-SCI Storage Element Installation and Configuration Branimir Ackovic Institute of Physics Serbia The SEE-GRID-SCI.

Slides:



Advertisements
Similar presentations
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America SRM Installation and Configuration.
Advertisements

Workflows over Grid-based Web services General framework and a practical case in structural biology gLite 3.0 Data Management David García Aristegui Grid.
SEE-GRID-SCI User Interface (UI) Installation and Configuration Branimir Ackovic Institute of Physics Serbia The SEE-GRID-SCI.
Grid Data Management Assaf Gottlieb - Israeli Grid NA3 Team EGEE is a project funded by the European Union under contract IST EGEE tutorial,
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
9th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America SRM Installation and Configuration.
БАЗОВЫЕ СРЕДСТВА РАБОТЫ С ФАЙЛАМИ В GRID. The gLite3 Architecture Security Service: Grid Security Infrastructure (GSI) Secure Sockets Layer (SSL) communication.
EGEE-II INFSO-RI Enabling Grids for E-sciencE gLite Data Management System Yaodong Cheng CC-IHEP, Chinese Academy.
DPM Server Installation Claudio Cherubino INFN - Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE gLite Demo Yaodong Cheng CC-IHEP, Chinese Academy of Sciences The.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Data Management Hands-on Claudio Cherubino.
The LCG File Catalog (LFC) Jean-Philippe Baud – Sophie Lemaitre IT-GD, CERN May 2005.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE middleware Data Management in gLite.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Nov. 18, EGEE and gLite are registered trademarks gLite Middleware Usage Dusan.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE middleware: gLite Data Management EGEE Tutorial 23rd APAN Meeting, Manila Jan.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
Jan 31, 2006 SEE-GRID Nis Training Session Hands-on V: Standard Grid Usage Dušan Vudragović SCL and ATLAS group Institute of Physics, Belgrade.
Light weight Disk Pool Manager experience and future plans Jean-Philippe Baud, IT-GD, CERN September 2005.
Data Access for Analysis Jeff Templon PDP Groep, NIKHEF A. Tsaregorodtsev, F. Carminati, D. Liko, R. Trompert GDB Meeting 8 march 2006.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Hands-on on data management Tony Calanducci.
INFSO-RI Enabling Grids for E-sciencE Experiences with LFC and comparison with RNS Erwin Laure Jean-Philippe.
E-science grid facility for Europe and Latin America Data Management Services E2GRIS1 Rafael Silva – UFCG (Brazil) Universidade Federal.
SEE-GRID-SCI Overview of YAIM and SEE-GRID-SCI YAIM templates Dusan Vudragovic Institute of Physics Belgrade Serbia The.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
EGEE is a project funded by the European Union under contract IST Grid Data Management Roberto Barbera Univ. Of Catania and INFN
Managing Data DIRAC Project. Outline  Data management components  Storage Elements  File Catalogs  DIRAC conventions for user data  Data operation.
INFSO-RI Enabling Grids for E-sciencE Introduction Data Management Ron Trompert SARA Grid Tutorial, September 2007.
SEE-GRID-SCI Hands-On Session: Using Grid Vladimir Slavnic Institute of Physics, Belgrade Serbia The SEE-GRID-SCI initiative.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Data Management System Giuseppe Andronico.
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Data management in LCG and EGEE David Smith.
INFSO-RI Enabling Grids for E-sciencE SRMv2.2 in DPM Sophie Lemaitre Jean-Philippe.
Recovery of Lost Files Jiří Chudoba Institute of Physics, Prague.
1 Xrootd-SRM Andy Hanushevsky, SLAC Alex Romosan, LBNL August, 2006.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Data management in EGEE.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Data Management Hands-on Juan Eduardo Murrieta.
1 DIRAC Data Management Components A.Tsaregorodtsev, CPPM, Marseille DIRAC review panel meeting, 15 November 2005, CERN.
INFSO-RI Enabling Grids for E-sciencE University of Coimbra Data Management System gLite – LCG – FiReMan Salvatore Scifo INFN Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Architecture of LHC File Catalog Valeria Ardizzone INFN Catania – EGEE-II NA3/NA4.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Algiers, EUMED/Epikh Application Porting Tutorial, 2010/07/04.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) LFC Installation and Configuration Dong Xu IHEP,
SEE-GRID-SCI New AEGIS services Dusan Vudragovic Institute of Physics Belgrade Serbia The SEE-GRID-SCI initiative is co-funded.
Introduction to Storage Element Hsin-Wei Wu Academia Sinica Grid Computing Center, Taiwan.
GRID commands lines Original presentation from David Bouvet CC/IN2P3/CNRS.
Grid Data Management Assaf Gottlieb Tel-Aviv University assafgot tau.ac.il EGEE is a project funded by the European Union under contract IST
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Data Management Maha Metawei
INFSO-RI Enabling Grids for E-sciencE Practicals on LFC and gLite DMS Tony Calanducci Emidio Giorgio INFN Retreat between GILDA.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
Martedi 8 novembre 2005 Consorzio COMETA “Progetto PI2S2” FESR Data Management System Annamaria Muoio -- INFN Catania PI2S2 First Tutorial -- Messina,
EGEE Data Management Services
GFAL Grid File Access Library
GFAL Grid File Access Library
GFAL: Grid File Access Library
gLite Basic APIs Christos Filippidis
DPM Installation Configuration
Java API del Logical File Catalog (LFC)
The gLite Data Management System
LFC Installation and Configuration
gLite Data management system overview
The gLite API – Part II Giuseppe LA ROCCA ACGRID-II School
Hands-On Session: Data Management
Data Management in Release 2
Data Management Ouafa Bentaleb CERIST, Algeria
Data services in gLite “s” gLite and LCG.
DPM Hands-on Session AEGIS Training for Site Administrators
Architecture of the gLite Data Management System
gLite Data and Metadata Management
INFNGRID Workshop – Bari, Italy, October 2004
Data Management system in gLite middleware
Presentation transcript:

SEE-GRID-SCI Storage Element Installation and Configuration Branimir Ackovic Institute of Physics Serbia The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no Regional SEE-GRID-SCI Training for Site Administrators Institute of Physics Belgrade March 5-6, 2009

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, Overview Storage Element SE Types SURL, GUID, LFN SE DPM Installation SE DPM Configuration Data Managament

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, Storage Element A Storage Element (SE) provides uniform access to data storage resources. The Storage Element may control simple disk servers, large disk arrays or tape-based Mass Storage Systems (MSS). Most sites provide at least one SE.

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, SE Types GSIFTP – Grid Security Infrastructure File Transfer Protocol RFIO – Remote File IO Gsidcap - GSI dCache Access Protocol SRM – Storage Resource Manager

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, LFN, GUID, SURL LFN – Logical File Name GUID - Grid Unique Identifier SURL – Storage URL

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, SE DPM Installation yum install glite-SE_dpm_disk glite-SE_dpm_mysql

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, SE DPM Configuration ############################### # DPM configuration variables # ############################### # The name of the DPM head node # Adjust according to your site DPM_HOST= # The DPM pool name (max 15 character long name) # Adjust according to your site DPMPOOL= # The filesystems/partitions parts of the pool # Adjust according to your site DPM_FILESYSTEMS="$DPM_HOST:/storage/data" #Directory where the data is stored (absolute path, e.g. /storage). on a DPM node #Deprecated in favour of DPM_FILESYSTEMS #DPMDATA=/storage # The database user # Adjust according to your site DPM_DB_USER=

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, SE DPM Configuration # The database user password # Adjust according to your site DPM_DB_PASSWORD= # The DPM database host # Adjust according to your site DPM_DB_HOST=$DPM_HOST # The DPM db name. Default is dpm_db DPM_DB=dpm_db # The DPNS db name. Default is cns_db DPNS_DB=cns_db # The DPM infosystem user name # Adjust according to your site DPM_INFO_USER= # The DPM infosystem user password # Adjust according to your site DPM_INFO_PASS=

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, SE DPM Configuration # Specifies the default amount of space reserved for a file DPMFSIZE=200M # Variable for the port range - Optional, default value is shown RFIO_PORT_RANGE=" " #The DPNS server base dir. Default value is home, i.e. the DPNS server is serving the #/dpm/domain/home name space. If you have multiple DPNS server under the same domain use #for example home2 or data for this value. DPNS_BASEDIR=home

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, SE DPM Configuration yaim -c -s -n SE_dpm_disk -n SE_dpm_mysql

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, Data Management - LFC lfc-chmod Change access mode of a LFC file/directory. lfc-chown Change owner and group of a LFC file/directory. lfc-delcomment Delete the comment associated with a file/directory. lfc-getacl Get file/directory access control lists. lfc-ln Make a symbolic link to a file/directory. lfc-ls List file/directory entries in a directory. lfc-mkdir Create directory. lfc-rename Rename a file/directory. lfc-rm Remove a file/directory. lfc-setacl Set file/directory access control lists. lfc-setcomment Add/replace a comment. lfc-entergrpmap Defines a new group entry in the Virtual ID table. lfc-enterusrmap Defines a new user entry in Virtual ID table. lfc-modifygrpmap Modifies a group entry corresponding to a given virtual gid. lfc-modifyusrmap Modifies a user entry corresponding to a given virtual uid. lfc-rmgrpmap Suppresses group entry corresponding to a given virtual gid or group name lfc-rmusrmap Suppresses user entry corresponding to a given virtual uid or user name.

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, Data Management – LCG lcg-cp Copies a Grid file to a local destination (download) lcg-cr Copies a file to a SE and registers the file in the catalog (LFC or LRC) (upload) lcg-del Deletes one file (either one replica or all replicas) lcg-rep Copies a file from one SE to another SE and registers it in the catalog (LFC or LRC) (replicate) lcg-gt Gets the TURL for a given SURL and transfer protocol lcg-sd Sets file status to ”Done” for a given SURL in an SRM’s request lcg-aa Adds an alias in the catalog (LFC or RMC) for a given GUID. lcg-ra Removes an alias in the catalog (LFC or RMC) for a given GUID. lcg-rf Registers in the the catalog (LFC or LRC/RMC), a file residing on an SE. lcg-uf Unregisters in the the catalog (LFC or LRC) a file residing on an SE. lcg-la Lists the aliases for a given LFN, GUID or SURL. lcg-lg Gets the GUID for a given LFN or SURL. lcg-lr Lists the replicas for a given LFN, GUID or SURL.