gLite 1.4. Data Mangement Exercises

Slides:



Advertisements
Similar presentations
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using EGEE middleware: AA and simple job submission.
Advertisements

Workflows over Grid-based Web services General framework and a practical case in structural biology gLite 3.0 Data Management Hands-on David García Aristegui.
EGEE is a project funded by the European Union under contract IST Grid Data Management Hands-on Simone Campana LCG Experiment Integration and.
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
It’s not about security... it’s about access! Grid Security Pieter van Beek.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Tutorial Getting started with GILDA.
EGEE is a project funded by the European Union under contract IST Data Services Valeria Ardizzone EGEE NA4 Generic Applications INFN Catania.
GLite authentication and authorization Discipline: Grid Computing, 07/08-2 Practical classes Inês Dutra, DCC/FCUP.
INFSO-RI Enabling Grids for E-sciencE Practicals on VOMS and MyProxy Emidio Giorgio INFN Retreat between GILDA and ESR VO, Bratislava,
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Luciano Díaz ICN-UNAM Based on Domenico.
INFSO-RI Enabling Grids for E-sciencE gLite Data Management Services - Overview Mike Mineter National e-Science Centre, Edinburgh.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America MyProxy server installation Emidio Giorgio.
E-infrastructure shared between Europe and Latin America Security Hands-on Christian Grunfeld, UNLP 8th EELA Tutorial, La Plata, 11/12-12/12,2006.
INFSO-RI Enabling Grids for E-sciencE GILDA Practicals : Security systems GILDA Tutors Singapore, 1st South East Asia Forum -- EGEE.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA Hands-on on security Pedro Rausch IF - UFRJ.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Giuseppe La Rocca INFN – Catania
Hands-on security Angelines Alberto Morillas Ciemat.
EGEE is a project funded by the European Union under contract IST Grid proxy and MyProxy Roberto Barbera Univ. of Catania and INFN SEE-GRID.
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America Security Hands-on Vanessa.
NorduGrid plans and questions for gLite Marko Niinimaki, NorduGrid 3 rd EGEE meeting Athens, April 2005.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Practicals on Security Miguel Cárdenas Montes.
E-infrastructure shared between Europe and Latin America Security Hands-on Alexandre Duarte CERN Fifth EELA Tutorial Santiago, 06/09-07/09,2006.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Moisés Hernández Duarte UNAM FES Cuautitlán.
Further aspects of EGEE middleware components INFN, Catania EGEE is funded by the European Union under contract IST
INFSO-RI Enabling Grids for E-sciencE VOMS & MyProxy interaction Emidio Giorgio INFN NA4 Generic Applications Meeting 10 January.
Enabling Grids for E-sciencE Sofia, 17 March 2009 INFSO-RI Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives –
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
Hands-on security Carlos Fuentes RedIRIS Madrid,26 – 30 de Octubre de 2008.
Hands on Security, Authentication and Authorization Virginia Martín-Rubio Pascual RedIRIS/Red.es Curso Grid y e-Ciencia.
EGI-InSPIRE RI Grid Training for Power Users EGI-InSPIRE N G I A E G I S Grid Training for Power Users Institute of Physics Belgrade.
Tutorial on "GRID Computing“ EMBnet Conference 2008 CNR - ITB Authenticated Grid access with robot certificates Giuseppe LA ROCCA INFN.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) 马兰馨 IHEP, CAS Hands on gLite Security.
Enabling Grids for E-sciencE gLite security pratical tutorial Dario Russo INFN Catania Catania,
INFSO-RI Enabling Grids for E-sciencE University of Coimbra gLite 1.4 Data Management System Salvatore Scifo, Riccardo Bruno Test.
INFSO-RI Enabling Grids for E-sciencE GILDA t-Infrastructure Antonio Fuentes Bermejo
First South Africa Grid Training June 2008, Catania (Italy) GILDA t-Infrastructure Valeria Ardizzone INFN Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Architecture of LHC File Catalog Valeria Ardizzone INFN Catania – EGEE-II NA3/NA4.
Entorno De Prácticas Gabriel Amorós (IFIC). vo.formacion.es-ngi.eu: is a Virtual Organisation (VO) from the Spanish National Grid Initiative (NGI) devoted.
GRID commands lines Original presentation from David Bouvet CC/IN2P3/CNRS.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
EGEE is a project funded by the European Union under contract IST Job Submission Giuseppe La Rocca EGEE NA4 Generic Applications INFN Catania.
EGEE is a project funded by the European Union under contract IST Grid proxy and MyProxy Giuseppe La Rocca EGEE NA4 Generic Applications GENIUS/GILDA.
GFAL Grid File Access Library
GFAL Grid File Access Library
GFAL: Grid File Access Library
LFC Server Installation & Configuration
gLite Basic APIs Christos Filippidis
GILDA t-Infrastructure
Java API del Logical File Catalog (LFC)
MyProxy Server Installation
Practicals on VOMS and MyProxy
LFC Installation and Configuration
Security and getting access to the training infrastructure
Introductions Using gLite Grid Miguel Angel Díaz Corchero
UI Installation and Configuration
gLite User Interface Installation
login: clermont-ferrandxx password: GridCLExx
Riccardo Bruno, Salvatore Scifo gLite - Tutorial Catania, dd.mm.yyyy
DMS API gLite Hands On Salvatore Scifo
Long term job submission and monitoring uing grid services
Data Management Ouafa Bentaleb CERIST, Algeria
Certificates Usage and Simple Job Submission
Data services in gLite “s” gLite and LCG.
Certificates Usage and Simple Job Submission
EGEE Middleware: gLite Information Systems (IS)
The GENIUS portal and the GILDA t-Infrastructure
Certificates Usage and Simple Job Submission
Architecture of the gLite Data Management System
gLite Data and Metadata Management
UI Installation and Configuration
Presentation transcript:

gLite 1.4. Data Mangement Exercises Salvatore Scifo Test Tutorial Catania February 8th, 2006

Starting to work with DMS Before starting to use DMS ensure yourself about having a valid proxy certificate. [glite-tutor] /home/sammysci/dms_exercise > voms-proxy-info Couldn't find a valid proxy. It means that your certificate has just expired  and you need to get a new one .…… Salvatore Scifo INFN Catania

Get a one day valid proxy [glite-tutor] /home/sammysci/dms_exercise > voms-proxy-init --voms gilda Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it Enter GRID pass phrase: Your proxy is valid until Tue Feb 7 22:57:56 2006 Creating temporary proxy ................................................. Done Contacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/Email=emidio.giorgio@ct.infn.it] "gilda" Creating proxy ........................................ Done [glite-tutor] /home/sammysci/dms_exercise > voms-proxy-info subject : /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it/CN=proxy issuer : /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it identity : /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it type : proxy strength : 512 bits path : /tmp/x509up_u3017 timeleft : 11:53:28 Now you are able to interact to the GRID services. Salvatore Scifo INFN Catania

Get a 7 days valid proxy [glite-tutor] /home/sammysci/dms_exercise > myproxy-init –voms –s grid001.ct.infn.it Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it Enter GRID pass phrase for this identity: Creating proxy ..................................... Done Proxy Verify OK Your proxy is valid until: Tue Feb 14 11:12:59 2006 Enter MyProxy pass phrase: Verifying password - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user sammysci now exists on grid001.ct.infn.it. [glite-tutor] /home/sammysci/dms_exercise > myproxy-get-delegation -sgrid001.ct.infn.it [glite-tutor] /home/sammysci/dms_exercise > myproxy-info -sgrid001.ct.infn.it username: sammysci owner: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it timeleft: 167:58:15 (7.0 days) Now you are able to interact to the GRID services. Salvatore Scifo INFN Catania

glite-catalog-ls [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy /sammy/pippoRemote.txt /sammy/tmpdir [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy –l -pdrwl-gs--r-l-g--------- 15 2006-02-06 12:40:40 /sammy/pippoRemote.txt dpdrwlx----rwl-----r-l---+ 0 2006-02-06 10:50:05 /sammy/tmpdir [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy –lv # Using endpoint https://grid017.ct.infn.it:8443/gilda/glite-data-catalog-service-fr-mysql/services/FiremanCatalog # Service version: 1.4.2 # Interface version: 2.0.0 # Schema version: 1 # Client version: 1.7.1 # Client interface version: 1.7.1 Salvatore Scifo INFN Catania

glite-catalog-rm [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-rm /sammy/tempdir rm: getFileCatalogEntry: Lfn "/sammy/tempdir" does not exist! [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-rm /sammy/tmpdir rm: rmdir: directory: "/sammy/tmpdir" is not empty! [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy -R /sammy/pippoRemote.txt /sammy/tmpdir /sammy/tmpdir/pippo.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-rm /sammy/tmpdir/pippo.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy -lR -pdrwl-gs--r-l-g--------- 15 2006-02-06 12:40:40 /sammy/pippoRemote.txt dpdrwlx----rwl-----r-l---+ 0 2006-02-06 10:50:05 /sammy/tmpdir Uhm… Uhm… Let’s take a look better!!! Salvatore Scifo INFN Catania

Creating a new test file [glite-tutor] /home/sammysci/dms_exercise > vi tutorial.txt this is a test file for this tutorial ;-) ~ :w :q [glite-tutor] /home/sammysci/dms_exercise > ls -al total 20 drwxr-xr-x 2 sammysci users 4096 Feb 7 2006 . drwx------ 9 sammysci users 4096 Feb 7 2006 .. -rw-r--r-- 1 sammysci users 42 Feb 7 11:44 tutorial.txt Notice that these are a linux command line of the UI machine Salvatore Scifo INFN Catania

Putting file to the Storage Element [glite-tutor] /home/sammysci/dms_exercise > glite-put tutorial.txt /sammy/tutorialRemote.txt 1139309742 INFO glite-io-client-put : Start File Transfer [glite-put] Total 0.00 MB |====================| 100.00 % [0.0 Mb/s] 1139309745 INFO glite-io-client-put : File Transfer Completed Transfer Completed: LFN : /sammy/tutorialRemote.txt GUID : 001c4f76-7cac-13e8-8439-c1ced08dbeef SURL : srm://egee016.cnaf.infn.it:8443/srm/managerv1?SFN=/dpm/cnaf.infn.it/home/gilda/sammy/tutorialRemote.txt Data Written [bytes] : 42 Eff.Transfer Rate[Mb/s] : 0.000015 [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy –lR -pdrwl-gs--r-l-g--------- 15 2006-02-06 12:40:40 /sammy/pippoRemote.txt -pdrwl-gs--r-l-g--------- 42 2006-02-07 11:55:41 /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-chmod a+w /sammy/tutorialRemote.txt -pdrwl-gs--rwl-g----w---- 42 2006-02-07 11:55:41 /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-chmod g+x /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy/tutorialRemote.txt –l -pdrwl-gs--rwlxg----w---- 42 2006-02-07 11:55:41 /sammy/tutorialRemote.txt Salvatore Scifo INFN Catania

glite-catalog-stat [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-stat /sammy/tutorialRemote.txt LFN: /sammy/tutorialRemote.txt Created: 2006-02-07 11:55:41.000 Modified: 2006-02-07 11:55:41.000 Size: 42 Type: File Expires: Never GUID: 001c4f76-7cac-13e8-8439-c1ced08dbeef Created: 2006-02-07 11:55:44.000 Modified: 2006-02-07 11:55:44.000 Checksum: 00000000 Status: 0 User: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it Group: egee-group User rights: pdrwl-gs Group rights: --rwlxg- Other rights: ---w---- Replicas: srm://egee016.cnaf.infn.it:8443/srm/managerv1?SFN=/dpm/cnaf.infn.it/home/gilda/sammy/tutorialRemote.txt Master replica Created: 2006-02-07 11:55:41.000 Modified: 2006-02-07 11:55:41.000 Salvatore Scifo INFN Catania

Working with metadata [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-setattr -m FileNumber=001 /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-setattr -m FileType=A /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-stat /sammy/tutorialRemote.txt LFN: /sammy/tutorialRemote.txt ... ... ... ... GUID: 001c4f76-7cac-13e8-8439-c1ced08dbeef User: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it Group: egee-group Replicas: srm://egee016.cnaf.infn.it:8443/srm/managerv1?SFN=/dpm/cnaf.infn.it/home/gilda/sammy/tutorialRemote.txt Attributes: FileNumber = 001 FileType = A [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-getattr -nFileNumber /sammy/tutorialRemote.txt FileNumber=001 [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-getattr /sammy/tutorialRemote.txt FileType=A Salvatore Scifo INFN Catania

Working with replica file [glite-tutor] /home/sammysci/dms_exercise > lcg-infosites --vo gilda se ************************************************************** These are the related data for gilda: (in terms of SE) Avail Space(Kb) Used Space(Kb) Type SEs ---------------------------------------------------------- 142370200 144907408 grid009.ct.infn.it 16160000000 410000000 aliserv6.ct.infn.it [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-setreplica -a grid009.ct.infn.it /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-getreplica /sammy/tutorialRemote.txt srm://egee016.cnaf.infn.it:8443/srm/managerv1?SFN=/dpm/cnaf.infn.it/home/gilda/sammy/tutorialRemote.txt grid009.ct.infn.it Salvatore Scifo INFN Catania

Complete status of the file [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-stat /sammy/tutorialRemote.txt LFN: /sammy/tutorialRemote.txt Created: 2006-02-07 11:55:41.000 Modified: 2006-02-07 11:55:41.000 Size: 42 Type: File Expires: Never GUID: 001c4f76-7cac-13e8-8439-c1ced08dbeef Created: 2006-02-07 11:55:44.000 Modified: 2006-02-07 11:55:44.000 Checksum: 00000000 Status: 0 User: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it Group: egee-group User rights: pdrwl-gs Group rights: --rwlxg- Other rights: ---w---- Replicas: srm://egee016.cnaf.infn.it:8443/srm/managerv1?SFN=/dpm/cnaf.infn.it/home/gilda/sammy/tutorialRemote.txt Master replica Created: 2006-02-07 11:55:41.000 Modified: 2006-02-07 11:55:41.000 grid009.ct.infn.it Created: 2006-02-07 18:20:58.000 Modified: 2006-02-07 18:20:58.000 Attributes: FileNumber = 001 FileType = A Salvatore Scifo INFN Catania