gLite 1.4. Data Mangement Exercises Salvatore Scifo Test Tutorial Catania February 8th, 2006
Starting to work with DMS Before starting to use DMS ensure yourself about having a valid proxy certificate. [glite-tutor] /home/sammysci/dms_exercise > voms-proxy-info Couldn't find a valid proxy. It means that your certificate has just expired and you need to get a new one .…… Salvatore Scifo INFN Catania
Get a one day valid proxy [glite-tutor] /home/sammysci/dms_exercise > voms-proxy-init --voms gilda Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it Enter GRID pass phrase: Your proxy is valid until Tue Feb 7 22:57:56 2006 Creating temporary proxy ................................................. Done Contacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/Email=emidio.giorgio@ct.infn.it] "gilda" Creating proxy ........................................ Done [glite-tutor] /home/sammysci/dms_exercise > voms-proxy-info subject : /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it/CN=proxy issuer : /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it identity : /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it type : proxy strength : 512 bits path : /tmp/x509up_u3017 timeleft : 11:53:28 Now you are able to interact to the GRID services. Salvatore Scifo INFN Catania
Get a 7 days valid proxy [glite-tutor] /home/sammysci/dms_exercise > myproxy-init –voms –s grid001.ct.infn.it Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it Enter GRID pass phrase for this identity: Creating proxy ..................................... Done Proxy Verify OK Your proxy is valid until: Tue Feb 14 11:12:59 2006 Enter MyProxy pass phrase: Verifying password - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user sammysci now exists on grid001.ct.infn.it. [glite-tutor] /home/sammysci/dms_exercise > myproxy-get-delegation -sgrid001.ct.infn.it [glite-tutor] /home/sammysci/dms_exercise > myproxy-info -sgrid001.ct.infn.it username: sammysci owner: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it timeleft: 167:58:15 (7.0 days) Now you are able to interact to the GRID services. Salvatore Scifo INFN Catania
glite-catalog-ls [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy /sammy/pippoRemote.txt /sammy/tmpdir [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy –l -pdrwl-gs--r-l-g--------- 15 2006-02-06 12:40:40 /sammy/pippoRemote.txt dpdrwlx----rwl-----r-l---+ 0 2006-02-06 10:50:05 /sammy/tmpdir [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy –lv # Using endpoint https://grid017.ct.infn.it:8443/gilda/glite-data-catalog-service-fr-mysql/services/FiremanCatalog # Service version: 1.4.2 # Interface version: 2.0.0 # Schema version: 1 # Client version: 1.7.1 # Client interface version: 1.7.1 Salvatore Scifo INFN Catania
glite-catalog-rm [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-rm /sammy/tempdir rm: getFileCatalogEntry: Lfn "/sammy/tempdir" does not exist! [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-rm /sammy/tmpdir rm: rmdir: directory: "/sammy/tmpdir" is not empty! [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy -R /sammy/pippoRemote.txt /sammy/tmpdir /sammy/tmpdir/pippo.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-rm /sammy/tmpdir/pippo.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy -lR -pdrwl-gs--r-l-g--------- 15 2006-02-06 12:40:40 /sammy/pippoRemote.txt dpdrwlx----rwl-----r-l---+ 0 2006-02-06 10:50:05 /sammy/tmpdir Uhm… Uhm… Let’s take a look better!!! Salvatore Scifo INFN Catania
Creating a new test file [glite-tutor] /home/sammysci/dms_exercise > vi tutorial.txt this is a test file for this tutorial ;-) ~ :w :q [glite-tutor] /home/sammysci/dms_exercise > ls -al total 20 drwxr-xr-x 2 sammysci users 4096 Feb 7 2006 . drwx------ 9 sammysci users 4096 Feb 7 2006 .. -rw-r--r-- 1 sammysci users 42 Feb 7 11:44 tutorial.txt Notice that these are a linux command line of the UI machine Salvatore Scifo INFN Catania
Putting file to the Storage Element [glite-tutor] /home/sammysci/dms_exercise > glite-put tutorial.txt /sammy/tutorialRemote.txt 1139309742 INFO glite-io-client-put : Start File Transfer [glite-put] Total 0.00 MB |====================| 100.00 % [0.0 Mb/s] 1139309745 INFO glite-io-client-put : File Transfer Completed Transfer Completed: LFN : /sammy/tutorialRemote.txt GUID : 001c4f76-7cac-13e8-8439-c1ced08dbeef SURL : srm://egee016.cnaf.infn.it:8443/srm/managerv1?SFN=/dpm/cnaf.infn.it/home/gilda/sammy/tutorialRemote.txt Data Written [bytes] : 42 Eff.Transfer Rate[Mb/s] : 0.000015 [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy –lR -pdrwl-gs--r-l-g--------- 15 2006-02-06 12:40:40 /sammy/pippoRemote.txt -pdrwl-gs--r-l-g--------- 42 2006-02-07 11:55:41 /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-chmod a+w /sammy/tutorialRemote.txt -pdrwl-gs--rwl-g----w---- 42 2006-02-07 11:55:41 /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-chmod g+x /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-ls /sammy/tutorialRemote.txt –l -pdrwl-gs--rwlxg----w---- 42 2006-02-07 11:55:41 /sammy/tutorialRemote.txt Salvatore Scifo INFN Catania
glite-catalog-stat [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-stat /sammy/tutorialRemote.txt LFN: /sammy/tutorialRemote.txt Created: 2006-02-07 11:55:41.000 Modified: 2006-02-07 11:55:41.000 Size: 42 Type: File Expires: Never GUID: 001c4f76-7cac-13e8-8439-c1ced08dbeef Created: 2006-02-07 11:55:44.000 Modified: 2006-02-07 11:55:44.000 Checksum: 00000000 Status: 0 User: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it Group: egee-group User rights: pdrwl-gs Group rights: --rwlxg- Other rights: ---w---- Replicas: srm://egee016.cnaf.infn.it:8443/srm/managerv1?SFN=/dpm/cnaf.infn.it/home/gilda/sammy/tutorialRemote.txt Master replica Created: 2006-02-07 11:55:41.000 Modified: 2006-02-07 11:55:41.000 Salvatore Scifo INFN Catania
Working with metadata [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-setattr -m FileNumber=001 /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-setattr -m FileType=A /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-stat /sammy/tutorialRemote.txt LFN: /sammy/tutorialRemote.txt ... ... ... ... GUID: 001c4f76-7cac-13e8-8439-c1ced08dbeef User: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it Group: egee-group Replicas: srm://egee016.cnaf.infn.it:8443/srm/managerv1?SFN=/dpm/cnaf.infn.it/home/gilda/sammy/tutorialRemote.txt Attributes: FileNumber = 001 FileType = A [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-getattr -nFileNumber /sammy/tutorialRemote.txt FileNumber=001 [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-getattr /sammy/tutorialRemote.txt FileType=A Salvatore Scifo INFN Catania
Working with replica file [glite-tutor] /home/sammysci/dms_exercise > lcg-infosites --vo gilda se ************************************************************** These are the related data for gilda: (in terms of SE) Avail Space(Kb) Used Space(Kb) Type SEs ---------------------------------------------------------- 142370200 144907408 grid009.ct.infn.it 16160000000 410000000 aliserv6.ct.infn.it [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-setreplica -a grid009.ct.infn.it /sammy/tutorialRemote.txt [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-getreplica /sammy/tutorialRemote.txt srm://egee016.cnaf.infn.it:8443/srm/managerv1?SFN=/dpm/cnaf.infn.it/home/gilda/sammy/tutorialRemote.txt grid009.ct.infn.it Salvatore Scifo INFN Catania
Complete status of the file [glite-tutor] /home/sammysci/dms_exercise > glite-catalog-stat /sammy/tutorialRemote.txt LFN: /sammy/tutorialRemote.txt Created: 2006-02-07 11:55:41.000 Modified: 2006-02-07 11:55:41.000 Size: 42 Type: File Expires: Never GUID: 001c4f76-7cac-13e8-8439-c1ced08dbeef Created: 2006-02-07 11:55:44.000 Modified: 2006-02-07 11:55:44.000 Checksum: 00000000 Status: 0 User: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN-Catania/CN=Salvatore Scifo/Email=s.scifo@aruba.it Group: egee-group User rights: pdrwl-gs Group rights: --rwlxg- Other rights: ---w---- Replicas: srm://egee016.cnaf.infn.it:8443/srm/managerv1?SFN=/dpm/cnaf.infn.it/home/gilda/sammy/tutorialRemote.txt Master replica Created: 2006-02-07 11:55:41.000 Modified: 2006-02-07 11:55:41.000 grid009.ct.infn.it Created: 2006-02-07 18:20:58.000 Modified: 2006-02-07 18:20:58.000 Attributes: FileNumber = 001 FileType = A Salvatore Scifo INFN Catania