E-science grid facility for Europe and Latin America E2GRIS1 Jaime Parada, Edgar Perdomo – UCV Itacuruça (Brazil), 2-15 November 2008 CATIVIC

E-science grid facility for Europe and Latin America Steps Implemented Local installation of application Compilation of modules of application Local execution of application Automatically JDL generated Use of AMGA for test ending of jobs

E-science grid facility for Europe and Latin America VOMS LFC Catalogue Metadata Catalogue CECE Storage Elements AMGA script_cativic.sh User 1. local proxy creation 2.Files are uploaded into the SE 3. Job - submit WM S CE 4.It checks the status of work 5.Downloading work in the UI Script_Cativic

E-science grid facility for Europe and Latin America LFC Catalogue Metadata Catalogue Storage Elements AMGA User 1. Set environment variables for SE 2. Get the stored file from the SE 3. Initializes the database AMGA 0 indicates that the application is started to run 4. Execute the application 5.Store the OutputFile.out in the SE Script_node export LCG_CATALOG_TYPE=lfc export LFC_HOST=m02- e2gris1.eela.ufrj.br export LCG_GFAL_INFOSYS=m41- e2gris1.eela.ufrj.br:2170 WN 6.Store the file and register in the LFC with a given LFN 7.Updates the database AMGA 1 indicates that the WN finalized

E-science grid facility for Europe and Latin America ` voms-proxy-init --voms e2gris1.vo.eu-eela.eu glite-wms-job-delegate-proxy -d $USER for i in `cat $LOGS` do echo Comienzo el ciclo... lcg-cr --vo e2gris1.vo.eu-eela.eu -l lfn://grid/e2gris1.vo.eu-eela.eu/app05/$i -d m09- e2gris1.eela.ufrj.br file:/home/app05/cativic/Model/$i lfc-ls -l /grid/e2gris1.vo.eu-eela.eu/app05 echo $i done echo Empiezo a crear el JDL cat > cativic_jobs.jdl << EOF [ Type = "collection"; nodes = { EOF variable=`echo [` echo $variable>> cativic_jobs.jdl contador=0 for i in `cat $LOGS` do contador=`expr $contador + 1` if [ $contador -gt 1 ] then echo $resultado variable=`echo ],[` echo $variable>> cativic_jobs.jdl fi variable1=`echo JobType = \"Normal\"\;` echo $variable1 >> cativic_jobs.jdl variable2=`echo NodeName = \"node$contador\"\;` echo $variable2 >> cativic_jobs.jdl done variable=`echo ]` echo $variable>> cativic_jobs.jdl variable=`echo }\;` echo $variable>> cativic_jobs.jdl variable=`echo ]` echo $variable>> cativic_jobs.jdl echo Termino de crear el JDL echo Antes de enviar el trabajo... glite-wms-job-submit -d $USER -o jobid cativic_jobs.jdl Script_cativic

E-science grid facility for Europe and Latin America E #!bin/bash/ LFNStoredFile=$1 #1) Get the stored file from the SE lcg-cp -v --vo e2gris1.vo.eu-eela.eu $LFNStoredFile file:./InputFile.infile:./InputFile.in LFN='LFN' NOM=${LFNStoredFile:38} ID=`mdcli sequence_next $AMGA/seq1` mdcli addentry $AMGA/${ID} LFN \'${LFNStoredFile}\' status 0 nom \'${NOM}\' #2) Execute the application with this file. catparm.exe InputFile.in OutputFile.out #3) Store the OutputFile.out in the SE SEDir="/grid/e2gris1.vo.eu-eela.eu/app05" #echo "This to be stored in the LFN " >> myfile.txt #FileName=$2 FileName=coroHHSCH3.out LFNName=$SEDir/$FileName #lfc-mkdir $SEDir lcg-cr --vo e2gris1.vo.eu-eela.eu -l lfn:$LFNName -d m09-e2gris1.eela.ufrj.br mdcli updateattr $AMGA/$ID status 1 \'status = 0\' #5) Verify if file is stored lfc-ls -l $SEDir | grep $FileName Script_node

E-science grid facility for Europe and Latin America AMGA='/test/app05/cativic2' while [ $lin -gt 0 ]; do ID=`mdcli selectattr $AMGA:FILE \'$AMGA:status = 1\' | head -1` if [ "$ID" != "" ] then echo $ID NOM=`mdcli selectattr $AMGA:nom \'$AMGA:FILE = $ID\' ` lcg-cp --vo e2gris1.vo.eu-eela.eu lfn:/grid/e2gris1.vo.eu-eela.eu/app05/${NOM/%in/out} file://$HOME/ejecucion/OUT/${NOM/%in/out} echo $NOM mdcli removeentries $AMGA/$ID let lin-- fi done for i in `cat $LOGS` do echo Comienzo el ciclo... lcg-del -a --vo e2gris1.vo.eu-eela.edu lfn:/grid/e2gris1.vo.eu-eela.eu/app05/$i echo $i done

E-science grid facility for Europe and Latin America Summary CATIVIC is runing satisfactorily It was found that the use of AMGA for obtaining information of the program as well as downloading it was faster than the traditional way (status command in gLite)‏

E-science grid facility for Europe and Latin America Improve the parallelization in some modules Use a Web User Interface for usability of application Coordinated development of new capabilities Nex steps

Itacuruça (Brazil), E2GRIS1, – Questions … 10