FESR Consorzio COMETA - Progetto PI2S2 Jobs with Input/Output data Fabio Scibilia, INFN - Catania, Italy Tutorial per utenti e sviluppo di applicazioni Luglio 2007

Catania, Tutorial al DIIT, Luglio Jobs with input dat You can specify the Input files you need to run your jobs You can specify file transport protocols The RB matchmaking algorithm will take into consideration this info to dispatch your as closest as possible to data files you need You have to download files manually from Storage Elements within submission script

Catania, Tutorial al DIIT, Luglio Job with input data $ cat inputdata.jdl [ Executable = "scriptInput.sh"; Arguments = "YourName lfn:/grid/gilda/grun.C"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = "scriptInput.sh"; OutputSandbox = {"std.out","std.err"}; InputData = {"lfn:/grid/gilda/grun.C"}; DataAccessProtocol = {"gridftp","rfio","gsiftp"}; RetryCount = 3; ] Job+Data]$ cat scriptInput.sh #!/bin/sh export LFC_HOST=lfc-gilda.ct.infn.it export LCG_GFAL_INFOSYS=grid004.ct.infn.it:2170 export LCG_CATALOG_TYPE=lfc lcg-cp -v --vo cometa $2 file:`pwd`/myfile ls -al /bin/echo "Hello $1 and welcome to this tutorial" >> `pwd`/myfile cat `pwd`/myfile

Catania, Tutorial al DIIT, Luglio Job with output data (1/2) $ cat JobWithOutput.jdl [ Executable = "scriptOutput.sh"; Arguments = "YourName"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = "scriptOutput.sh"; OutputSandbox = {"std.out","std.err"}; OutputData = { [ OutputFile = “job_output.txt"; LogicalFileName = "lfn:/grid/cometa/job_output.txt"; StorageElement = "iceage-se-01.ct.infn.it"; ] }; RetryCount = 3; ] You can specify the what output files to upload to Storage Elements once the job has finished

Catania, Tutorial al DIIT, Luglio Job with output data (2/2) The job simply echoes a string into a file –The file is the one that will be automatically uploaded to the SE specified in the JDL and registered onto the LFC with the LFN you specified $ cat scriptOutput.sh #!/bin/sh /bin/echo Hello $1 and Welcome to the tutorial! > job_output.txt This file is the one that will be automatically uploaded to the SE you specified in the JDL and registered onto the LFC with the LFN you specified

Catania, Tutorial al DIIT, Luglio Questions…