Download presentation
Presentation is loading. Please wait.
Published byMagdalen Wilcox Modified over 9 years ago
1
Working with AliEn Kilian Schwarz ALICE Group Meeting April 19 2006
2
Initialisation and login . /u/aliprod/bin/.alienlogin alien proxy-init alien-token-init aliensh
3
Searching technique for simulated data with certain properties Not possible with PDC01-05-data wait for PDC06 wait for PDC06 Current method: aliensh alien: find /alice/cern.ch/demo/data %.root > /tmp/collection.xml The XML collection file can be read directly by ROOT DC data can be found, e.g. in alien://alice/cern.ch/user/a/aliprod/production_200 5/
4
Large scale data simulation using Grid Example at alien://alice/cern.ch/demo/production/flow.jdl Needed configuration files can be found in alien://alice/cern.ch/demo/production/configs (e.g. Config.C, rec.C, sim.C, simrun.C,…) Start production with alien> submit flow.jdl 001 (run number, is used as SEED for random generator to be able to repeat simulation with same random generator initialisation) If you want to modify, create your own jdl and configuration files, following the given examples.
5
The production JDL # our executable Executable = “aliroot”; (compulsary !!!) Has to be in alien://bin, /alice/bin or $HOME/bin. “aliroot” exists already in /alice/bin and is a shell script executing AliRoot. # this are pseudo names to identify the production Jobtag={“comment:PDC05 flow events”, “round::2005”, “tag:v4-03-04”, “type:Flow”}; # the packages we need Packages={“AliRoot”::v4-03-04”,”GEANT3::v1-3”}; Jobs runs only at sites where those packages are installed # the estimated maximal runtime in seconds TTL = “86400”; WN has to provide the requested run time # this script runs when the job is finished. If it returns 0, the job is validated (SAVED DONE), if it returns !=0, the job ends in status ERROR_V Validationcommand = “/alice/cern.ch/demo/production/scripts/validation.sh”;
6
The production JDL 2 # this uses only sites, which are member in this particular grid partition Requirements = member(other.GridPartitions,”Production”); # this are the input files/macros we need InputFile={ “LF:/alice/cern.ch/demo/production/configs/Config.C”, “LF:/alice/cern.ch/demo/production/configs/simrun.C”, “LF:/alice/cern.ch/demo/production/configs/sim.C”, “LF:/alice/cern.ch/demo/production/configs/rec.C”, “LF:/alice/cern.ch/demo/production/configs/CheckESD.C” }; These files will be transported to the node where the job will run and can bei either lfn or pfn # we want to pack the output together into archive files. One with all the root files, one with all the log files. OutputArchive={ “root_archive.zip:galice.root,Kinematics.root,AliESDs.root@Alice::CERN::Castor2 ”, ”log_archive:*.log,stdout, stderr@Alice::CERN::se01 ”}; ”log_archive:*.log,stdout, stderr@Alice::CERN::se01 ”};
7
The production JDL 3 # we define the arguments for the simulation script as run number and event number Splitargument=“simrun.C –run $1 –event #alien_counter#”; Arguments field for each job. Here the subjobs counter produced by the Split tag below is given. If more than one value is defined, each subjob will be submitted as many times as there are items in the array, and the subjobs will have the element in the array as arguments. # we produce event number 1-10, the runnumber is given as argument $1 during the submission Split = “production:1-10”; The job can be splitted in several sub jobs, according to file (1 job per input data file), directory (all input files of 1 directory will be analysed in 1 job), event (all files with the same name of the last subdirectory in 1 job), production #start-<#end (no InputData required, it will submit the same JDL several times from #start to #finish. This counter can be referenced in Splitarguments using #alien_counter# Workdirectorysize={“1500 MB”}; The node has to provide the requested size
8
Job status Can be investigated by using alien:// ps e.g.: ps –f DONE (lists all finished jobs) ps –u user (all jobs from the user) ps –s site (all jobs on one site) ps –trace all (gives job trace information) Output can be found in alien://proc/user Copy output back to local via e.g. alien://cp output.root file:/tmp/output.root
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.