Download presentation
Presentation is loading. Please wait.
Published byAlan Wade Modified over 9 years ago
1
Group Metting Submit job to Grid 20070704 Grass
2
outline Why we need Grid CPUs example : How to run TPCana Before run TPCana
3
Why we need Grid CPUs
4
IPAS Condor
5
LHC Taiwan Tier-1
6
example : How to run TPCana
7
example for setup grid environment [grass@hepfarm2 ~]$ ls -l /usrX/grass/.globus/x509up_grass -rw------- 1 grass spring8 5562 Jul 2 16:26 /usrX/grass/.globus/x509up_grass ## grid environment \> source /scratch/grid/glite-3.0.26/etc/profile.d/grid_env.csh \> setenv X509_USER_PROXY /usrX/grass/.globus/x509up_grass STEP2 setup grid environment STEP1: copy proxy file \> chmod 600 x509up_grass
8
the data we need
9
the data we need is too big
10
generate drift table online Drift table production time generate drift table 5 times, we get the same drift table the same size no difference
12
upload data size of others data is small rawdata size
13
manual of “globus_submit” usage: globus_submit --tarFile=file --output=file --start=num --end=num... --tarFile=file: path for tar file to be submitted e.g../submitme.tgz --outputFile=file: path for output file to be stored e.g../cronus.$.tgz --cmd=command: command to be executed, normally a shell script e.g../cronus.sh $ --start=num: beginning segment number e.g. 1 --end=num: ending segment number e.g. 100 --segments=num: segment number list e.g. 2-5,7,10 --VO=vo: VO name you belong to e.g. twgrid --verbose: verbose output --cronus: submit to Cronus, it's necessary in ipas003 --test: do not submit, show JDL to standard output --email: email address for summary output e.g. tsan@fnal.gov --globusscheduler: gatekeeper you wan to submit to e.g. lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs --globusrsl: additional options to gatekeeper special character, $, will be replaced with segment number for --outputFile and --cmd
14
globus_submit --tarFile=../submitme.tgz --outputFile='tpcana.$.tgz' --cmd='./runTPC.sh /hepdata4/jychen/TPC/data/2004Oct17 $' --segments=30525-30527,30529 --globusscheduler=lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs --verbose --globusrsl='(queue=twgrid)'
15
Before run TPCana
16
grid copy rate upload 3.1G file need 85 second must of file small then 3G
17
submit 27 run at 23:00 raid: /hepdata4 file server: asscratch2
18
What we need to do later 1)Test the best number of upload files in the same time in our file server. (Tsanlung’s suggestion is 16 runs one time ) 2)Write a perl split to submit job.
19
backup
20
grid copy rate upload 1.2G file need 40 second must of file small then 3G
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.