Presentation is loading. Please wait.

Presentation is loading. Please wait.

GETTING STARTED ON THE GRID: W. G. SCOTT (RAL/PPD) RAL PHYSICS MEETING TUES 15 MAY 2007. GENERATED 10K SAMPLES IN EACH CHANNEL ON LXPLUS (IN 2006) SIMULATED/DIGITISDED.

Similar presentations


Presentation on theme: "GETTING STARTED ON THE GRID: W. G. SCOTT (RAL/PPD) RAL PHYSICS MEETING TUES 15 MAY 2007. GENERATED 10K SAMPLES IN EACH CHANNEL ON LXPLUS (IN 2006) SIMULATED/DIGITISDED."— Presentation transcript:

1 GETTING STARTED ON THE GRID: W. G. SCOTT (RAL/PPD) RAL PHYSICS MEETING TUES 15 MAY 2007. GENERATED 10K SAMPLES IN EACH CHANNEL ON LXPLUS (IN 2006) SIMULATED/DIGITISDED 1K SUB-SAMPLES ON LXPLUS BUT LXPLUS TOO SLOW FOR LARGE SAMPLES – MOVE TO GRID? MC STUDY OF RADIATIVE B-DECAYS FOR B-PHYSICS/HLT STUDIES

2 csc.018200.B_Kstar_Kplus_PiMinus_gamma4.evgen._00001.pool.root csc.018200.B_kstar_Kplus_PiMinus_gamma4.evgen._00002.pool.root csc.018200.B_kstar_Kplus_PiMinus_gamma4.evgen._00003.pool.root csc.018200.B_kstar_Kplus_PiMinus_gamma4.evgen._00004.pool.root csc.018200.B_kstar_Kplus_PiMinus_gamma4.evgen._00005.pool.root csc.018200.B_Kstar_Kplus_PiMinus_gamma4.evgen._00006.pool.root csc.018200.B_Ksatr_Kplus_PiMinus_gamma4.evgen._00007.pool.root csc.018200.B_Ksatr_Kplus_PiMinus_gamma4.evgen._00008.pool.root csc.018200.B_kstar_Kplus_PiMinus_gamma4.evgen._00009.pool.root csc.018200.B_Ksatr_Kplus_piMinus_gamma4.evgen._00010.pool.root /castor/cern.ch/user/s/scottw/gjab02/ 10 files @ 1000 events per file = 10,000 B -> K* gamma events total Generated Bd -> K* gamma Events stored in Castor: Generation is easy: 1000 events per 8 hr job ~ 30Mb per file RELEASE 12.0.0 csc no. is not present for these Bd -> K* gamma data sets

3

4

5 csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00001.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00002.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00003.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00004.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00005.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00006.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00007.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00008.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00009.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00010.pool.root /castor/cern.ch/user/s/scottw/gjab02/ 10 files @ 1000 events per file = 10,000 Bs -> Phi gamma events total Bs -> phi gamma Events stored in Castor: RELEASE 12.0.0 Generation is easy: 1000 events per 8 hr job ~ 30Mb per file

6

7

8 Simulated and digistsed Bd -> K* gamma Samples : B_Kstar_Kplus_PiMinus_gamma4.digi._00001.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00002.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00003.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00004.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00005.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00006.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00007.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00008.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00009.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00010.pool.root castor/cern.ch/user/s/scottw/gjab02/ 10 files @ 100 events per file = 1000 Bd -> K* gamma events total 100 EVENTS PER 1 DAY JOB ON LXPLUS = TOO SLOW !! ~200Mb PER 100 EVENT FILE!! RELEASE 12.0.6 USING STANDARD SIMUL+DIGIT TRANSFORMATIONS

9 Simulated and digitised Bs -> phi gamma sample : csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00001.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00002.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00003.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00004.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00005.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00006.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00007.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00008.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00009.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00010.pool.root castor/cern.ch/user/s/scottw/gjab02/ 10 files @ 100 events per file = 1000 Bs -> Phi gamma events total 100 EVENTS PER 1 DAY JOB ON LXPLUS = TOO SLOW !! ~200Mb PER 100 EVENT FILE!! RELEASE 12.0.6 USING STANDARD SIMUL+DIGIT TRANSFORMATIONS

10 LVL-! TRIGGER EFFIENCY PLOT (THANKS JULIE!) LVL-1 THR: 3 GeV 4 GeV 5 GeV

11 MORE JULIE PLOTS!!

12 MOVING TO THE GRID: /afs/cern.ch/user/s/scottw/mycertificate.pfx You need a copy of your Grid Certificate in your home directory: Go to your work directory and use z-shell: cd public/b1206 zsh Execute the following commands to setup Ganga (and Don-Quijote): source /afs/cern.ch/project/gd/LCG-share/sl3/etc/profile.d/grid_env.sh source /afs/usatlas.bnl.gov/Grid/Don-Quijote/dq2_user_client/setup.zsh.CERN export PATH=${PATH}:/afs/cern.ch/sw/ganga/install/slc3_gcc323/4.2.12/bin/ export GANGA_CONFIG_PATH=GangaAtlas/Atlas.ini voms-proxy-init Enter your 18-character pass phrase in response to this last command: ****************** ALL QUESTIONS TO S. DALLISON PLEASE!!

13 PREPARE A SIMPLE JOB TO RUN ON THE GRID: emacs mygangajob.py Prepare the “job” as a simple python script (in your work area)t: j=Job() j.application=Executable() j.application.exe=File('$HOME/public/b1206/myscript.sh') j.backend=LCG() j.submit() Prepare the “exe” referenced above as a simple shell script: emacs myscript.sh #!/bin/sh echo 'myscript.sh running...' echo "----------------------" /bin/hostname echo "----------------------" env This script does essentially nothing except to announce that it is running and list all the environment variables https://twiki.cern.ch/twiki/bin/view/Atlas/GangaTutorial427

14 RUN THE JOB USING GANGA: Start Ganga and submit the job: ganga *** Welcome to Ganga *** Version: Ganga-4-2-12....etc. In[1]: execfile(`mygangajob.py’) submitting job 58 to LCG backend …. etc. In[2]:jobs (to see status of all jobs) In[3]:jobs[58] (to see detailed status of job 58) job status changes: submitted /new? running completed /failed When the job is completed, vew the output using !less: In[4]!less /afs/cern.ch/user/s/scottw/gangadir/workspace/Local/58/output/stdout CNTRL D (to quit ganga!) myscript.sh running... ---------------------- wn59.itep.ru ---------------------- ….. etc. q (to quit less command) e.g. HOSTNAME=wn59.itep.ru HOSTNAME=r4b-s16.local HOSTNAME=wn60.itep.ru HOSTNAME=wn072.athena.hellasgrid.gr …. etc. It seems that you run Ganga for the first time …creates /afs/cern.ch/user/s/scottw/.gangarc ganga --gui to use the gui

15 dq2_ls -g user.billscott.testregister011 dq2_ls user.billscott.testregister011 NEED TO REGISTER FILES IN DON-QUIJOTE: Now register the file(s) in Don Quijote: nsls -l /castor/cern.ch/user/s/scottw/gjab02/ csc.018200.B_Kstar_Kplus_PiMinus_gamma4.evgen._00011.pool.root List my input file in castor: pool_insertFileToCatalog rfio:/castor/cern.ch/user/s/scottw/gjab02/ csc.018200.B_Kstar_Kplus_PiMinus_gamma4.evgen._00011.pool.root Insert the file into the PoolFile Catalog: dq2_put -p PoolFileCatalog.xml user.billscott.testregister011 List the dataset in Don Quijote: List the dataset and the files comprising: (dq2_ls –h for help on dq2_ls) (dataset name) (file name)

16 j=Job() j.application=AthenaMC() j.application.random_seed='1102362401' j.application.production_name='csc' j.application.process_name='B_Kstar_Kplus_PiMinus_gamma4' j.application.run_number='018200' j.application.firstevent='1' j.application.number_events_job='10' j.application.atlas_release='12.0.6' j.application.transform_archive='AtlasProduction_12_0_6_1_noarch.tar.gz' j.application.mode='simul' j.application.geometryTag = 'ATLAS-CSC-01-02-00' j.application.datasets.indirectory="user.billscott.testregister001" j.application.datasets.inputfile="csc.018200.B_Kstar…gamma4.evgen._00011.pool.root" j.backend=LCG() #j.backend.CE='heplnx206.pp.rl.ac.uk:2119/jobmanager-lcgpbs-atlas' j.backend.CE='ce102.cern.ch:2119/jobmanager-lcglsf-grid_2nh_atlas' j.backend.middleware='EDG' j.outputdata=DQ2OutputDataset() j.application.se_name='RALDISK' j.splitter=AthenaMCSplitterJob() j.splitter.numsubjobs = 2 j.splitter.nsubjobs_inputfile = j.splitter.numsubjobs # j.submit() MY CURRENT GANGA SIMUL/DIGIT JOB: emacs gsim006.py

17 cd /tmp dq2_get -r user.billscott.testregister001 csc.18200.B_Kstar…gamma4.evgen._00011.ntup.root.61 Use Don-Quijote to “Get” the Output file: WHEN THE JOB HAS RUN: Remove the job number appended the end of the output file before using root: mv csc.18200.B_Kstar…gamma4.evgen._00011.ntup.root.61 csc.18200.B_Kstar…gamma4.evgen._00011.ntup.root root csc.18200.B_Kstar…gamma4.evgen._00011.ntup.root How do I clean-up/remove all the old jobs/files in Ganga and start fresh?? BIG BROTHER IS WATCHING YOU/ME!! !less /afs/cern.ch/user/s/scottw/gangadir/workspace/Local/27/0/output/stdout Use the “less” command to view the Output file: Subjob #Job # unix command prefixed by shriek !


Download ppt "GETTING STARTED ON THE GRID: W. G. SCOTT (RAL/PPD) RAL PHYSICS MEETING TUES 15 MAY 2007. GENERATED 10K SAMPLES IN EACH CHANNEL ON LXPLUS (IN 2006) SIMULATED/DIGITISDED."

Similar presentations


Ads by Google