1 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools for distributed analysis N. De Filippis - LLR-Ecole Polytechnique
2 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools tutorial organization morning session: overview of CMS tools concepts of the CMS computing/analysis model overview of the analysis workflow and tools overview of the analysis job monitoring system afternoon session: practical examples demonstration of data discovery demonstration of job submission job monitoring and trouble-shooting
3 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools: practical session
4 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Access to the GRID resources Prerequisites: Mandatory: A grid certificate is needed, eventually with specific role to set a priorities or to cope with policies ( Mandatory: A registration in a virtual organization (VO) : CMS ( Mandatory: a glite user interface environment To setup the environment: Log into polgrid31: ssh –l polgrid31 or gsissh source /opt/exp_soft/cmss/cms_ui_env_crab.sh If you have a grid certificate: voms-proxy-init –voms cms –valid 100:59 If you have a proxy already created: Export X509_USER_PROXY= /proxy_nicola
5 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Preselection for H ZZ 2e2mu: duplication removal of electrons sharing the same supercluster/track “loose” ElectronID at least 2 electrons with pT> 5 GeV/c irrespective of the charge at least 2 muons with pT > 5 GeV/c irrespective of the charge at least 1 Z ee candidate with m ll > 12 GeV/c 2 at least 1 Z candidate with m ll > 12 GeV/c 2 at least one l+l-l+l- (H) candidate with m llll > 100 GeV/c 2 2 loose isolated electrons: p T tracks /p T e < 0.7 Example: H ZZ 2e2 analysis
6 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis scramv1 project CMSSW CMSSW_1_6_7 cd CMSSW_1_6_7/src wget “ ” tar –zxvf TutorialHiggs.tgz cd HiggsAnalysis/HiggsToZZ2e2m scramv1 b eval `scramv1 runtime -sh` Setup CMSSW & CRAB environment
7 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example: test the code locally cd HiggsAnalysis/HiggsToZZ2e2m/test cmsRun HiggsToZZ2e2mCSA07Preselection.cfg 3 files created: hTozzToEEMuMuPresel.root hTozzToEEMuMuPreselRootTree.root preselec.out plots can be done with a macro: root –b –q HZZ2e2muPreselectionRootTreeAnalysis.C let’s go on with CRAB wget “
8 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to discover data in DBS Examples: /Njet_2j_20_80-alpgen/CMSSW_1_6_7-CSA /RECO /Njet_2j_80_140-alpgen/CMSSW_1_6_7-CSA /RECO /H150_ZZ_4l/CMSSW_1_6_7-CSA /RECO /H140_ZZ_4l/CMSSW_1_6_7-CSA /RECO /CSA07Muon/CMSSW_1_6_7-CSA07-Gumbo-P1-PDMuon-Skims2-higgsToZZ4LeptonsRECOSIM/USER
9 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to configure CRAB
10 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description (1)
11 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description (2)
12 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description:handling output
13 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description (3)
14 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB
15 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (2)
16 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (3) Publish data: crab –publish The above command is used to publish the samples of the output jobs in the DBS specified in the configuration. The option –continue working_dir is used to executed operation with a task previously created.
17 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (4)
18 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (5)
19 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of crab.cfg (1) /H150_ZZ_4l/CMSSW_1_6_7-CSA /RECO /H140_ZZ_4l/CMSSW_1_6_7-CSA /RECO Cfg for preleselection Output files to be retrieved or stored in a storage element sample datasetpath form DBS SE and path where to store output files
20 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of crab.cfg (2) Specific match for sites based on CE or SE
21 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (1) Run crab: crab –create –submit 10
22 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (2) Run crab: crab –status all –continue
23 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Monitoring of jobs in Dashboard Select your jobs from the list of tasks
24 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (3) Run crab: crab –getoutput all -continue When the job will be in Done status the getoutput can be executed. You will find logs, stdout and stderr files in /res directory. All the files you declared to be saved in the storage element will not be retrieved with getoutput on the user interface
25 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing: error codes
26 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (4) Check the existence of files in the storage element: rfdir /dpm/in2p3.fr/home/cms/trivcat/store/user/ndefilip A directory was created like CMSSW_1_6_7-testPublish- H150_bd809ee83429f1c823e885694f4109b6
27 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (5) Run a macro to do plots: HiggsAnalysis/HiggsToZZ2e2m/test/HZZ2e2muPreselectionRootTreeAnalysis.C please change the files name in it root –b –q HZZ2e2muPreselectionRootTreeAnalysis.C Files in GIF format are saved. Display RECO_MassesTotH_0.gif give the higgs mass peak reconstructed You can also publish your root EDM output files in a specific DBS: CMS/CrabForPublication
28 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Use CRAB at CERN, at CAF/LSF AT CERN AT CAF at CAF
29 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Acknowledgements Thanks to: the LLR team: Paulo, Pascale, Igor, Philippe, Claude the CMS computing people: D. Spiga, A. Fanfani, J. Andreeva, O. Gutsche for providing material the grid support team
30 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Backup slides
31 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS analysis job in GRID
32 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CRAB (CMS remote analysis builder) What is CRAB ? Goal of CRAB ? The aim of CRAB is to hide as much as possible of grid complexity to final user