Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools for distributed analysis N. De Filippis - LLR-Ecole Polytechnique.

Published byVincent Gardner Modified over 8 years ago

Similar presentations

Presentation on theme: "1 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools for distributed analysis N. De Filippis - LLR-Ecole Polytechnique."— Presentation transcript:

1 1 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools for distributed analysis N. De Filippis - LLR-Ecole Polytechnique

2 2 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools tutorial organization morning session: overview of CMS tools concepts of the CMS computing/analysis model overview of the analysis workflow and tools overview of the analysis job monitoring system afternoon session: practical examples demonstration of data discovery demonstration of job submission job monitoring and trouble-shooting

3 3 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools: practical session

4 4 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Access to the GRID resources Prerequisites: Mandatory: A grid certificate is needed, eventually with specific role to set a priorities or to cope with policies ( http://cmsdoc.cern.ch/cms/aprom/www/top/CMS_VO.html) Mandatory: A registration in a virtual organization (VO) : CMS (https://lcg-voms.cern.ch:8443/vo/cms/vomrs?path=/RootNode) Mandatory: a glite user interface environment To setup the environment: Log into polgrid31: ssh –l polgrid31 or gsissh source /opt/exp_soft/cmss/cms_ui_env_crab.sh If you have a grid certificate: voms-proxy-init –voms cms –valid 100:59 If you have a proxy already created: Export X509_USER_PROXY= /proxy_nicola

5 5 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Preselection for H  ZZ  2e2mu: duplication removal of electrons sharing the same supercluster/track “loose” ElectronID at least 2 electrons with pT> 5 GeV/c irrespective of the charge at least 2 muons with pT > 5 GeV/c irrespective of the charge at least 1 Z  ee candidate with m ll > 12 GeV/c 2 at least 1 Z   candidate with m ll > 12 GeV/c 2 at least one l+l-l+l- (H) candidate with m llll > 100 GeV/c 2 2 loose isolated electrons:  p T tracks /p T e < 0.7 Example: H  ZZ  2e2  analysis

6 6 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis scramv1 project CMSSW CMSSW_1_6_7 cd CMSSW_1_6_7/src wget “ http://webcms.ba.infn.it/cms-software/higgs/TutorialHiggs.tgz ” tar –zxvf TutorialHiggs.tgz cd HiggsAnalysis/HiggsToZZ2e2m scramv1 b eval `scramv1 runtime -sh` Setup CMSSW & CRAB environment

7 7 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example: test the code locally cd HiggsAnalysis/HiggsToZZ2e2m/test cmsRun HiggsToZZ2e2mCSA07Preselection.cfg 3 files created: hTozzToEEMuMuPresel.root hTozzToEEMuMuPreselRootTree.root preselec.out plots can be done with a macro: root –b –q HZZ2e2muPreselectionRootTreeAnalysis.C  let’s go on with CRAB wget “http://webcms.ba.infn.it/cmssoftware/higgs/crab.cfg”

8 8 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to discover data in DBS https://cmsweb.cern.ch/dbs_discovery/_navigator?userMode=user Examples: /Njet_2j_20_80-alpgen/CMSSW_1_6_7-CSA07-1199459756/RECO /Njet_2j_80_140-alpgen/CMSSW_1_6_7-CSA07-1200571375/RECO /H150_ZZ_4l/CMSSW_1_6_7-CSA07-1197878683/RECO /H140_ZZ_4l/CMSSW_1_6_7-CSA07-1193560504/RECO /CSA07Muon/CMSSW_1_6_7-CSA07-Gumbo-P1-PDMuon-Skims2-higgsToZZ4LeptonsRECOSIM/USER

9 9 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to configure CRAB

10 10 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description (1)

11 11 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description (2)

12 12 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description:handling output

13 13 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description (3)

14 14 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB

15 15 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (2)

16 16 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (3) Publish data: crab –publish The above command is used to publish the samples of the output jobs in the DBS specified in the configuration. The option –continue working_dir is used to executed operation with a task previously created.

17 17 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (4)

18 18 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (5)

19 19 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of crab.cfg (1) /H150_ZZ_4l/CMSSW_1_6_7-CSA07-1197878683/RECO /H140_ZZ_4l/CMSSW_1_6_7-CSA07-1193560504/RECO Cfg for preleselection Output files to be retrieved or stored in a storage element sample datasetpath form DBS SE and path where to store output files

20 20 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of crab.cfg (2) Specific match for sites based on CE or SE

21 21 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (1) Run crab: crab –create –submit 10

22 22 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (2) Run crab: crab –status all –continue

23 23 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Monitoring of jobs in Dashboard http://lxarda16.cern.ch/dashboard/request.py/taskmonitoring Select your jobs from the list of tasks

24 24 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (3) Run crab: crab –getoutput all -continue  When the job will be in Done status the getoutput can be executed.  You will find logs, stdout and stderr files in /res directory.  All the files you declared to be saved in the storage element will not be retrieved with getoutput on the user interface

25 25 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing: error codes

26 26 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (4) Check the existence of files in the storage element: rfdir /dpm/in2p3.fr/home/cms/trivcat/store/user/ndefilip A directory was created like CMSSW_1_6_7-testPublish- H150_bd809ee83429f1c823e885694f4109b6

27 27 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (5) Run a macro to do plots: HiggsAnalysis/HiggsToZZ2e2m/test/HZZ2e2muPreselectionRootTreeAnalysis.C please change the files name in it root –b –q HZZ2e2muPreselectionRootTreeAnalysis.C Files in GIF format are saved. Display RECO_MassesTotH_0.gif give the higgs mass peak reconstructed You can also publish your root EDM output files in a specific DBS: https://twiki.cern.ch/twiki/bin/view/ CMS/CrabForPublication

28 28 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Use CRAB at CERN, at CAF/LSF AT CERN AT CAF https://twiki.cern.ch/twiki/bin/view/CMS/CrabAtCAF at CAF

29 29 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Acknowledgements Thanks to: the LLR team: Paulo, Pascale, Igor, Philippe, Claude the CMS computing people: D. Spiga, A. Fanfani, J. Andreeva, O. Gutsche for providing material the grid support team

30 30 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Backup slides

31 31 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS analysis job in GRID

32 32 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CRAB (CMS remote analysis builder) What is CRAB ? Goal of CRAB ? The aim of CRAB is to hide as much as possible of grid complexity to final user

Download ppt "1 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools for distributed analysis N. De Filippis - LLR-Ecole Polytechnique."

Similar presentations

1 14 Feb 2007 CMS Italia – Napoli A. Fanfani Univ. Bologna A. Fanfani University of Bologna MC Production System & DM catalogue.

1 14 Feb 2007 CMS Italia – Napoli A. Fanfani Univ. Bologna A. Fanfani University of Bologna MC Production System & DM catalogue.
1 CRAB Tutorial 19/02/2009 CERN F.Fanzago CRAB tutorial 19/02/2009 Marco Calloni CERN – Milano Bicocca Federica Fanzago INFN Padova.

1 CRAB Tutorial 19/02/2009 CERN F.Fanzago CRAB tutorial 19/02/2009 Marco Calloni CERN – Milano Bicocca Federica Fanzago INFN Padova.
1 CMS user jobs submission with the usage of ASAP Natalia Ilina 16/04/2007, ITEP, Moscow.

1 CMS user jobs submission with the usage of ASAP Natalia Ilina 16/04/2007, ITEP, Moscow.
CRAB Tutorial Federica Fanzago – Cern/Cnaf 13/02/2007 CRAB Tutorial (Cms Remote Analysis Builder)

CRAB Tutorial Federica Fanzago – Cern/Cnaf 13/02/2007 CRAB Tutorial (Cms Remote Analysis Builder)
Workload Management meeting 07/10/2004 Federica Fanzago INFN Padova Grape for analysis M.Corvo, F.Fanzago, N.Smirnov INFN Padova.

Workload Management meeting 07/10/2004 Federica Fanzago INFN Padova Grape for analysis M.Corvo, F.Fanzago, N.Smirnov INFN Padova.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim

The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
Basic Grid Job Submission Alessandra Forti 28 March 2006.

Basic Grid Job Submission Alessandra Forti 28 March 2006.
Workload Management Massimo Sgaravatto INFN Padova.

Workload Management Massimo Sgaravatto INFN Padova.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.

Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
Analysis demos from the experiments. Analysis demo session Introduction –General information and overview CMS demo (CRAB) –Georgia Karapostoli (Athens.

Analysis demos from the experiments. Analysis demo session Introduction –General information and overview CMS demo (CRAB) –Georgia Karapostoli (Athens.
Physicists's experience of the EGEE/LCG infrastructure usage for CMS jobs submission Natalia Ilina (ITEP Moscow) NEC’2007.

Physicists's experience of the EGEE/LCG infrastructure usage for CMS jobs submission Natalia Ilina (ITEP Moscow) NEC’2007.
CERN - IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.

CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.
A Project about: Molecular Dynamic Simulation (MDS) Prepared By Ahmad Lotfy Abd El-Fattah Grid Computing Group Supervisors Alexandr Uzhinskiy & Nikolay.

A Project about: Molecular Dynamic Simulation (MDS) Prepared By Ahmad Lotfy Abd El-Fattah Grid Computing Group Supervisors Alexandr Uzhinskiy & Nikolay.
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.

Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.

The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
F.Fanzago – INFN Padova ; S.Lacaprara – LNL; D.Spiga – Universita’ Perugia M.Corvo - CERN; N.DeFilippis - Universita' Bari; A.Fanfani – Universita’ Bologna;

F.Fanzago – INFN Padova ; S.Lacaprara – LNL; D.Spiga – Universita’ Perugia M.Corvo - CERN; N.DeFilippis - Universita' Bari; A.Fanfani – Universita’ Bologna;
GRID Computing: Ifrastructure, Development and Usage in Bulgaria M. Dechev, G. Petrov, E. Atanassov.

GRID Computing: Ifrastructure, Development and Usage in Bulgaria M. Dechev, G. Petrov, E. Atanassov.
Computational grids and grids projects DSS, 4.4.2005

Computational grids and grids projects DSS,
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.

:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
EGEE-III INFSO-RI-222667 Enabling Grids for E-sciencE www.eu-egee.org Julia Andreeva CERN (IT/GS) CHEP 2009, March 2009, Prague New job monitoring strategy.

EGEE-III INFSO-RI Enabling Grids for E-sciencE Julia Andreeva CERN (IT/GS) CHEP 2009, March 2009, Prague New job monitoring strategy.

Similar presentations

Ads by Google