1 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools for distributed analysis N. De Filippis - LLR-Ecole Polytechnique.

Slides:



Advertisements
Similar presentations
1 14 Feb 2007 CMS Italia – Napoli A. Fanfani Univ. Bologna A. Fanfani University of Bologna MC Production System & DM catalogue.
Advertisements

1 CRAB Tutorial 19/02/2009 CERN F.Fanzago CRAB tutorial 19/02/2009 Marco Calloni CERN – Milano Bicocca Federica Fanzago INFN Padova.
1 CMS user jobs submission with the usage of ASAP Natalia Ilina 16/04/2007, ITEP, Moscow.
CRAB Tutorial Federica Fanzago – Cern/Cnaf 13/02/2007 CRAB Tutorial (Cms Remote Analysis Builder)
Workload Management meeting 07/10/2004 Federica Fanzago INFN Padova Grape for analysis M.Corvo, F.Fanzago, N.Smirnov INFN Padova.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
Basic Grid Job Submission Alessandra Forti 28 March 2006.
Workload Management Massimo Sgaravatto INFN Padova.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
Analysis demos from the experiments. Analysis demo session Introduction –General information and overview CMS demo (CRAB) –Georgia Karapostoli (Athens.
Physicists's experience of the EGEE/LCG infrastructure usage for CMS jobs submission Natalia Ilina (ITEP Moscow) NEC’2007.
CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.
A Project about: Molecular Dynamic Simulation (MDS) Prepared By Ahmad Lotfy Abd El-Fattah Grid Computing Group Supervisors Alexandr Uzhinskiy & Nikolay.
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
F.Fanzago – INFN Padova ; S.Lacaprara – LNL; D.Spiga – Universita’ Perugia M.Corvo - CERN; N.DeFilippis - Universita' Bari; A.Fanfani – Universita’ Bologna;
GRID Computing: Ifrastructure, Development and Usage in Bulgaria M. Dechev, G. Petrov, E. Atanassov.
Computational grids and grids projects DSS,
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Julia Andreeva CERN (IT/GS) CHEP 2009, March 2009, Prague New job monitoring strategy.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Workload Management System + Logging&Bookkeeping Installation.
Nadia LAJILI User Interface User Interface 4 Février 2002.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
Stuart Wakefield Imperial College London Evolution of BOSS, a tool for job submission and tracking W. Bacchi, G. Codispoti, C. Grandi, INFN Bologna D.
July 28' 2011INDIA-CMS_meeting_BARC1 Tier-3 TIFR Makrand Siddhabhatti DHEP, TIFR Mumbai July 291INDIA-CMS_meeting_BARC.
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
CERN IT Department CH-1211 Genève 23 Switzerland t Monitoring: Tracking your tasks with Task Monitoring PAT eLearning – Module 11 Edward.
GRID. Register Fill the form. Your IP (Juanjo) signature is needed and the one from the.
Enabling Grids for E-sciencE System Analysis Working Group and Experiment Dashboard Julia Andreeva CERN Grid Operations Workshop – June, Stockholm.
June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.
Test Beam Oriented CMSSW Tutorial Sergei Gleyzer Professor Harrison Prosper FIU CMS Workshop.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
Job Management DIRAC Project. Overview  DIRAC JDL  DIRAC Commands  Tutorial Exercises  What do you have learned? KEK 10/2012DIRAC Tutorial.
User Experience in using CRAB and the LPC CAF Suvadeep Bose TIFR/LPC US CMS 2008 Run Plan Workshop May 15, 2008.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
Enabling Grids for E-sciencE Workload Management System on gLite middleware - commands Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi.
INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,
Tier 3 Status at Panjab V. Bhatnagar, S. Gautam India-CMS Meeting, July 20-21, 2007 BARC, Mumbai Centre of Advanced Study in Physics, Panjab University,
Korea Workshop May GAE CMS Analysis (Example) Michael Thomas (on behalf of the GAE group)
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CRAB: the CMS tool to allow data analysis.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Command Line Grid Programming Spiros Spirou Greek Application Support Team NCSR “Demokritos”
INFSO-RI Enabling Grids for E-sciencE CRAB: a tool for CMS distributed analysis in grid environment Federica Fanzago INFN PADOVA.
WLCG Authentication & Authorisation LHCOPN/LHCONE Rome, 29 April 2014 David Kelsey STFC/RAL.
INFSO-RI Enabling Grids for E-sciencE Policy management and fair share in gLite Andrea Guarise HPDC 2006 Paris June 19th, 2006.
Portable Batch System – Definition and 3 Primary Roles Definition: PBS is a distributed workload management system. It handles the management and monitoring.
Daniele Spiga PerugiaCMS Italia 14 Feb ’07 Napoli1 CRAB status and next evolution Daniele Spiga University & INFN Perugia On behalf of CRAB Team.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Porting an application to the EGEE Grid & Data management for Application Rachel Chen.
1Bockjoo Kim 2nd Southeastern CMS Physics Analysis Workshop CMS Commissioning and First Data Stan Durkin The Ohio State University for the CMS Collaboration.
Enabling Grids for E-sciencE CMS/ARDA activity within the CMS distributed system Julia Andreeva, CERN On behalf of ARDA group CHEP06.
User Interface UI TP: UI User Interface installation & configuration.
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
RI EGI-TF 2010, Tutorial Managing an EGEE/EGI Virtual Organisation (VO) with EDGES bridged Desktop Resources Tutorial Robert Lovas, MTA SZTAKI.
P.Miné Visu CMS1 Philippe Miné LLR, Ecole Polytechnique, IN2P3/CNRS, France Introduction Views and options Tutorial Demonstration Practice Visualization.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
INFN/IGI contributions Federated Clouds Task Force F2F meeting November 24, 2011, Amsterdam.
Job Management Beijing, 13-15/11/2013. Overview Beijing, /11/2013 DIRAC Tutorial2  DIRAC JDL  DIRAC Commands  Tutorial Exercises  What do you.
May 27, 2009T.Kurca JP CMS-France1 CMS T2_FR_CCIN2P3 Towards the Analysis Facility (AF) Tibor Kurča Institut de Physique Nucléaire de Lyon JP CMS-France.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Practical: The Information Systems
Creating and running applications on the NGS
Grid Application Support Group Case study Schrodinger equations on the Grid Status report 16. January, Created by Akos Balasko
CRAB and local batch submission
N. De Filippis - LLR-Ecole Polytechnique
EGEE Middleware: gLite Information Systems (IS)
gLite Job Management Christos Theodosiou
Presentation transcript:

1 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools for distributed analysis N. De Filippis - LLR-Ecole Polytechnique

2 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools tutorial organization morning session: overview of CMS tools concepts of the CMS computing/analysis model overview of the analysis workflow and tools overview of the analysis job monitoring system afternoon session: practical examples demonstration of data discovery demonstration of job submission job monitoring and trouble-shooting

3 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS tools: practical session

4 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Access to the GRID resources Prerequisites: Mandatory: A grid certificate is needed, eventually with specific role to set a priorities or to cope with policies ( Mandatory: A registration in a virtual organization (VO) : CMS ( Mandatory: a glite user interface environment To setup the environment: Log into polgrid31: ssh –l polgrid31 or gsissh source /opt/exp_soft/cmss/cms_ui_env_crab.sh If you have a grid certificate: voms-proxy-init –voms cms –valid 100:59 If you have a proxy already created: Export X509_USER_PROXY= /proxy_nicola

5 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Preselection for H  ZZ  2e2mu: duplication removal of electrons sharing the same supercluster/track “loose” ElectronID at least 2 electrons with pT> 5 GeV/c irrespective of the charge at least 2 muons with pT > 5 GeV/c irrespective of the charge at least 1 Z  ee candidate with m ll > 12 GeV/c 2 at least 1 Z   candidate with m ll > 12 GeV/c 2 at least one l+l-l+l- (H) candidate with m llll > 100 GeV/c 2 2 loose isolated electrons:  p T tracks /p T e < 0.7 Example: H  ZZ  2e2  analysis

6 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis scramv1 project CMSSW CMSSW_1_6_7 cd CMSSW_1_6_7/src wget “ ” tar –zxvf TutorialHiggs.tgz cd HiggsAnalysis/HiggsToZZ2e2m scramv1 b eval `scramv1 runtime -sh` Setup CMSSW & CRAB environment

7 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example: test the code locally cd HiggsAnalysis/HiggsToZZ2e2m/test cmsRun HiggsToZZ2e2mCSA07Preselection.cfg 3 files created: hTozzToEEMuMuPresel.root hTozzToEEMuMuPreselRootTree.root preselec.out plots can be done with a macro: root –b –q HZZ2e2muPreselectionRootTreeAnalysis.C  let’s go on with CRAB wget “

8 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to discover data in DBS Examples: /Njet_2j_20_80-alpgen/CMSSW_1_6_7-CSA /RECO /Njet_2j_80_140-alpgen/CMSSW_1_6_7-CSA /RECO /H150_ZZ_4l/CMSSW_1_6_7-CSA /RECO /H140_ZZ_4l/CMSSW_1_6_7-CSA /RECO /CSA07Muon/CMSSW_1_6_7-CSA07-Gumbo-P1-PDMuon-Skims2-higgsToZZ4LeptonsRECOSIM/USER

9 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to configure CRAB

10 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description (1)

11 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description (2)

12 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description:handling output

13 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Basic configuration description (3)

14 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB

15 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (2)

16 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (3) Publish data: crab –publish The above command is used to publish the samples of the output jobs in the DBS specified in the configuration. The option –continue working_dir is used to executed operation with a task previously created.

17 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (4)

18 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis How to run CRAB (5)

19 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of crab.cfg (1) /H150_ZZ_4l/CMSSW_1_6_7-CSA /RECO /H140_ZZ_4l/CMSSW_1_6_7-CSA /RECO Cfg for preleselection Output files to be retrieved or stored in a storage element sample datasetpath form DBS SE and path where to store output files

20 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of crab.cfg (2) Specific match for sites based on CE or SE

21 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (1) Run crab: crab –create –submit 10

22 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (2) Run crab: crab –status all –continue

23 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Monitoring of jobs in Dashboard Select your jobs from the list of tasks

24 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (3) Run crab: crab –getoutput all -continue  When the job will be in Done status the getoutput can be executed.  You will find logs, stdout and stderr files in /res directory.  All the files you declared to be saved in the storage element will not be retrieved with getoutput on the user interface

25 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing: error codes

26 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (4) Check the existence of files in the storage element: rfdir /dpm/in2p3.fr/home/cms/trivcat/store/user/ndefilip A directory was created like CMSSW_1_6_7-testPublish- H150_bd809ee83429f1c823e885694f4109b6

27 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Example of processing (5) Run a macro to do plots: HiggsAnalysis/HiggsToZZ2e2m/test/HZZ2e2muPreselectionRootTreeAnalysis.C please change the files name in it root –b –q HZZ2e2muPreselectionRootTreeAnalysis.C Files in GIF format are saved. Display RECO_MassesTotH_0.gif give the higgs mass peak reconstructed You can also publish your root EDM output files in a specific DBS: CMS/CrabForPublication

28 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Use CRAB at CERN, at CAF/LSF AT CERN AT CAF at CAF

29 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Acknowledgements Thanks to: the LLR team: Paulo, Pascale, Igor, Philippe, Claude the CMS computing people: D. Spiga, A. Fanfani, J. Andreeva, O. Gutsche for providing material the grid support team

30 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis Backup slides

31 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CMS analysis job in GRID

32 Tutorial:Initiation a l’Utilisation de la Grille EGEE/LCG, June 5-6 N. De Filippis CRAB (CMS remote analysis builder) What is CRAB ? Goal of CRAB ? The aim of CRAB is to hide as much as possible of grid complexity to final user