Download presentation
Presentation is loading. Please wait.
Published byElfrieda Walters Modified over 8 years ago
1
1 M. Paganoni, 17/1/08 Modello di calcolo di CMS M. Paganoni Workshop Storage T2 - 17/01/08
2
2 M. Paganoni, 17/1/08
3
3 Testing system at scale
4
4 M. Paganoni, 17/1/08 Terminated jobs / 6 days Currently: >20k jobs/day Massive MC production Constant, significant presence of analysis jobs complemented by JobRobot tests Middleware tests, CRAB Analysis Server tests, … Significant, constant user analysis CSA06 job submission (dominated by Job Robot) Massive MC production for CSA07 More JobRobot… mw testing Data processing: 1 year
5
5 M. Paganoni, 17/1/08 Event Size Current event size requirements estimated from measurements of CSA07 samples: RAWsim ~ 2.0 MB RAW ~ 1.5 MB RECO ~ 0.5 MB AOD ~ 0.2 MB Scope for reducing size: Remove duplication / optimize resources Handling RAW and RECO in 2 files (no FEVT) Mini-workshop with Physics and DPG Groups on January 28/29 at CERN to discuss and prepare implementation plan (RECO and AOD) Implementation during February 2008 in time to be included in CMSSW_2_0 release /CSA07BJet/CMSSW_1_6_4-CSA07-Tier0-A2-Chowder/RECO
6
6 M. Paganoni, 17/1/08 Processing time Current event size requirements estimated from measurements of CSA07 samples: SIM ~ 180 kSI2K*s (2 volte quanto previsto) RECO ~ 25-50 kSI2K*s AOD ~ 0.25 kSI2K*s Results of task force are being implemented in CMSSW_2_0 release (Feb. 08)
7
7 M. Paganoni, 17/1/08 Loadtest07 (2.5TB/week in upload and 12 TB/week in download) Roma->* * ->Roma LNL->* * ->LNL
8
8 M. Paganoni, 17/1/08 Pisa->* Bari->* * ->Bari * ->Pisa
9
9 M. Paganoni, 17/1/08 MC Prod (50 M/month) 50 % at OSG 75 % from T2
10
10 M. Paganoni, 17/1/08
11
11 M. Paganoni, 17/1/08 Risorse usate da LCG3
12
12 M. Paganoni, 17/1/08 Commissioning Detector (2007) TK: dati processati alla TIF nel 2007 (25 % Tracciatore acquisiti in 2 mesi) = 20 TB Muoni: dati acquisiti nell’ultimo Global Run (2 settimane) = 2 TB ECAL: 1.acquisizione dati in modalità locale ECAL con trigger cosmico 2.acquisizione dati in modalità locale ECAL con trigger di piedistallo, test- pulse o laser. Evento ECAL non zero-suppressed = 1.8 MB Rate trigger locale ECAL = 5 Hz 500 GB/day per run locale ECAL
13
13 M. Paganoni, 17/1/08 Produzione MC 2008 INFN produce 15% di CMS 10 9 ev/anno in totale 15 giorni di buffer per sRAW+RECO Tutti gli AOD in 2 copie 380 TB 1500 kSI2K
14
14 M. Paganoni, 17/1/08 Global Run 2008 20 Hz x 10 7 s * 75% = 1.5 x 10 8 ev 25 kSI2k s/ev 5 reprocessing Assumendo di portare il 5% dei RAW nei T2 INFN per studi di calibrazione/allineamento e commissioning: 110 TB 200 kSI2K
15
15 M. Paganoni, 17/1/08 Possible Analysis Workflows RECO AOD RAW First pass at Tier0/CAF Central analysis skims at Tier1 AOD RECO, AOD shipped at Tier1 Analysis algos Analysis Data AOD + Analysis skim output shipped at Tier2 Analysis Data AOD + Further selection, Reduced output Further selection, Reduced output Analysis Data Fewer AOD coll. fast processing and FWLite at Tier3 Final analysis pre-selection at Tier2 Final samples shipped at Tier3
16
16 M. Paganoni, 17/1/08 Modello di analisi 10 gruppi di analisi/T2 10 7 eventi per analisi su 3x10 8 : AOD (2 copie) e 5% RAW+RECO 5 volte su dati e 5 su simulazione 0.25 kSI2K s/ev 160 TB 100 kSI2K
17
17 M. Paganoni, 17/1/08 Operazioni tape in/out al T0
18
18 M. Paganoni, 17/1/08 importanza di: buffer I/O file di size grande per CASTOR
19
19 M. Paganoni, 17/1/08 Tier2 CMS-INFN disco 2007 CPU 2007 (TBN)(KSI2k) Bari38284 LNL72420 Pisa631358 Roma62222 TOT2352284 PLEDGED 2008
20
20 M. Paganoni, 17/1/08 Aug Sep Oct Nov Dec Jan Feb Mar Apr May Tracker Insertion MC Production for Startup S/w Release 2_0 (CCR_4T, Production startup MC samples) 1) Detector Installation, Commissioning & Operation 2) Preparation of Software, Computing & Physics Analysis Beam-pipe Closed and Baked- out CMS Cosmic Run CCR_0T Several short periods Dec-Mar) Cosmic Run CCR_4T 1 EE endcap Installed, Pixels installed 2007 Physics Analyses First Results Out CSA07 Test Magnet at low current S/w Release 1_7 ( CCR_0T, HLT Validation) S/w Release 1_6 ( CSA07) S/w Release 1_8 ( Lessons of ‘07) CSA08 (CCRC) Combined Computing Readiness Challenge Master Contingency 2nd ECAL Endcap Ready for Installation end Jun’08 V36 Schedule (Nov’07) Functional Tests CSA08 (CCRC) Last Heavy Element Lowered Cooldown of Magnet: Test
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.