Presentation is loading. Please wait.

Presentation is loading. Please wait.

PADME Kick-Off Meeting – LNF, April 20-21, 2015. DAQ Data Rate - Preliminary estimate Tentative setup: all channels read with Fast ADC 1024 samples, 12.

Published byPatricia Ramsey Modified over 8 years ago

Similar presentations

Presentation on theme: "PADME Kick-Off Meeting – LNF, April 20-21, 2015. DAQ Data Rate - Preliminary estimate Tentative setup: all channels read with Fast ADC 1024 samples, 12."— Presentation transcript:

1 PADME Kick-Off Meeting – LNF, April 20-21, 2015

2 DAQ Data Rate - Preliminary estimate Tentative setup: all channels read with Fast ADC 1024 samples, 12 bits per sample → 1536 Bytes per channel per event Beam rate: 50 Hz Data source# channelsData rate (MiB/s) Active target322.3 Hodoscope20014.6 Calorimeter65648.0 SAC40.3 Positron veto503.7 Total69.0 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 2 Preliminary DAQ L0 Rate

3 After L1 (zero suppression) Data source # channelsData rate Total0-suppMiB/sTB/y Active target3260.4414.5 Hodoscope20050.3712.1 Calorimeter656251.8360.6 SAC440.299.7 Positron veto5050.3712.1 Total3.30109.0 Notes: Occupancies from MC studies 1 year = 365 days of data taking No event selection: all events are written to disk ROOT can give a 30-50% data compression factor when writing data to disk 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 3 RAW data keeping full ADC samples RAW data keeping full ADC samples

4 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 4 Reconstruction format (RECO) Energy/Time per Channel Physics objects (Clusters/Tracks) O(10 TB/y) Reconstruction format (RECO) Energy/Time per Channel Physics objects (Clusters/Tracks) O(10 TB/y) Analysis format (ANAL) Physics objects only O(1 TB/y) Analysis format (ANAL) Physics objects only O(1 TB/y) RAW data L2

5 Storage requirements ~2 TB/Production Unit Storage requirements ~2 TB/Production Unit 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 5 Monte Carlo production - Storage Production Unit 10 13 e + i.e. 2x10 9 bunches of O(5000) e + N.B. 1 bunch = 1 MC event Production Unit 10 13 e + i.e. 2x10 9 bunches of O(5000) e + N.B. 1 bunch = 1 MC event Event size: O(1KB/event) Includes only E,t for each active channel Event size: O(1KB/event) Includes only E,t for each active channel If we want 10x statistics each year: ~20 TB/y

6 Full GEANT4 simulation of the experimental setup Running on a HP Proliant DL560 server o 4 Intel Xeon E5-4610v2 @ 2.3GHz (32 cores) o 128 GB ECC RAM Full GEANT4 simulation of the experimental setup Running on a HP Proliant DL560 server o 4 Intel Xeon E5-4610v2 @ 2.3GHz (32 cores) o 128 GB ECC RAM 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 6 Monte Carlo production - CPU Use of GRID for MC production under investigation Current MC production rate: 3 Hz/core (3 bunches per second per core) 10 production units per year → 37 days per production CPU power needed: 210 cores, i.e. 7 servers. Current MC production rate: 3 Hz/core (3 bunches per second per core) 10 production units per year → 37 days per production CPU power needed: 210 cores, i.e. 7 servers.

7 Disk costs: 0.2 K€/TB Tape costs: 0.1 K€/TB CPU: 6K€ per server (32 cores) All data (RAW+RECO+ANAL) written to tape 10% RAW + 100% RECO + 100% ANAL kept on disk 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 7 Costs DiskTape TB/yK€/yTB/yK€/y Data20412012 MC204404 CPU: 7 server → 42 K€ Accessories: racks, networking, cables, … → O(10 K€)

8 Informal preliminary meeting with Massimo Pistoni, head of the LNF IT services, on April 1 st. Space, power, cooling, UPS, network are available. No technical problems to host computing resources for PADME. 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 8 IT @ LNF – Central services Computing Center Allocate computer room resources for PADME ASAP BTF Caveat New collaboration INFN-INAF LNF will be asked to host computing resources for the CTA/SKA project. Caveat New collaboration INFN-INAF LNF will be asked to host computing resources for the CTA/SKA project.

9 Cloud-based storage is being investigated by INFN (CNAF, LNGS, To) Good scaling properties (PB and beyond) Automatic and configurable redundancy (not RAID-based) Lower cost per TB → SAN ~200€/TB vs. Cloud ~100€/TB IT @ LNF - Disk 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 9 A Storage Area Network (SAN) exists 1.EMC 2 CX500 (120 disks) + CX300 (60 disks) 2.Hitachi-Storagetek 9985V (up to 240 disks) 3.2 Switch FC Brocade DS4900B 2x32 ports @ 4 Gbps It can host storage for PADME but the current SAN infrastructure (servers and switches) is close to saturation Bottlenecks are possible Might need an upgrade

10 Two tape libraries are available. 1.IBM 3494 1000 slot 4 Magstar 3592, 300 GB/tape, 40 MB/s 2.StorageTek L1400 700 slot (max 1400) 2 STK 9940, 200 GB/tape, 30 MB/s Both have spare cartridge slots and can be upgraded with TB-class tape drives. Alternative: buy a new LTO tape library FormatCapacity (unc.)Transfer rate (unc.)Cost per tapeCost per TBAvailability LTO-62.5 TB/tape160 MB/s50 €20 €Now LTO-76.4 TB/tape300 MB/s(?) End 2015 IBM 3494 STK L1400 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 10 IT @ LNF - Tapes Cost of tape storage: ≤100 €/TB (less for LTO) Need to evaluate cost of new tape drives/library for different solutions

11 IT @ LNF - Networking 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 11 Internal BTF control room close to LAT room  Existing single-mode fiber link @ 10 Gbps BTF experimental area: currently connected @ 1 Gbps  No upgrade planned. Should we require one? Internal BTF control room close to LAT room  Existing single-mode fiber link @ 10 Gbps BTF experimental area: currently connected @ 1 Gbps  No upgrade planned. Should we require one? Geographical ATLAS T2 has a dedicated 10 Gbps link Other traffic on a 1 Gbps link → will be upgraded to 10 Gbps soon Geographical ATLAS T2 has a dedicated 10 Gbps link Other traffic on a 1 Gbps link → will be upgraded to 10 Gbps soon Computer room Central switch with 40 ports @ 10 Gbps Computer room Central switch with 40 ports @ 10 Gbps

12 IT @ LNF - Services 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 12 Batch system LSF is commonly used Central license administered by CNAF @LNF: batch farms are managed by each collaboration with “some support” from IT Uses AFS to manage clients’ common area Batch system LSF is commonly used Central license administered by CNAF @LNF: batch farms are managed by each collaboration with “some support” from IT Uses AFS to manage clients’ common area DataBase MySQL available. Currently used for LNF web services. Oracle used by INFN central services Cloud-based DB-as-a-service being investigated DataBase MySQL available. Currently used for LNF web services. Oracle used by INFN central services Cloud-based DB-as-a-service being investigated GRID Computing Used (and managed) by ATLAS T2  M.Antonelli, E.Vilucchi GRID Computing Used (and managed) by ATLAS T2  M.Antonelli, E.Vilucchi

13 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 13 Controls Investigate solutions used by other experiments Slow control DAQ monitoring

14 21/04/2015E.Leonardi - PADME Kick-off Meeting - Controls and Computing 14 Conclusions  Data production Preliminary estimate of DAQ rate: ~70 MiB/s Data production close to 100 TB/y  MC production G4 simulation already quite advanced Storage requirements close to 40 TB/y Investigate use of GRID for MC production  LNF IT resources Well suited to host PADME computing Allocate computer room resources ASAP Investigate use of existing SAN and alternatives Investigate use of existing tape libraries and alternatives  Controls Controls must allow automatic and unattended run of the experiment

Download ppt "PADME Kick-Off Meeting – LNF, April 20-21, 2015. DAQ Data Rate - Preliminary estimate Tentative setup: all channels read with Fast ADC 1024 samples, 12."

Similar presentations

Amber Boehnlein, FNAL D0 Computing Model and Plans Amber Boehnlein D0 Financial Committee November 18, 2002.

Amber Boehnlein, FNAL D0 Computing Model and Plans Amber Boehnlein D0 Financial Committee November 18, 2002.
23/04/2008VLVnT08, Toulon, FR, April 2008, M. Stavrianakou, NESTOR-NOA 1 First thoughts for KM3Net on-shore data storage and distribution Facilities VLV.

23/04/2008VLVnT08, Toulon, FR, April 2008, M. Stavrianakou, NESTOR-NOA 1 First thoughts for KM3Net on-shore data storage and distribution Facilities VLV.
Belle computing upgrade Ichiro Adachi 22 April 2005 Super B workshop in Hawaii.

Belle computing upgrade Ichiro Adachi 22 April 2005 Super B workshop in Hawaii.
SUMS Storage Requirement 250 TB fixed disk cache 130 TB annual increment for permanently on- line data 100 TB work area (not controlled by SUMS) 2 PB near-line.

SUMS Storage Requirement 250 TB fixed disk cache 130 TB annual increment for permanently on- line data 100 TB work area (not controlled by SUMS) 2 PB near-line.
CPP Staff - 30 CPP Staff - 30 FCIPT Staff - 35 IPR Staff - 500 IPR Staff - 500 ITER-India Staff - 150 ITER-India Staff - 150 Research Areas: 1.Studies.

CPP Staff - 30 CPP Staff - 30 FCIPT Staff - 35 IPR Staff IPR Staff ITER-India Staff ITER-India Staff Research Areas: 1.Studies.
Agenda Network Infrastructures LCG Architecture Management

Agenda Network Infrastructures LCG Architecture Management
March 27,28 2009IndiaCMS Meeting, Delhi1 T2_IN_TIFR of all-of-us, for all-of-us, by some-of-us Tier-2 Status Report.

March 27, IndiaCMS Meeting, Delhi1 T2_IN_TIFR of all-of-us, for all-of-us, by some-of-us Tier-2 Status Report.
Data oriented job submission scheme for the PHENIX user analysis in CCJ Tomoaki Nakamura, Hideto En’yo, Takashi Ichihara, Yasushi Watanabe and Satoshi.

Data oriented job submission scheme for the PHENIX user analysis in CCJ Tomoaki Nakamura, Hideto En’yo, Takashi Ichihara, Yasushi Watanabe and Satoshi.
Computing/Tier 3 Status at Panjab S. Gautam, V. Bhatnagar India-CMS Meeting, Sept 27-28, 2007 Delhi University, Delhi Centre of Advanced Study in Physics,

Computing/Tier 3 Status at Panjab S. Gautam, V. Bhatnagar India-CMS Meeting, Sept 27-28, 2007 Delhi University, Delhi Centre of Advanced Study in Physics,
KLOE Offline Status Report Data Reconstruction MonteCarlo updates MonteCarlo production Computing Farm C.Bloise – May 28th 2003.

KLOE Offline Status Report Data Reconstruction MonteCarlo updates MonteCarlo production Computing Farm C.Bloise – May 28th 2003.
BESIII computing 王贻芳. Peak Data volume/year Peak data rate at 3000 Hz Events/year: 1*10 10 Total data of BESIII is about 2*640 TB Event size(KB)Data volume(TB)

BESIII computing 王贻芳. Peak Data volume/year Peak data rate at 3000 Hz Events/year: 1*10 10 Total data of BESIII is about 2*640 TB Event size(KB)Data volume(TB)
FZU Computing Centre Jan Švec Institute of Physics of the AS CR, v.v.i. 29.8.2011.

FZU Computing Centre Jan Švec Institute of Physics of the AS CR, v.v.i
CASPUR Site Report Andrei Maslennikov Sector Leader - Systems Catania, April 2001.

CASPUR Site Report Andrei Maslennikov Sector Leader - Systems Catania, April 2001.
Planning and Designing Server Virtualisation.

Planning and Designing Server Virtualisation.
+ discussion in Software WG: Monte Carlo production on the Grid + discussion in TDAQ WG: Dedicated server for online services + experts meeting (Thusday.

+ discussion in Software WG: Monte Carlo production on the Grid + discussion in TDAQ WG: Dedicated server for online services + experts meeting (Thusday.
Federico Ruggieri INFN-CNAF GDB Meeting 10 February 2004 INFN TIER1 Status.

Federico Ruggieri INFN-CNAF GDB Meeting 10 February 2004 INFN TIER1 Status.
Scientific Computing Experimental Physics Lattice QCD Sandy Philpott May 20, 2011 IT Internal Review 12GeV Readiness.

Scientific Computing Experimental Physics Lattice QCD Sandy Philpott May 20, 2011 IT Internal Review 12GeV Readiness.
LCG Service Challenge Phase 4: Piano di attività e impatto sulla infrastruttura di rete 1 Service Challenge Phase 4: Piano di attività e impatto sulla.

LCG Service Challenge Phase 4: Piano di attività e impatto sulla infrastruttura di rete 1 Service Challenge Phase 4: Piano di attività e impatto sulla.
The Computing System for the Belle Experiment Ichiro Adachi KEK representing the Belle DST/MC production group CHEP03, La Jolla, California, USA March.

The Computing System for the Belle Experiment Ichiro Adachi KEK representing the Belle DST/MC production group CHEP03, La Jolla, California, USA March.
ScotGRID:The Scottish LHC Computing Centre Summary of the ScotGRID Project Summary of the ScotGRID Project Phase2 of the ScotGRID Project Phase2 of the.

ScotGRID:The Scottish LHC Computing Centre Summary of the ScotGRID Project Summary of the ScotGRID Project Phase2 of the ScotGRID Project Phase2 of the.

Similar presentations

Ads by Google