ALICE DAQ Plans for 2006 Procurement, Installation, Commissioning P. VANDE VYVRE – CERN/PH for LHC DAQ Club - CERN - May 2006

LHC DAQ Club May 20062P. VANDE VYVRE CERN-PH GDC DAQ architecture CTP LTU TTC FERO LTU TTC FERO LDC BUSY Rare/All Event Fragment Sub-event Event File Storage Network TDS PDS L0, L1a, L2 342 DDLs EDM LDC Load Bal. LDC HLT Farm FEP DDL H-RORC 10 DDLs 10 D-RORC 10 HLT LDC 144 DDLs TDS DS Event Building Network 416 D-RORC 194 Detector LDC 50 GDC 25 TDS 5 DSS

LHC DAQ Club May 20063P. VANDE VYVRE CERN-PH Trigger Level 0,1 Trigger Level 2 High-Level Trigger Decision Data ALICE online logical model Detector Digitizers Front-end Pipeline/Buffer Decision Readout Buffer Decision Subevent Buffer Event Buffer Storage Local Data Concentrator (LDC) Global Data Collector (GDC) Data transfer Detector Data Link (DDL) DAQ Read-Out Receiver Card (D-RORC) ALICE Terminology Transient Data Storage (TDS) Permanent Data Storage (PDS) Decision Event Building

LHC DAQ Club May 20064P. VANDE VYVRE CERN-PH DAQ Deployment Staged deployment of DAQ: Full detector readout from the start (enough PCI slots for all DDLs) 20/40/100 % of event building and storage bandwidth Jan 2006: DAQ Stage 0 DAQ for detector test and commissioning at CERN Covers needs till June 06 Jun 2006: DAQ Stage 1 (20%) Equipment of present generation of hw (Supermicro X6, FC 2G) already qualified after extensive and competitive testing Tender delayed till 20 February to include latest developments from industry LDCs: dual-core Xeon CPUs, FB DIMM memory, I/O acceleration Servers: dual-core AMD CPUs Storage Fibre Channel 4 Gb (FC 4G)

LHC DAQ Club May 20065P. VANDE VYVRE CERN-PH Detector Data Link (DDL) Two functions: Detector readout: fast data transfer to PC memory Electronics configuration: pedestals download PCI-X adapter for 2 DDL

LHC DAQ Club May 20066P. VANDE VYVRE CERN-PH DDL SIU and D-RORC production Jan ’06: tender launched for production of 550 DDL SIU cards 460 D-RORC cards Mar ’06 – Jun ‘06: delivery of DDL SIUs in batches So far 108 DDL SIUs cards produced, burnt in and tested by manufacturer Used to equip 1 side of TPC Delay of delivery of ACTEL ProASIC 3 May ’06 – July ’06: delivery of D-RORCs in batches

LHC DAQ Club May 20067P. VANDE VYVRE CERN-PH PCs LDC 110 x 4U PCs Dual Xeons Up to 6 PCI-X slots GDC 30 x 1U PCs Dual Xeons 1 PCI-X slot with Q-LOGIC FC-4G adapter DS 5 x 1U PCs Dual AMD Opteron 27x IT 3294/PH/ALICE (adjudication on 20 April ’06) LDC: Supermicro X6DHE-XB now (50 ordered) (CPU Nocona/Irwindale, Chipset Lindenhurst, DDR2 400, 6 PCI-X slots) Supermicro X7DBE-XB not yet available (CPU Dempsey, Chipset Blackford, DDR2 FBD, 6 PCI-X slots) Supermicro X7DB8-E under test (CPU Dempsey, Chipset Blackford, DDR2 FBD, 3 PCI-X slots)

LHC DAQ Club May 20068P. VANDE VYVRE CERN-PH Transient Data Storage Local disk buffer at P2 (Fibre Channel 4G) Storage network: 3 x QLogic SANbox ports FC4G 4 uplinks ports FC10G Transient Data Storage 18 x Infortrend INF-A16F-G ports FC 4G 16 SATA II HD DO 23295/PH/ALICE (adjudication on 20 April ’06)

LHC DAQ Club May 20069P. VANDE VYVRE CERN-PH Event Building Switch ALICE baseline: TCP/IP over switched Ethernet Event-Building Switch CERN frame contracts Needs of IT and experiments Good prices On site maintenance (company+IT) Switch qualification test Special set-up (IT): 60 PCs DATE software used for benchmarking Force 10 Model 1200 delivered and installed

LHC DAQ Club May P. VANDE VYVRE CERN-PH DAQ and ECS Software DAQ software ready for startup DDL software DAQ framework (Control, configuration, dataflow) (DATE V5) Performance Monitoring (AFFAIR) Data quality monitoring (MOOD) Information dissemination Documentation: 4 DAQ sw packages + ECS: fully documented. User’s guide released and printed Regular DAQ trainings (70 people in last 3 years) Linux Linux SLC3 now. ALICE DAQ contributing to Linux SLC4 certification. Transition to SLC4 scheduled before end ’06. Process defined to produce, distribute, install new versions Code management system: CVS. Release packaging and distribution: RPM (~20 MB) Automatic installation of Linux and DATE on DAQ nodes

LHC DAQ Club May P. VANDE VYVRE CERN-PH DATE V5 Control Configuration Dataflow Using DIM, SMI++ Tcl/Tk MySQL

LHC DAQ Club May P. VANDE VYVRE CERN-PH Data quality monitoring: MOOD Monitoring Of Online Data Raw data integrity Detector performance Using DATE ROOT

LHC DAQ Club May P. VANDE VYVRE CERN-PH DAQ performance monitoring: AFFAIR Using Apache DATE, ROOT DIM, SMI++ DAQ performance monitoring Node view System view

LHC DAQ Club May P. VANDE VYVRE CERN-PH ECS Overall ALICE Control TRG DAQ HLT DCS Using DIM, SMI++ Tcl/Tk MySQL

LHC DAQ Club May P. VANDE VYVRE CERN-PH DAQ Commissioning DAQ commissioning: 1 system DAQ commissioning: “reference system” in DAQ lab Test all functionalities Running last released versions of DDL firmware, DAQ and ECS software Detector emulator DDL Data Generator (DDG) DDL data source triggered by TTC Generation of busy Uses the D-RORC as DMA engine to read data from PC memory Send them over DDL

LHC DAQ Club May P. VANDE VYVRE CERN-PH DDG GDC DAQ Reference System: hw data generator LDC Rare/All Storage Network TDS Infortrend IT2 PDS EDM LDC Load Bal. LDC HLT TDS DotHill DSS Event Building Network LDC IT1 Storage DDG sw DDG LTU TTC DDG LTU TTC DDG BUSY L0, L1a, L2 DDG DDG sw

LHC DAQ Club May P. VANDE VYVRE CERN-PH DAQ systems for detector test & commissioning Detector tests with DAQ Data transfer: 25 DDLs for tests (1 chain per detector delivered since 2002) DATE sw Detector commissioning with DAQ Hardware DAQ dedicated to detector tests: Distributed in different locations according to needs Data transfer CERN: 20 DDL SIUs, 16 D-RORCs, 8 DIUs DAQ fabric 12 LDCs (6 PCI slots) 4 GDCs, 3 servers 2 storage units 2 TB

LHC DAQ Club May P. VANDE VYVRE CERN-PH DAQ systems for detector test & commissioning SPDFirst sector with DAQ, TRG, ECS in DSF (CERN Bld 186) SSDDAQ system (Utrecht) SDDDAQ system (Torino) TPCElectronics setup (Bergen, CERN Bld 13). Detector (SXL2 CERN) TRDDAQ ready for super-module being assembled (Heidelberg) TOFDAQ ready for module being assembled (Bologna, CERN Bld 156) Muon TRKDAQ system (Orsay). Feb ’06: test SXL2 Muon TRGDAQ system (Nantes) HMPIDDAQ system (CERN Bld 581) PHOSDAQ for electronics test, then module assembly (Bergen, CERN Bld 167) FMDDAQ installed for test in March (NBI, CERN Bld 1) T0DAQ in TOF labs (Bologna and CERN) V0Test of CCIU (Lyon) ACORDEDAQ system for detector (SXL2 CERN) EMCalDAQ system used during TB (Fermilab)

LHC DAQ Club May P. VANDE VYVRE CERN-PH Detector/DAQ integration (Mar 06) SPDSPD SSDSSD SDDSDD TPCTPC TRDTRD TOFTOF MUONTRKMUONTRK MUONTRGMUONTRG HMPIDHMPID PHOSPHOS FMDFMD T0T0 V0V0 ZDCZDC PMDPMD ACORDEACORDE EMCALEMCAL DATE system DDL with data gen. Detector readout with DDL & DATE Data quality monitor. (MOOD) Must be done in the lab before starting commissioning at Point 2

LHC DAQ Club May P. VANDE VYVRE CERN-PH DAQ Installation (CR1)

LHC DAQ Club May P. VANDE VYVRE CERN-PH Services Ready 35 racks 56 U Normal Power Air conditioning Cooling doors for 35 racks Connections to chilled water Chilled water circuits Network Access control Optical fibres SXL-CR1 In progress Optical fibres between CR1 and other CRs and UX Quality and schedule critical

LHC DAQ Club May P. VANDE VYVRE CERN-PH Some of the next steps Apr ’06DAQ standalone commissioned in lab May ’06ECS + DAQ + HLT at Point 2 Jun ’06ECS + TRG + DAQ test and commissioning in lab Installation DAQ Stage 1 Jun’06 – Sep’06 Data Challenge from Point 2 to IT May ’06TPC commissioning on surface with cosmics Jul ’06PHOS, TOF, TRD, HMPID, ACORDE Sep ’06TPC Jan ’07ITS Feb ’07TOF, TRD Apr ’07FMD, V0, T0, PMD

LHC DAQ Club May P. VANDE VYVRE CERN-PH Conclusion Production of DDL and D-RORC in progress Mar-Jul ’06. Enough DDL SIUs to equip 1 side of TPC DAQ fabric hardware All hw elements qualified. Tenders include most recent equipment. Procurement and delivery in progress. DAQ software ready Software (DDL sw, DATE, AFFAIR, MOOD) released and documented. Linux SLC3 now. Transition to SLC4 scheduled before end ’06. DAQ system deployment Stage 0: small DAQ system for detector test and commissioning Stage 1: deployed in June (full readout, 20% performance) Installation Services for DAQ finished. Optical fibres progressing with detector installation. Commissioning of detectors in parallel