ATLAS HLT/DAQ Progress report V. Vercesi on behalf of the ATLAS Italia HLT/DAQ Group Maggio 2007

CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 2 A. Negri (Irvine, Pavia) Coordinatore Event Filter DataflowA. Nisati (Roma1) TDAQ Institute Board chair e Coordinatore Muon SliceF. Parodi (Genova) Coordinatore b-tagging PESAV. Vercesi Coordinatore TAPM (TriggerAlgorithmsPerformance&Menus) Trigger di Livello-1 muoni barrel (Napoli, Roma1, Roma2) Trigger di Livello-2 muoni (Pisa, Roma1) Trigger di Livello-2 pixel (Genova) Event Filter Dataflow (LNF, Pavia) Selection software steering (Genova) Event Filter Muoni (Lecce, Napoli, Pavia, Roma1) DAQ (LNF, Pavia, Roma1) DCS (Napoli, Roma1, Roma2) Monitoring (Cosenza, Napoli, Pavia, Pisa) Online Data Quality Muon Slice (Lecce) Responsabilità integrazione online Muon Slice (Pavia, Roma1) HLT/DAQ system commissioning and exploitation (Everybody) Attività italiane

Event data pulled: partial ≤ 100 kHz, full ~ 3.5 kHz CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 3 Event data requests Delete commands Gigabit Ethernet Requested event data pROS stores LVL2 output LVL2 farm Network switches Second- level trigger SDX1 USA15 UX15 ATLAS detector Read- Out Drivers ( RODs ) First- level trigger Read-Out Subsystems ( ROSs ) Dedicated links Timing Trigger Control (TTC) 1600 Read- Out Links VME ~150 PCs Data of events accepted by first-level trigger Event data ≤ 100 kHz, 1600 fragments of ~ 1 kByte each RoI Builder Event Filter (EF) Network switches DataFlow Manager Event Builder SubFarm Inputs (SFIs) ~1600 5~100 multi-CPU nodes ~ 500 Event rate ~ 200 Hz Local Storage SubFarm Outputs (SFOs) CERN computer centre Data Storage Regions Of Interest LVL2 Super- visor TDAQ in ATLAS site

Executive summary Moltissime attività nel corso degli ultimi mesi, forte collaborazione con i sotto-rivelatori, intensa fase preparatoria Dal read-out, al monitoring, ai cosmic runs, al commissioning, all’event building, al deployment delle slice di selezione, la comunità TDAQ è in continua accelerazione Large Scale Tests, Technical Runs, Cosmics Data Taking e Integration Tests gettano le basi del sistema che dovrà essere pronto alla fine dell’anno CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 4

5  Moreover  Fully equipped RoI Builder (+ 1 at bldg 32)  All network switches & cables needed in 2007  IPMI control Hardware 2007 CSN1 Maggio 2007

Hardware 2007 notes LAr, Tile, L1Calo, MDT : installed and ~ tested SCT : installed, not yet connected Pix, TRT, CSC, TGC, RPC : not yet installed ROD-ROS readout links Effort required, schedule available Need contribution from all Institutes involved Dynamic allocation to LVL2 or EF farms 130 [quad-core dual- cpu] boxes installed and to be commissioned Should cover all needs for partitioning during commissioning ~33% ATLAS EB capability (#SFI) Full throughput to CDR for calib/align/… 100% ATLAS data recording capability (#SFO) CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 6

Infrastructure in SDX CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 7

Read Out System (USA15) CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 8

SFI, DFM and friends CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 9

Installing HLT racks… CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 10 Ancient monuments were built without cranes…

HLT racks CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 11

Next steps CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 12

Event Builder Integrated and commissioned the first 1/3 of the ATLAS final Event Builder Assembles full events and serves Event Filter, or Local Disk (and then pulled to CASTOR) In parallel, serves Events to Monitoring Tasks in spying mode (e.g., to be used to Event Display) SFI Triggers Event Building using either Internal trigger, or L2Decision messages DFM 32 SFIs, writing to local disk, 10 had their data files pulled to CASTOR (100 SFI in full ATLAS) 5 DFMs, exercised triggering it without a LVL2 system 60 ROSs, producing fake events either at the ROS PC level, or the ROBIN level Technical run February #SFIs EB Rate kHz (~250 Hz per SFI) kHz kHz Perfect scaling of EB rate with # of SFIs CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia Read-Out Subsystems (ROSs) DFM Switches Event Builder (SFIs ) Local Disk  CASTOR 13

Monitoring CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 14 Core sw depends on ROOT only At present, input can be any ROOT object (only) Online I/O interface implemented Next: configure histograms & algorithms DQMF (MWG): online-offline common project Target: network & CPU load optimization Graphical configuration to be improved To come: plugin manager New implementation of OHP Based on COOL Implemented within ATHENA 5 millions histograms... Reference histogram handling OHP: standard TileCal, LAr, Muon histograms Online DQMF: prototype version with basic display Offline monitoring: ROOT display of ROOT histo files Event Display: Atlantis in loop (demo) mode taking events from EF server (or file) Data Quality Desk

Counting Room Desks CSN1 Maggio Valerio Vercesi - INFN Pavia

Large Scale Tests November – December 2006 LXBATCH facility, farm size up to 1000 nodes Configure HLT infrastructure and algorithms, both Level 2 and Event Filter Exercise DB access for configuration and metadata Run HLT with a set of trigger slices and algorithms on a realistic mix of MC events Configure (emulated) ROD cratesInfrastructure timings, monitoring COOL database 38 MB Geometry database 23 MB (SQLite file) Trigger configuration database 1 MB POOL files 31 MB including the catalogues Magnetic field file 5 MB (packed) Data volumes used for HLT configuration: CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 16

Technical run March events (mixed physics processes LVL1 pre-selected) They contain about: ~55% J0, J1, J2, J3, J4, J5, J6 jet-jet samples ~15% Wee ~13% W  ~3% Wtauhad ~2% Zee ~7% Z  ~5% JF17 (dijets filtered to be very electromagnetic) Execute the full DAQ/HLT chain including LVL2 trigger, Event Builder and Event Filter, write accepted events written to disk Emulate LVL1 trigger; use final Region of Interest Builder (ROIB) Test performance in terms of the various resources CPU usage, network usage, configuration time, algorithm execution times Pre-series test-bed used from the ATLAS Control RoomGood participation from DAQ, HLT, TAPM developers CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 17

Valerio Vercesi - INFN Pavia 18 It’s fun… CSN1 Maggio 2007

Online trigger menu 19 EgammaJetMuonTauBphysicsMET LVL1 EM01 —7 GeV thr— JT15 —15 GeV thr— MU06 —6 GeV thr— HA08 —8 GeV thr— JT04 —4 GeV thr— MU06 HA05 —5 GeV thr— L2 e10 signature 1. Find cluster 2. Find track 3. Match g10 signature 1. Find cluster jet20 signature 1. Sum Et of cells in cone mu6 signature 1. Find track in muon 2. Find tracks in ID 3. Match tracks tau10 signature 1. Find had cluster 2. Find tracks 3. Match BsDsPhiPi Bmu6mu6 dummy algorithm EF e10 signature 1. Find cluster 2. Find track 3. Match g10 signature 1. Find cluster jet20 signature 1. Find clusters 2. Sum Et of clusters in cone mu6 Signature 1. Find track in muon tau10 signature 1. Find had cluster 2. Find tracks 3. Match BsDsPhiPi MET10 CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia

Timing: LVL2 Calo 20 Photon run 2373 mean 6.6 ms/Ro I Electron run 2515 mean 8.0 ms Egamma run 2309 mean 7.4 ms Combined run 2368 mean 6.9 ms CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia

Online and offline: egamma EF CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 21 Online AthenaPT  Pt  =7.0  8.25  E  =43.18  TrigEgammaRec TrigEFTrackHypo  Pt  =6.9  8.1  E  =43.63  TrigEgammaRec

More plots CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 22 SiTrack p T MuFast residuals E/p 1/p T

Technical run next week CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 23 l 23 ‘Final’ Hardware ROIB (+ LVL1 emulator), 153 ROS, 30 SFI, 5 DFM, 3-4 HLT racks (up to 130 dual quad-core machines), … Basically same software setup as March TR

Physics Trigger Menus Detailed information available at CSC-06 Used for production with offline release triggers for cm -2 s -1 triggers for cm -2 s -1 triggers for optimization studies and validation CSC GeV Used exclusively for B-physics production in Contains lower muon threshold values and specific B-physics triggers Physics menus Current emphasis mostly (but not entirely) on menu for cm -2 s -1 Physics analysis studies starting to use trigger information available in Release 12 for studies of physics menus. CSC production provides required data and tools to go through first iteration Important to develop close collaboration between trigger and physics communities Trigger Rate Tool Develop toolkit to simplify trigger rate studies (collection of scripts and useful plotting tools) Provide “realistic” trigger rates (including overlap, independent fraction, prescales) of a full trigger menu CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 24

Trigger Aware Analysis CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 25 Trigger information available (result and features) for all the samples produced now Many Trigger aware analyses presented at last Trigger&Physics Week based on the new CSC samples across many groups (SM, Top, SUSY, Higgs, Exotics, B-Physics,..…..) Trigger efficiencies and distributions since reconstructed AODs Example from the Higgs group: VBF H→bb and bbH

CSN1 Maggio 2007 Valerio Vercesi - INFN Pavia 26