CWG13: Ideas and discussion about the online part of the prototype P. Hristov, 11/04/2014

2

DAQ lab machines 3  8 machines  Sandy Bridge-EP, dual E GHz, 64GB RAM  2x8 hw cores, 32 threads  Network  4x with 40G Ethernet  4x with 10G Ethernet

Naive test (with ZeroMQ?) 4 FLP1 Data source (DDL sim) Buffering Data reduction sim. Data “sender” FLP1 Data source (DDL sim) Buffering Data reduction sim. Data “sender” EPN1 Data “receiver” Time frame builder Algorithm simulator EPN1 Data “receiver” Time frame builder Algorithm simulator Storage simulator FLP2 Data source (DDL sim) Buffering Data reduction sim. Data “sender” FLP2 Data source (DDL sim) Buffering Data reduction sim. Data “sender” EPN2 Data “receiver” Time frame builder Algorithm simulator EPN2 Data “receiver” Time frame builder Algorithm simulator EPN3 Data “receiver” Time frame builder Algorithm simulator EPN3 Data “receiver” Time frame builder Algorithm simulator FLP3 Data source (DDL sim) Buffering Data reduction sim. Data “sender” FLP3 Data source (DDL sim) Buffering Data reduction sim. Data “sender” DQM simulator

Goals for a naïve test 5  Get experience with the ALFA software (currently in FairRoot), ZeroMQ, etc.  Become familiar with the online computing (especially for the offline people)  Perform some initial measurements, i.e. networking throughput, latency, performance with different size of the messages,…  Provide “sandbox” for development of the online components  logging system  control system  Test the access patterns, the distribution of produced/requested information, i.e. calibration, geometry, etc.

Some questions 6  Base (i.e. for components)  Common  Buffer  Networking/messaging (Pub/Sub, client/server, push/pull…)  FLP  Data Reduction Components  Clusterization  Tracklet finders  Calibration0 Components  EPN  Data aggregation component  Data reduction/reconstruction components  Vertex finding (?)  Global tracking  Rejection of non-associated clusters/cluster reformatting  Huffman encoding  Calibration1 Components  Control/logging  Which parts of the DAQ and HLT software can be reused in the test?  Is there any example in the FairRoot repository?  example/Tutorial3?  How do we organize the software in the repository? i.e.

Proposed actions for the next 2 weeks 7  JIRA project, Git workflow (Peter) JIRA project  Creation of MC points for ITS and TPC (Charis, Mohammad, Andrei)  Description of the Run3 raw data structures (Andrei, Peter)  Discussion with CWG3: 16/04/14  Installation of FairRoot/ALFA on the test nodes (Mohammad, Peter)  Detailed presentation on ALFA (Mohammad, Anar): 25/04/14  Ideas about the condition data base in Run3 (Raffaele): 05/14  Presentation on the ITS & TPC reconstruction components for Run3: cluster finder, fast tracker, track fit (Sergey, Ruben): 05/14  Next meeting 25/04/2014

Backup 8

O 2 Prototype: Complementary approaches “Offline” “Online” 9  Simulation (ITS + TPC) in FairRoot environment  Creation of hits (MC points)  Use of Geant4 w/wo multithreading, comparison (CWG8)  Digitization in time frames  Use of (0MQ) multiprocessing  Creation of raw data in Run3 format (CWG4)  Simulated from digits  Emulated from existing raw  Setup of test nodes (CWG1, CWG12)  Hardware and software data generation  See the “offline” part  Control, configuration and monitoring (CWG10)  ALFA components + control software

O 2 Prototype: Complementary approaches “Offline” “Online” 10  Use of CWG5 + CWG7 demonstrators to process (reconstruct) the raw data  Add more detectors (i.e. the ones in triggered mode) in the simulation  GOTO digitization, creation of raw data, reconstruction  Put some calibration algorithms in the processing (CWG6)  Data transport and fan-in, event-building (CWG3)  Use of generated raw data  Data access for processing, monitoring, QA (CWG9)  Data storage

Collaboration with the other CWGs 11  CWG 1 - Architecture  CWG 2 - Tools and Procedures  CWG 3 - Dataflow and Condition Data  CWG 4 - Data Model  CWG 5 - Computing Platforms  CWG 6 - Calibration  CWG 7 - Reconstruction  CWG 9 - QA, DQM, Visualization  CWG 8 - Physics Simulation  CWG 10 - Control, Configuration & Monitoring  CWG 11 - Software Lifecycle  CWG 12 - Computing Hardware