QA tools – introduction and summary of activities Jacek Otwinowski (for the DPG QA tools) 26-Sep-17 Alice Mini Week

Outline Goal: Improve set of QA tools for the software validation, online and offline QA to be used in Run2 and Run3. Software validation with reference RAW and MC data Offline QA tools Online QA (HLT QA) tools Service tasks Outlook 26-Sep-17 Alice Mini Week

Software validation with reference RAW and MC data Full processing chains Data: Calibration, reconstruction, QA MC: Performance generation, Geant3 transport, reconstruction, QA Run for each ALICE software build Tools / implementation status Execution system (implemented, tested) – Matteo Concas/Dario Berzano https://pypi.python.org/pypi/alien-jdl2makeflow Performance MC generator (setup, under tests) – Jihyun Bhom/Marian Ivanov https://alice.its.cern.ch/jira/browse/ATO-245 Analyze QA output: completeness checks, RAM/CPU and detector QA (to be included) https://indico.cern.ch/event/662424/ 26-Sep-17 Alice Mini Week

Offline QA tools Iwona Sputowska, Marian Ivanov, Hans Beck, Jacek Otwinowski, Boris Rumantsev, Christian Borjau Detector, trigger, calibration, tracking, PID and analysis QA QA tools developments QA based on Elastic (https://www.elastic.co) ROOT tree based DB (TPC QA generalization) https://indico.cern.ch/event/578479/ Data samples comparison based on the parameterization maps https://alice.its.cern.ch/jira/browse/PWGPP-163 Massive tests ongoing Elasticsearch query: python and c++ clients Data normalization in Elasticsearch (parent-child relationships) https://indico.cern.ch/event/617701/ To be implemented Time series support for ROOT tree based DB Visualization / dashboards https://indico.cern.ch/event/665974/ https://indico.cern.ch/event/649759/ 26-Sep-17 Alice Mini Week

Online QA (HLT QA) https://aliceoverwatch.physics.yale.edu/monitoring Raymond Ehlers, Markus Fasel, Sarah LaPointe https://aliceoverwatch.physics.yale.edu/monitoring Online processing and interface for online detector monitoring and basic QA using data from the HLT (originally implemented for EMCAL) Architecture similar to data processing in Run3 (parallel processing -> merging -> QA -> visualization) Ongoing activities Deployment of the Overwatch Upgrade Elasticsearch usage for trending information Future plans Apache Kafka usage Triggering alarms https://indico.cern.ch/event/662424 26-Sep-17 Alice Mini Week

Service task 1 Task: Development of a trending and alarm framework for online HLT QA Several QA components on the HLT provide QA data for different detectors at discrete times as simple 1 or multi-dimensional histogram. These data are visualized using the overwatch web application. The scope of the task is to implement a component processing the histograms and extracting trending information. These trending information will be sent to an elasticsearch database for visualization. In addition, by comparing to limits defined by users, automatic alarms should be raised (E-Mail to detector responsible with alarm message + Log in database). The alarm handling should be in testing phase during the pp data taking period end of 2017. Ready to be taken (Data Preparation Groups) https://glance.cern.ch/alice/membership/service_tasks/enrollment_task.php 26-Sep-17 Alice Mini Week

Outlook Development is ongoing on several fronts Connection to JSROOT developers and CERN monitoring/Elastic stack teams established Regular meetings (Wednesdays 2:30 PM) Email list alice-dpg-qa-tools@cern.ch Dedicated JIRA project (ADQT) Please join and participate in developments! 26-Sep-17 Alice Mini Week