The Tier-1 center for CMS experiment at LIT JINR N. S. Astakhov, A. S. Baginyan, S. D. Belov, A. G. Dolbilov, A. O. Golunov, I. N. Gorbunov, N. I. Gromova, I.Kadochnikov, I. A. Kashunin, V. V. Korenkov, V. V. Mitsyn, S. V. Shmatov, T. А. Strizh, E. А. Tikhonenko, V. V. Trofimov, N. N. Voitishin, V. E. Zhiltsov Joint Institute for Nuclear Research

Grid technologies - a way to success On a festivity dedicated to receiving the Nobel Prize for discovery of Higgs boson, CERN Director professor Rolf Dieter Heuer directly called the grid- technologies one of three pillars of success (alongside with the LHC accelerator and physical installations). Without implementation of the grid-infrastructure on LHC it would be impossible to process and store enormous data coming from the collider and therefore to make discoveries. Nowadays, every large-scale project will fail without using a distributed infrastructure for data processing. NEC2015, 2 Oct. 2015, Becici, Montenegro 2

In November, 2011 at the suggestion of A.A. Fursenko at a session of the Committee on Russia-CERN cooperation, a decision was accepted on the creation in Russia of a Tier-1 center for LHC experiments on the base of NRC "Kurchatov institute" and JINR. On September 28, 2012, a session of the Supervisory Council of WLCG project approved a work schedule on the creation of Tier-1 in Russia. First stage (December, 2012) - creation of a prototype of Tier-1 at NRC KI and at JINR. Second stage (November, 2013) - installation of equipment for the base Tier-1 center, its testing and finishing up to required functional characteristics. Third stage (March, 2015) – finalization of this complex and commissioning a full- scale Tier-1 center for СМS in JINR. In the sequel, a systematic increase of computing capacity and data storage is needed in accordance with the experiment requirements. The project of launching Tier-1 at JINR NEC2015, 2 Oct. 2015, Becici, Montenegro 3

LHC Computing Model Tier-0 (CERN): Data recording Initial data reconstruction Data distribution Tier-1 (11 → 14 centres): Permanent storage Re-processing Analysis Simulation Tier-2 (>200 centres): Simulation End-user analysis Dubna, JINR NEC2015, 2 Oct. 2015, Becici, Montenegro 4

Tier-1 Tier-2 + Local Computing HybriLIT Tier-2 + Local Computing + Cloud IBM Tape Robot Cloud GridEdu AIS 1C Network equipment JINR Computing Centre Status UPS NEC2015, 2 Oct. 2015, Becici, Montenegro 5

Creation of CMS Tier-1 in JINR  Engineering infrastructure (a system of uninterrupted power supply, climate - control);  High-speed reliable network infrastructure with a dedicated reserved data link to CERN (LHCOPN);  Computing system and storage system on the basis of disk arrays and tape libraries of high capacity;  100% reliability and availability. NEC2015, 2 Oct. 2015, Becici, Montenegro6

Tier-1 Components March 2015 LHCOPN LHCOPN 2400 cores (~ 30 kHS06) 2400 cores (~ 30 kHS06) 5 PB tapes (IBM TS3500) 5 PB tapes (IBM TS3500) 2,4 PB disk 2,4 PB disk Close-coupled, chilled water cooling InRow Close-coupled, chilled water cooling InRow Hot and cold air containment system Hot and cold air containment system MGE Galaxy 7000 – 2x300 kW energy efficient solutions 3Ph power protection with high adaptability MGE Galaxy 7000 – 2x300 kW energy efficient solutions 3Ph power protection with high adaptability Tape Robot Computing elements Uninterrupted power supply system Cooling system NEC2015, 2 Oct. 2015, Becici, Montenegro 7

JINR Tier-1 monitoring system JINR Tier-1 monitoring system provides real-time information about:  work nodes;  disk servers;  network equipment;  uninterruptible power supply elements;  cooling system. It also can be used for creating network maps and network equipment load maps, for drawing state tables and different plots. NEC2015, 2 Oct. 2015, Becici, Montenegro 8

Development perspectives of the JINR Tier-1 monitoring system NEC2015, 2 Oct. 2015, Becici, Montenegro9

10/98 JINR Tier-1 Connectivity Scheme NEC2015, 2 Oct. 2015, Becici, Montenegro

11/98 NEC2015, 2 Oct. 2015, Becici, Montenegro

12

Last month jobs 13NEC2015, 2 Oct. 2015, Becici, Montenegro

Last month pending and running jobs 14NEC2015, 2 Oct. 2015, Becici, Montenegro

Efficiency good&all jobs 15NEC2015, 2 Oct. 2015, Becici, Montenegro

Events Processed 16NEC2015, 2 Oct. 2015, Becici, Montenegro

WallClock Efficiency based on success/all accomplished jobs 17NEC2015, 2 Oct. 2015, Becici, Montenegro

Efficiency based on success/all accomplished jobs 18NEC2015, 2 Oct. 2015, Becici, Montenegro

Resource Utilization 19NEC2015, 2 Oct. 2015, Becici, Montenegro

TRANSFERS NEC2015, 2 Oct. 2015, Becici, Montenegro20

JINR-T1 farm usage history 21NEC2015, 2 Oct. 2015, Becici, Montenegro

Tier-1 jobs (history July-September 2015) NEC2015, 2 Oct. 2015, Becici, Montenegro22

Tier-1 usage and jobs (real time) NEC2015, 2 Oct. 2015, Becici, Montenegro23

Job processing by activities 24NEC2015, 2 Oct. 2015, Becici, Montenegro

Lyon/CCIN2P3 Barcelona/PIC De-FZK US-FNAL Ca- TRIUMF NDGF CERN US-BNL UK-RAL Taipei/ASGC 26 June 2009 Amsterdam/NIKHEF-SARA Bologna/CNAF Russia: NRC KI JINR NEC2015, 2 Oct. 2015, Becici, Montenegro25

NICA Accelerator Complex For the NICA project the data stream has the following parameters: high speed of the event set (up to 6 kHz), in central Au-Au collision at the NICA energies, about 1000 charged particles are generated, predicted event quantity - 19 billion; the total amount of initial data can be valued as 30 PB annually or 8.4 PB after processing. Simulation of the distributed computer infrastructure A model for studying processes has been created: Tape robot, Disk array, CPU Cluster. NEC2015, 2 Oct. 2015, Becici, Montenegro26

Importance of the Tier-1 center at JINR  Creation of conditions for JINR physicists, JINR Member States, RDMS-CMS collaboration for a full-scale participation in processing and analysis of data of the CMS experiment on the Large Hadron Collider.  The invaluable experience of launching the Tier-1 center will be used for creating a system of storage and data processing of megaproject NICA and other scale projects of the JINR- participating countries.  The studies in the field of Big Data analytics assume significance for the development of the perspective directions of science and economy as well as analysis and forecasting of processes in various fields. NEC2015, 2 Oct. 2015, Becici, Montenegro27

Thank you for your attention!