Laboratory of Information Technologies Proposal of the Laboratory of Information Technologies to the plan for the JINR development during 2010- 2016 V.V.

Slides:



Advertisements
Similar presentations
Institute for High Energy Physics ( ) NEC’2007 Varna, Bulgaria, September Activities of IHEP in LCG/EGEE.
Advertisements

Perspectives of JINR Grid-infrastructure V.V. Ivanov, Gh. Adam, V.V. Korenkov, T.A. Strizh, P.V. Zrelov Laboratory of Information Technologies Joint Institute.
DEVELOPMENT OF THE JINR ENGINEERING INFRASTRUCTURE AND INFORMATION TECHNOLOGIES DURING G.Shirkov, JINR Chief Engineer 106 th JINR Scientific.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.
Bondyakov A.S. Institute of Physics of ANAS, Azerbaijan JINR, Dubna.
Information and Communication Technologies in the field of general education in Armenia NATIONAL CENTER OF EDUCATIONAL TECHNOLOGIES.
Assessment of Core Services provided to USLHC by OSG.
ITEP participation in the EGEE project NEC’2005, Varna, Bulgaria Ivan Korolko (ITEP Moscow)
Possibilities for further intensification of the JINR Educational Programme S.Pakuliak 110 th session of JINR Scientific Council September 15-16, 2011.
S.Z. Pakuliak Active director of the JINR University Centre 107 th Session of the JINR Scientific Council, February 2010.
Tier 1 in Dubna for CMS: plans and prospects Korenkov Vladimir LIT, JINR AIS-GRID School 2013, April 25.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
Task 6.1 Installing and testing components of the LCG infrastructure to achieve full-scale functionality CERN-INTAS , 25 June, 2006, Dubna V.A.
Computing for HEP in the Czech Republic Jiří Chudoba Institute of Physics, AS CR, Prague.
ISS-AliEn and ISS-gLite Adrian Sevcenco RO-LCG 2011 WORKSHOP Applications of Grid Technology and High Performance Computing in Advanced Research.
Report from the Program Advisory Committee for Particle Physics to the JINR Scientific Council T. Hallman for J. Nassalski JINR Scientific Council Meeting.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA3 Activity in Russia Sergey Oleshko, PNPI,
GRID development in Russia 1) Networking for science and higher eductation 2) Grid for HEP 3) Digital Divide V. Ilyin SINP MSU.
DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.
14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Tony Doyle - University of Glasgow Introduction. Tony Doyle - University of Glasgow 6 November 2006ScotGrid Expression of Interest Universities of Aberdeen,
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow UK-T0 Meeting 21 st Oct 2015 GridPP.
1 Report of PAC for Particle Physics T. Hallman Presented by P. Spillantini JINR Scientific Council Meeting June 3-4, 2004 Dubna, Russia.
ITEP participation in the EGEE project NEC’2007, Varna, Bulgaria Ivan Korolko (ITEP Moscow)
INFSO-RI Enabling Grids for E-sciencE RDIG - Russia in EGEE Viatcheslav Ilyin RDIG Consortium Director, EGEE PMB SINP MSU (48),
LHC Computing, CERN, & Federated Identities
Performance assessment of the 2008 configuration of the JINR CICC cluster A. Ayriyan 1,*, Gh. Adam 1,2, S. Adam 1,2, E. Dushanov 1, V. Korenkov 1, A. Lutsenko.
JINR WLCG Tier 1 for CMS CICC comprises 2582 Core Disk storage capacity 1800 TB Availability and Reliability = 99% 49% 44% JINR (Dubna)End of.
Participation of JINR in CERN- INTAS project ( ) Korenkov V., Mitcin V., Nikonov E., Oleynik D., Pose V., Tikhonenko E. 19 march 2004.
IAG – Israel Academic Grid, EGEE and HEP in Israel Prof. David Horn Tel Aviv University.
Eygene Ryabinkin, on behalf of KI and JINR Grid teams Russian Tier-1 status report May 9th 2014, WLCG Overview Board meeting.
V. Ilyin, Russia – EU, Russia participation in EGEE stable core infrastructure - new applications/new resources/new.
JINR-CERN 5-years Partnership Program N.Russakovich 103-rd session of theJINR Scientific Council meeting JINR, Dubna, 21 February 2008.
Round-table session «Presentation of the new telecommunication channel JINR-Moscow and of the JINR Grid-segment» of the JINR Grid-segment» Korenkov Vladimir.
Dominique Boutigny December 12, 2006 CC-IN2P3 a Tier-1 for W-LCG 1 st Chinese – French Workshop on LHC Physics and associated Grid Computing IHEP - Beijing.
Information, Computer and Network Support of the JINR's Activity Information, Computer and Network Support of the JINR's Activity Laboratory of Information.
Grid technologies for large-scale projects N. S. Astakhov, A. S. Baginyan, S. D. Belov, A. G. Dolbilov, A. O. Golunov, I. N. Gorbunov, N. I. Gromova, I.
Current status of the JINR Central Information and Computing Complex (CICC) and its user service V.V. Ivanov Laboratory of Information Technologies, JINR.
LIT participation LIT participation Ivanov V.V. Laboratory of Information Technologies Meeting on proposal of the setup preparation for external beams.
The Tier-1 center for CMS experiment at LIT JINR N. S. Astakhov, A. S. Baginyan, S. D. Belov, A. G. Dolbilov, A. O. Golunov, I. N. Gorbunov, N. I. Gromova,
Report on availability of the JINR networking, computing and information infrastructure for real data taking and processing in LHC experiments Ivanov V.V.
Grids and SMEs: Experience and Perspectives Emanouil Atanassov, Todor Gurov, and Aneta Karaivanova Institute for Parallel Processing, Bulgarian Academy.
LHC collisions rate: Hz New PHYSICS rate: Hz Event selection: 1 in 10,000,000,000,000 Signal/Noise: Raw Data volumes produced.
Bob Jones EGEE Technical Director
Ian Bird WLCG Workshop San Francisco, 8th October 2016
STRATEGIC ACADEMIC UNIT “PEOPLE & TECHNOLOGIES”
Report from WLCG Workshop 2017: WLCG Network Requirements GDB - CERN 12th of July 2017
Grid site as a tool for data processing and data analysis
U.S. ATLAS Tier 2 Computing Center
The LHC Computing Grid Visit of Mtro. Enrique Agüera Ibañez
Grid infrastructure development: current state
Christos Markou Institute of Nuclear Physics NCSR ‘Demokritos’
Egle Tomasi-Gustafsson
Long-term Grid Sustainability
I Brazilian LHC Computing Workshop Welcome
Update on Plan for KISTI-GSDC
Russian Regional Center for LHC Data Analysis
Clouds of JINR, University of Sofia and INRNE Join Together
EGEE support for HEP and other applications
The LHC Computing Grid Visit of Her Royal Highness
Victor Abramovsky Laboratory “GRID technology in modern physics”
RDIG for ALICE today and in future
Dagmar Adamova (NPI AS CR Prague/Rez) and Maarten Litmaath (CERN)
UK Status and Plans Scientific Computing Forum 27th Oct 2017
Статус ГРИД-кластера ИЯФ СО РАН.
New strategies of the LHC experiments to meet
Project “DUBNA-GRID” Victor Ivanov DUBNA-GRID
The LHC Computing Grid Visit of Professor Andreas Demetriou
Presentation transcript:

Laboratory of Information Technologies Proposal of the Laboratory of Information Technologies to the plan for the JINR development during V.V. Ivanov Laboratory of Information Technologies, JINR Programme Advisory Committee for Particle Physics 30th meeting, January 2009

V.V.Ivanov (LIT, JINR) Strategic items of LIT activity within JINR Roadmap A well developed, corresponding to the nowadays requirements, telecommunication, networking, and computing infrastructure A well developed, corresponding to the nowadays requirements, telecommunication, networking, and computing infrastructure The data analysis will require massive distributed CPU power with huge data storage facilities connected together through high bandwidth links, as well as new mathematical methods for extracting insightful information from experimental data. The data analysis will require massive distributed CPU power with huge data storage facilities connected together through high bandwidth links, as well as new mathematical methods for extracting insightful information from experimental data. The home made implementations of open software, together with their quality assessment through specific validation procedures, are cornerstones of an activity devoted to the minimization of the financial effort. This is particularly important for successful realization of JINR new home projects and participation of JINR in future large scale projects such as FAIR complex, Super-LHC, International Linear Collider (ILC), etc. The home made implementations of open software, together with their quality assessment through specific validation procedures, are cornerstones of an activity devoted to the minimization of the financial effort. This is particularly important for successful realization of JINR new home projects and participation of JINR in future large scale projects such as FAIR complex, Super-LHC, International Linear Collider (ILC), etc. Training of high-skilled IT specialists: Training of high-skilled IT specialists: - user training and support; - user training and support; - student specialization, preparation of diploma and master theses at the 2 MIREA chairs and 1 chair of Dubna University working on the LIT basis; - student specialization, preparation of diploma and master theses at the 2 MIREA chairs and 1 chair of Dubna University working on the LIT basis; - preparation of PhD and DSc theses; - preparation of PhD and DSc theses; - organization of dedicated periodic Schools, Conferences, Workshops, tutorials - organization of dedicated periodic Schools, Conferences, Workshops, tutorials

V.V.Ivanov (LIT, JINR) Development of the JINR Grid-environment The formation of a unified Grid- environment of the JINR Member States is a pillar of the 7-year plan within the direction “Networks. Computing. Computational Physics”. Three main levels within the Grid- environment: network, resource and applied.

V.V.Ivanov (LIT, JINR) Network level developments of the JINR Grid-infrastructure Telecommunication channels The development and upgrade of the JINR telecommunication links include a wide spectrum of activities focused on the growth of the cooperation with the Russian Satellite Communications Company (RSCC), the development of a high-speed network infrastructure in Russia, the improvement of the system of international computer channels for science and education in Russia, the data links with the JINR-participating countries. JINR partners networks – RBNet, RASNet, RUNNet, RUHEP in Russia, and GEANT2 JINR-Moscow channel In 2008, an agreement was concluded between JINR and RSCC on the rent of optical fiber cable for the provision of optical communication links between Moscow and Dubna on the basis of state-of-the-art technologies DWDM and 10Gb Ethernet. The channel is planned to be launched in 2009 with a capacity of 20 Gbps. The mentioned technologies allow one to create up to 72 channels of 10 Gbps each, and to raise the total throughput up to 720 Gbps.

V.V.Ivanov (LIT, JINR) Network level developments of the JINR Grid-infrastructure

V.V.Ivanov (LIT, JINR) Resource level developments of the JINR Grid-infrastructure Today the requirements of the LHC experiments stimulate the development of a global Grid- infrastructure, together with the resource centers of all the cooperating organizations. First of all, this is of primary concern for such large research centers as the JINR. To reach effective processing and analysis of the experimental data, further increase in the JINR CICC performance and disk space is needed. Computing clusters and data storage systems The kernel - the high-efficiency computing clusters and the data storage systems of the JINR Central Information and Computing Complex Center of primary Grid-services (CPGS): manage the joint Grid-infrastructure, manage the joint Grid-infrastructure, coordinate functioning of geographically distributed resource centers, coordinate functioning of geographically distributed resource centers, gLite middleware at the initial stage as a platform for the CPGS construction. gLite middleware at the initial stage as a platform for the CPGS construction. Information and primary software

Tier 0 – Tier 1 – Tier 2 7 Tier-0 (CERN): Data recording Initial data reconstruction Data distribution Tier-1 (11 centres): Permanent storage Re-processing Analysis Tier-2 (>200 centres): Simulation End-user analysis

V.V.Ivanov (LIT, JINR) Central Information and Computing Complex ( JINR Central Information and Computing Complex (CICC) Development of JINR CICC and Grid segment in accordance with experiment requirements Development of JINR CICC and Grid segment in accordance with experiment requirements Raising the computing cluster performance Raising the computing cluster performance Expansion of the disk storage system Expansion of the disk storage system Creation of the data storage system of Active tape type Creation of the data storage system of Active tape type Upgrade of the local CICC network up to 10 Gbps Upgrade of the local CICC network up to 10 Gbps Development of the servers maintaining the JINR Grid segment and computing cluster Development of the servers maintaining the JINR Grid segment and computing cluster Development and modernization of the servers of the JINR information structure and the general storage system (dCachе, WEB, database servers) Development and modernization of the servers of the JINR information structure and the general storage system (dCachе, WEB, database servers)

V.V.Ivanov (LIT, JINR) Central Information and Computing Complex In 2007, total CICC performance was 670 kSI2K, the disk storage capacity 100 TB At present, the CICC performance equals 1400 kSI2K and the disk storage capacity 100 TB Feb 2009 Dec 2009 CPU(kSI2K) Disk (TB) Tapes(TB)-100 The unit of computing power 2.5 kSI2K corresponds to 1 core of Intel Xeon 2.8 GHz processor New CICC structure after the equipment installation New equipment was purchased at the end of 2008 under the FASI Contract “Working out the computing system for development of the Grid-complex RuTier2/RDIG for carrying out by the Russian institutes the distributed data analysis for the LHC experiments as a part of global Grid-system WLCG/EGEE”

V.V.Ivanov (LIT, JINR) Central Information and Computing Complex ( JINR Central Information and Computing Complex (CICC)

V.V.Ivanov (LIT, JINR) 594 Registered users Total registered 17 experiments Special groups for COMPASS (8), NA48(1), H1(1), ATLAS(77), CMS(31), ALICE(28), LHCb, HARP(9), COMPASS, DIRAC(7), D0(3), NEMO(7), OPERA(4), STAR(2), KLOD(1), FOTON-2(3), PANDA Statistics by Laboratories and groups (Jan-Dec 2008, Jobs number, batch mode)

V.V.Ivanov (LIT, JINR) CPU time Jobs Statistics by Laboratories and experiments (Jan-Мау 2008, CPU time, Jobs number, batch mode)

V.V.Ivanov (LIT, JINR) GRID USERS CPU TIME JOBS Statistics by Grid Virtual organizations (Jan-Мау 2008, CPU time, Jobs number, batch mode) Jan – May, 2008 Local jobs: Local CPU time: ,34 Grid-jobs: Grid CPU time: ,6

V.V.Ivanov (LIT, JINR) RDIG monitoring&accounting Monitored values CPUs - total /working / down/ free / busy Jobs - running / waiting Storage space - used / available Network - Available bandwidth Accounting values Number of submitted jobs Used CPU time Totally sum in seconds Normalized (with WNs productivity) Average time per job Waiting time Totally sum in seconds Average ratio waiting/used CPU time per job Physical memory Average per job JINR CICC

V.V.Ivanov (LIT, JINR) JINR-LCG2 in RDIG January – December 2008 JINR - 40% of total RDIG CPU time Normalised CPU time per VO at JINR site

V.V.Ivanov (LIT, JINR) EGEE SITES: LHC VOs (ALICE, ATLAS, CMS and LHCb) Normalised CPU time by SITE January - December FZK-LCG FR-IN2P3-CC-T TRIUMF-LCG FR-GRIF IN2P3-CC CERN-PROD NIKHEF-ELPROD RAL-LCG RWTH-Aachen NDGF-T PIC JINR-LCG Statistics obtained from the EGEE Accounting Portal:

V.V.Ivanov (LIT, JINR) Further participation in the WLCG project Support and development of the JINR WLCG-segment in frames of global WLCG infrastructure; Support and development of the JINR WLCG-segment in frames of global WLCG infrastructure; Participation in Service/Data Challenges in coordination with LHC experiments; Participation in Service/Data Challenges in coordination with LHC experiments; WLCG middleware testing/evaluation; WLCG middleware testing/evaluation; Grid-monitoring the LCG-infrastructure at JINR and other sites of the Russian Tier2 cluster; Grid-monitoring the LCG-infrastructure at JINR and other sites of the Russian Tier2 cluster; Evaluation of new Grid technologies in context of their usage in WLCG; Evaluation of new Grid technologies in context of their usage in WLCG; MCDB development (data base structure; basic modules; MCDB development (data base structure; basic modules; Participation in ARDA activities in coordination with experiments; Participation in ARDA activities in coordination with experiments; JINR WLCG web-portal improvement; JINR WLCG web-portal improvement; User’s support to stimulate their active usage of WLCG resources (courses, lectures, trainings, publication of user guides in Russian); User’s support to stimulate their active usage of WLCG resources (courses, lectures, trainings, publication of user guides in Russian); Support of JINR member states in WLCG activities. Support of JINR member states in WLCG activities.

V.V.Ivanov (LIT, JINR) Resource level developments of the JINR Grid-infrastructure

V.V.Ivanov (LIT, JINR) Foreseen expenses during 2010–2016 States. The funding of the foreseen payments will be done at the expense of both the LIT budget provisions and within special purpose funding coming from the collaboration and international cooperation with the JINR Member States.

V.V.Ivanov (LIT, JINR) Applied level developments of the JINR Grid-environment (I) 1.The applied level covers the user applications working in a virtual organization (VO) environment which comprises both users and owners of computing resources. 2.In the existing Grid-systems, a VO defines a collaboration of specialists in some area, who combine their efforts to achieve a common aim. 3.The virtual organization is a flexible structure that can be formed dynamically and may have a limited life-time. VOs working within the WLCG project are the VOs on the LHC experiments - ATLAS, CMS, Alice, LHCb, the first three being carried out with the noticeable and direct participation of the JINR. Nowadays, as a Grid-segment of the EGEE/RDIG, the JINR CICC supports computations of the virtual organizations registered in RDIG ( LHC experiments, BioMed, PHOTON, eEarth, Fusion, HONE, Panda. VOs working within the WLCG project are the VOs on the LHC experiments - ATLAS, CMS, Alice, LHCb, the first three being carried out with the noticeable and direct participation of the JINR. Nowadays, as a Grid-segment of the EGEE/RDIG, the JINR CICC supports computations of the virtual organizations registered in RDIG ( LHC experiments, BioMed, PHOTON, eEarth, Fusion, HONE, Panda. In the future, as the interest arises at a large-scale level, VOs can be organized at JINR in the fields of nuclear physics and condensed matter physics and, most probably, in the new promising direction related to the research of the nanostructure properties. In the future, as the interest arises at a large-scale level, VOs can be organized at JINR in the fields of nuclear physics and condensed matter physics and, most probably, in the new promising direction related to the research of the nanostructure properties.

V.V.Ivanov (LIT, JINR) The creation of new VOs gets possible and necessary under maturation of the algorithmic approaches to the problem solution, the development of corresponding mathematical methods and tools: methods and tools for simulation of physical processes and analysis of experimental data software and computer complexes for experimental data processing; methods and tools for simulation of physical processes and analysis of experimental data software and computer complexes for experimental data processing; numerical methods, algorithms and software for modeling complex physical systems; numerical methods, algorithms and software for modeling complex physical systems; methods, algorithms and software of computer algebra; methods, algorithms and software of computer algebra; new computing paradigms; new computing paradigms; adaptation of specialized software for solving problems within the Grid- environment. adaptation of specialized software for solving problems within the Grid- environment. Applied level developments of the JINR Grid-environment (II)

V.V.Ivanov (LIT, JINR) Applied level developments of the JINR Grid-environment (III)

V.V.Ivanov (LIT, JINR) Formation of the Grid environment of the JINR-Member States Creation of the Grid environment of the JINR-participating countries. It will allow to bring out the research underway at JINR in the field of high energy physics, nuclear physics, solid state physics and condensed matter physics, biophysics, biosensor (nano)technologies, etc., on a qualitatively new level. Basic directions: Creation of a working group of the representatives of the JINR-participating countries for the development of the main directions of the activity toward forming a joint Grid environment. Creation of a working group of the representatives of the JINR-participating countries for the development of the main directions of the activity toward forming a joint Grid environment. Investigation, together with the JINR Member States, of the basic directions of activity toward forming the joint Grid environment. Investigation, together with the JINR Member States, of the basic directions of activity toward forming the joint Grid environment. Preparation of corresponding multi-side agreements. Preparation of corresponding multi-side agreements. Development of the network level of the Grid environment of the JINR Member States. Development of the network level of the Grid environment of the JINR Member States. Development of the resource level of the Grid environment of the JINR Member States. Development of the resource level of the Grid environment of the JINR Member States. Formation of the applied level of the Grid environment of the JINR Member States. Formation of the applied level of the Grid environment of the JINR Member States. Preparation and implementation of joint projects. Preparation and implementation of joint projects.

V.V.Ivanov (LIT, JINR) Staff Total 298 ( Total 298 ( Scientific staff + engineers Scientific staff + engineers –25 doctor of science –63 candidate of science –44 from JINR Member States 73 - Technicians 73 - Technicians

V.V.Ivanov (LIT, JINR) Thank you for your attention !