1. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 1 Participation of IHEP in EGEE Project Vadim Petukhov (IHEP, Protvino, Russia) E-mail: Vadim.Petoukhov@ihep.ru

2. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 2 Talk Outline IHEP within the RDIG Consortium; EGEE activities in IHEP; Russian CIC, ROC and RCs relation schema; Existing resources (farms, storage, links); Usage of resources; Software (middleware versions); Requirement for Russian Tier2 to support LHC Experiments.

3. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 3 IHEP within RDIG RDIG Consortium (Russian Data Intensive GRID) has been formed with a view to maintenance of full-scale participation of Russia in EGEE project. It is also planned to involve Russian organizations from various areas of science and education in the EGEE project. Institute of High Energy Physics (IHEP) is one of the 8 institutes consisting in the consortium. It is largest particle accelerator center in Russia. 2 500 Personals. 20 specialists are involved in EGEE project with overall activities near 8 FTE.

4. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 4 IHEP Activity in EGEE Project NA2 – Dissemination and Outreach (5 specialists) NA3 – User Training and Induction (8 specialists) NA4 - Application Identification and Support (3 specialists) SA1 - European Grid Operations, Support and Management ( 17 specialists) Activity NA2NA3NA4SA1 Total FTE 0.531.35 0.8 5.257.93

5. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 5 Activity NA2: The main areas of dissemination in IHEP are: Translation of the main EGEE documentations into Russian. Preparation and support of the Web-site http://www.ihep.su/egee/

6. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 6 Activity NA2 (cont): Attraction some Russian scientific organizations in EGEE (especially from Ministry for Atomic Energy); Support mail lists and web base collaborative tools; Organizing of a meetings and Workshops: Workshop “ GRID-EGEE infrastructure in Russia for support of scientific research”, Protvino, 17-19 Jan, 2005

7. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 7 Activity NA3: IHEP has a leading role for NA3 activity in RDIG: Organizing training of users to GRID software; Preparation of training courses and materials; Maintenance of functioning of the distributed courses. Elena Slabospitskaya (Elena.Slabospitskaya@ihep.ru) is Leader of NA3 activity in RDIG

8. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 8 Activity NA4: The main areas IHEP in NA4 activity are:  Management of ATLAS VO in Russia;  Support of ALICE, CMS and LHCb pilot applications;  Preparation for DCs;  Testing GRID software with reference to specific targets of various experiments;  Discussion and work out of the decisions for the resourses required.

9. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 9 Application SW Application SW ALICE ATLAS VO-alice-ALIROOT-v4-03-04 VO-atlas-release-10.0.1 VO-alice-AliEn-1.33.15 VO-atlas-lcg-release-0.0.3 VO-alice-ALIROOT-CVS HEADV VO-atlas-release-9.0.4 ROOT V5-02-00 ROOT V5-03-01 LHCB VO-lhcb-Gauss-v15r13 CMS VO-lhcb-Gauss-v19r4 VO-cms-CMKIN_4_2_0_dar VO-lhcb-Gaudi-v15r3 VO-lhcb-Gaudi-v15r5 DTEAM VO-lhcb-DaVinchi-v12r4 teamd-testingthesite1 VO-lhcb-DaVinchi-v12r11 VO-lhcb-RTTC-v1 VO-lhcb-Boole-v8r4

10. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 10 CIC, ROC and RCs relation for SA1 in Russia CIC, ROC and RCs relation for SA1 in Russia OMC - Operations Management Centre dCIC - distributed Core Infrastructure Centre dROC - distributed Regional Operations Centre RC - Resource Centre

11. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 11 SA1/ROC: The EGEE-RDIG federation runs a distributed ROC, focused at middleware deployment and runtime support for the sites in the region. The middleware repository for the RDIG resource centre is created and supported. (http://grid-cvs.ihep.su); This repository is located at IHEP and include a CVS (Concurrent Versioning System ) deployment area where all the resource centers can store and retrieve their configuration files as it is being done at LCG-2;http://grid-cvs.ihep.su

12. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 12 The List of informative notification for Administrators of RCs is supported. roc.support@ihep.ru roc.support@ihep.ru SA1/ROC

13. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 13 SA1/ROC For participation in the Pre-Production Service (PPS) the cluster consisting of seven computers was created

14. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 14 Resources in IHEP for EGEE/LCG

15. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 15 EGEE resources in IHEP: Computer resources: 55 KSI2K Disks: 5 ТБ Tapes: 5 ТБ External link: 100 Мб/с

16. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 16

17. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 17

18. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 18 Software status in IHEP:

19. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 19 It is planned in 2006 year (on the agreement with Gaztelecom) to organize a channel using gigabit Ethernet technology and to lease out so-called "dark" optical fibres for the extension of the IHEP optical cable to the international communication node in Moscow.

20. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 20 Link IHEP – Internet load

21. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 21 A distributed Tier 2 aggregates the resources of the constituent institutes to provide a significant number of resources. While each site may not have the manpower to develop expertise to run a production service, pooling technical knowledge and support can make this possible. In aggregating their resources, if one site encounters problems and has to go offline, the Tier 2 as a whole can still be providing a production quality service. Participating institutes: : Moscow ITEP, SINP MSU, RRC KI Moscow region JINR, IHEP St. Petersburg PNPI RAS Russian Tier2 Cluster is planned to be connected to the CERN Tier1 Centre. Russian Tier2 Cluster

22. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 22 ALICEATLASCMSLHCbALICEATLASCMSLHCbALICEATLASCMSLHCb 2006 5733708004001301602001008760300 2007 100071112501000251320310300163122460100 2008 1319129616251500456600410440345332670380 2009 167323962000 84410006708206964821450360 2010 217334963250250013441800970120012466822000440 Russian Tier2 Cluster Planning Table 1. Resources requested by Experiments. The resources indicated are assumed to be available for using to October each year. CPU KSI2KDISK (usable) TBTape Active TB

23. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 23 Summary parameters of the Russian Tier2 Cluster Summary parameters of the Russian Tier2 Cluster

24. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 24 Some general requirements to the Cluster architecture: The farm has to have integrated uniform hardware structure. One farm is usually shared by several VOs, and the corresponding restructuring of CPU resources can be done by means of the local scheduler. Scalability: the farm resources are steadily growing in time and each extension of the farm should not cause its strong rearrangement. Flexibility, Reliability of critical elements, and of course Price/Performance factors are crucial points. The main elements of the farm are the following: A farm building block is 20 WNs attached to an Ethernet switch with 24 1Gb/s ports. One 1Gb/s port is “external”, i.e. it is used for connection with the MSS. There are some SEs with I/O Ethernet lines of 1 Gb/sec each. To unify all these elements in the whole an environment with 40 – 160Gb/s throughput is needed. It should be able to connect each incoming line to all the others. This commutator can be constructed on the base of an Ethernet stackable switches.

25. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 25 A proposal on building blocks for RU-Tier2 Cluster

26. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 26 Thanks for your attention.

27. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 27 Tier2 Centre ~1 TIPS Online System Offline Processor Farm ~20 TIPS CERN Computer Centre FermiLab ~4 TIPSFrance Regional Centre Italy Regional Centre Germany Regional Centre Institute Institute ~0.25TIPS Physicist workstations ~100 MBytes/sec ~622 Mbits/sec ~1 MBytes/sec There is a “bunch crossing” every 25 nsecs. There are 100 “triggers” per second Each triggered event is ~1 MByte in size Physicists work on analysis “channels”. Each institute will have ~10 physicists working on one or more channels; data for these channels should be cached by the institute server Physics data cache ~PBytes/sec ~622 Mbits/sec or Air Freight (deprecated) Tier2 Centre ~1 TIPS Caltech ~1 TIPS ~622 Mbits/sec Tier 0 Tier 1 Tier 2 Tier 4 1 TIPS is approximately 25,000 SpecInt95 equivalents

28. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 28 OMC - Operations Management Centre RC - Resource Centre dCIC - distributed Core Infrastructure Centre dROC - distributed Regional Operations Centre

29. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 29

30. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 30

31. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 31

32. Institute of High Energy Physics ( http://www.ihep.su )http://www.ihep.su NEC’2005 Varna, Bulgaria, 12-18 September 2005 32 Activity SA1: The main areas IHEP in SA1 activity are: