1. HEP Grid Computing in China Gang CHEN@IHEP-CC 06-16-2006 Workshop on Future PRC-U.S. Cooperation in High Energy Physics

2. Gang Chen/IHEP-CC 2015-10-4 - 2 Agenda Computing Requirements Computing Requirements Grid Deployment Grid Deployment Applications Applications Networking Networking Prospects Prospects

3. Gang Chen/IHEP-CC 2015-10-4 - 3 BEPCII/BESIII BEPC: Beijing Electron Positron Collider Started in 1989 Started in 1989 2~5GeV/C 2~5GeV/C Being upgraded to Dual-Ring, (3~10)×10 32 cm -2 s -1 Being upgraded to Dual-Ring, (3~10)×10 32 cm -2 s -1 27 Universities and Institutes from 27 Universities and Institutes from Korea, US, UK, Korea, US, UK, Japan, and China. Japan, and China.

4. Gang Chen/IHEP-CC 2015-10-4 - 4 BESIII Computing Requirements CPU ： ~2000 P-IV/3GHz CPU for data production/reconstruction and physics analysis CPU ： ~2000 P-IV/3GHz CPU for data production/reconstruction and physics analysis Storage ： ~5PB in 5 years. Storage ： ~5PB in 5 years. Network ： for international/domestic communications Network ： for international/domestic communications

5. Gang Chen/IHEP-CC 2015-10-4 - 5 YBJ-ARGO/AS  International cosmic ray observatories in Tibet. International cosmic ray observatories in Tibet. 200TB raw data per year. 200TB raw data per year. Data transferred to IHEP and processed with 400 CPUs. Data transferred to IHEP and processed with 400 CPUs. Rec. data accessible by collaborators. Rec. data accessible by collaborators.

6. Gang Chen/IHEP-CC 2015-10-4 - 6 LHC China is involved in all four LHC experiments, China is involved in all four LHC experiments, IHEP in CMS and ATLAS. IHEP in CMS and ATLAS.

7. Gang Chen/IHEP-CC 2015-10-4 - 7 More Collaborations Members of International Collaborations: Huge computing demands.

8. Gang Chen/IHEP-CC 2015-10-4 - 8 Grid Vision The GRID: networked data processing centres and ”middleware” software as the “glue” of resources. Researchers perform their activities regardless geographical location, interact with colleagues, share and access data Scientific instruments and experiments (and simulations) provide huge amount of data Federico.Carminati@cern.ch

9. Gang Chen/IHEP-CC 2015-10-4 - 9 HEP Grid in China Coordinated by IHEP Coordinated by IHEP Based on EGEE etc. Based on EGEE etc. To build a Tier-2 center at IHEP for LHC, WLCG MoU has been signed To build a Tier-2 center at IHEP for LHC, WLCG MoU has been signed Cooperating among institutes and universities Cooperating among institutes and universities

10. Gang Chen/IHEP-CC 2015-10-4 - 10 LCG Deployment in China UI CE_torque SE_classicl MON WN1 UI CE_torque SE_dcache BDII PX RB LFC_mysql WN2 SDU VO: ATLAS PC farm UI CE_torque SE_classicl WN1 WN2 PC farm UI WN1 WN2 PC farm PKU VO: CMS CSTNET\CERNET CNICIHEP

11. Gang Chen/IHEP-CC 2015-10-4 - 11 LCG Beijing Site Operation UI (User Interface) ： gLite-3.0.0 UI (User Interface) ： gLite-3.0.0 RB (Resource Broker) ： LCG-2.7.0 RB (Resource Broker) ： LCG-2.7.0 MyProxy ： gLite-3.0.0 MyProxy ： gLite-3.0.0 SE (SRM/Dcache) ： gLite-3.0.0 SE (SRM/Dcache) ： gLite-3.0.0 CE (OpenPBS->Torque) ： LCG-2.7.0 CE (OpenPBS->Torque) ： LCG-2.7.0 MON (R-GMA ) ： gLite-3.0.0 MON (R-GMA ) ： gLite-3.0.0 BDII ： gLite-3.0.0 BDII ： gLite-3.0.0 WNs ： gLite-3.0.0 WNs ： gLite-3.0.0 LFC ： LHC File Catalogue LFC ： LHC File Catalogue CA ： IHEP CA CA ： IHEP CA VOMS ： for BES/YBJ-ARGO VOs VOMS ： for BES/YBJ-ARGO VOs

12. Gang Chen/IHEP-CC 2015-10-4 - 12 CA and BES VOMS Operation IHEP CA is Unique CA accredited by EUGridPMA and APGridMPA, covering HEP and other grid applications. IHEP CA is Unique CA accredited by EUGridPMA and APGridMPA, covering HEP and other grid applications.

13. Gang Chen/IHEP-CC 2015-10-4 - 13 Grid Applications in HEP LHC LHC BES-III: Beijing Electron-Positron Collider/Beijing Electron Spectrometer: tau/charm physics BES-III: Beijing Electron-Positron Collider/Beijing Electron Spectrometer: tau/charm physics ARGO-YBJ: China-Italy cosmic ray observatories in Tibet ARGO-YBJ: China-Italy cosmic ray observatories in Tibet D0 D0 …

14. Gang Chen/IHEP-CC 2015-10-4 - 14 HEP Grid with BES Support

15. Gang Chen/IHEP-CC 2015-10-4 - 15 CMS PHeDex Data transfer Setup PHeDEX system for Dataset transfer. Setup PHeDEX system for Dataset transfer. Successful test for dataset subscription, data transfer, error recovery,etc. Successful test for dataset subscription, data transfer, error recovery,etc.

16. Gang Chen/IHEP-CC 2015-10-4 - 16 YBJ-ARGO Computing on LCG MC, Medea+ and Reconstruction in /opt/exp_soft/bes area. MC, Medea+ and Reconstruction in /opt/exp_soft/bes area. Submit jobs via BES VO to Beijing Site. Submit jobs via BES VO to Beijing Site. Results show everything is working. Results show everything is working.

17. Gang Chen/IHEP-CC 2015-10-4 - 17 Data Processing model Based on the sharing of the resources and the use of synchronized Data Catalogues Based on the sharing of the resources and the use of synchronized Data Catalogues A common ARGO Virtual Organization A common ARGO Virtual Organization A top ARGO-VO BDII and RB A top ARGO-VO BDII and RB The output files in the “local” Data Catalogue The output files in the “local” Data Catalogue Synchronization procedure for the Data Catalogues to have a copy of the files in each site Synchronization procedure for the Data Catalogues to have a copy of the files in each site All information in the experiment Data Base All information in the experiment Data Base

18. Gang Chen/IHEP-CC 2015-10-4 - 18 ARGO Achievements Use of Gilda infrastructure to test the computing model: GILDA elements installed at IHEP and INFN ROMA TRE Use of Gilda infrastructure to test the computing model: GILDA elements installed at IHEP and INFN ROMA TRE Most of the scripts implementing the data transfer model already designed and implemented Most of the scripts implementing the data transfer model already designed and implemented Soon extensive test Soon extensive test Many requirements specified Many requirements specified

19. Gang Chen/IHEP-CC 2015-10-4 - 19 Grid VPN between IHEP and USTC Motivation Motivation International bandwidth bottleneck of China universitiesInternational bandwidth bottleneck of China universities Academic users in universities have to use commercial service shared with millions of public users.Academic users in universities have to use commercial service shared with millions of public users. USTC d0ustc MC production remote farm to FNAL SAM Grid running at unstable 50kBps, which is the best can be provided by China Telecom.USTC d0ustc MC production remote farm to FNAL SAM Grid running at unstable 50kBps, which is the best can be provided by China Telecom. Grid won’t be function this way!Grid won’t be function this way!

20. Gang Chen/IHEP-CC 2015-10-4 - 20 Grid VPN between IHEP and USTC Solution Solution Virtual Private Network (VPN) channel between CSTNET (USTC) and CSTNET (IHEP). d0ustc gain 120-150kBps stable net connection.Virtual Private Network (VPN) channel between CSTNET (USTC) and CSTNET (IHEP). d0ustc gain 120-150kBps stable net connection. Problem Problem Grid CONDOR CLOBUS does not recognize a VPN IP farm, and there is no standard solution provided by Wisconsin Group yet.Grid CONDOR CLOBUS does not recognize a VPN IP farm, and there is no standard solution provided by Wisconsin Group yet. IHEP, USTC and FNAL computing experts are working on it now. If we success, then we can distribute university LCG Tiers.IHEP, USTC and FNAL computing experts are working on it now. If we success, then we can distribute university LCG Tiers. 120-150kBps is far from acceptable for Grid, a P2P link between IHEP to FNAL etc is highly desired.120-150kBps is far from acceptable for Grid, a P2P link between IHEP to FNAL etc is highly desired.

21. Gang Chen/IHEP-CC 2015-10-4 - 21 Secure VPN

22. Gang Chen/IHEP-CC 2015-10-4 - 22 d0ustc is on via USTC-IHEP VPN, much faster and stable still have some problem with gridftp SAM GRID SUMMARY

23. Gang Chen/IHEP-CC 2015-10-4 - 23 To foster the creation of a intercontinental e-Science community To foster the creation of a intercontinental e-Science community Training peopleTraining people Supporting existing and new applications: LHC, ARGO, Biology…Supporting existing and new applications: LHC, ARGO, Biology… To support interoperable infrastructure for grid operations between Europe and China To support interoperable infrastructure for grid operations between Europe and China A EU funded project of Interconnection & Interoperation of Grid between Europe and China EUChinaGrid

24. Gang Chen/IHEP-CC 2015-10-4 - 24 Partners 1 Istituto Nazionale di Fisica Nucleare (IT) (coordinator) 2 European Organisation for Nuclear Research CERN (CH) 3 Dipartimento di Biologia - Università di Roma Tre (IT) 4 Consortium GARR (IT) 5 Greek Research & Technology Network (GR) 6 Jagiellonian University – Medical College, Cracow (PL) 7 School of Computer Science and Engineering – Beihang University Beijing (CN) 8 Computer Network Information Center, Chinese Academy of Sciences – Beijing (CN) 9 Institute of High Energy Physics, Beijing (CN) 10 Peking University – Beijing (CN)

25. Gang Chen/IHEP-CC 2015-10-4 - 25 GILDA sites

26. Gang Chen/IHEP-CC 2015-10-4 - 26 GILDA sites

27. Gang Chen/IHEP-CC 2015-10-4 - 27 Job Statistics

28. Gang Chen/IHEP-CC 2015-10-4 - 28 EUChinaGrid Workshop: 12-14 June, 2006

29. Gang Chen/IHEP-CC 2015-10-4 - 29 EUChinaGrid Tutorial: 15-16 June, 2006 Organized by IHEP Tutors from IHEP and INFN

30. Gang Chen/IHEP-CC 2015-10-4 - 30 Networking 10 G 155M 

31. Gang Chen/IHEP-CC 2015-10-4 - 31 Networking 1Gbps

32. Gang Chen/IHEP-CC 2015-10-4 - 32 GLORIAD Gloriad is an initiative from China, USA and Russia. And now has been extended with Korea, Netherlands, and Canada.Gloriad is an initiative from China, USA and Russia. And now has been extended with Korea, Netherlands, and Canada. Gloriad provides expanded capacity for science and education collaboration (10 Gbps).Gloriad provides expanded capacity for science and education collaboration (10 Gbps). Gloriad is open to more members, especially in Asia Pacific region!Gloriad is open to more members, especially in Asia Pacific region!

33. Gang Chen/IHEP-CC 2015-10-4 - 33 Users of Gloriad IHEP

34. Gang Chen/IHEP-CC 2015-10-4 - 34 Network Performance Test IHEP-Taipei IHEP-CERN

35. Gang Chen/IHEP-CC 2015-10-4 - 35 In near future expand computing power and storage capacity. expand computing power and storage capacity. Participate in LCG SC4 soon. Participate in LCG SC4 soon. Promote HEP applications on Grid platform. Promote HEP applications on Grid platform. Establish more collaborations Establish more collaborations Main issues: Main issues: - Interoperability among other grid projects: CNGrid, ChinaGrid … - Interoperability among other grid projects: CNGrid, ChinaGrid … - Network bandwidth upgrading. - Network bandwidth upgrading.

36. Gang Chen/IHEP-CC 2015-10-4 - 36 Resource Plan at IHEP Resources Planned Resources 200520062007200820092010 CPU (kSI2K) 2006001500200030004000 Disk (TB) 310020060010001400 Tape (TB) 145001000200030004400 Tape (MB/s) 1580160200260300 WAN (Mb/s) 1000100010001000010000 10000 ~50% for BES, ~50% LHC and others:

37. Gang Chen/IHEP-CC 2015-10-4 - 37 Thank You!