Grid Computing 6th FCPPL Workshop Gang Chen & Eric Lançon March 29, 2013, NJU

Main achievements in 2012-13 Network performance monitoring and debugging Multi-core simulation tests on IHEP farm Workshop in Paris (June 2012) on site operational issues, 2 Chinese participants : SUN Gongxing/孙功星, YAN Xiaofei/闫晓 飞 Presentation of ZANG Dongsong/臧冬松 (PhD. in 2013) work at CHEP 2012 conference Student (LI Sha/李莎) spent 3 months in Europe to work on ATLAS data distribution system Visit to GRIF T2 (Paris) of YAN Xiaofei in December 2012 to discuss site configuration + Frequent meetings (ATLAS & LCG) with remote connection

Beijing T2 performance Thanks to high availability/reliability, Beijing T2 is classified ‘Direct’ T2 (T2D) Can get/send data to/from every T1/T2D site in the world Host primary data Network connection performance & stability are of primary concern T2D status may be lost if network deteriorates

Beijing site availability for ATLAS services Well above 90% comp. element storage maintenance

Beijing site performance： data transferred Import Beijing being T2D repository for ATLAS JET physics group 1PB (>1M files) Data volume transferred since March 2012 Export Beijing being T2D exports data to everywhere

Processing at Beijing over 90% job efficiency for centralized activities 50% of CPU consumption only for simulation ! Site is now also heavily used for user analysis, group analysis, reconstruction...

ATLAS Jobs through PanDA Production Jobs: 311,5000 ( Job Success Rate: 94%) Analysis Jobs: 691,6000 (Job Success Rate: 81%)

Network performance monitoring ATLAS ‘sonar’ : Calibrated file transfers by ATLAS Data Distribution system, from storage to storage perfSONAR (PS) : Network performance tool (throughput, latency), from memory to memory Has to be located as close as possible to storage at site and with similar hardware connectivity

perfSonar monitoring Deployment of perfSonar machines (Fazhi Qi/齐法制) Work done in cooperation with GRIF T2 within the WLCG working group Identical configuration files for French and Chinese machines Monitoring hosted in BNL

ORIENT-plus : improved connectivity EU-China

Transfer rates from European T1s to Beijing New Line : Not same impact for all T1s To be understood

Networking monitoring and debugging Beijing connected to Europe via GEANT/ORIENT But performances not identical for all T1s, specific issues for each sites Asymmetries observed, not understood yet CERN → Beijing was using GLORIAD/KREONET changed end of 2012 on our request, ORIENT now used Firewall removed on our request at various sites Lyon→Beijing Beijing →Lyon KIT→Beijing Beijing →KIT

Multi-core processing Special multi-core (8) queue setup at Beijing spring 2012 (YAN Xiaofei/闫晓飞), pioneers ! Used to validate AthenaMP, the ATLAS parallel event processing (to save memory) AthenaMP will be used as standard software for ATLAS simulation end of 2013

CMS Jobs Total jobs 829K ： production 436k，analysis 231k

CMS Jobs production data : import 158TB，export 58TB

Prospect for 2013-2014 Continue network monitoring and debugging activities Deployment of large multi-core setup for production, scaling issues to be addressed, common solutions with French T2s Deployment of WebDAV interface to storage (http access) in cooperation with French T2s Cloud computing : application for CSC-FCPPL grant for student (LI Sha/李莎) stay in Grenoble for 18 months Chinese-French-Japanese workshop at Beijing May 2013

THANK YOU Gang Chen/CC/IHEP 2018/12/5 - 17