StoRM+Lustre Performance Test with 10Gbps Network YAN Tian for Distributed Computing Group Meeting Nov. 4th, 2014

Testbed with 10Gbps Network StoRM server configuration: ModelDell PowerEdger R620 CPUXeon E GHz CPU Cores8 cores (HT disabled) Memory64 GB HDDscsi 300 GB hostname/IPcream.ihep.ac.cn ( ) Network10 Gbps WebDAV access 10GB/(39.148s) = MB/s

Test 1: Single Thread Download Test time: Nov 2nd, 15:30-15:32, 15:37-15:40 Lustre is a little busy (load 40%, out 800 MB/s) 20 times test of download 1 GB file Download destination: badger01 Average download speed: MB/s with eth5: 10 Gbps load of SE: 0.8~1.4 load, 2~3% wa

Test 2: Multi Threads Download Multi-tread download tool: mytget Test result: – can start multi-thread mode; – But can’t impove performance 1 GB file download with 8-thread: 10 GB file download with 8-thread

Test 3: Multi Processes Download 1 Multi-process wget download: – test time: Nov. 2 nd, 17:48~18:02 – 8 processes, each downlad a 10GB file – peak speed: 250 MB/s – estimate average speed: ~ 200 MB/s – Lustre is very busy

Test 4: Multi Processes Download 2 Multi-process wget download: – test time: Nov. 3 nd, 17:50~18:03 – 8 processes, each downlad a 10GB file – peak speed: 275 MB/s – estimate average speed: ~ 240 MB/s – real gross speed: 98 MB/s – Lustre a little busy, raise 600 M/s

Test 3: srm - Symbolic Link Problem Modify namespace.xml is under trying.

Storm+Lustre Test: To Do Solve symblik link problem Dataset transfer test between IHEPD-USER Open ports 50000:55000 Dataset transfer test between WHU/USTC-USER