Presentation is loading. Please wait.

Presentation is loading. Please wait.

StoRM+Lustre Performance Test with 10Gbps Network YAN Tian for Distributed Computing Group Meeting Nov. 4th, 2014.

Similar presentations


Presentation on theme: "StoRM+Lustre Performance Test with 10Gbps Network YAN Tian for Distributed Computing Group Meeting Nov. 4th, 2014."— Presentation transcript:

1 StoRM+Lustre Performance Test with 10Gbps Network YAN Tian for Distributed Computing Group Meeting Nov. 4th, 2014

2 Testbed with 10Gbps Network StoRM server configuration: ModelDell PowerEdger R620 CPUXeon E5-2609 v2 @ 2.50 GHz CPU Cores8 cores (HT disabled) Memory64 GB HDDscsi 300 GB hostname/IPcream.ihep.ac.cn (202.122.33.44) Network10 Gbps WebDAV access 10GB/(39.148s) = 261.6 MB/s

3 Test 1: Single Thread Download Test time: Nov 2nd, 15:30-15:32, 15:37-15:40 Lustre is a little busy (load 40%, out 800 MB/s) 20 times test of download 1 GB file Download destination: badger01 Average download speed: 108.0 MB/s with eth5: 10 Gbps load of SE: 0.8~1.4 load, 2~3% wa

4 Test 2: Multi Threads Download Multi-tread download tool: mytget Test result: – can start multi-thread mode; – But can’t impove performance 1 GB file download with 8-thread: 10 GB file download with 8-thread

5 Test 3: Multi Processes Download 1 Multi-process wget download: – test time: Nov. 2 nd, 17:48~18:02 – 8 processes, each downlad a 10GB file – peak speed: 250 MB/s – estimate average speed: ~ 200 MB/s – Lustre is very busy

6 Test 4: Multi Processes Download 2 Multi-process wget download: – test time: Nov. 3 nd, 17:50~18:03 – 8 processes, each downlad a 10GB file – peak speed: 275 MB/s – estimate average speed: ~ 240 MB/s – real gross speed: 98 MB/s – Lustre a little busy, raise 600 M/s

7 Test 3: srm - Symbolic Link Problem Modify namespace.xml is under trying.

8 Storm+Lustre Test: To Do Solve symblik link problem Dataset transfer test between IHEPD-USER Open ports 50000:55000 Dataset transfer test between WHU/USTC-USER


Download ppt "StoRM+Lustre Performance Test with 10Gbps Network YAN Tian for Distributed Computing Group Meeting Nov. 4th, 2014."

Similar presentations


Ads by Google