Download presentation
Presentation is loading. Please wait.
Published byAmanda Bell Modified over 8 years ago
1
StoRM+Lustre Performance Test with 10Gbps Network YAN Tian for Distributed Computing Group Meeting Nov. 4th, 2014
2
Testbed with 10Gbps Network StoRM server configuration: ModelDell PowerEdger R620 CPUXeon E5-2609 v2 @ 2.50 GHz CPU Cores8 cores (HT disabled) Memory64 GB HDDscsi 300 GB hostname/IPcream.ihep.ac.cn (202.122.33.44) Network10 Gbps WebDAV access 10GB/(39.148s) = 261.6 MB/s
3
Test 1: Single Thread Download Test time: Nov 2nd, 15:30-15:32, 15:37-15:40 Lustre is a little busy (load 40%, out 800 MB/s) 20 times test of download 1 GB file Download destination: badger01 Average download speed: 108.0 MB/s with eth5: 10 Gbps load of SE: 0.8~1.4 load, 2~3% wa
4
Test 2: Multi Threads Download Multi-tread download tool: mytget Test result: – can start multi-thread mode; – But can’t impove performance 1 GB file download with 8-thread: 10 GB file download with 8-thread
5
Test 3: Multi Processes Download 1 Multi-process wget download: – test time: Nov. 2 nd, 17:48~18:02 – 8 processes, each downlad a 10GB file – peak speed: 250 MB/s – estimate average speed: ~ 200 MB/s – Lustre is very busy
6
Test 4: Multi Processes Download 2 Multi-process wget download: – test time: Nov. 3 nd, 17:50~18:03 – 8 processes, each downlad a 10GB file – peak speed: 275 MB/s – estimate average speed: ~ 240 MB/s – real gross speed: 98 MB/s – Lustre a little busy, raise 600 M/s
7
Test 3: srm - Symbolic Link Problem Modify namespace.xml is under trying.
8
Storm+Lustre Test: To Do Solve symblik link problem Dataset transfer test between IHEPD-USER Open ports 50000:55000 Dataset transfer test between WHU/USTC-USER
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.