Download presentation
Presentation is loading. Please wait.
Published byRhoda Paul Modified over 9 years ago
1
Local IBP Use at Vanderbilt University Advanced Computing Center for Research and Education
2
Introduction Current IBP Installation IBP Scalability Testing Current Enstore Installation Production (Stewart Lab) Testing Enstore Goals Planned IBP / Enstore Installation
3
Current IBP Installation
4
Registered with Public L-Bone 1 IBM x335 Vlad01: ibp.accre.vanderbilt.edu:6714 Vlad02: ibp.accre.vanderbilt.edu:6715 1 Infotrend EonStor Vlad01: 1.6 TB Vlad02: 1.4 TB Two of the three largest individual depots on the public L-Bone
5
IBP Scalability Testing Depot Testing 326 Active Depots Single File (259 MB) Uploaded to each Depot Results sorted to determine 50 fastest depots Multiple Test Runs to see variations over time
6
IBP Scalability Testing Campus Capacity AT&T:45 Mb/s Qwest:180 Mb/s Sox:442 Mb/s One Workstation 267 MB RAM Disk 2 GB Total RAM Dual CPU (AMD Opteron 246) Gigabit Ethernet
7
IBP Scalability Testing Ten 259 MB Files (multiple uploads) Test Results Short Run Throughput: 399.85 Mb/s (49.98 MB/s) Duration: 518.19 seconds (8.6 minutes) Used 90% of Internet2 Long Run Throughput: 338.08 Mb/s (42.26 MB/s) Duration: 1761.6 seconds (29.36 minutes) Used 76% of Internet2
8
IBP Scalability Testing #! /bin/sh # bwTest.sh for i in `seq 1 10`; do./upload.sh $i &> upload.out.$i & done wait ############ #! /bin/sh # upload.sh time /klm/lors/bin/lors_upload -o ~/bw/test$1.xnd --depot-list \ --xndrc ~/bw/bwTest$1.xndrc --threads=10 --timeout='5m' \ --copies=1 --none --duration=300 /mnt/rd/small.tar rm -f ~/bw/test$1.xnd
9
Python Integration Layer Uses Python.h Limited IBP changes Called on IBP store / load Proof of concept to disk Next step: integration with encp
10
Current Enstore Installation Production (Stewart Lab)
11
Current Enstore Installation Production (Stewart Lab) 2 IBM x335 (1 Enstore Server / 1 Enstore Client) WhiteBox Linux 2.4 Kernel 1 Infotrend EonStor attached to Enstore client 1 Overland Storage PowerLoader 1 SDLT Drive 15 Tapes Total Capacity: 2.4 TB Native (4.8 TB Compressed) Current Usage: 0.81 TB
12
Current Enstore Installation Testing 2 IBM x335 (1 Enstore Server / 1 Enstore Client) CentOS Linux 2.6 Kernel 1 Infotrend EonStor 2 Overland Storage Neo-2000 2 LTO-2 Drives each 30 Tapes each Total Capacity: 12 TB Native (24 TB Compressed)
13
Enstore Goals Obtain latest code base Simplified installation Add ability to mark read-only tapes writable Incorporate Vanderbilt changes into CVS
14
Planned IBP / Enstore Installation
15
Private L-Bone Multiple IBP Depots around campus IBP Depots attached to “cache” mechanism SRM-dCache LoDN-Cache Integrated with Enstore for tape archival
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.