Local IBP Use at Vanderbilt University Advanced Computing Center for Research and Education

Introduction  Current IBP Installation  IBP Scalability Testing  Current Enstore Installation  Production (Stewart Lab)  Testing  Enstore Goals  Planned IBP / Enstore Installation

Current IBP Installation

 Registered with Public L-Bone  1 IBM x335  Vlad01: ibp.accre.vanderbilt.edu:6714  Vlad02: ibp.accre.vanderbilt.edu:6715  1 Infotrend EonStor  Vlad01: 1.6 TB  Vlad02: 1.4 TB  Two of the three largest individual depots on the public L-Bone

IBP Scalability Testing  Depot Testing  326 Active Depots  Single File (259 MB)  Uploaded to each Depot  Results sorted to determine 50 fastest depots  Multiple Test Runs to see variations over time

IBP Scalability Testing  Campus Capacity  AT&T:45 Mb/s  Qwest:180 Mb/s  Sox:442 Mb/s  One Workstation  267 MB RAM Disk  2 GB Total RAM  Dual CPU (AMD Opteron 246)  Gigabit Ethernet

IBP Scalability Testing  Ten 259 MB Files (multiple uploads)  Test Results  Short Run  Throughput: Mb/s (49.98 MB/s)  Duration: seconds (8.6 minutes)  Used 90% of Internet2  Long Run  Throughput: Mb/s (42.26 MB/s)  Duration: seconds (29.36 minutes)  Used 76% of Internet2

IBP Scalability Testing #! /bin/sh # bwTest.sh for i in `seq 1 10`; do./upload.sh $i &> upload.out.$i & done wait ############ #! /bin/sh # upload.sh time /klm/lors/bin/lors_upload -o ~/bw/test$1.xnd --depot-list \ --xndrc ~/bw/bwTest$1.xndrc --threads=10 --timeout='5m' \ --copies=1 --none --duration=300 /mnt/rd/small.tar rm -f ~/bw/test$1.xnd

Python Integration Layer  Uses Python.h  Limited IBP changes  Called on IBP store / load  Proof of concept to disk  Next step: integration with encp

Current Enstore Installation Production (Stewart Lab)

Current Enstore Installation  Production (Stewart Lab)  2 IBM x335 (1 Enstore Server / 1 Enstore Client)  WhiteBox Linux  2.4 Kernel  1 Infotrend EonStor attached to Enstore client  1 Overland Storage PowerLoader  1 SDLT Drive  15 Tapes  Total Capacity: 2.4 TB Native (4.8 TB Compressed)  Current Usage: 0.81 TB

Current Enstore Installation  Testing  2 IBM x335 (1 Enstore Server / 1 Enstore Client)  CentOS Linux  2.6 Kernel  1 Infotrend EonStor  2 Overland Storage Neo-2000  2 LTO-2 Drives each  30 Tapes each  Total Capacity: 12 TB Native (24 TB Compressed)

Enstore Goals  Obtain latest code base  Simplified installation  Add ability to mark read-only tapes writable  Incorporate Vanderbilt changes into CVS

Planned IBP / Enstore Installation

 Private L-Bone  Multiple IBP Depots around campus  IBP Depots attached to “cache” mechanism  SRM-dCache  LoDN-Cache  Integrated with Enstore for tape archival