1. HEPIX Backup Survey David Asbury CERN/IT/FIO HEPIX, Rome, 6 April 2006

2. 6 April 2006HEPIX Rome 2006: Backup Survey2 Survey by email u Harry Renshall sent questionnaire to HEPIX sites u 15 questions u 10.76 responses u Chocolate bar for each site which responded u Collect from Andrei tomorrow!

3. 6 April 2006HEPIX Rome 2006: Backup Survey3 Who responded? u CERN, Geneva, Switzerland u DESY-H, Hamburg, Germany u DESY-Z, Zeuthen, Germany u FNAL, Fermilab, Chicago, USA u FZK, Forschungszentrum, Karlsruhe, Germany u INFN, (several sites), Italy u IN2P3, Lyon, France u JLAB, Jefferson Nat. Accelerator Lab, VA, USA u RAL-HPC, Rutherford Appleton Lab, UK u TRIUMF, Vancouver, Canada

4. 6 April 2006HEPIX Rome 2006: Backup Survey4 Which backup Product? u 9 Home made (INFN, RAL-HPC) u 7 TSM (CERN, DESY-H, FZK, IN2P3, 3xINFN) u 3 Legato (DESY-Z, 2xINFN) u 2 Time Navigator (2xINFN) u 3 HP Data Protector (3xINFN) u 1 TiBS (FNAL) u 1 AMANDA (TRIUMF) u 1 Oracle Reliaty (JLAB)

5. 6 April 2006HEPIX Rome 2006: Backup Survey5 Types of Data handled u Home directories – all u File systems - all u Databases – 5 (CERN, DESY-H, IN2P3, JLAB) u Mail – 2 (1 does the spam too!) u Experiment data – 1 (INFN)

6. 6 April 2006HEPIX Rome 2006: Backup Survey6 Incremental Frequency u Most do daily incremental backups u Volumes of data ranges… u ~30GB/d:DESY-Z u 200GB/d-600GB/d:FNAL, IN2P3, JLAB, RAL-HPC, TRIUMF u > 1TB/d:CERN, FZK

7. 6 April 2006HEPIX Rome 2006: Backup Survey7 Full backup frequency u Wide range… u Weekly, each 10 days, monthly, 6-monthly u Ranges … u TRIUMF:2TB/10days u JLAB:4TB/week u CERN, RAL-HPC:6TB/weekend

8. 6 April 2006HEPIX Rome 2006: Backup Survey8 Restore period (backup) u Varies with type of data and site u RAL-HPC – one month u Often 1 year for normal files u FZK & JLAB keep backup files “forever” u DESY-H keeps DBs for a week u 2 copies of DBs kept in CERN

9. 6 April 2006HEPIX Rome 2006: Backup Survey9 How Much Retsored? u Not in questionnaire! u CERN: u ~100 files (~ 1GB) per day u Big restores (> 250,000 files, 1TB) every month u Much more starting in 2005 u Increasing

10. 6 April 2006HEPIX Rome 2006: Backup Survey10 Total Volume stored u Wide range according to site u < 100TB:TRIUMF, DESY-H, DESY-Z, IN2P3, RAL- HPC u 100TB-200TB:FNAL, JLAB u > 400TB:CERN, FZK

11. 6 April 2006HEPIX Rome 2006: Backup Survey11 Archived total u According to site: u RAL-HPC:none u < 2TB:DESY-Z, IN2P3 u 2TB – 5TB:CERN, DESY-H, TRIUMF u 280TB: FZK

12. 6 April 2006HEPIX Rome 2006: Backup Survey12 Restore period (archive) u Several sites keep files forever u DESY-H: for 3y (user), or 12y (expt) u IN2P3: 25y

13. 6 April 2006HEPIX Rome 2006: Backup Survey13 Clients by OS u Most have PCs with Linux or Windows u Solaris:almost all sites u AIX:FZK, INFN, IN2P3 u HPUX, OSF:CERN

14. 6 April 2006HEPIX Rome 2006: Backup Survey14 Backup Servers by OS u All TSM sites use AIX u TSM on Linux coming in CERN u Solaris used for other products - Legato u Linux used for AMANDA (TRIUMF) u RAL-HPC uses their Atlas Datastore

15. 6 April 2006HEPIX Rome 2006: Backup Survey15 Tape Drives – wide variety u LTO (FZK, DESY-Z, JLAB, INFN) u SDLT (TRIUMF) u IBM 3590 & 3592 in IBM 3594 robot (FZK, INFN) u STK 9940, 9940B in Powderhorns (DESY- H, CERN, IN2P3, RAL-HPC) u SAIT in T950 robot (FNAL) u Total Cartridges 1000 (IN2P3) – 5600 (DESY-H)

16. 6 April 2006HEPIX Rome 2006: Backup Survey16 Why This backup system? u TSM http://www-306.ibm.com/software/tivoli/products/storage-mgr u Functionality, wide range of clients, good support u AMANDA http://www.amanda.org u works and is cheap u Legato http://www.legato.com u Good offer for our Solaris requirements when started u TiBS http://www.teradactyl.com u Scalable, easily partitioned, met requirements u Oracle Reliaty u http://www.oracle.com/technology/deploy/availability/pdf/1168_Bednar_PPT u Best fit to requirements in 2001

17. 6 April 2006HEPIX Rome 2006: Backup Survey17 FTEs to run it u Wide range according to site u RAL-HPC uses shared site-wide store u < 1 FTE: DESY-Z, JLAB, INFN, TRIUMF u > 1 FTE: CERN, DESY-H, FZK, FNAL

18. 6 April 2006HEPIX Rome 2006: Backup Survey18 Problems and Plans u No obvious trend u Backup is not very exciting u Plan more Linux servers at CERN u RAL-HPC data rate too slow into store

19. 6 April 2006HEPIX Rome 2006: Backup Survey19 Conclusions u Several large sites use TSM on AIX u Legato also used on Solaris u Smaller sites have more freedom of choice