Backup Rationalisation Reorganisation of the CERN Computer Centre Backups David Asbury IT/DS Friday 6 December 2002

6 Dec 2002C5 Presentation: Backup Rationalisation2 Reasons for backup u Accidental corruption of files/mail/data u Storage failure, disks, raid arrays(!) u Need to get a server running again u Backup is very boring until ….!

6 Dec 2002C5 Presentation: Backup Rationalisation3 Different sorts of data u Home Directories u AFS u Windows DFS u Mail u Unix servers u Microsoft Exchange u Databases u Unix group & project servers u Experimental Data TSM AFS specific backup Legato TSM Castor TSM

6 Dec 2002C5 Presentation: Backup Rationalisation4 Backup Systems available u IBM Tivoli Storage Manager (TSM) u Formerly called ADSM u Run by CERN, IBM & DCS u Legato Networker u TSM did not support collocation, slow to restore u Run by Serco u Mostly computer centre backups u Veritas u TSM has some functional advantages u Expensive on Windows

6 Dec 2002C5 Presentation: Backup Rationalisation5 Proposal: Use TSM for everything (1) u Supports backing up on u Unix Solaris 2.6/7/8/9 & Linux 6/ legacy systems u Windows DFS & Exchange u AFS u Already contains archived data u pubarch (613GB, est 5M files) u vmarch (160GB, 1.6M files) u Backup exchange is running u No need to move cartridges out of silos

6 Dec 2002C5 Presentation: Backup Rationalisation6 Proposal: Use TSM for everything (2) u Collocation option supported and in use u Minimises tape mounts on restore, but more on backup u Works well with current 1TB disk staging areas u Backup during day, move to tape overnight u With ~2TB disk could keep yesterday’s backup online u Supports journal-style scan for DFS u Constructs list of files to backup as they are changed u Avoids slow scan of file tree

6 Dec 2002C5 Presentation: Backup Rationalisation7 How we propose to get there (1) u Overlap periods? u Keep existing products for restores u Mostly 6 months, max 1 year u Archived engineering data to be copied (600 files, 8TB) u Hardware upgraded (see later slide)

6 Dec 2002C5 Presentation: Backup Rationalisation8 How we propose to get there (2) u Timing: u Stop Legato service when backups age out u Latest, at end of Serco contract (end 2003) u Automation of restores u Scripts possible with TSM (may save manpower) u Like pubarch allowing controlled user access

6 Dec 2002C5 Presentation: Backup Rationalisation9 Costs today (1): Legato SunBasic Licence61 KCHF Serco Service Contract Reloads 105 KCHF Est 30 KCHF Sun Hardware Maintenance 2 x E450 machines 5 STK 9840 drives 9.4 KCHF 15.4 KCHF 9840 Tape Media 24 KCHF in 2002

6 Dec 2002C5 Presentation: Backup Rationalisation10 Costs today (2): TSM v4 IBMBasic Licence32 KCHF IBMServer & product support20 KCHF DCSClient support36 KCHF IBM Hardware Maintenance 2 x IBM F50 machines 8 x 3590E drives 9 KCHF 30 KCHF 3590E Tape Media0 in 2002

6 Dec 2002C5 Presentation: Backup Rationalisation11 Cost Comparison u Assuming all done with one product u Hardware & support costs similar u Licences must increase: u Legato: 61 KCHF to (est) 108 KCHF u TSM: 32 KCHF to (est) 82 KCHF (in v5) u Optional one-time charge for ORACLE hot backup extra RMAN product u TSM v5 charged differently from v4 u Will be cheaper as many machines already in TSM

6 Dec 2002C5 Presentation: Backup Rationalisation12 Hardware today u TSM: 2 x IBM F50 (previously HPSS): u 2/2 cpus u 4/4 x IBM 3590E tape drives (40GB capacity) u 28/28 x 18GB disk buffer u Gigabit u Fast back planes – good for I/O u Legato: 2 x Sun E450 u 2/4 cpus u 2/4 STK 9840 drives (20GB capacity) u No disk buffer u Gigabit

6 Dec 2002C5 Presentation: Backup Rationalisation13 TSM experience & tests u Unix servers already backed-up: AIX, HP, IRIX, Linux, OSF, Solaris, ULTRIX u Windows servers: u Exchange, DFS, (Active Directory) u AFS tested u Database servers (15 now in TSM) u File backup today u Incremental costs 860 CHF/1 st yr/cpu (RMAN) u DFS test (1 server): Legato 65min, TSM 46min

6 Dec 2002C5 Presentation: Backup Rationalisation14 Hardware expansion u Little or no extra cost u Add ~ E tapes (from HPSS), more needed later u add more 3590E drives (2 more available now) u Additional TSM server u Use old Legato E450 (expensive), or new machine u Use existing 9840 drives & tapes (unsuitable for backup) u Long term server platform u AIX or Solaris (linux supported recently)

6 Dec 2002C5 Presentation: Backup Rationalisation15 Immediate Plan u Replace old staging disks and increase u Start AFS backup using TSM u Move Legato clients into TSM u Nearly all are IT machines u Organise move of archived Legato data u Run with current hardware for 2003 u TSM to be run by new Operations Team u Review hardware in 2004

6 Dec 2002C5 Presentation: Backup Rationalisation16 Future growth expected u AFS – 20% increase (COCOtime) < 1TB u Windows ~ 20% est increase u Small additional unix data u Maybe 15 more databases ~ 10TB u Oracle physics dbs ~ 1TB each

Questions?