Deutsches Zentrum für Luft- und Raumfahrt e.V. Bench mark study for new technology archiving devices H.-J. Wolf K.-D Mißling, G. M.Pinna CEOS Subgroup ATT meeting ESRIN 9 May 2002
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 2 Bench mark study for new archiving devices Introduction operation of remote sensing facilities growing amount of sensor data archiving subsystems separated from the acquisition specialized computer peripheral shorter use time of archive technology automated migration/ risk of non-matured devices replacement and phasing out of current (DLT 7000) drives Objectives: computer compatible handle- able by robot systems high reliability of information cost of the drive and media/ archiving capability archiving costs per GB transfer time/ access time system provision delay future of technology/ acceptance by the marked current market : LTO, SDLT, AIT-2, AIT-3, 9840 B, 9940 A (B)
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 3 Approach conservative selection ( not on basis of announcements) consideration of system coherence Bench mark study for new archiving devices reliability of medium reliability of information access time transfer rate provision time robot handling time organization of data (cache,no-release, media- mix) administrative time/ HSM bandwidth to user IFs between archive elements number of devices : : number of copies organization of data (HW(firm ware, ECC), SW) maturity of device (technology) use time of technology environmental conditions Archive system
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 4 Bench mark study for new archiving devices roadmap of archive technologies
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 5 Bench mark study for new archiving devices Price for drives and media *list price in Europe, no consideration of discounts **Price of DLT 8000
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 6 Bench mark study for new archiving devices Test Configuration Hardware Sun Server E450, 2x 480MHz/2 GB RAM 12 x 36,4 GB Disk (10000UPM) X 6541 A PCI Differential F/W-UltraSCSI Adapter (SDLT, LTO and AIT 2/3) JNI 1063 FC-AL PCI Adapter (STK 9840 B, 9940 A, Loop Mode without Switch/Hup) Ultra SCSI Differential F/W (HVD) to Ultra SCSI (LVD) Converter MSKL (Test LTO/ADIC; SDLT/ Quantum, ESA; AIT-2/Sony) Software -Solaris 8, kernel Veritas Volume Manager Version dvt (Solaris Performance Test software) -SAM-FS Version and 4.0.BD (last B-Version) LSC(now SUN) Test drives LTO, SDLT, AIT-2, AIT-3, 9840 B, 9940 A
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 7 Bench mark study for new archiving devices Test file system –only SAM-FS file system –Veritas Volume Manager (RAID 0+1) using four drives (striped and mirrored) Test files –A mix of typical remote sensing data Off the shelf Measuring method –Solaris 8 tools /usr/bin/time iostat –SAM-FS tools dvt debugging and logging comparable, duplicable
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 8 Bench mark study for new archiving devices Measured Tape Capacities
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 9 Bench mark study for new archiving devices Measured Transfer Rate
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 10 Bench mark study for new archiving devices Measured Access Time (Position)
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 11 Bench mark study for new archiving devices COSTS per GB
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 12 Bench mark study for new archiving devices Conclusion use of different technologies (AIT-2(AIT-3), LTO) 9840x for high performance access (NRT, MOD- substitute)
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 13 Bench mark study for new archiving devices Future developments Complete of the study: load/ unload time of the drives influence of block size variation on transfer time influence of special data formats (e.g. L7-RawData, SARData,ERS- low bit rate) different platforms (e.g. SGI, PC(LINUX) ) possibility of partitioning drives support of diagnostics
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 14 Future developments Next activities –Monitoring of Roadmaps –New Technologies Ultra Density Optical (UDO) GB 1. Generation2.0 $/GB GB2. Generation 1.0 $/GB GB3. Generation 0.5 $/GB Lots Technology (Laser optical tape) Format:DTF-2 Tape from Kodak, licence Imation Capacity:1 TByte (once write) Interface:Ultra-SCSI-2; FC-AL Transfer Rate:40 MB/s Price drive:~ 27 T$ Price media:~ 200 $/ 0.19$/GB Not before end of 2003 Bench mark study for new archiving devices
Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 15 Bench mark study for new archiving devices The Challenges of Magnetic Recording on Tape for Data Storage, Richard H. Dee, Storage Technology Corporation,