Bernd Panzer-Steindel, CERN/IT

Slides:



Advertisements
Similar presentations
Computing Infrastructure
Advertisements

Buffers & Spoolers J L Martin Think about it… All I/O is relatively slow. For most of us, input by typing is painfully slow. From the CPUs point.
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
1 External Sorting for Query Processing Yanlei Diao UMass Amherst Feb 27, 2007 Slides Courtesy of R. Ramakrishnan and J. Gehrke.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
BACKUP/MASTER: Immediate Relief with Disk Backup Presented by W. Curtis Preston VP, Service Development GlassHouse Technologies, Inc.
Disk and Tape Square Off Again Tape Remains King of Hill with LTO-4 Presented by Heba Saadeldeen.
Basic Computer Structure and Knowledge Project Work.
Day 10 Hardware Fault Tolerance RAID. High availability All servers should be on UPSs –2 Types Smart UPS –Serial cable connects from UPS to computer.
Computing Hardware Starter.
Computers in the real world Objectives Understand what is meant by memory Difference between RAM and ROM Look at how memory affects the performance of.
CPU (CENTRAL PROCESSING UNIT): processor chip (computer’s brain) found on the motherboard.
School of EECS, Peking University Microsoft Research Asia UStore: A Low Cost Cold and Archival Data Storage System for Data Centers Quanlu Zhang †, Yafei.
1 Selecting LAN server (Week 3, Monday 9/8/2003) © Abdou Illia, Fall 2003.
May 14, Mass Storage Test of a storage solution based on external USB 2.0 or FireWire disks.
CPSC 404, Laks V.S. Lakshmanan1 External Sorting Chapter 13: Ramakrishnan & Gherke and Chapter 2.3: Garcia-Molina et al.
Storage issues for end-user analysis Bernd Panzer-Steindel, CERN/IT 08 July
IDE disk servers at CERN Helge Meinhard / CERN-IT CERN OpenLab workshop 17 March 2003.
Hard Drives aka Hard Disk Drives Internal, External, and New Solid State Drives.
© GCSE Computing Computing Hardware Starter. Creating a spreadsheet to demonstrate the size of memory. 1 byte = 1 character or about 1 pixel of information.
Hosted by Creating RFPs for Tape Libraries Dianne McAdam Senior Analyst and Partner Data Mobility Group.
Abstract Increases in CPU and memory will be wasted if not matched by similar performance in I/O SLED vs. RAID 5 levels of RAID and respective cost/performance.
01. December 2004Bernd Panzer-Steindel, CERN/IT1 Tape Storage Issues Bernd Panzer-Steindel LCG Fabric Area Manager CERN/IT.
CERN IT Department CH-1211 Genève 23 Switzerland t The Tape Service at CERN Vladimír Bahyl IT-FIO-TSI June 2009.
19. November 2007Bernd Panzer-Steindel, CERN/IT1 CERN Computing Fabric Status LHCC Review, 19 th November 2007.
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
1 Lecture 16: Data Storage Wednesday, November 6, 2006.
26. Juni 2003Bernd Panzer-Steindel, CERN/IT1 LHC Computing re-costing for for the CERN T0/T1 center.
CERN Disk Storage Technology Choices LCG-France Meeting April 8 th 2005 CERN.ch.
GDB Meeting 12. January Bernd Panzer-Steindel, CERN/IT 1 Mass Storage at CERN GDB meeting, 12. January 2005.
Bernd Panzer-Steindel CERN/IT/ADC1 Medium Term Issues for the Data Challenges.
15.June 2004Bernd Panzer-Steindel, CERN/IT1 CERN Mass Storage Issues.
CS Introduction to Operating Systems
William Stallings Computer Organization and Architecture 6th Edition
Storage HDD, SSD and RAID.
Open-E Data Storage Software (DSS V6)
Getting the Most out of Scientific Computing Resources
Integrating Disk into Backup for Faster Restores
Video Security Design Workshop:
Getting the Most out of Scientific Computing Resources
Processing Device and Storage Devices
Ian Bird WLCG Workshop San Francisco, 8th October 2016
HPE Storage Solution Focus on your business, Not File Storage
Hardware Components By Charlie Leivers.
What every server wants!
Lecture 16: Data Storage Wednesday, November 6, 2006.
Computer Hard Drive.
for the Offline and Computing groups
Focus on your business, Not File Storage:
Bernd Panzer-Steindel, CERN/IT
Philippe Charpentier CERN – LHCb On behalf of the LHCb Computing Group
Choosing the best storage method
LHC Computing re-costing for
Robert Grauer and Maryann Barber
Introduction To Computers
Bernd Panzer-Steindel CERN/IT
Business Computer Technology
Lesson Objectives Aims You should be able to:
Computer Architecture
Lecture 11: DMBS Internals
XenData SX-550 LTO Archive Servers
Special Promo Valid Until
2.C Memory GCSE Computing Langley Park School for Boys.
Computer Evolution and Performance
Regression testing Tor Stållhane.
CENG 351 Data Management and File Structures
Hard Drives & RAID PM Video 10:28
Special Promo Valid Until
Special Promo Valid Until
Presentation transcript:

Bernd Panzer-Steindel, CERN/IT Disk versus Tape Status and Outlook 14.Nov.2005 Bernd Panzer-Steindel, CERN/IT

Bernd Panzer-Steindel, CERN/IT Replace tapes with disks CPU server Disk server storage cache Tape server and drives permanent tape storage Replacement of the tape storage system, not the disk cache Apply the same requirements : large store, certain lifetime, limited performance, high reliability and availability 14.Nov.2005 Bernd Panzer-Steindel, CERN/IT

Bernd Panzer-Steindel, CERN/IT Disk storage models NAS integrated disk server ~24 SATA disks integrated into chassis ~3 RAID5 file systems proven technology today ~ 2.1 CHF/GB ‘extended’ CPU server 50 external disks, USB 2.0 or Firewire connected via hubs ~7 RAID5 file systems experimental system (tested a 14 external disk system  works okay, but still lots of tests to be done…..) today ~ 1.3 CHF/GB 14.Nov.2005 Bernd Panzer-Steindel, CERN/IT

Bernd Panzer-Steindel, CERN/IT Disk storage cost evolution cost increase *2 for mirrored *1.4 for RAID5 flat lines ?? 14.Nov.2005 Bernd Panzer-Steindel, CERN/IT

Bernd Panzer-Steindel, CERN/IT Input parameters for the cost simulation evolution over 6 years, aggregate performance of 4 GBytes/s needed, the growth rate is 5 PB in 2006 and than 10 PB per year Disk cost estimate for mid 2006 : 1.5 CHF/GB standard disk server, 1.0 CHF/GB for special USB solution lifetime of the disk server is 3 years, full replacement in the fourth year price/performance improvement is a factor 1.5 per year 2. Tape tape silos are ~ 0.5 MCHF for 6000 slots tape drives plus servers are ~ 35 KCHF, average performance = 25 MB/s cartridge size = 500 GB, 0.35 CHF/GB lifetime of drives is 5 years, replacement starts in the fifth year, all previous data need to be copied to new cartridges  1000 GB, 0.17 CHF/GB 14.Nov.2005 Bernd Panzer-Steindel, CERN/IT

Bernd Panzer-Steindel, CERN/IT Cartridge lifetime and data copy if one assumes a 4 year effective lifetime of tape drives and a linear data growth, then the average lifetime of tape data is less than 3 years ( disk lifetime) cost of the copy , example : Assume : 10 PB of data, new cartridges cost 0.2 CHF/GB, copy needs to be done within 300 days, drive performance is 25 MB/s (inefficiencies included) Gain : double density tapes, 10 PB free space == 2 MCHF Loss : 10 PB in 300 days == 390 MB/s copy speed == 16 input drives (model A) + 16 output drives (model B) ~ 1.3 MCHF 1 FTE + 48h disk buffer + extra tapes/slots ~ 0.3 MCHF  Gain 2 MCHF Loss 1.6 MCHF Copy is mandatory at the end of a tape drive technology cycle. In-between it might be cost effective to re-use the already existing tapes at double density There are some uncertainties in the calculations and it might not be cost-effective 14.Nov.2005 Bernd Panzer-Steindel, CERN/IT

Bernd Panzer-Steindel, CERN/IT Accumulative cost models for different storage options 20% error bars purchases are not continuous, but discrete points once or twice a year 14.Nov.2005 Bernd Panzer-Steindel, CERN/IT

Bernd Panzer-Steindel, CERN/IT Uncertainties Disk price/performance evolution (assumed factor 1.5 ) : flat curve ?, focus on 2 ½ and smaller disks, reliability, power consumption large consumer market for external disks  audio, video, notebook trend Tape price evolution -- the difference between LTO-2 and LTO-3 is only 20% not a factor 2 -- re-use of the same cartridges with higher density possible but unclear -- general future of tape storage in the market ( only high end) …….. 14.Nov.2005 Bernd Panzer-Steindel, CERN/IT

Bernd Panzer-Steindel, CERN/IT Conclusions The ‘USB-disk-model’ looks very promising, but needs more investigation (also need much better power-consumption estimates). Other models can be investigated merge the CPU and disk servers attachment of external storage to the CPU server don’t use any RAID safety, rely on external copies of the data The problem here is to understand the shift of costs e.g. ‘cheaper’ hardware  software/operational complexity The alternatives to tape storage are becoming attractive, but are still immature. Thus we will continue with tape storage for the next ~3 years and need to test the alternatives thoroughly in parallel. From the software and hardware point of view it will be transparent and probably ‘not too complicated’ to have both solutions running in parallel. 14.Nov.2005 Bernd Panzer-Steindel, CERN/IT