Deutsches Zentrum für Luft- und Raumfahrt e.V. Bench mark study for new technology archiving devices H.-J. Wolf K.-D Mißling, G. M.Pinna CEOS Subgroup.

Slides:



Advertisements
Similar presentations
The Data Information and Management System (DIMS)
Advertisements

Business Continuity/Disaster Recovery: Solutions For Firms Of All Sizes Atlas Lee, CBCP Director Of Business Continuity Atlas Lee, CBCP Director Of Business.
Tony Doyle - University of Glasgow GridPP EDG - UK Contributions Architecture Testbed-1 Network Monitoring Certificates & Security Storage Element R-GMA.
Chapter 5 Input/Output 5.1 Principles of I/O hardware
Hard Disks Low-level format- organizes both sides of each platter into tracks and sectors to define where items will be stored on the disk. Partitioning:
Tasks in Setting Up a Hard Disk
Chapter 4 Storing Information in a Computer Peter Nortons Introduction to Computers.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
Chapter 7 Configuring and Managing Data Storage
Secondary Storage Input Output Processing Internal Memory.
By Rashid Khan Lesson 6-A Place for Everything: Storage Management.
Silberschatz and Galvin Operating System Concepts Module 14: Tertiary-Storage Structure Tertiary Storage Devices Operating System Issues Performance.
Conserving Disk Energy in Network Servers ACM 17th annual international conference on Supercomputing Presented by Hsu Hao Chen.
Hard Disk Drives Chapter 7.
4.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 4: Organizing a Disk for Data.
Computer Studies Today Chapter 18 1 »Two main types of secondary storage devices: –Magnetic storage devices –Optical storage devices.
Professor Michael J. Losacco CIS 1150 – Introduction to Computer Information Systems Secondary Storage Chapter 7.
Troubleshooting Startup Problems
1 Disks Introduction ***-. 2 Disks: summary / overview / abstract The following gives an introduction to external memory for computers, focusing mainly.
© 2006 DataCore Software Corp SANmotion New: Simple and Painless Data Migration for Windows Systems Note: Must be displayed using PowerPoint Slideshow.
Storing Data Chapter 4.
Virtualization & Disaster Recovery
Computing ESSENTIALS CHAPTER Copyright 2003 The McGraw-Hill Companies, Inc.Copyright 2003 The McGraw-Hill Companies, Inc Secondary Storage computing.
GRAP 3175 Computer Applications for Drafting Unit II Computer Hardware.
© 2009 EMC Corporation. All rights reserved. Direct Attached Storage and Introduction to SCSI Module 2.1.
XenData SX-520 LTO Archive Servers A series of archive servers based on IT standards, designed for the demanding requirements of the media and entertainment.
HP Virtual Tape Library (VTL) Appliance Powered by IPStor Ross Parker – Sales Director, Northern Europe.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
Preservation of Video in the Conservation Laboratory Tim Vitale Preservation Associates 1500 Park Ave., Suite 132 Emeryville, CA 94608
11 BACKING UP AND RESTORING DATA Chapter 4. Chapter 4: BACKING UP AND RESTORING DATA2 CHAPTER OVERVIEW Describe the various types of hardware used to.
CASTOR Project Status CASTOR Project Status CERNIT-PDP/DM February 2000.
1.1 Installing Windows Server 2008 Windows Server 2008 Editions Windows Server 2008 Installation Requirements X64 Installation Considerations Preparing.
Hugo HEPiX Fall 2005 Testing High Performance Tape Drives HEPiX FALL 2005 Data Services Section.
Designing Storage Architectures for Preservation Collections Library of Congress, September 17-18, 2007 Preservation and Access Repository Storage Architecture.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
Secondary Storage Unit 013: Systems Architecture Workbook: Secondary Storage 1G.
Mass RHIC Computing Facility Razvan Popescu - Brookhaven National Laboratory.
Windows Server MIS 424 Professor Sandvig. Overview Role of servers Performance Requirements Server Hardware Software Windows Server IIS.
CIS 105 Concepts and Terminology Unit 3 CIS 105 Survey of Computer Information Systems Essential Concepts and Terminology Study Unit Three.
Information Technology
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
A+ Guide to Managing and Maintaining Your PC Fifth Edition Chapter 22 All About SCSI.
Chapter 7 Microsoft Windows XP. Windows XP Versions XP Home XP Home XP Professional XP Professional XP Professional 64-Bit XP Professional 64-Bit XP Media.
Online Systems Status Review of requirements System configuration Current acquisitions Next steps... Upgrade Meeting 4-Sep-1997 Stu Fuess.
Gorman, Stubbs, & CEP Inc. 1 Introduction to Operating Systems Lesson 12 Windows 2000 Server.
1 U.S. Department of the Interior U.S. Geological Survey Contractor for the USGS at the EROS Data Center EDC CR1 Storage Architecture August 2003 Ken Gacke.
Overview of Physical Storage Media
Hosted by 2004 Purchasing Intentions Survey Mark Schlack Editorial Director, Storage Media Group TechTarget.
CBI Creative Businesses, Inc. Overview of Secondary Storage Technologies Prepared For: The Government Information Preservation Working Group December 16,
 The End to the Means › (According to IBM ) › 03.ibm.com/innovation/us/thesmartercity/in dex_flash.html?cmp=blank&cm=v&csr=chap ter_edu&cr=youtube&ct=usbrv111&cn=agus.
D0 Taking Stock1 By Anil Kumar CD/CSS/DSG June 06, 2005.
Randy MelenApril 14, Stanford Linear Accelerator Center Site Report April 1999 Randy Melen SLAC Computing Services/Systems HPC Team Leader.
Hands-On Virtual Computing
Storage Networking. Storage Trends Storage grows %/year, gets more complicated It’s necessary to pool storage for flexibility Intelligent storage.
AMS02 Data Volume, Staging and Archiving Issues AMS Computing Meeting CERN April 8, 2002 Alexei Klimentov.
Bernd Panzer-Steindel CERN/IT/ADC1 Medium Term Issues for the Data Challenges.
Information Technology
Local Area Networks, 3rd Edition David A. Stamper
Tape Drive Testing.
Technology for Long-Term Digital Preservation
Storage Networking.
Cluster Active Archive
Mass Storage & Information Retrieval
Chapter 12: Mass-Storage Structure
Storage Networking.
Chapter 12: Mass-Storage Systems
Airbus Archive Technologies
Web Server Administration
Overview Continuation from Monday (File system implementation)
Hard disk basics Prof:R.CHARLES SILVESTER JOE Departmet of Electronics St.Joseph’s College,Trichy.
Presentation transcript:

Deutsches Zentrum für Luft- und Raumfahrt e.V. Bench mark study for new technology archiving devices H.-J. Wolf K.-D Mißling, G. M.Pinna CEOS Subgroup ATT meeting ESRIN 9 May 2002

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 2 Bench mark study for new archiving devices Introduction operation of remote sensing facilities  growing amount of sensor data archiving subsystems separated from the acquisition  specialized computer peripheral shorter use time of archive technology  automated migration/ risk of non-matured devices replacement and phasing out of current (DLT 7000) drives Objectives:  computer compatible  handle- able by robot systems  high reliability of information  cost of the drive and media/ archiving capability  archiving costs per GB  transfer time/ access time  system provision delay  future of technology/ acceptance by the marked  current market : LTO, SDLT, AIT-2, AIT-3, 9840 B, 9940 A (B)

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 3 Approach conservative selection ( not on basis of announcements) consideration of system coherence Bench mark study for new archiving devices reliability of medium reliability of information access time transfer rate provision time robot handling time organization of data (cache,no-release, media- mix) administrative time/ HSM bandwidth to user IFs between archive elements number of devices : : number of copies organization of data (HW(firm ware, ECC), SW) maturity of device (technology) use time of technology environmental conditions Archive system

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 4 Bench mark study for new archiving devices roadmap of archive technologies

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 5 Bench mark study for new archiving devices Price for drives and media *list price in Europe, no consideration of discounts **Price of DLT 8000

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 6 Bench mark study for new archiving devices Test Configuration Hardware  Sun Server E450, 2x 480MHz/2 GB RAM  12 x 36,4 GB Disk (10000UPM)  X 6541 A PCI Differential F/W-UltraSCSI Adapter (SDLT, LTO and AIT 2/3)  JNI 1063 FC-AL PCI Adapter (STK 9840 B, 9940 A, Loop Mode without Switch/Hup)  Ultra SCSI Differential F/W (HVD) to Ultra SCSI (LVD) Converter MSKL (Test LTO/ADIC; SDLT/ Quantum, ESA; AIT-2/Sony) Software -Solaris 8, kernel Veritas Volume Manager Version dvt (Solaris Performance Test software) -SAM-FS Version and 4.0.BD (last B-Version) LSC(now SUN) Test drives LTO, SDLT, AIT-2, AIT-3, 9840 B, 9940 A

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 7 Bench mark study for new archiving devices Test file system –only SAM-FS file system –Veritas Volume Manager (RAID 0+1) using four drives (striped and mirrored) Test files –A mix of typical remote sensing data Off the shelf Measuring method –Solaris 8 tools /usr/bin/time iostat –SAM-FS tools dvt debugging and logging comparable, duplicable

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 8 Bench mark study for new archiving devices Measured Tape Capacities

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 9 Bench mark study for new archiving devices Measured Transfer Rate

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 10 Bench mark study for new archiving devices Measured Access Time (Position)

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 11 Bench mark study for new archiving devices COSTS per GB

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 12 Bench mark study for new archiving devices Conclusion use of different technologies (AIT-2(AIT-3), LTO) 9840x for high performance access (NRT, MOD- substitute)

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 13 Bench mark study for new archiving devices Future developments  Complete of the study:  load/ unload time of the drives  influence of block size variation on transfer time  influence of special data formats (e.g. L7-RawData, SARData,ERS- low bit rate)  different platforms (e.g. SGI, PC(LINUX) )  possibility of partitioning  drives support of diagnostics

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 14 Future developments  Next activities –Monitoring of Roadmaps –New Technologies Ultra Density Optical (UDO) GB 1. Generation2.0 $/GB GB2. Generation 1.0 $/GB GB3. Generation 0.5 $/GB Lots Technology (Laser optical tape) ­Format:DTF-2 Tape from Kodak, licence Imation ­Capacity:1 TByte (once write) ­Interface:Ultra-SCSI-2; FC-AL ­Transfer Rate:40 MB/s ­Price drive:~ 27 T$ ­Price media:~ 200 $/ 0.19$/GB ­Not before end of 2003 Bench mark study for new archiving devices

Deutsches Zentrum für Luft- und Raumfahrt e.V. May 9, 2002presentation of ESA study results 15 Bench mark study for new archiving devices The Challenges of Magnetic Recording on Tape for Data Storage, Richard H. Dee, Storage Technology Corporation,