Hugo HEPiX Fall 2005 Testing High Performance Tape Drives HEPiX FALL 2005 Data Services Section.

Slides:



Advertisements
Similar presentations
System Integration and Performance
Advertisements

At a glance: HP StoreEver LTO-6 Tape Speaker’s name / Month day, 2012 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained.
© 2011 IBM Corporation1 Tape Logical Block Protection (aka Tape Checksum ) Kevin D. Butt SCSI Architect, Data Protection & Retention, IBM T10/SSC Working.
Deutsches Zentrum für Luft- und Raumfahrt e.V. Bench mark study for new technology archiving devices H.-J. Wolf K.-D Mißling, G. M.Pinna CEOS Subgroup.
Copyright © 2014 EMC Corporation. All Rights Reserved. Linux Host Installation and Integration for Block Upon completion of this module, you should be.
11 BACKING UP AND RESTORING DATA Chapter 4. Chapter 4: BACKING UP AND RESTORING DATA2 CHAPTER OVERVIEW Describe the various types of hardware used to.
Vorlesung Speichernetzwerke Teil 2 Dipl. – Ing. (BA) Ingo Fuchs 2003.
EET 450 – Advanced Digital Chapter 10 Hard Disk Drives.
1 File Systems Chapter Files 6.2 Directories 6.3 File system implementation 6.4 Example file systems.
Network Administration Procedures Tools –Ping –SNMP –Ethereal –Graphs 10 commandments for PC security.
Check Disk. Disk Defragmenter Using Disk Defragmenter Effectively Run Disk Defragmenter when the computer will receive the least usage. Educate users.
Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE Server with redundant NICs.
Using and Configuring Storage Devices Guide to Operating Systems Third Edition.
Introduction to Database Systems 1 The Storage Hierarchy and Magnetic Disks Storage Technology: Topic 1.
12.1 Silberschatz, Galvin and Gagne ©2009 Operating System Concepts with Java – 8 th Edition Chapter 12: Mass-Storage Systems.
COEN 180 Hard Drive Interface Evolution. Hard Drive Interface How does the system interact with the disk. Slow development towards autonomous, intelligent.
HEPIX 3 November 2000 Current Mass Storage Status/Plans at CERN 1 HEPIX 3 November 2000 H.Renshall PDP/IT.
Experiences and Challenges running CERN's High-Capacity Tape Archive 14/4/2015 CHEP 2015, Okinawa2 Germán Cancio, Vladimír Bahyl
Tape Drive Technology Overview AITSAITSDLTLTO. Tape Drive Recording Technologies AITSAITSuperDLTLTO Recording styleHelical Scan Linear serpentine Cartridge.
Module 10 Configuring and Managing Storage Technologies.
Physical Storage and File Organization COMSATS INSTITUTE OF INFORMATION TECHNOLOGY, VEHARI.
5 Copyright © 2008, Oracle. All rights reserved. Using RMAN to Create Backups.
Slide 1 DESIGN, IMPLEMENTATION, AND PERFORMANCE ANALYSIS OF THE ISCSI PROTOCOL FOR SCSI OVER TCP/IP By Anshul Chadda (Trebia Networks)-Speaker Ashish Palekar.
SCSI Commands Overview
© 2006 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice HP Library Encryption - LTO4 Key.
Linux+ Guide to Linux Certification Chapter Six Linux Filesystem Administration.
Sep. 17, 2002BESIII Review Meeting BESIII DAQ System BESIII Review Meeting IHEP · Beijing · China Sep , 2002.
1 Microsoft Windows 2000 Network Infrastructure Administration Chapter 4 Monitoring Network Activity.
4/26/2017 HP Insight Managament Agents and RSM disabling Tape Storage Wei Jung Shih Hung July HP template.
4P13 Week 12 Talking Points Device Drivers 1.Auto-configuration and initialization routines 2.Routines for servicing I/O requests (the top half)
1 U.S. Department of the Interior U.S. Geological Survey CR1 Silo Briefing Presented By Ken Gacke, SAIC* U.S. Geological Survey, National Center EROS Sioux.
TS7700 Performance and Capacity Daily charts only Enter Description, Month & Year in this Text Box.
2 Copyright © 2007, Oracle. All rights reserved. Configuring for Recoverability.
TS7700 Performance and Capacity Daily and Hourly charts Enter Description, Month & Year in this Text Box.
Advances in Bit Preservation (since DPHEP’2015) 3/2/2016 DPHEP / WLCG Workshop1 Germán Cancio IT Storage Group CERN DPHEP / WLCG Workshop Lisbon, 3/2/2016.
CERN - IT Department CH-1211 Genève 23 Switzerland Tape Operations Update Vladimír Bahyl IT FIO-TSI CERN.
01. December 2004Bernd Panzer-Steindel, CERN/IT1 Tape Storage Issues Bernd Panzer-Steindel LCG Fabric Area Manager CERN/IT.
CERN IT Department CH-1211 Genève 23 Switzerland t The Tape Service at CERN Vladimír Bahyl IT-FIO-TSI June 2009.
Developments for tape CERN IT Department CH-1211 Genève 23 Switzerland t DSS Developments for tape CASTOR workshop 2012 Author: Steven Murray.
CERN IT Department CH-1211 Genève 23 Switzerland t Increasing Tape Efficiency Original slides from HEPiX Fall 2008 Taipei RAL f2f meeting,
Tape write efficiency improvements in CASTOR Department CERN IT CERN IT Department CH-1211 Genève 23 Switzerland DSS Data Storage.
Tape archive challenges when approaching Exabyte-scale CHEP 2010, Taipei G. Cancio, V. Bahyl, G. Lo Re, S. Murray, E. Cano, G. Lee, V. Kotlyar CERN IT-DSS.
This courseware is copyrighted © 2016 gtslearning. No part of this courseware or any training material supplied by gtslearning International Limited to.
C Copyright © 2006, Oracle. All rights reserved. Oracle Secure Backup Additional Installation Topics.
Bernd Panzer-Steindel CERN/IT/ADC1 Medium Term Issues for the Data Challenges.
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS CASTOR status and development HEPiX Spring 2011, 4 th May.
Data Storage and Querying in Various Storage Devices.
CERN - IT Department CH-1211 Genève 23 Switzerland CERN Tape Status Tape Operations Team IT/FIO CERN.
Tgt: Framework Target Drivers FUJITA Tomonori NTT Cyber Solutions Laboratories Mike Christie Red Hat, Inc Ottawa Linux.
Analyzing Quantum LTO Drive Issues. 01/31/2006 LTO 4 HH Training © 2006 Quantum Corporation. Company Confidential. Forward-looking information is based.
Unit V part 2.
Chapter 10: Mass-Storage Systems
SDP Installation Installation March 2005 CISCO VPN Router SDP Unit
Operating System (013022) Dr. H. Iwidat
Tape Drive Testing IBM 3592.
Tape Drive Testing.
Tape Operations Vladimír Bahyl on behalf of IT-DSS-TAB
The Unbearable Slowness of Tape
Direct Attached Storage and Introduction to SCSI
Experiences and Outlook Data Preservation and Long Term Analysis
Chapter 12: Mass-Storage Structure
Mass-Storage Structure
Pierre-Emmanuel Brinette
Direct Attached Storage and Introduction to SCSI
LTO Cartridge native (uncompressed) capacity, Interchangeability and Maximum tape drive native data transfer speeds Tape Drive Operation Generation 1 cartridge.
Overview Continuation from Monday (File system implementation)
Chapter 12: Mass-Storage Structure
Mass-Storage Systems (Disk Scheduling)
Presentation transcript:

Hugo HEPiX Fall 2005 Testing High Performance Tape Drives HEPiX FALL 2005 Data Services Section

Hugo HEPiX Fall 2005 Motivation 2007 ~15 Petabytes/year LHC

Hugo HEPiX Fall 2005 Current Model CASTOR HSM RFIO DATA

Hugo HEPiX Fall 2005 IBM 3584 Library IBM 3592JA Tape Drive HP LT0-3STK SL GB 80 MB/sec 40 MB/sec 300 GB / 60 GB 1,448 carts 64 drives 117 carts 12 drives Devices Tested Future Generation Tape Drives >100 MB/s Testing in 2006

Hugo HEPiX Fall 2005 Test Infrastructure Tape Library Tape Drive Fiber Fiber Channel HBA Tape Server

Hugo HEPiX Fall 2005 Functionality Tests Go through the set of commands available on the SCSI standard Check returned information, timing, command acceptance SCSI COMMANDS: Change Definition, Compare, Copy, Copy and Verify, Display Message, Erase, Format Medium, Inquiry, Load/Unload, Locate, Log Select, Log Sense, Mode Select (6), Mode Select (10), Mode Sense (6), Mode Sense (10), Persistent Reserve In, Persistent Reserve Out, Prevent/Allow Medium Removal, Read, Read Attribute, Read Block Limits, Read Buffer, Read Position, Read Reverse, Receive Diagnostic Results, Recover Buffered Data, Release Unit (6), Release Unit (10), Report Density Support LUNs, Request Sense Unit (6), Reserve Unit (10), Rewind, Send Diagnostic, Set Capacity, Space, Test Unit Ready, Verify, Write, Write Attribute, Write Buffer, Write Filemarks

Hugo HEPiX Fall 2005 Functionality Tests fibre channel analyzer for verifying SCSI commands

Hugo HEPiX Fall 2005 Test Scenarios Linux tape driver and cernTapeTestUtil (interactive/command line mode)

Hugo HEPiX Fall 2005 Analysis of Results

Hugo HEPiX Fall 2005 Mechanical Tests IBM 3592: Over 125,000 mount/dismount cycles performed, no errors Test mechanical reliability of drive / media: some cartridges now mounted > 4000 times, no errors Random file reads on selected tapes and media: superseded by CASTOR operation in data challenges HP LTO-3: Over 125,000 mount/dismount cycles performed, no errors Test mechanical reliability of drive / media: some cartridges now mounted > 5000 times, no errors

Hugo HEPiX Fall 2005 Performance Tests - Use of native Linux Commands (mt/dd) for data transfers : read / write compression / no compression blocksize filesize position “labeled” files

Hugo HEPiX Fall 2005 Performance LTO-3 Data Transfer Rate Write no compression

Hugo HEPiX Fall 2005 Performance LTO-3 Data Transfer Rate Read no compression

Hugo HEPiX Fall 2005 LTO-3 Locate File Timing LTO-3 Locate Record Timing Performance Algorithm problem(?) seen older LTO-1 drives, just HP (? )

Hugo HEPiX Fall 2005 TapemarkData 0-? Bytes TapemarkHeader 1 80 Bytes Header 2 80 Bytes Header 3 80 Bytes Trailer 1 80 Bytes Trailer 2 80 Bytes Trailer 3 80 Bytes TapemarkSync ANSI Labels Headers Trailers Tapemark Sync Filename, block size, HSM version, time of writing … Number of blocks, non standard data … Flush buffer Special records on tape used by the drive, immediate bit =0/1

Hugo HEPiX Fall 2005 Labels vs Performance Minimum over head Maximum over head

Hugo HEPiX Fall 2005 Labels vs Performance HP-LTO3 IBM 3592JA

Hugo HEPiX Fall 2005 Labels vs Performance IBM 3592 small files

Hugo HEPiX Fall 2005 HSM Integration Functionality + Mechanical + Performance tape_up tape unit standard testing for production utility tplabel tape labelling utility dumptape tape dumping (scanning) utility stagein tape reading utility stagewrt tape writing utility repack move CASTOR file from tape and reclaim utilities OK Drive integration in HSM system

Hugo HEPiX Fall 2005 Operations IBM 3592/HP LT0-3: SNMP Agent : Error Counters Tape Alerts Drive and Media: number mounts/Loads/… IBM 3592: Statistical Analysis and Reporting System : bit 62: SARS Drive Relative Quality X'00' is unknown, best X'01' -> worst X'FF‘ bit 63 SARS Media Relative Quality X'00' is unknown, best X'01' -> worst X'FF' No Vendor: Perfect tool for monitoring all type of drives and for a large number of drives Request Sense

Hugo HEPiX Fall 2005 More Tests CASTOR HSM RFIO ?? $$ SAN