Tape Drive Testing IBM 3592.

Slides:



Advertisements
Similar presentations
11 BACKING UP AND RESTORING DATA Chapter 4. Chapter 4: BACKING UP AND RESTORING DATA2 CHAPTER OVERVIEW Describe the various types of hardware used to.
Advertisements

Vorlesung Speichernetzwerke Teil 2 Dipl. – Ing. (BA) Ingo Fuchs 2003.
Modifying the SCSI / Fibre Channel Block Size Presented by Keith Bonneau, John Chrzanowski and Craig O’Brien Advised by Robert Kinicki and Mark Claypool.
I/O Hardware n Incredible variety of I/O devices n Common concepts: – Port – connection point to the computer – Bus (daisy chain or shared direct access)
Octopus system1 Moshe Tocker Avihai Mejer. Octopus system2 The Octopus system Goal The system’s primary goal is to Measure performance parameters in real.
Hugo HEPiX Fall 2005 Testing High Performance Tape Drives HEPiX FALL 2005 Data Services Section.
*nix and Non-Intel Platform issues CSC 486/586 1.
Front view 3.5-inch floppy disk drive
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
Using and Configuring Storage Devices Guide to Operating Systems Third Edition.
Passage Three Storage Devices. Training target: In this part , you should try your best to form good reading habits. In order to avoid your ill habits.
Administration etc.. What is this ? This section is devoted to those bits that I could not find another home for… Again these may be useless, but humour.
Tape Drive Technology Overview AITSAITSDLTLTO. Tape Drive Recording Technologies AITSAITSuperDLTLTO Recording styleHelical Scan Linear serpentine Cartridge.
Module 10 Configuring and Managing Storage Technologies.
Backup Techniques Objectives –to illustrate practical application of backup utilities Contents –using dd, a direct device access command –manipulating.
1 Chapter Client-Server Interaction. 2 Functionality  Transport layer and layers below  Basic communication  Reliability  Application layer.
Chapter 11 Backups Unix System Administration. Backup. Why? Because We Like You. w Why backup at all? Restore from data loss Disaster recovery Archival.
I/O Systems I/O Hardware Application I/O Interface
Computing and the Web Computer Hardware Components.
SCSI Commands Overview
Silberschatz, Galvin and Gagne  Operating System Concepts Chapter 13: I/O Systems I/O Hardware Application I/O Interface Kernel I/O Subsystem.
Peter Mattei HP Storage Consultant 16. May 2013
18-19 July, 2002Correlator Backend System OverviewTom Morgan 1 Correlator Backend System Overview Tom Morgan, NRAO.
Chapter 13 – I/O Systems (Pgs ). Devices  Two conflicting properties A. Growing uniformity in interfaces (both h/w and s/w): e.g., USB, TWAIN.
Hosted by Creating RFPs for Tape Libraries Dianne McAdam Senior Analyst and Partner Data Mobility Group.
Silberschatz, Galvin and Gagne  Operating System Concepts Six Step Process to Perform DMA Transfer.
4P13 Week 12 Talking Points Device Drivers 1.Auto-configuration and initialization routines 2.Routines for servicing I/O requests (the top half)
Focus 28 March Tape Service and CASTOR Issues Focus 28 March 2002 H.Renshall IT/DS.
2 Copyright © 2007, Oracle. All rights reserved. Configuring for Recoverability.
Importance of Routine File System Backups To prevent loss data due to: Accidental deletion of files Hardware failures Problems with re-installation or.
CERN - IT Department CH-1211 Genève 23 Switzerland Tape Operations Update Vladimír Bahyl IT FIO-TSI CERN.
01. December 2004Bernd Panzer-Steindel, CERN/IT1 Tape Storage Issues Bernd Panzer-Steindel LCG Fabric Area Manager CERN/IT.
CERN IT Department CH-1211 Genève 23 Switzerland t The Tape Service at CERN Vladimír Bahyl IT-FIO-TSI June 2009.
Developments for tape CERN IT Department CH-1211 Genève 23 Switzerland t DSS Developments for tape CASTOR workshop 2012 Author: Steven Murray.
Tape archive challenges when approaching Exabyte-scale CHEP 2010, Taipei G. Cancio, V. Bahyl, G. Lo Re, S. Murray, E. Cano, G. Lee, V. Kotlyar CERN IT-DSS.
1 Chapter 2: Operating-System Structures Services Interface provided to users & programmers –System calls (programmer access) –User level access to system.
C Copyright © 2006, Oracle. All rights reserved. Oracle Secure Backup Additional Installation Topics.
Bernd Panzer-Steindel CERN/IT/ADC1 Medium Term Issues for the Data Challenges.
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS CASTOR status and development HEPiX Spring 2011, 4 th May.
Data Storage and Querying in Various Storage Devices.
CERN - IT Department CH-1211 Genève 23 Switzerland CERN Tape Status Tape Operations Team IT/FIO CERN.
Tgt: Framework Target Drivers FUJITA Tomonori NTT Cyber Solutions Laboratories Mike Christie Red Hat, Inc Ottawa Linux.
Chapter 13: I/O Systems.
Chapter 10: Mass-Storage Systems
Storage Area Networks The Basics.
Module 12: I/O Systems I/O hardware Application I/O Interface
Chapter 13: I/O Systems Modified by Dr. Neerja Mhaskar for CS 3SH3.
I/O SYSTEMS MANAGEMENT Krishna Kumar Ahirwar ( )
Robotics and Tape Drives
Tape Drive Testing.
Tape Operations Vladimír Bahyl on behalf of IT-DSS-TAB
The Unbearable Slowness of Tape
Direct Attached Storage and Introduction to SCSI
Experiences and Outlook Data Preservation and Long Term Analysis
Pierre-Emmanuel Brinette
Direct Attached Storage and Introduction to SCSI
CSCI 315 Operating Systems Design
LTO Cartridge native (uncompressed) capacity, Interchangeability and Maximum tape drive native data transfer speeds Tape Drive Operation Generation 1 cartridge.
Chapter 2: The Linux System Part 1
I/O Systems I/O Hardware Application I/O Interface
Operating System Concepts
13: I/O Systems I/O hardwared Application I/O Interface
CS703 - Advanced Operating Systems
Chapter 1 Introduction to Operating System Part 5
Chapter 13: I/O Systems I/O Hardware Application I/O Interface
Hard disk basics Prof:R.CHARLES SILVESTER JOE Departmet of Electronics St.Joseph’s College,Trichy.
Chapter 13: I/O Systems I/O Hardware Application I/O Interface
Mass-Storage Systems (Disk Scheduling)
Module 12: I/O Systems I/O hardwared Application I/O Interface
Presentation transcript:

Tape Drive Testing IBM 3592

IBM 3592 tape drive Maximum native data rate of 40 MB/s 60GB (not for us) and 300 GB IBM 3592 cartridge 8 meters/s high-speed search Compatible with IBM tape library, not STK tape library (Powderhorn) 1Gps/2Gps fibre channel connection 3592 tape drive 3584 library

Initial test infrastructure (now 8 ‘mid-range` servers) Tape Server IBM 3584 Tape Library Fiber Qlogic Fiber Channel Bus Adapter IBM 3592 Tape Drive

Over 125,000 mount/dismount cycles performed, no errors ‘Mechanical` tests Over 125,000 mount/dismount cycles performed, no errors Test mechanical reliability of drive / media: some cartridges now mounted > 4000 times, no errors Perform random file reads on selected tapes and media: superseded by CASTOR/ALICE MDC6 operation

Performance tests General characteristics Drive mount (from slot) 3.2 s Time to access VOL1 20.9 s Rewind 0.01 s Unload 22.0 s Dismount (to slot) 2.8 s Write very small ‘labelled file’ 0.2s CM chip, RF I/O, 4096 bytes, part of cartridge 512 tracks in 64 sets of 8 8 m/s high speed search 20,000 load/unload cycle lifetime for cartridge 300 full file passes lifetime for cartridge Measurements made over 88 cartridges in the 3584

`Performance` tests (without CASTOR) Read and write to tape Use UNIX commands mt, dd only Similar tests are carried out on all new types of drive to be used at CERN to measure… Capacity of cartridge and blocksize, 1-256K Capacity of cartridge and filesize Write datarate with blocksize 1-256K Write datarate with blocksize 1-17K Write datarate with very small blocksize 1-1024 bytes Read datarate with blocksize 1-256K Reproducibility of maximum capacity, filling a single cartridge Variation in maximum capacity, filling different cartridges Labelled files, 'position to file' and rewind timings Blocks, 'position to block' and rewind timings Apparent sizes of small labelled files, from rewind timings Time to create small labelled files Compression write datarate with blocksize 1-256K Compression read datarate with blocksize 1-256K Compression write datarate with filesize Verification of legal FC command execution …..and so on and so on…….

`Performance` tests (using CASTOR) Verify the functioning of the CASTOR and CASTOR related functions: tape_up tape unit standard testing for production utility tplabel tape labelling utility dumptape tape dumping (scanning) utility stagein tape reading utility stagewrt tape writing utility repack move CASTOR file from tape and reclaim utilities

`Performance` tests: some typical examples.. No compression, 1K=1024, 1M=1048576 Data transfer rate (write)

`Performance` tests: some typical examples.. Compressed data transfer rate (write) Use compression, 1K=1024, 1M=1048576 dd if=/dev/zero ibs=256k of=/dev/nst0 obs=256k count=n

`Performance` tests: some typical examples.. ‘Labelled’ file position/rewind times ‘user’ files on tape, each ~25 MB (100 blocks of 256K), simulated labels The 64 serpentine track sets (32 ‘out’, 32 ‘back) show clearly! Command mt -f /dev/nst0 fsf n Command mt -f /dev/nst0 rewind

Check returned information, timing, command acceptance Functionality Tests Go through the set of commands available on the SCSI standard Check returned information, timing, command acceptance SCSI 3 COMMANDS: Change Definition, Compare, Copy, Copy and Verify, Display Message, Erase, Format Medium, Inquiry, Load/Unload, Locate , Log Select, Log Sense, Mode Select (6), Mode Select (10), Mode Sense (6), Mode Sense (10), Persistent Reserve In, Persistent Reserve Out, Prevent/Allow Medium Removal, Read, Read Attribute, Read Block Limits, Read Buffer, Read Position, Read Reverse, Receive Diagnostic Results, Recover Buffered Data, Release Unit (6), Release Unit (10), Report Density Support LUNs, Request Sense Unit (6), Reserve Unit (10), Rewind, Send Diagnostic, Set Capacity, Space, Test Unit Ready, Verify, Write, Write Attribute, Write Buffer, Write Filemarks IBM 3592 TESTED COMMANDS Display Message, Erase, Inquiry, Load/Unload, Locate , Log Select, Log Sense, Mode Select (10), Mode Sense (10), Persistent Reserve In, Persistent Reserve Out, Prevent/Allow Medium Removal, Read, Read Block Limits, Read Buffer, Read Position, Receive Diagnostic Results, Recover Buffered Data, Release Unit (6), Report Density Support, Report LUNs, Request Sense Unit (6), Reserve Unit (6), Rewind, Send Diagnostic, Space, Test Unit Ready, Write, Write Buffer, Write Filemarks OK

Test Infrastructure

Test Scenarios 1) IBM tape driver and IBMtapeutil (interactive/command line mode) 2) Linux tape driver and cernTapeTestUtil (interactive/command line mode)

Analysis of Results

Conclusions IBM 3592 Tape Drive SCSI commands OK cernTapeTestUtil more than a test tool for tape drives; also a diagnostics tool .... provides access to vital information on tape drive and media statistics and status cernTapeTestUtil works on STK 9840, STK 9940, HP LT02 as well as 3592 and will be used on any new equipment that will arrive to be tested Use of a SCSI/fibre channel analyzer permits a precise logging of results and this can be used for all our drives