1 Recap (RAID and Storage Architectures). 2 RAID To increase the availability and the performance (bandwidth) of a storage system, instead of a single.

Slides:



Advertisements
Similar presentations
RAID Redundant Arrays of Independent Disks Courtesy of Satya, Fall 99.
Advertisements

RAID (Redundant Arrays of Independent Disks). Disk organization technique that manages a large number of disks, providing a view of a single disk of High.
NAS vs. SAN 10/2010 Palestinian Land Authority IT Department By Nahreen Ameen 1.
CSCE430/830 Computer Architecture
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
RAID- Redundant Array of Inexpensive Drives. Purpose Provide faster data access and larger storage Provide data redundancy.
1 CSC 486/586 Network Storage. 2 Objectives Familiarization with network data storage technologies Understanding of RAID concepts and RAID levels Discuss.
R.A.I.D. Copyright © 2005 by James Hug Redundant Array of Independent (or Inexpensive) Disks.
RAIDRAID Rithy Chhay Shari Holstege CMSC 691X: UNIX Systems Administration.
CSE521: Introduction to Computer Architecture Mazin Yousif I/O Subsystem RAID (Redundant Array of Independent Disks)
Lecture 36: Chapter 6 Today’s topic –RAID 1. RAID Redundant Array of Inexpensive (Independent) Disks –Use multiple smaller disks (c.f. one large disk)
CSCE 212 Chapter 8 Storage, Networks, and Other Peripherals Instructor: Jason D. Bakos.
REDUNDANT ARRAY OF INEXPENSIVE DISCS RAID. What is RAID ? RAID is an acronym for Redundant Array of Independent Drives (or Disks), also known as Redundant.
Computer ArchitectureFall 2007 © November 28, 2007 Karem A. Sakallah Lecture 24 Disk IO and RAID CS : Computer Architecture.
1 Storage (cont’d) Disk scheduling Reducing seek time (cont’d) Reducing rotational latency RAIDs.
1 Lecture 26: Storage Systems Topics: Storage Systems (Chapter 6), other innovations Final exam stats:  Highest: 95  Mean: 70, Median: 73  Toughest.
High Performance Computing Course Notes High Performance Storage.
Computer ArchitectureFall 2008 © November 12, 2007 Nael Abu-Ghazaleh Lecture 24 Disk IO.
1 COMP 206: Computer Architecture and Implementation Montek Singh Mon., Dec. 1, 2003 Topic: Storage Systems (Disk Technology) – contd.
COMP381 by M. Hamdi 1 RAID (Redundant Array of Inexpensive Disks) & Storage Systems.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition Mass-Storage Systems Revised Tao Yang.
Storage Area Network (SAN)
CSE 451: Operating Systems Winter 2010 Module 13 Redundant Arrays of Inexpensive Disks (RAID) and OS structure Mark Zbikowski Gary Kimura.
Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE Server with redundant NICs.
Storage Networking. Storage Trends Storage growth Need for storage flexibility Simplify and automate management Continuous availability is required.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
Data Storage Willis Kim 14 May Types of storages Direct Attached Storage – storage hardware that connects to a single server Direct Attached Storage.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
File Systems and N/W attached storage (NAS) | VTU NOTES | QUESTION PAPERS | NEWS | VTU RESULTS | FORUM | BOOKSPAR ANDROID APP.
Redundant Array of Inexpensive Disks (RAID). Redundant Arrays of Disks Files are "striped" across multiple spindles Redundancy yields high data availability.
Managing Storage Lesson 3.
Computer Organization CS224 Fall 2012 Lesson 51. Measuring I/O Performance  I/O performance depends on l Hardware: CPU, memory, controllers, buses l.
Chapter 6 RAID. Chapter 6 — Storage and Other I/O Topics — 2 RAID Redundant Array of Inexpensive (Independent) Disks Use multiple smaller disks (c.f.
RAID Shuli Han COSC 573 Presentation.
Storage & Peripherals Disks, Networks, and Other Devices.
CS 352 : Computer Organization and Design University of Wisconsin-Eau Claire Dan Ernst Storage Systems.
Redundant Array of Independent Disks
RAID: High-Performance, Reliable Secondary Storage Mei Qing & Chaoxia Liao Nov. 20, 2003.
Architecture of intelligent Disk subsystem
N-Tier Client/Server Architectures Chapter 4 Server - RAID Copyright 2002, Dr. Ken Hoganson All rights reserved. OS Kernel Concept RAID – Redundant Array.
I/O – Chapter 8 Introduction Disk Storage and Dependability – 8.2 Buses and other connectors – 8.4 I/O performance measures – 8.6.
RAID COP 5611 Advanced Operating Systems Adapted from Andy Wang’s slides at FSU.
Lecture 9 of Advanced Databases Storage and File Structure (Part II) Instructor: Mr.Ahmed Al Astal.
CSI-09 COMMUNICATION TECHNOLOGY FAULT TOLERANCE AUTHOR: V.V. SUBRAHMANYAM.
RAID REDUNDANT ARRAY OF INEXPENSIVE DISKS. Why RAID?
Chapter 12: Mass-Storage Systems Silberschatz, Galvin and Gagne ©2005 Operating System Concepts Chapter 12: Mass-Storage Systems Overview of Mass.
RAID SECTION (2.3.5) ASHLEY BAILEY SEYEDFARAZ YASROBI GOKUL SHANKAR.
Redundant Array of Independent Disks.  Many systems today need to store many terabytes of data.  Don’t want to use single, large disk  too expensive.
RAID Disk Arrays Hank Levy. 212/5/2015 Basic Problems Disks are improving, but much less fast than CPUs We can use multiple disks for improving performance.
RAID Systems Ver.2.0 Jan 09, 2005 Syam. RAID Primer Redundant Array of Inexpensive Disks random, real-time, redundant, array, assembly, interconnected,
1 Lecture 27: Disks Today’s topics:  Disk basics  RAID  Research topics.
Storage Networking. Storage Trends Storage grows %/year, gets more complicated It’s necessary to pool storage for flexibility Intelligent storage.
1 CEG 2400 Fall 2012 Network Servers. 2 Network Servers Critical Network servers – Contain redundant components Power supplies Fans Memory CPU Hard Drives.
LECTURE 13 I/O. I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access.
RAID Technology By: Adarsha A,S 1BY08A03. Overview What is RAID Technology? What is RAID Technology? History of RAID History of RAID Techniques/Methods.
Network-Attached Storage. Network-attached storage devices Attached to a local area network, generally an Ethernet-based network environment.
Silberschatz, Galvin and Gagne ©2013 Operating System Concepts – 9 th Edition Chapter 10: Mass-Storage Systems.
I/O Errors 1 Computer Organization II © McQuain RAID Redundant Array of Inexpensive (Independent) Disks – Use multiple smaller disks (c.f.
CMPE Database Systems Workshop June 16 Class Meeting
RAID Redundant Arrays of Independent Disks
RAID Non-Redundant (RAID Level 0) has the lowest cost of any RAID
Storage Networking.
Introduction to Networks
Introduction to Networks
Storage Networking.
RAID RAID Mukesh N Tekwani
UNIT IV RAID.
Mark Zbikowski and Gary Kimura
RAID RAID Mukesh N Tekwani April 23, 2019
Improving performance
Presentation transcript:

1 Recap (RAID and Storage Architectures)

2 RAID To increase the availability and the performance (bandwidth) of a storage system, instead of a single disk, a set of disks (disk arrays) can be used. However, the reliability of the system drops (n devices have 1/n the reliability of a single device). Reliability of N disks = Reliability of 1 Disk ÷N –50,000 Hours ÷ 70 disks = 700 hours Disk system Mean Time To Failure (MTTF): Drops from 6 years to 1 month!

3 RAID-0 Strip 12 Strip 8 Strip 4 Strip 0 Strip 13 Strip 9 Strip 5 Strip 1 Strip 14 Strip 10 Strip 6 Strip 2 Strip 15 Strip 11 Strip 7 Strip 3 Striped, non-redundant  Excellent data transfer rate  Excellent I/O request processing rate  Not fault tolerant Typically used for applications requiring high performance for non-critical data

4 RAID 1 - Mirroring Called mirroring or shadowing, uses an extra disk for each disk in the array (most costly form of redundancy) Whenever data is written to one disk, that data is also written to a redundant disk: good for reads, fair for writes If a disk fails, the system just goes to the mirror and gets the desired data. Fast, but very expensive. Typically used in system drives and critical files –Banking, insurance data –Web (e-commerce) servers Strip 3 Strip 2 Strip 1 Strip 0 Strip 3 Strip 2 Strip 1 Strip 0

5 RAID 2: Memory-Style ECC f 0 (b) b2b2 b1b1 b0b0 b3b3 f 1 (b) P(b) Data Disks Multiple ECC Disks and a Parity Disk Multiple disks record the (error correcting code) ECC information to determine which disk is in fault A parity disk is then used to reconstruct corrupted or lost data Needs log 2 (number of disks) redundancy disks Least used since ECC is irrelevant because most new Hard drives support built-in error correction

6 RAID 3 - Bit-interleaved Parity Use 1 extra disk for each array of n disks. Reads or writes go to all disks in the array, with the extra disk to hold the parity information in case there is a failure. Performance of RAID 3: –Only one request can be serviced at a time – Poor I/O request rate –Excellent data transfer rate –Typically used in large I/O request size applications, such as imaging or CAD Logical record Striped physical records P Physical record

7 RAID 4: Block Interleaved Parity block 0 block 4 block 8 block 12 block 1 block 5 block 9 block 13 block 2 block 6 block 10 block 14 block 3 block 7 block 11 block 15 P(0-3) P(4-7) P(8-11) P(12-15) Allow for parallel access by multiple I/O requests Doing multiple small reads is now faster than before. A write, however, is a different story since we need to update the parity information for the block. In this case the parity disk is the bottleneck.

8 RAID 5 - Block-interleaved Distributed Parity To address the write deficiency of RAID 4, RAID 5 distributes the parity blocks among all the disks. This allows some writes to proceed in parallel –For example, writes to blocks 8 and 5 can occur simultaneously. –However, writes to blocks 8 and 11 cannot proceed in parallel.

9 Performance of RAID 5 - Block- interleaved Distributed Parity Performance of RAID 5 –I/O request rate: excellent for reads, good for writes –Data transfer rate: good for reads, good for writes –Typically used for high request rate, read-intensive data lookup –File and Application servers, Database servers, WWW, , and News servers, Intranet servers The most versatile and widely used RAID.

10 Which Storage Architecture? DAS - Directly-Attached Storage NAS - Network Attached Storage SAN - Storage Area Network

11 Storage Architectures (Direct Attached Storage (DAS)) Unix NetWare NT/W2K NetWare Server Storage NetWare Server Storage NT Server Storage NT Server Storage Virtual Drive 3 Unix Server Storage Unix Server Storage

12 DAS CPUs Bus Memory SCSI Adaptor SCSI Disk Drive NIC SCSI protocol MS Windows Traditional Server Block I/O

13 Storage Architectures (Network Attached Storage (NAS)) Hosts IP Network NAS Controller Disk subsystem Shared Information

14 NAS CPUs Bus Memory NIC MS Windows “Diskless” App Server (or rather a “Less Disk” server) IP network File protocol (CIFS, NFS) CPUs Bus Memory NIC Optimised OS NAS appliance SCSI Adaptor SCSI Disk Drive SCSI Adaptor SCSI Disk Drive SCSI protocol Block I/O

15 The NAS Network IP network App Server NAS Appliance NAS - truly an appliance

16 Storage Architectures (Storage Area Networks (SAN)) Storage Network Hosts IP Network Clients Shared Storage

17 SAN- Fibre Channel (FC) CPUs Bus Memory SCSI Adaptor SCSI Disk Drive NIC SCSI protocol MS Windows DAS CPUs Bus Memory FC HBA (Host Bus Adaptor) NIC MS Windows Server with FC FC Adaptor SCSI Disk Drive Remote-ish Storage Unit (to 30 metres) SCSI Adaptor SCSI over FC Protocol Block I/O (to 3 metres)

18 FC-based SAN FC Switch Fabric IP network App server FC Storage Sub-system FC Storage Sub-system FC Storage Sub-system FC Backup System