W4118 Operating Systems Instructor: Junfeng Yang.

Slides:



Advertisements
Similar presentations
A Case for Redundant Arrays Of Inexpensive Disks Paper By David A Patterson Garth Gibson Randy H Katz University of California Berkeley.
Advertisements

1 Lecture 18: RAID n I/O bottleneck n JBOD and SLED n striping and mirroring n classic RAID levels: 1 – 5 n additional RAID levels: 6, 0+1, 10 n RAID usage.
Faculty of Information Technology Department of Computer Science Computer Organization Chapter 7 External Memory Mohammad Sharaf.
RAID (Redundant Arrays of Independent Disks). Disk organization technique that manages a large number of disks, providing a view of a single disk of High.
- Dr. Kalpakis CMSC Dr. Kalpakis 1 Outline In implementing DBMS we need to answer How should the system store and manage very large amounts of data?
RAID Redundant Array of Independent Disks
CS 6560: Operating Systems Design
CSCE430/830 Computer Architecture
Operating Systems ECE344 Ashvin Goel ECE University of Toronto Disks and RAID.
RAID- Redundant Array of Inexpensive Drives. Purpose Provide faster data access and larger storage Provide data redundancy.
RAID Redundant Arrays of Inexpensive Disks –Using lots of disk drives improves: Performance Reliability –Alternative: Specialized, high-performance hardware.
R.A.I.D. Copyright © 2005 by James Hug Redundant Array of Independent (or Inexpensive) Disks.
CSE521: Introduction to Computer Architecture Mazin Yousif I/O Subsystem RAID (Redundant Array of Independent Disks)
Lecture 36: Chapter 6 Today’s topic –RAID 1. RAID Redundant Array of Inexpensive (Independent) Disks –Use multiple smaller disks (c.f. one large disk)
CSCE 212 Chapter 8 Storage, Networks, and Other Peripherals Instructor: Jason D. Bakos.
Computer ArchitectureFall 2007 © November 28, 2007 Karem A. Sakallah Lecture 24 Disk IO and RAID CS : Computer Architecture.
1 Storage (cont’d) Disk scheduling Reducing seek time (cont’d) Reducing rotational latency RAIDs.
1  1998 Morgan Kaufmann Publishers Chapter 8 Storage, Networks and Other Peripherals.
Other Disk Details. 2 Disk Formatting After manufacturing disk has no information –Is stack of platters coated with magnetizable metal oxide Before use,
1 Lecture 26: Storage Systems Topics: Storage Systems (Chapter 6), other innovations Final exam stats:  Highest: 95  Mean: 70, Median: 73  Toughest.
Computer ArchitectureFall 2008 © November 12, 2007 Nael Abu-Ghazaleh Lecture 24 Disk IO.
Disks.
S.1 Review: Major Components of a Computer Processor Control Datapath Memory Devices Input Output Cache Main Memory Secondary Memory (Disk)
Secondary Storage CSCI 444/544 Operating Systems Fall 2008.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
Secondary Storage Unit 013: Systems Architecture Workbook: Secondary Storage 1G.
Storage System: RAID Questions answered in this lecture: What is RAID? How does one trade-off between: performance, capacity, and reliability? What is.
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 6 – RAID ©Manuel Rodriguez.
Storage Systems CSE 598d, Spring 2007 Lecture 5: Redundant Arrays of Inexpensive Disks Feb 8, 2007.
Chapter 6 RAID. Chapter 6 — Storage and Other I/O Topics — 2 RAID Redundant Array of Inexpensive (Independent) Disks Use multiple smaller disks (c.f.
DISKS IS421. DISK  A disk consists of Read/write head, and arm  A platter is divided into Tracks and sector  The R/W heads can R/W at the same time.
1 Database Systems Storage Media Asma Ahmad 21 st Apr, 11.
Storage & Peripherals Disks, Networks, and Other Devices.
CS 352 : Computer Organization and Design University of Wisconsin-Eau Claire Dan Ernst Storage Systems.
Redundant Array of Independent Disks
RAID: High-Performance, Reliable Secondary Storage Mei Qing & Chaoxia Liao Nov. 20, 2003.
L/O/G/O External Memory Chapter 3 (C) CS.216 Computer Architecture and Organization.
CSE431 Chapter 6A.1Irwin, PSU, 2008 Chapter 6A: Disk Systems Mary Jane Irwin ( ) [Adapted from Computer Organization.
I/O – Chapter 8 Introduction Disk Storage and Dependability – 8.2 Buses and other connectors – 8.4 I/O performance measures – 8.6.
1 Chapter 7: Storage Systems Introduction Magnetic disks Buses RAID: Redundant Arrays of Inexpensive Disks.
Disk Access. DISK STRUCTURE Sector: Smallest unit of data transfer from/to disk; 512B 2/4/8 adjacent sectors transferred together: Blocks Read/write heads.
RAID COP 5611 Advanced Operating Systems Adapted from Andy Wang’s slides at FSU.
Lecture 9 of Advanced Databases Storage and File Structure (Part II) Instructor: Mr.Ahmed Al Astal.
Parity Logging O vercoming the Small Write Problem in Redundant Disk Arrays Daniel Stodolsky Garth Gibson Mark Holland.
Redundant Array of Inexpensive Disks aka Redundant Array of Independent Disks (RAID) Modified from CCT slides.
Topic: Disks – file system devices. Rotational Media Sector Track Cylinder Head Platter Arm Access time = seek time + rotational delay + transfer time.
RAID Systems Ver.2.0 Jan 09, 2005 Syam. RAID Primer Redundant Array of Inexpensive Disks random, real-time, redundant, array, assembly, interconnected,
Auxiliary Memory Magnetic Disk:
CS 6290 I/O and Storage Milos Prvulovic. Storage Systems I/O performance (bandwidth, latency) –Bandwidth improving, but not as fast as CPU –Latency improving.
1 Lecture 27: Disks Today’s topics:  Disk basics  RAID  Research topics.
1 Lecture 23: Storage Systems Topics: disk access, bus design, evaluation metrics, RAID (Sections )
Chapter 14: Mass-Storage Systems Disk Structure. Disk Scheduling. RAID.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
LECTURE 13 I/O. I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access.
RAID Technology By: Adarsha A,S 1BY08A03. Overview What is RAID Technology? What is RAID Technology? History of RAID History of RAID Techniques/Methods.
CS422 Principles of Database Systems Disk Access Chengyu Sun California State University, Los Angeles.
Lecture 17 Raid. Device Protocol Variants Status checks: polling vs. interrupts Data: PIO vs. DMA Control: special instructions vs. memory-mapped I/O.
I/O Errors 1 Computer Organization II © McQuain RAID Redundant Array of Inexpensive (Independent) Disks – Use multiple smaller disks (c.f.
Storage HDD, SSD and RAID.
Module: Storage Systems
Disks and RAID.
CS 554: Advanced Database System Notes 02: Hardware
Chapter 10 Mass-Storage Structure
Lecture 13 I/O.
RAID RAID Mukesh N Tekwani
UNIT IV RAID.
Disks and scheduling algorithms
Mass-Storage Systems.
RAID RAID Mukesh N Tekwani April 23, 2019
Presentation transcript:

W4118 Operating Systems Instructor: Junfeng Yang

Disk  Goal  Learn how disks work  This knowledge will help us better understand tradeoffs in file systems  Disk Structure  Disk Interface  Disk Overhead  Disk Technology Trends  Redundant Arrays of Inexpensive Disks (RAID) 1

Moving-head Disk Structure

Disk Interface  Disk drives addressed as one-dimension of logical sectors  The logical sector is the smallest unit of transfer  This array is mapped sequentially onto disk sectors  Logical sector 0 is the 1 st sector of 1 st track of the outermost cylinder  Logical sector address incremented within track, then within tracks of cylinder, then across cylinders, from outermost to innermost  Precisely reverse-engineer this mapping in OS is difficult  Disk transparently remap defective sectors  Number of sectors per track is not a constant 3

Disk Overheads  To read from disk, disk controller computes cylinder #, surface #, sector #  Latency includes:  Seek time: to get to the track  Latency time: to get to the sector (rotation delay)  Transfer time: get bits off the disk Track Sector Seek Time Rotation Delay

Sequential v.s. Random  Overhead of sequential access  Seek to the right track  Rotate to the right sector  Transfer  Overhead of random access of the same amount of data  Seek to the right track  Rotate to the right sector  Transfer  Repeat  Since seek and rotate are slow, sequential access is much faster than random access 5

Modern Disk Parameters Barracuda 180Cheetah X15 36LP Capacity181GB36.7GB Disk/Heads12/244/8 Cylinders24,24718,479 Sectors/track~609~485 Speed7200 RPM15000 RPM Rotational latency (ms) Avg seek (ms) Track-2-track(ms)0.80.3

Disk Technology Trends  Data  More dense  More bits per square inch  Disk head closer to surface  Create smaller disk with same capacity  Disk geometry  smaller  Spin faster  Increase bandwidth, reduce rotational delay  Faster seek  Lighter weight  Disk price  cheaper  Density improving more than speed (mechanical limitations) 7

RAID Motivation  Performance  disks are slow compared to CPU  Disk speed improves slowly compared to CPU  Reliability  In single disk systems, one disk failure  data loss  Cost  A single fast, reliable disk is expensive 8

RAID Idea  RAID idea: use redundancy to improve performance and reliability  Redundant array of cheap disks as one storage unit  Fast: simultaneous read and write disks in the array  Reliable: use parity to detect and correct errors  RAID can have different redundancy levels, achieving different performance and reliability  Seven different RAID levels (0-6) 9

Evaluating RAID  Performance  Large Read  Large Write  Large Read-Modify-Write  Small Read  Small Write  Small Read-Modify-Write  Reliability  Tolerance of disk failures  Cost  Storage utilization: data capacity / total capacity 10

RAID 0: Non-redundant Striping  Structure  Data striped across all disks in an array  No parity  Advantages:  Good performance: with N disks, speed up N times  Disadvantages:  Poor reliability: one disk failure  data loss 11

RAID 1: Mirroring  Structure  Keep a mirrored (shadow) copy of data  Advantages  Good reliability: one disk failure OK  Good read performance  Disadvantage  High cost: one data disk requires one parity disk 12

RAID2: Error-Correction Parity  Structure  A data sector striped across data disks  Compute error-correcting parity and store in parity disks  Advantages  Good reliability with higher storage utilization than mirroring  Disadvantages  Cost still high  Poor small read, write, read-modify-write performance E.g., to read a data sector, must read a sector from each disk 13 parity disks

RAID3: Bit-Interleaved Parity  Structure  Each data sector striped across data disks  One parity disk (XOR of each stripe of a data sector)  Advantages  Same reliability with one disk failure as RAID2 since disk controller can determine what disk fails  High storage utilization  Disadvantages  Poor small read, write, read-modify-write performance 14

RAID4: Block-Interleaved Parity  Structure  A set of data sectors (parity group) striped across data disks  One parity disk (XOR of data sectors)  Advantages  Same reliability as RAID3 since disk controller can detect if sector is correct  Good small read performance  Disadvantages  Poor small write and read-modify-write performance All writes must write parity  parity disk is bottleneck 15 P

RAID5: Block-Interleaved Distributed Parity  Structure  Same as RAID4 except no single parity disk  Parity sectors distributed across all disks  Advantages  Good performance Good Small write and read-modify-write performance  Disadvantages  Only tolerate one disk failure 16 P P P P

RAID6: P+Q Redundancy  Structure  Same as RAID 5 except using two parity sectors per parity group  Advantages  Can tolerate two disk failures 17 P Q PQ PQ Q P

RAID Levels

New Mass Storage Technologies  Disk speed limited by mechanical parts  Seek and rotational delays  New memory-based mass storage technologies solve this problem  NAND Flash  Battery-backed DRAM (NVRAM)  Disadvantages  Price: still more expensive than same capacity disk  Reliability: more likely to lose data 19