Presented by: KAMONASISH HORE (100103003) RIPON DEB ROY (100103013) BINITA BONIA () PARTHA P. DAS (100103025) DHANJIT KALITA (100103032)

Slides:



Advertisements
Similar presentations
Faculty of Information Technology Department of Computer Science Computer Organization Chapter 7 External Memory Mohammad Sharaf.
Advertisements

RAID (Redundant Arrays of Independent Disks). Disk organization technique that manages a large number of disks, providing a view of a single disk of High.
RAID Oh yes Whats RAID? Redundant Array (of) Independent Disks. A scheme involving multiple disks which replicates data across multiple drives. Methods.
CS 6560: Operating Systems Design
Operating Systems ECE344 Ashvin Goel ECE University of Toronto Disks and RAID.
R.A.I.D. Copyright © 2005 by James Hug Redundant Array of Independent (or Inexpensive) Disks.
REDUNDANT ARRAY OF INEXPENSIVE DISCS RAID. What is RAID ? RAID is an acronym for Redundant Array of Independent Drives (or Disks), also known as Redundant.
Computer ArchitectureFall 2007 © November 28, 2007 Karem A. Sakallah Lecture 24 Disk IO and RAID CS : Computer Architecture.
CPSC-608 Database Systems Fall 2008 Instructor: Jianer Chen Office: HRBB 309B Phone: Notes #6.
1 Storage (cont’d) Disk scheduling Reducing seek time (cont’d) Reducing rotational latency RAIDs.
Lecture 17 I/O Optimization. Disk Organization Tracks: concentric rings around disk surface Sectors: arc of track, minimum unit of transfer Cylinder:
Recap of Feb 25: Physical Storage Media Issues are speed, cost, reliability Media types: –Primary storage (volatile): Cache, Main Memory –Secondary or.
Based on the slides supporting the text
Lecture 3: A Case for RAID (Part 1) Prof. Shahram Ghandeharizadeh Computer Science Department University of Southern California.
Computer ArchitectureFall 2008 © November 12, 2007 Nael Abu-Ghazaleh Lecture 24 Disk IO.
SECTIONS 13.1 – 13.3 Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin SECONDARY STORAGE MANAGEMENT.
1 Disk Scheduling Chapter 14 Based on the slides supporting the text.
Disks CS 416: Operating Systems Design, Spring 2001 Department of Computer Science Rutgers University
Secondary Storage CSCI 444/544 Operating Systems Fall 2008.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition Mass-Storage Systems Revised Tao Yang.
Physical Storage Organization. Advanced DatabasesPhysical Storage Organization2 Outline Where and How data are stored? –physical level –logical level.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
Introduction to Database Systems 1 The Storage Hierarchy and Magnetic Disks Storage Technology: Topic 1.
12.1 Silberschatz, Galvin and Gagne ©2009 Operating System Concepts with Java – 8 th Edition Chapter 12: Mass-Storage Systems.
Secondary Storage Unit 013: Systems Architecture Workbook: Secondary Storage 1G.
CS4432: Database Systems II Data Storage (Better Block Organization) 1.
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 6 – RAID ©Manuel Rodriguez.
CS 346 – Chapter 10 Mass storage –Advantages? –Disk features –Disk scheduling –Disk formatting –Managing swap space –RAID.
1 Database Systems Storage Media Asma Ahmad 21 st Apr, 11.
CS 352 : Computer Organization and Design University of Wisconsin-Eau Claire Dan Ernst Storage Systems.
1 Recitation 8 Disk & File System. 2 Disk Scheduling Disks are at least four orders of magnitude slower than main memory –The performance of disk I/O.
Redundant Array of Independent Disks
L/O/G/O External Memory Chapter 3 (C) CS.216 Computer Architecture and Organization.
Physical Storage and File Organization COMSATS INSTITUTE OF INFORMATION TECHNOLOGY, VEHARI.
I/O – Chapter 8 Introduction Disk Storage and Dependability – 8.2 Buses and other connectors – 8.4 I/O performance measures – 8.6.
Disk Access. DISK STRUCTURE Sector: Smallest unit of data transfer from/to disk; 512B 2/4/8 adjacent sectors transferred together: Blocks Read/write heads.
Lecture 9 of Advanced Databases Storage and File Structure (Part II) Instructor: Mr.Ahmed Al Astal.
©Silberschatz, Korth and Sudarshan11.1Database System Concepts Magnetic Hard Disk Mechanism NOTE: Diagram is schematic, and simplifies the structure of.
Disk Structure Disk drives are addressed as large one- dimensional arrays of logical blocks, where the logical block is the smallest unit of transfer.
CE Operating Systems Lecture 20 Disk I/O. Overview of lecture In this lecture we will look at: Disk Structure Disk Scheduling Disk Management Swap-Space.
Disks Chapter 5 Thursday, April 5, Today’s Schedule Input/Output – Disks (Chapter 5.4)  Magnetic vs. Optical Disks  RAID levels and functions.
RAID SECTION (2.3.5) ASHLEY BAILEY SEYEDFARAZ YASROBI GOKUL SHANKAR.
Physical Storage Organization. Advanced DatabasesPhysical Storage Organization2 Outline Where and How data are stored? –physical level –logical level.
Chapter 12 – Mass Storage Structures (Pgs )
The concept of RAID in Databases By Junaid Ali Siddiqui.
Chapter 14: Mass-Storage Systems Disk Structure. Disk Scheduling. RAID.
CS399 New Beginnings Jonathan Walpole. Disk Technology & Secondary Storage Management.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
Part IV I/O System Chapter 12: Mass Storage Structure.
W4118 Operating Systems Instructor: Junfeng Yang.
LECTURE 13 I/O. I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access.
Data Storage and Querying in Various Storage Devices.
Magnetic Disks Have cylinders, sectors platters, tracks, heads virtual and real disk blocks (x cylinders, y heads, z sectors per track) Relatively slow,
Storage HDD, SSD and RAID.
Storage Overview of Physical Storage Media Magnetic Disks RAID
Disks and RAID.
I/O System Chapter 5 Designed by .VAS.
CS 554: Advanced Database System Notes 02: Hardware
Operating System I/O System Monday, August 11, 2008.
Performance Measures of Disks
Chapter 14 Based on the slides supporting the text
RAID RAID Mukesh N Tekwani
Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin
ICOM 6005 – Database Management Systems Design
Overview Continuation from Monday (File system implementation)
Module 10: Physical Storage Systems
Mass-Storage Systems.
CS333 Intro to Operating Systems
RAID RAID Mukesh N Tekwani April 23, 2019
Disk Scheduling The operating system is responsible for using hardware efficiently — for the disk drives, this means having a fast access time and disk.
Presentation transcript:

Presented by: KAMONASISH HORE ( ) RIPON DEB ROY ( ) BINITA BONIA () PARTHA P. DAS ( ) DHANJIT KALITA ( )

YOUR DATA IS  Do U hav backups of all ur data...??? -The stuff u cannot afford to loose...!!  How often do u backups...??? -Daily,Weekly or Monthly... ??  Are they magnetic,optical or physical...??  How long would it take to totally recover from the disaster...??

RAID : REDUNDANT ARRAY OF INEXPENSIVE DISKS In 1987,Patterson,Gibson and Katz at the University of California Berkeley, published a paper entitled “A Case for Redundant Array of Inexpensive Disks (RAID)” The basic idea of RAID was to combine multiple, small inexpensive disks drive into an array of disks which yeilds performance exceeding that of a Single,Large Expensive Drive(SLED). Additionally this array of drives appers to the computer as a single logical storage unit or drive.

SOFTWARE AND HARDWARE RAID can be Software, Hardware or a combination of both. Generally speaking, Software RAID tends to offer duplication or mirroring, whilst Hardware RAID offers Parity-based protection. Software RAID uses more system resources as more disk ports and channels are required and it is subject to additional load during write and copy operations. Software RAID may have a lower cost than hardware RAID because it has no dedicated RAID controller, but may not have the same hotfix or performance capabilities. Software RAID is needed for mirroring to remote locations.

RAID 0  Striping at the level of blocks.  Data split across in drives resulting in higher data throughout.  Performance is very good but the failure of any disc in the array result in data loss.  RAID 0 commonly referred to as striping.  Reliability Problems : No mirroring or parity bits.

RAID 0

RAID 1 Introduce redundancy through mirroring. Expensive Performance Issues -No data loss if either drive fails. -Good read performance. -Resonable write performance. -Cost/Mb is high. -Commonly refrenced as “Mirroring”

RAID 1

RAID 2 Uses Hamming (or any other) error-correcting code(ECC) Intended for use in drives which do not have built-in error detection. Central idea is if one of the disc fails the remaining bits of byte are the associated ECC bits can be used to reconstruct the data. Not very popular.

RAID 2

RAID 3 Improves upon RAID 2,known as Bit-Interleaved Parity. Disc controller can detect whether a sector has been read correctly. Storage overhead is reduced – onlu 1 parity disk. Expenses of computing and writing parity. Need to include a dedicated parity hardware.

RAID 3

RAID 4 Stripes data at a block level across several drives, with parity stored on one drive – block interleaved parity. Allow recovery from the failure of any disks. Performance is very good for reads. Writes require that parity data be updated each time. Slows small random writes but large writes are fairly fast.

RAID 4

RAID 5 Block-interleaved Distributed parity. Spreads data and parity among all N+1 disks,rather than storing data in N disks and parity in 1 disk. Avoids potential overuse of a single parity disk- improvement over RAID 4. Most common parity RAID system.

RAID 5

RAID 6 Double-parity RAID, commonly known a s RAID 6,safeguards against data loss by allowing up to two consecutive drive failures.

CONCLUSION RAIDs offers a cost effective option to meet the challenge of exponential growth in the processor and memory speed. We believe the size reduction of personal computer is a key to success of disks arrays, just as Gordon Bell argues that the size reduction of microprocessors is a key to success in multiprocessors. With advantages in cost-performance, reliability,power consumption, and modular growth, we except RAIDs to replace SLEDs in future I/O Systems..

PERFORMANCE MEASURE OF DISKS  The main measures of the qualities of disk are : 1. Access Time 2. Data Transfer Rate 3. Reliability

ACCESS TIME  The time from when a read or write request is issued to when data transfer begins. Consists of :  Seek time  Average seek time  Rotational latency or Rotational Delay.

SEEK TIME  To access data on a given sector of a disk, the arm first must move so that it is positioned over the correct track, and then must wait for the sector to appear under it as the disk rotates.  The time for repositioning the arm is called seek time.  Typical seek time range from 2 to 30 milliseconds

AVERAGE SEEK TIME  The average of the seek time, measured over a sequence of random requests.  It is about one third of the worst case seek time.

ROTIONAL LATENCY  Once the seek has occurred, the time spent waiting for the sector to be accesses to appear under the head is called rotational latency time.  Typical rotational speed of disks range from 6 to 120 rotations per second or 4 to 11 millisecond.

DATA TRANSFER RATE  Data transfer rate is the rate at which data can be retrieved from or stored to the disk.  Current disk system support transfer rate from 1 to 5 megabyte per second.  Data transfer rate depends on “data rate” and “transfer size”. Two kinds of data rate:  Media rate  Interface rate

MEDIA RATE  Media rate depends on recording density and rotational speed.  For example, a disk rotating at 5,400 rpm with 111 sectors(512byte each)per track will have a media rate 5Mbyte per second.

INTERFACE RATE  Interface rate is how fast data can be transferred between the host and the disk drive over its interface.  SCSI drives can do upto 20Mbyte per second over each 8-bite-wide transfer.  IDE drives with the Ultra ATA interface support upto 33.3Mbytes per second.

TRANSFER TIME  Transfer time equals to transfer size divided by data rate.  The average media transfer time is 0.8ms, the average interface transfer time is 0.4ms.  For example, the typical average time to do a random 4-kbyte I/O is.  Overhead+seek+latency+transfer= 0.5ms+10ms+5.6ms+0.8ms=16.9ms.

RELIABILITY  Measured by the mean time to failure.  Mean Time To Failure(MTTF):-  The average time the disk is expected to run continuously without any failure.  Typically 3 to 5 years.  The typical mean time to failure of disks today ranges from 30,000 to 800,000 hours.

OPTIMISATION OF DISK- BLOCK ACCESS  Block - A contiguous sequence of sectors from a single track.  Data is transferred between disk and main memory in blocks.  Size range from 512 bytes to several kilobytes. → Smaller blocks-more transfers from disk → Larger blocks -more space wasted due to partially filled blocks → Typical block sizes today range from 4 to 16 kilobytes  Access to data on disk is slower than access to data in main memory.  Techniques developed for improving the speed of access to blocks on disk.

An Ordinary disk

MAGNETIC HARD DISK MECHANISM NOTE: Diagram is schematic, and simplifies the structure of actual disk drives

 Buffering: buffer is that part of main memory available for storage of copies of disk blocks →There is always a copy kept on disk of every block, but the copy on disk may be a version of the block older than the version in the buffer → S ubsystem responsible for the allocation of buffer space is called the buffer manager.  Scheduling : If several blocks from a cylinder need to be transferred from disk to main memory →Save access time by requesting the blocks in the order in which they will pass under the heads

→ if the desired blocks are on different cylinders, it is advantageous to request the blocks in an order that minimizes disk-arm movement.  Disk-arm-scheduling algorithms order pending accesses to tracks so that disk arm movement is minimized  Elevator algorithm : commonly used algorithm that move disk arm in one direction (from outer to inner tracks or vice versa), processing next request in that direction, till no more requests in that direction, then reverse direction and repeat  File organization - optimize block access time by organizing the blocks to correspond to how data will be accessed

 E.g. Store related information on the same or nearby cylinders. Files may get fragmented over time → E.g. if data is inserted to/deleted from the file → Or free blocks on disk are scattered, and newly created file has its blocks scattered over the disk → Sequential access to a fragmented file results in increased disk arm movement  Some systems have utilities to defragment the file system, in order to speed up file access  Nonvolatile write buffers -speed up disk writes by writing blocks to a non volatile RAM buffer immediately  Non-volatile RAM: battery backed up RAM or flash memory → Even if power fails, the data is safe and will be written to disk when power returns

 Controller then writes to disk whenever the disk has no other requests or request has been pending for some time  Database operations that require data to be safely stored before continuing can continue without waiting for data to be written to disk  Writes can be reordered to minimize disk arm movement  Log disk -a disk devoted to writing a sequential log of block updates  Used exactly like nonvolatile RAM → Write to log disk is very fast since no seeks are required → No need for special hardware [NV(Non Volatile)-RAM]

 File systems typically reorder writes to disk to improve performance  Journaling file systems, write data in safe order to NV-RAM or log disk  Reordering without journaling: risk of corruption of file system data  Log-based file system, data are not written back to their original destination on disk  T he file system keeps track of where in the log disk the blocks were written most recently, and retrieves them from that location

Example of disk blocks being defragmented