CSE 451: Operating Systems Spring 2005 Module 13 Secondary Storage

Slides:



Advertisements
Similar presentations
Disk Storage SystemsCSCE430/830 Disk Storage Systems CSCE430/830 Computer Architecture Lecturer: Prof. Hong Jiang Courtesy of Yifeng Zhu (U. Maine) Fall,
Advertisements

CS 6560: Operating Systems Design
Operating Systems ECE344 Ashvin Goel ECE University of Toronto Disks and RAID.
Disk Drivers May 10, 2000 Instructor: Gary Kimura.
Disks.
1 File System Implementations. 2 Overview The Low Level –disks –caching –RAM disks –RAIDs –disk head scheduling The higher level –file systems –directories.
Disks CS 416: Operating Systems Design, Spring 2001 Department of Computer Science Rutgers University
Secondary Storage CSCI 444/544 Operating Systems Fall 2008.
Secondary Storage Management Hank Levy. 8/7/20152 Secondary Storage • Secondary Storage is usually: –anything outside of “primary memory” –storage that.
Introduction to Database Systems 1 The Storage Hierarchy and Magnetic Disks Storage Technology: Topic 1.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 12: Mass-Storage Systems.
12.1 Silberschatz, Galvin and Gagne ©2009 Operating System Concepts with Java – 8 th Edition Chapter 12: Mass-Storage Systems.
Disk and I/O Management
Device Management. So far… We have covered CPU and memory management Computing is not interesting without I/Os Device management: the OS component that.
CS 153 Design of Operating Systems Spring 2015 Lecture 20: File Systems.
Silberschatz, Galvin and Gagne ©2013 Operating System Concepts – 9 th Edition Chapter 10: Mass-Storage Systems.
IT 344: Operating Systems Winter 2010 Module 13 Secondary Storage Chia-Chi Teng CTB 265.
Disks and Storage Systems
Silberschatz, Galvin, and Gagne  Applied Operating System Concepts Ref: Chap 12 Secondary Storage and I/O Systems.
OPERATING SYSTEMS IO SYSTEMS. Categories of I/O Devices Human readable –Used to communicate with the user –Printers –Video display terminals Display Keyboard.
CSE 451: Operating Systems Winter 2015 Module 14 Secondary Storage Mark Zbikowski Allen Center 476 © 2013 Gribble, Lazowska, Levy,
1.  Disk Structure Disk Structure  Disk Scheduling Disk Scheduling  FCFS FCFS  SSTF SSTF  SCAN SCAN  C-SCAN C-SCAN  C-LOOK C-LOOK  Selecting a.
Operating Systems (CS 340 D) Princess Nora University Faculty of Computer & Information Systems Computer science Department.
Device Management Mark Stanovich Operating Systems COP 4610.
Disk Scheduling The operating system is responsible for using hardware efficiently — for the disk drives, this means having a fast access time and disk.
CSE 451: Operating Systems Winter 2012 Secondary Storage Mark Zbikowski Gary Kimura.
Device Management Andy Wang Operating Systems COP 4610 / CGS 5765.
CSE 451: Operating Systems Spring 2006 Module 14 From Physical to Logical: File Systems John Zahorjan Allen Center 534.
CSE 451: Operating Systems Spring 2010 Module 12.5 Secondary Storage John Zahorjan Allen Center 534.
Chapter 10: Mass-Storage Systems
Operating System (013022) Dr. H. Iwidat
Sarah Diesburg Operating Systems CS 3430
Disks and RAID.
Operating Systems Disk Scheduling A. Frank - P. Weisberg.
OPERATING SYSTEMS CS 3502 Fall 2017
Secondary Storage Secondary storage typically: Characteristics:
CS703 - Advanced Operating Systems
CPSC-608 Database Systems
Disk Scheduling Algorithms
Mass-Storage Structure
IT 344: Operating Systems Winter 2008 Module 13 Secondary Storage
Disks and Files DBMS stores information on (“hard”) disks.
Chapter 14 Based on the slides supporting the text
CSE 153 Design of Operating Systems Winter 2018
Operating Systems (CS 340 D)
Disk Scheduling The operating system is responsible for using hardware efficiently — for the disk drives, this means having a fast access time and disk.
CSE 451: Operating Systems Winter 2006 Module 13 Secondary Storage
CSE 451: Operating Systems Autumn 2009 Module 13 Secondary Storage
CSE 451: Operating Systems Autumn 2003 Lecture 12 Secondary Storage
CSE 451: Operating Systems Winter 2007 Module 13 Secondary Storage
CSE 451: Operating Systems Spring 2006 Module 13 Secondary Storage
Disks and scheduling algorithms
Secondary Storage Management Brian Bershad
Persistence: hard disk drive
CSE 451: Operating Systems Secondary Storage
CSE 451: Operating Systems Winter 2003 Lecture 12 Secondary Storage
Disks and Storage Systems
CSE 451: Operating Systems Winter 2009 Module 12 Secondary Storage
Secondary Storage Management Hank Levy
CSE451 File System Introduction and Disk Drivers Autumn 2002
CSE 451: Operating Systems Autumn 2004 Secondary Storage
CSE 451: Operating Systems Winter 2004 Module 13 Secondary Storage
CSE 451: Operating Systems Spring 2006 Module 14 From Physical to Logical: File Systems John Zahorjan Allen Center
Lecture 10: Magnetic Disks
Operating Systems 2019 Spring by Euiseong Seo
CSE 451: Operating Systems Spring 2007 Module 11 Secondary Storage
Disks Magnetic (hard) Disk arrays are used for reliable storage (RAID)
Andy Wang Operating Systems COP 4610 / CGS 5765
CS 245: Database System Principles Notes 02: Hardware
Operating Systems Disk Scheduling A. Frank - P. Weisberg.
Presentation transcript:

CSE 451: Operating Systems Spring 2005 Module 13 Secondary Storage Ed Lazowska lazowska@cs.washington.edu Allen Center 570 1

© 2005 Gribble, Lazowska, Levy Secondary storage Secondary storage typically: is anything that is outside of “primary memory” does not permit direct execution of instructions or data retrieval via machine load/store instructions Characteristics: it’s large: 30-250GB it’s cheap: $1/GB it’s persistent: data survives power loss it’s slow: milliseconds to access why is this slow?? 4/20/2019 © 2005 Gribble, Lazowska, Levy

Another trip down memory lane … IBM 2314 About the size of 6 refrigerators 8 x 29MB (M!) 4/20/2019 © 2005 Gribble, Lazowska, Levy

© 2005 Gribble, Lazowska, Levy Disk trends Disk capacity, 1975-1989 doubled every 3+ years 25% improvement each year factor of 10 every decade exponential, but far less rapid than processor performance Disk capacity since 1990 doubling every 12 months 100% improvement each year factor of 1000 every decade 10x as fast an improvement as processor performance! 4/20/2019 © 2005 Gribble, Lazowska, Levy

© 2005 Gribble, Lazowska, Levy Only a few years ago, we purchased disks by the megabyte (and it hurt!) Today, 1 GB (a billion bytes) costs $1 from Dell (except you have to buy in increments of 20 GB) => 1 TB costs $1K, 1 PB costs $1M In 3 years, 1 GB will cost $.10 => 1 TB for $100, 1 PB for $100K 4/20/2019 © 2005 Gribble, Lazowska, Levy

© 2005 Gribble, Lazowska, Levy Memory hierarchy 100 bytes CPU registers 1 ns 32KB L1 cache 1 ns 256KB L2 cache 4 ns 1GB Primary Memory 60 ns 100GB Secondary Storage 10+ ms Tertiary Storage 1s-1hr 1-1000TB Each level acts as a cache of lower levels 4/20/2019 © 2005 Gribble, Lazowska, Levy

Memory hierarchy: distance analogy CPU registers “My head” 1 1 minute L1 cache “This room” 10 minutes L2 cache “This building” 1.5 hours Primary Memory Olympia 2 years Secondary Storage Pluto Tertiary Storage 2,000 years Andromeda 4/20/2019 © 2005 Gribble, Lazowska, Levy

4/20/2019 © 2005 Gribble, Lazowska, Levy © 2004 Jim Gray, Microsoft Corporation

© 2005 Gribble, Lazowska, Levy Disks and the OS Disks are messy, messy devices errors, bad blocks, missed seeks, etc. Job of OS is to hide this mess from higher-level software low-level device drivers (initiate a disk read, etc.) higher-level abstractions (files, databases, etc.) OS may provide different levels of disk access to different clients physical disk block (surface, cylinder, sector) disk logical block (disk block #) file logical (filename, block or record or byte #) 4/20/2019 © 2005 Gribble, Lazowska, Levy

Physical disk structure Disk components platters surfaces tracks sectors cylinders arm heads sector track surface cylinder platter arm head 4/20/2019 © 2005 Gribble, Lazowska, Levy

© 2005 Gribble, Lazowska, Levy Disk performance Performance depends on a number of steps seek: moving the disk arm to the correct cylinder depends on how fast disk arm can move seek times aren’t diminishing very quickly (why?) rotation (latency): waiting for the sector to rotate under head depends on rotation rate of disk rates are increasing, but slowly (why?) transfer: transferring data from surface into disk controller, and from there sending it back to host depends on density of bytes on disk increasing, and very quickly When the OS uses the disk, it tries to minimize the cost of all of these steps particularly seeks and rotation 4/20/2019 © 2005 Gribble, Lazowska, Levy

© 2005 Gribble, Lazowska, Levy Disk scheduling Seeks are very expensive, so the OS attempts to schedule disk requests that are queued waiting for the disk FCFS (do nothing) reasonable when load is low long waiting time for long request queues SSTF (shortest seek time first) minimize arm movement (seek time), maximize request rate unfairly favors middle blocks SCAN (elevator algorithm) service requests in one direction until done, then reverse skews wait times non-uniformly (why?) C-SCAN like scan, but only go in one direction (typewriter) uniform wait times 4/20/2019 © 2005 Gribble, Lazowska, Levy

Interacting with disks In the old days… OS would have to specify cylinder #, sector #, surface #, transfer size i.e., OS needs to know all of the disk parameters Modern disks are even more complicated not all sectors are the same size, sectors are remapped, … disk provides a higher-level interface, e.g., SCSI exports data as a logical array of blocks [0 … N] maps logical blocks to cylinder/surface/sector OS only needs to name logical block #, disk maps this to cylinder/surface/sector on-board cache as a result, physical parameters are hidden from OS both good and bad 4/20/2019 © 2005 Gribble, Lazowska, Levy

Example disk characteristics IBM Ultrastar 36XP drive form factor: 3.5” capacity: 36.4 GB (150x those 6 fridges!) rotation rate: 7,200 RPM (120 RPS) platters: 10 surfaces: 20 sector size: 512-732 bytes (why?) cylinders: 11,494 cache: 4MB transfer rate: 17.9 MB/s (inner) – 28.9 MB/s (outer) (why?) full seek: 14.5 ms head switch: 0.3 ms 4/20/2019 © 2005 Gribble, Lazowska, Levy