File management and Performance. File Systems Architecture device drivers physical I/O (PIOCS) logical I/O (LIOCS) access methods File organization and.

Slides:



Advertisements
Similar presentations
Storage Management Lecture 7.
Advertisements

I/O Management and Disk Scheduling Chapter 11. I/O Driver OS module which controls an I/O device hides the device specifics from the above layers in the.
Faculty of Information Technology Department of Computer Science Computer Organization Chapter 7 External Memory Mohammad Sharaf.
RAID (Redundant Arrays of Independent Disks). Disk organization technique that manages a large number of disks, providing a view of a single disk of High.
Magnetic Disk Magnetic disks are the foundation of external memory on virtually all computer systems. A disk is a circular platter constructed of.
RAID Redundant Array of Independent Disks
CS 6560: Operating Systems Design
Raid dr. Patrick De Causmaecker What is RAID Redundant Array of Independent (Inexpensive) Disks A set of disk stations treated as one.
CSCE430/830 Computer Architecture
Operating Systems ECE344 Ashvin Goel ECE University of Toronto Disks and RAID.
File Management Lecture 3.
Lecture 36: Chapter 6 Today’s topic –RAID 1. RAID Redundant Array of Inexpensive (Independent) Disks –Use multiple smaller disks (c.f. one large disk)
File Systems.
CMPT 300: Final Review Chapters 8 – Memory Management: Ch. 8, 9 Address spaces Logical (virtual): generated by the CPU Physical: seen by the memory.
File Management Systems
1 Storage (cont’d) Disk scheduling Reducing seek time (cont’d) Reducing rotational latency RAIDs.
1 Storage Hierarchy Cache Main Memory Virtual Memory File System Tertiary Storage Programs DBMS Capacity & Cost Secondary Storage.
1 File Management in Representative Operating Systems.
Memory Management Chapter 5.
Virtual Memory Deung young, Moon ELEC 5200/6200 Computer Architecture and Design Lectured by Dr. V. Agrawal Lectured by Dr. V.
Disks CS 416: Operating Systems Design, Spring 2001 Department of Computer Science Rutgers University
Secondary Storage CSCI 444/544 Operating Systems Fall 2008.
File System Implementation
1 I/O Management in Representative Operating Systems.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
Storage System: RAID Questions answered in this lecture: What is RAID? How does one trade-off between: performance, capacity, and reliability? What is.
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 6 – RAID ©Manuel Rodriguez.
RAID Ref: Stallings. Introduction The rate in improvement in secondary storage performance has been considerably less than the rate for processors and.
CSE 321b Computer Organization (2) تنظيم الحاسب (2) 3 rd year, Computer Engineering Winter 2015 Lecture #4 Dr. Hazem Ibrahim Shehata Dept. of Computer.
Redundant Array of Independent Disks
RAID: High-Performance, Reliable Secondary Storage Mei Qing & Chaoxia Liao Nov. 20, 2003.
Chapter 5 Part 2 Secondary Storage Mgt. File Mgt. in Popular OSs
Operating System Chapter 7. Memory Management Lynn Choi School of Electrical Engineering.
N-Tier Client/Server Architectures Chapter 4 Server - RAID Copyright 2002, Dr. Ken Hoganson All rights reserved. OS Kernel Concept RAID – Redundant Array.
Disk Access. DISK STRUCTURE Sector: Smallest unit of data transfer from/to disk; 512B 2/4/8 adjacent sectors transferred together: Blocks Read/write heads.
Lecture 9 of Advanced Databases Storage and File Structure (Part II) Instructor: Mr.Ahmed Al Astal.
1 Lecture 8: Secondary-Storage Structure 2 Disk Architecture Cylinder Track SectorDisk head rpm.
Chapter pages1 File Management Chapter 12.
Memory Management – Page 1 of 49CSCI 4717 – Computer Architecture Memory Management Uni-program – memory split into two parts –One for Operating System.
RAID SECTION (2.3.5) ASHLEY BAILEY SEYEDFARAZ YASROBI GOKUL SHANKAR.
IMS 4212: Database Implementation 1 Dr. Lawrence West, Management Dept., University of Central Florida Physical Database Implementation—Topics.
Redundant Array of Independent Disks.  Many systems today need to store many terabytes of data.  Don’t want to use single, large disk  too expensive.
1 File Management Chapter File Management n File management system consists of system utility programs that run as privileged applications n Concerned.
Chapter 8 CPU and Memory: Design, Implementation, and Enhancement The Architecture of Computer Hardware and Systems Software: An Information Technology.
File Storage Organization The majority of space on a device is reserved for the storage of files. When files are created and modified physical blocks are.
By Teacher Asma Aleisa Year 1433 H.   Goals of memory management  To provide a convenient abstraction for programming.  To allocate scarce memory.
File Structures. 2 Chapter - Objectives Disk Storage Devices Files of Records Operations on Files Unordered Files Ordered Files Hashed Files Dynamic and.
File management. File Systems Architecture device drivers physical I/O (PIOCS) logical I/O (LIOCS) access methods File organization and access l sequential.
Improving Disk Throughput in Data-Intensive Servers Enrique V. Carrera and Ricardo Bianchini Department of Computer Science Rutgers University.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
Introduction to RAID Rogério Perino de Oliveira Neves Patrick De Causmaecker
Part IV I/O System Chapter 12: Mass Storage Structure.
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
Lecture 3 Secondary Storage and System Software I
CS422 Principles of Database Systems Disk Access Chengyu Sun California State University, Los Angeles.
File organization Secondary Storage Devices Lec#7 Presenter: Dr Emad Nabil.
Understanding Operating Systems Seventh Edition
Multiple Platters.
External Memory.
RAID, Programmed I/O, Interrupt Driven I/O, DMA, Operating System
Database Management System
26 - File Systems.
Operating System I/O System Monday, August 11, 2008.
RAID RAID Mukesh N Tekwani
Chapter 15 – Part 1 The Internal Operating System
UNIT IV RAID.
Mark Zbikowski and Gary Kimura
RAID RAID Mukesh N Tekwani April 23, 2019
File System Implementation
Storage Management Lecture 7.
Presentation transcript:

File management and Performance

File Systems Architecture device drivers physical I/O (PIOCS) logical I/O (LIOCS) access methods File organization and access l sequential l index-sequential l direct

File sharing and blocking n File sharing – access rights: read, write, execute, by user classes. – File/record locking: simultaneous access n Record blocking – Logical vs physical record – unblocked vs blocked record – fixed-lenght vs variable-lenght IRG block data IBG block data IBG IRG

File allocation n File allocation table (FAT) n Pre allocation vs dynamic allocation n Portion size – contiguity increases performance – fixed-size portions simplify reallocation – variable-size or small fixed-size minimizes waste of unused space for overallocation – two main alternatives: l variable, large contiguous portions (performance) l small fixed portions (flexibility) n File fragmentation and reorganization

Redundant Array of Independent/ Inexpensive Disks (RAID) RAID is a set of physical disk drives viewed by the OS as a single logical drive Data are distributed across the physical drives of an array Redundant disk capacity is used to store parity information, which guarantees data recovery RAID Levels: various levels of performance and redundancyRAID Levels –the disks are divided in strips: physical blocks, sectors, or similar –the strips are mapped round robin on the array –I/O requests can be processed in parallel strip 0 strip 4 strip 8 strip 12 strip 1 strip 5 strip 9 strip 13 strip 2 strip 6 strip 10 strip 14 strip 3 strip 7 strip 11 strip 15

Performance n How effective is the OS in managing resources? n Overall performance measures: – turnaround time – response time – throughput – workload – capacity – utilization n Bottlenecks

Evaluation Techniques n Timings (hardware) n Instruction mix (software mix) n Kernel (typical program) n Benchmarks (comparison between systems) n Synthetic programs n Analytical models and simulation n Commercial performance packages

Performance enhancement n coprocessing n parallel processing n the RISC vs CISC controversy – CISC l frequently used code as (complex) instructions l increase lower level programming productivity l extensive market penetration – RISC l very few of the complex instructions are used (empirical studies) l therefore a reduced instruction set is more efficient l programs are 20% larger, requiring more disk space and memory l much more registers are needed, but speed of programs written for RISC is close to twice of equivalent for CISC. l facilitate scalability