SECTIONS 13.1 – 13.3 Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin SECONDARY STORAGE MANAGEMENT.

Slides:



Advertisements
Similar presentations
Storing Data: Disk Organization and I/O
Advertisements

13.2 Disks Gaurav Sharma Class ID Mechanics of Disks 2 Moving Principal Moving pieces of Disk are: 1. Disk assembly & 2. Head Assembly The.
Lecture # 7. Topics Storage Techniques of Bits Storage Techniques of Bits Mass Storage Mass Storage Disk System Performance Disk System Performance File.
- Dr. Kalpakis CMSC Dr. Kalpakis 1 Outline In implementing DBMS we need to answer How should the system store and manage very large amounts of data?
Storing Data: Disks and Files: Chapter 9
OPERATING SYSTEMS CS3530 Summer 2014 OPERATING SYSTEMS CS3530 Summer 2014 Input/Output System Chapter 9.
The Memory Hierarchy fastest, perhaps 1Mb
Storage. The Memory Hierarchy fastest, but small under a microsecond, random access, perhaps 2Gb Typically magnetic disks, magneto­ optical (erasable),
CS4432: Database Systems II Data Storage - Lecture 2 (Sections 13.1 – 13.3) Elke A. Rundensteiner.
1 Advanced Database Technology February 12, 2004 DATA STORAGE (Lecture based on [GUW ], [Sanders03, ], and [MaheshwariZeh03, ])
SECTION 13.3 Eilbroun Benjamin CS 257 – Dr. TY Lin SECONDARY STORAGE MANAGEMENT.
13.2 Disks Mechanics of Disks Presented by Chao-Hsin Shih Feb 21, 2011.
OS2-1 Chapter 2 Computer System Structures. OS2-2 Outlines Computer System Operation I/O Structure Storage Structure Storage Hierarchy Hardware Protection.
1 Storing Data: Disks and Files Yanlei Diao UMass Amherst Feb 15, 2007 Slides Courtesy of R. Ramakrishnan and J. Gehrke.
1 Storage Hierarchy Cache Main Memory Virtual Memory File System Tertiary Storage Programs DBMS Capacity & Cost Secondary Storage.
SECTIONS 13.1 – 13.3 Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin SECONDARY STORAGE MANAGEMENT.
CS4432: Database Systems II Lecture 2 Timothy Sutherland.
CPSC-608 Database Systems Fall 2009 Instructor: Jianer Chen Office: HRBB 309B Phone: Notes #5.
CPSC-608 Database Systems Fall 2010 Instructor: Jianer Chen Office: HRBB 315C Phone: Notes #5.
1 CS222: Principles of Database Management Fall 2010 Professor Chen Li Department of Computer Science University of California, Irvine Notes 01.
Data Storage Technology
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
Storage. The Memory Hierarchy fastest, but small under a microsecond, random access, perhaps 512Mb Access times in milliseconds, great variability. Unit.
Introduction to Database Systems 1 The Storage Hierarchy and Magnetic Disks Storage Technology: Topic 1.
CS4432: Database Systems II Data Storage (Better Block Organization) 1.
Chapter 2 Data Storage How does a computer system store and manage very large volumes of data ?
Lecture 11: DMBS Internals
Physical Storage and File Organization COMSATS INSTITUTE OF INFORMATION TECHNOLOGY, VEHARI.
Disk Storage Copyright © 2004 Pearson Education, Inc.
1 Secondary Storage Management Submitted by: Sathya Anandan(ID:123)
Chapter 111 Chapter 11: Hardware (Slides by Hector Garcia-Molina,
1 Chapter 17 Disk Storage, Basic File Structures, and Hashing Chapter 18 Index Structures for Files.
CS 6502 Operating Systems Dr. J.. Garrido Device Management (Lecture 7b) CS5002 Operating Systems Dr. Jose M. Garrido.
Overview of Physical Storage Media
1/14/2005Yan Huang - CSCI5330 Database Implementation – Storage and File Structure Storage and File Structure.
Database Management Systems,Shri Prasad Sawant. 1 Storing Data: Disks and Files Unit 1 Mr.Prasad Sawant.
2.1 Operating System Concepts Chapter 2: Computer-System Structures Computer System Operation Storage Structure Storage Hierarchy Hardware Protection General.
© 2005 Pearson Addison-Wesley. All rights reserved Figure 2.1 This chapter focuses on key hardware layer components.
Chapter 13 Disk Storage, Basic File Structures, and Hashing. Copyright © 2004 Pearson Education, Inc.
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
CS4432: Database Systems II Data Storage 1. Storage in DBMSs DBMSs manage large amounts of data How does a DBMS store and manage large amounts of data?
CPSC-608 Database Systems Fall 2015 Instructor: Jianer Chen Office: HRBB 315C Phone: Notes #5.
By : Reem Hasayen. A storage device is a hardware device capable of storing information. There are two types of storage devices used in computers 1. Primary.
Section 13.2 – Secondary storage management (Former Student’s Note)
Section 13.1 – Secondary storage management (Former Student’s Note)
DMBS Internals I February 24 th, What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the.
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
DMBS Architecture May 15 th, Generic Architecture Query compiler/optimizer Execution engine Index/record mgr. Buffer manager Storage manager storage.
Section 13.2 – Secondary storage management. Index 13.2 Disks Mechanics of Disks The Disk Controller Disk Access Characteristics.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
COSC 6340: Disks 1 Disks and Files DBMS stores information on (“hard”) disks. This has major implications for DBMS design! » READ: transfer data from disk.
1 Lecture 16: Data Storage Wednesday, November 6, 2006.
Data Storage and Querying in Various Storage Devices.
File organization Secondary Storage Devices Lec#7 Presenter: Dr Emad Nabil.
Copyright © 2007 Ramez Elmasri and Shamkant B. Navathe Lec 5 part1 Disk Storage, Basic File Structures, and Hashing.
Computer System Structures Storage
CHAPTER 10: Computer Peripherals
Section 13.2 – Secondary storage management (Former Student’s Note)
Chapter 2: Computer-System Structures
Storage and Disks.
Lecture 16: Data Storage Wednesday, November 6, 2006.
Database Management Systems (CS 564)
9/12/2018.
Disks and Files DBMS stores information on (“hard”) disks.
Lecture 11: DMBS Internals
Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin
Operating Systems (CS 340 D)
Computer-System Architecture
Section 13.1 – Secondary storage management (Former Student’s Note)
Chapter 11: Mass-Storage Systems
Presentation transcript:

SECTIONS 13.1 – 13.3 Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin SECONDARY STORAGE MANAGEMENT

Presentation Outline  13.1 The Memory Hierarchy  The Memory Hierarchy  Transfer of Data Between Levels  Volatile and Nonvolatile Storage  Virtual Memory  13.2 Disks  Mechanics of Disks  The Disk Controller  Disk Access Characteristics

Presentation Outline (con’t)  13.3 Accelerating Access to Secondary Storage  The I/O Model of Computation  Organizing Data by Cylinders  Using Multiple Disks  Mirroring Disks  Disk Scheduling and the Elevator Algorithm  Prefetching and Large-Scale Buffering

Memory Hierarchy  Cost per byte to store data also varies  Device with smallest capacity offer the fastest speed with highest cost per bit  These components have data capacities ranging over at least seven orders of magnitude and also have access speeds ranging over seven or more orders of magnitude.

Memory Hierarchy Diagram Programs, DBMS Main Memory DBMS’s Main Memory Cache As Visual Memory Disk File System Tertiary Storage

Memory Hierarchy  Cache  Lowest level of the hierarchy  Data items are copies of certain locations of main memory  Sometimes, values in cache are changed and corresponding changes to main memory are delayed  Machine looks for instructions as well as data for those instructions in the cache  Holds limited amount of data  Cache data can be accessed by the processor in a few nanoseconds.

Memory Hierarchy (con’t)  No need to update the data in main memory immediately in a single processor computer  In multiple processors data is updated immediately to main memory….called as write through

Main Memory  Everything happens in the computer i.e. instruction execution, data manipulation, as working on information that is resident in main memory  Main memories are random access….one can obtain any byte in the same amount of time

Secondary storage  Used to store data and programs when they are not being processed  More permanent than main memory, as data and programs are retained when the power is turned off  E.g. magnetic disks, hard disks

Tertiary Storage  Holds data volumes in terabytes  Used for databases much larger than what can be stored on disk

Transfer of Data Between levels  Data moves between adjacent levels of the hierarchy  At the secondary or tertiary levels accessing the desired data or finding the desired place to store the data takes a lot of time  Disk is organized into bocks  Entire blocks are moved to and from memory called a buffer

Transfer of Data Between level (cont’d)  A key technique for speeding up database operations is to arrange the data so that when one piece of data block is needed it is likely that other data on the same block will be needed at the same time  Same idea applies to other hierarchy levels

Volatile and Non Volatile Storage  A volatile device forgets what data is stored on it after power off  Non volatile holds data for longer period even when device is turned off  All the secondary and tertiary devices are non volatile and main memory is volatile  Magnetic and optical materials hold their data in the absence of power. Thus, essentially all secondary and tertiary storage devices are nonvolatile. On the other hand main memory is generally volatile.

Virtual Memory  Typical software executes in virtual memory  Address space is typically 32 bit or 2 32 bytes or 4GB  Transfer between memory and disk is in terms of blocks

Mechanism of Disk  Mechanisms of Disks  Use of secondary storage is one of the important characteristic of DBMS  Consists of 2 moving pieces of a disk 1. disk assembly 2. head assembly  Disk assembly consists of 1 or more platters  Platters rotate around a central spindle  Bits are stored on upper and lower surfaces of platters

Mechanism of Disk  Disk is organized into tracks  The track that are at fixed radius from center form one cylinder  Tracks are organized into sectors  Tracks are the segments of circle separated by gap

Disk Controller  One or more disks are controlled by disk controllers  Disks controllers are capable of  Controlling the mechanical actuator that moves the head assembly  Selecting the sector from among all those in the cylinder at which heads are positioned  Transferring bits between desired sector and main memory  Possible buffering an entire track

Disk Access Characteristics  Accessing (reading/writing) a block requires 3 steps  Disk controller positions the head assembly at the cylinder containing the track on which the block is located. It is a ‘seek time’  The disk controller waits while the first sector of the block moves under the head. This is a ‘rotational latency’  All the sectors and the gaps between them pass the head, while disk controller reads or writes data in these sectors. This is a ‘transfer time’

Questions