Data Storage and Querying in Various Storage Devices.

Slides:



Advertisements
Similar presentations
Tertiary Storage Devices
Advertisements

Lecture # 7. Topics Storage Techniques of Bits Storage Techniques of Bits Mass Storage Mass Storage Disk System Performance Disk System Performance File.
Storing Data: Disks and Files: Chapter 9
CpSc 3220 File and Database Processing Lecture 1 Course Overview File Storage Basics.
Recap of Feb 20: Database Design Goals, Normalization, Normal Forms Goals for designing a database: a schema with: –simple, easy to phrase queries –avoids.
Recap of Feb 25: Physical Storage Media Issues are speed, cost, reliability Media types: –Primary storage (volatile): Cache, Main Memory –Secondary or.
1 Storage Hierarchy Cache Main Memory Virtual Memory File System Tertiary Storage Programs DBMS Capacity & Cost Secondary Storage.
1 Classification of Physical storage Media Speed with which data can be accessed Cost per unit of data Reliability  data loss on power failure or system.
SECTIONS 13.1 – 13.3 Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin SECONDARY STORAGE MANAGEMENT.
Database System Concepts, 5th Ed. ©Silberschatz, Korth and Sudarshan See for conditions on re-usewww.db-book.com Chapter 11: Storage and.
1 CS222: Principles of Database Management Fall 2010 Professor Chen Li Department of Computer Science University of California, Irvine Notes 01.
©Silberschatz, Korth and Sudarshan11.1Database System Concepts Chapter 11: Storage and File Structure Overview of Physical Storage Media Magnetic Disks.
SECTIONS 13.1 – 13.3 Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin SECONDARY STORAGE MANAGEMENT.
Dr. Kalpakis CMSC 461, Database Management Systems URL: Storage and File Structure.
Introduction to Database Systems 1 The Storage Hierarchy and Magnetic Disks Storage Technology: Topic 1.
Free Powerpoint Templates Page 1 Free Powerpoint Templates DBMS Unit -1 Overview of physical Storage Media.
Storing Data: Disks & Files
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 5 – Storage Organization.
BY Eleazar Chidke Okereke ITEC546Storage and File Structure1.
1 Database Systems Storage Media Asma Ahmad 21 st Apr, 11.
Lecture 11: DMBS Internals
Physical Storage and File Organization COMSATS INSTITUTE OF INFORMATION TECHNOLOGY, VEHARI.
Lecture 8 of Advanced Databases Storage and File Structure Instructor: Mr.Ahmed Al Astal.
Chapter 10 Storage and File Structure Yonsei University 2 nd Semester, 2013 Sanghyun Park.
Lecture 9 of Advanced Databases Storage and File Structure (Part II) Instructor: Mr.Ahmed Al Astal.
Chapter 10 Storage & File Structure. n Overview of Physical Storage Media n Magnetic Disks n Tertiary Storage n Storage Access n File Organization n Organization.
SCUHolliday13–1 Schedule Today: u Data Storage and Indexing u Read Sections Next u Query Evaluation.
©Silberschatz, Korth and Sudarshan11.1Database System Concepts Magnetic Hard Disk Mechanism NOTE: Diagram is schematic, and simplifies the structure of.
Database System Concepts, 5th Ed. Bin Mu at Tongji University Chapter 11: Storage and File Structure.
1 Secondary Storage Management Submitted by: Sathya Anandan(ID:123)
1 Chapter 17 Disk Storage, Basic File Structures, and Hashing Chapter 18 Index Structures for Files.
1 Storage and File Structure. 2 Classification of Physical Storage Media Speed with which data can be accessed Cost per unit of data Reliability  data.
Overview of Physical Storage Media
Database System Concepts, 5th Ed. ©Silberschatz, Korth and Sudarshan See for conditions on re-usewww.db-book.com Chapter 11: Storage and.
1/14/2005Yan Huang - CSCI5330 Database Implementation – Storage and File Structure Storage and File Structure.
Database Management Systems,Shri Prasad Sawant. 1 Storing Data: Disks and Files Unit 1 Mr.Prasad Sawant.
2.1 Operating System Concepts Chapter 2: Computer-System Structures Computer System Operation Storage Structure Storage Hierarchy Hardware Protection General.
File Processing : Storage Media 2015, Spring Pusan National University Ki-Joune Li.
©Silberschatz, Korth and Sudarshan18.1Database System Concepts Lecture 9: Storage and File Structure Overview of Physical Storage Media Magnetic Disks.
11.1Database System Concepts. 11.2Database System Concepts Now Something Different 1st part of the course: Application Oriented 2nd part of the course:
Lecture 3 Page 1 CS 111 Online Disk Drives An especially important and complex form of I/O device Still the primary method of providing stable storage.
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
CS4432: Database Systems II Data Storage 1. Storage in DBMSs DBMSs manage large amounts of data How does a DBMS store and manage large amounts of data?
©Silberschatz, Korth and Sudarshan11.1Database System Concepts Chapter 11: Storage and File Structure Overview of Physical Storage Media Magnetic Disks.
Database System Concepts, 6 th Ed. ©Silberschatz, Korth and Sudarshan See for conditions on re-usewww.db-book.com Chapter 10: Storage and.
Copyright © Curt Hill Disk Basics Structure and Characteristics of Secondary Storage.
DMBS Internals I February 24 th, What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the.
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
COSC 6340: Disks 1 Disks and Files DBMS stores information on (“hard”) disks. This has major implications for DBMS design! » READ: transfer data from disk.
Storage and File Structure Malavika Srinivasan Prof. Franya Franek.
1 Lecture 16: Data Storage Wednesday, November 6, 2006.
File Organization Record Storage and Primary File Organization
Computer System Structures Storage
Storage Overview of Physical Storage Media Magnetic Disks RAID
CHAPTER 10: Computer Peripherals
Chapter 2: Computer-System Structures
Storage and Disks.
Lecture 16: Data Storage Wednesday, November 6, 2006.
Database Management Systems (CS 564)
Introduction to Database
Disks and Files DBMS stores information on (“hard”) disks.
File Processing : Storage Media
Lecture 11: DMBS Internals
Lecture 9: Data Storage and IO Models
Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin
File Processing : Storage Media
Overview Continuation from Monday (File system implementation)
Module 10: Physical Storage Systems
FILE & SYSTEM STRUCTURE (CHAPTER 11)
Storage and File Structure
Presentation transcript:

Data Storage and Querying in Various Storage Devices

Classification of Physical Storage Media Speed with which data can be accessed Cost per unit of data Reliability data loss on power failure or system crash physical failure of the storage device Can differentiate storage into: volatile storage: loses contents when power is switched off non-volatile storage: contents persist even when power is switched off. Includes secondary and tertiary storage, as well as battery-backed up main-memory.

Physical Storage Media Cache-fastest and most costly form of storage; volatile; managed by the hardware/operating system. Main memory: general-purpose machine instructions operate on data resident in main memory fast access, but generally too small to store the entire database sometimes referred to as core memory volatile — contents of main memory are usually lost if a power failure or system crash occurs

Physical Storage Media (Cont.) Flash memory – reads are roughly as fast as main memory; data survives power failure; but can support a only limited number of write/erase cycles Magnetic-disk storage – primary medium for the long-term storage of data; typically stores entire database. data must be moved form disk to main memory for access, and written back for storage direct-access – possible to read data on disk in any order usually survives power failures and system crashes; disk failure can destroy data, but is much less frequent than system crashes

Physical Storage Media (Cont.) Optical storage – non-volatile. CD-ROM most popular form. Write-once, read-many (WORM) optical disks used for archival storage. Tape storage – non-volatile, used primarily for backup (to recover from disk failure), and for archival data sequential-access – much slower than disk very high capacity (5 GB tapes are common) tape can be removed from drive  storage costs much cheaper than disk

Storage Hierarchy main memory flash memory cache magnetic disk magnetic tapes optical disk

Storage Hierarchy (Cont.) primary storage: Fastest media but volatile (cache, main memory) secondary storage: next level in hierarchy, non-volatile, moderately fast access time; also called on-line storage (flash memory, magnetic disks) tertiary storage: lowest level in hierarchy, non-volatile, slow access time; also called off-line storage (magnetic tape, optical storage)

Magnetic Disks Mechanism

Magnetic Disks Read–write head – device positioned close to the platter surface; reads or writes magnetically encoded information. Surface of platter divided into circular tracks, and each track is divided into sectors. A sector is the smallest unit of data that can be read or written. Cylinder i consists of ith track of all the platters To read/write a sector disk arm swings to position head on right track platter spins continually, data is read/written when sector comes under head Disk assemblies – multiple disk platters on a single spindle, with multiple heads (one per platter) mounted on a common arm.

Disk Subsystem Disk controller – interfaces between the computer system and the disk drive hardware. Accepts high-level commands to read or write a sector initiates actions such as moving the disk arm to the right track and actually reading or writing the data Disk Controller System Bus Disks

Performance Measures of Disks Access time – the time it takes from when a read or write request is issued to when data transfer begins. Consists of: Seek time – time it takes to reposition the arm over that correct track. Average seek time is 1/3rd the worst case seek time. Rotational latency – time it takes for the sector to be accessed to appear under the head. Average latency is 1/2 of the worst case latency. Data-transfer rate – the rate at which data can be retrieved from or stored to the disk. Mean time to failure (MTTF) – the average time the disk is expected to run continuously without any failure.

Optimization of Disk-Block Access Block – a contiguous sequence of sectors form a single track data is transferred between disk and main memory in blocks sizes range from 512 bytes to several kilobytes Disk-arm–scheduling algorithms order accesses to tracks so that disk arm movement is minimized (elevator algorithm is often used) File organization – optimize block access time by organizing the blocks to correspond to how data will be accessed. Store related information on the same or nearby cylinders. Nonvolatile write buffers speed up disk writes by writing blocks to a non-volatile RAM buffer immediately; controller then writes to disk whenever the disk has no other requests. Log disk – a disk devoted to writing a sequential log of block updates; this eliminates seek time. Used like nonvolatile RAM.