Comp 335 – File Structures Why File Structures?. Goal of the Class To develop an understanding of the file I/O process. Software must be able to interact.

Slides:



Advertisements
Similar presentations
IT253: Computer Organization
Advertisements

Databasteknik Databaser och bioinformatik Data structures and Indexing (II) Fang Wei-Kleiner.
Section 6.2. Record data by magnetizing the binary code on the surface of a disk. Data area is reusable Allows for both sequential and direct access file.
Describing Storage Devices Store data when computer is off Two processes –Writing data –Reading data Storage terms –Media is the material storing data.
Lecture 13 Page 1 CS 111 Online File Systems: Introduction CS 111 On-Line MS Program Operating Systems Peter Reiher.
January 11, Csci 2111: Data and File Structures Week1, Lecture 1 Introduction to the Design and Specification of File Structures.
The Evolution of Storage Technologies Daniel Frankl, Ph.D. Kinesiology & Nutritional Science.
1 Chapter 6 Storage and Multimedia: The Facts and More.
12/3/2004EE 42 fall 2004 lecture 391 Lecture #39: Magnetic memory storage Last lecture: –Dynamic Ram –E 2 memory This lecture: –Future memory technologies.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
1 Introduction to Computers Day 4. 2 Storage device A functional unit into which data can be –placed –retained(stored) –retrieved(accessed)
Introduction to Database Systems 1 The Storage Hierarchy and Magnetic Disks Storage Technology: Topic 1.
Layers of a DBMS Query optimization Execution engine Files and access methods Buffer management Disk space management Query Processor Query execution plan.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
File Organization Techniques
Lecture 11: DMBS Internals
Computing Hardware Starter.
Introduction to Database Systems 1 Storing Data: Disks and Files Chapter 3 “Yea, from the table of my memory I’ll wipe away all trivial fond records.”
CS 111 – Aug – 1.3 –Information arranged in memory –Types of memory –Disk properties Commitment for next day: –Read pp , In other.
Announcements Exam Friday Project: Steps –Due today.
January 11, Files – Chapter 1 Introduction to the Design and Specification of File Structures.
Chapter 1 The Big Picture.
Introduction to the course. Objectives of the course  To provide a solid introduction to the topic of file structures design.  To discuss a number of.
By:Billy Nguyen Teacher: Luce. Introduction Within technological terms, storage mainly refers and relates to computer devices that keep or retains information.
1 Chapter 17 Disk Storage, Basic File Structures, and Hashing Chapter 18 Index Structures for Files.
Disks Chapter 5 Thursday, April 5, Today’s Schedule Input/Output – Disks (Chapter 5.4)  Magnetic vs. Optical Disks  RAID levels and functions.
OSes: 11. FS Impl. 1 Operating Systems v Objectives –discuss file storage and access on secondary storage (a hard disk) Certificate Program in Software.
Database Management Systems,Shri Prasad Sawant. 1 Storing Data: Disks and Files Unit 1 Mr.Prasad Sawant.
External Storage Primary Storage : Main Memory (RAM). Secondary Storage: Peripheral Devices –Disk Drives –Tape Drives Secondary storage is CHEAP. Secondary.
2.1 Operating System Concepts Chapter 2: Computer-System Structures Computer System Operation Storage Structure Storage Hierarchy Hardware Protection General.
Describing Storage Devices  Storage terms  Media is the material storing data  Storage devices manage the media  Magnetic devices use a magnet  Optical.
SECONDARY STORAGE DEVICES. Agenda of Today’s Lecture  Introduction to Hardware  Types of hardware devices  Storage Devices  Secondary Storage devices.
File Organization Lecture 1
Chapter 8 External Storage. Primary vs. Secondary Storage Primary storage: Main memory (RAM) Secondary Storage: Peripheral devices  Disk drives  Tape.
11.1Database System Concepts. 11.2Database System Concepts Now Something Different 1st part of the course: Application Oriented 2nd part of the course:
CPSC 231 D.H.1 Learning Objectives Understanding of disk versus RAM performance gap. Understanding definition, design goals and design problems of file.
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
© GCSE Computing Computing Hardware Starter. Creating a spreadsheet to demonstrate the size of memory. 1 byte = 1 character or about 1 pixel of information.
Chapter 1 Introduction File Structures Readings: Folk, Chapter 1.
Disk Basics CS Introduction to Operating Systems.
By : Reem Hasayen. A storage device is a hardware device capable of storing information. There are two types of storage devices used in computers 1. Primary.
CS 101 – Sept. 28 Main vs. secondary memory Examples of secondary storage –Disk (direct access) Various types Disk geometry –Flash memory (random access)
Review 1 Chapters Chapter 1 Understanding Computers, 12th Edition 2 Chapter 1 Explain why it is essential to learn about computers today and discuss.
DMBS Internals I February 24 th, What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the.
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
DMBS Architecture May 15 th, Generic Architecture Query compiler/optimizer Execution engine Index/record mgr. Buffer manager Storage manager storage.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
Computer Systems Objectives: To gain an understanding of the types of computer systems. Be able to identify the main components. Understand the difference.
1 Lecture 16: Data Storage Wednesday, November 6, 2006.
File organization Secondary Storage Devices Lec#7 Presenter: Dr Emad Nabil.
Computer System Structures Storage
CHAPTER 10: Computer Peripherals
File Organization and Processing
Welcome to ….. File Organization.
Chapter 2: Computer-System Structures
Storage and Disks.
Lecture 16: Data Storage Wednesday, November 6, 2006.
Database Management Systems (CS 564)
Computer Science 210 Computer Organization
Backing Store.
Oracle SQL*Loader
Part V Memory System Design
Lecture 11: DMBS Internals
Lecture 9: Data Storage and IO Models
File Storage and Indexing
Persistence: I/O devices
File Storage and Indexing
Lesson 9 Types of Storage Devices.
Department of Computer Science
Secondary Storage Devices
Presentation transcript:

Comp 335 – File Structures Why File Structures?

Goal of the Class To develop an understanding of the file I/O process. Software must be able to interact with files on secondary storage devices. Learn primary methods of how files can be structured and organized to aid in efficient information storage and retrieval of the information QUICKLY and EFFICIENTLY!

History of File Structures Early in computing history, secondary storage was in the form of magnetic tape and punched cards. Storage was cheap but access was limited to sequential. In 1956, IBM introduced the RAMAC magnetic disk device. It could be leased for $620 month and could store approximately 5 Mb of data. Data could be accessed directly instead of sequentially. Conserving the space on the disk and getting to the data quickly became an area of research. This was the dawn of the study of file structures. RAMAC Video

IBM 350 Disk File

History of File Structures Advances in operating systems gave rise to more research in operating systems. The ability to multi-task processes was a new concept. Disk drives were slow (and still are) and became a big bottleneck in software. It was important to come up with ways to speed up the file I/O process.

How SLOW is a disk drive? To the human, disk drives are extremely fast. Higher end computers like servers can purchase 10K to 15K RPM. For consumers, laptops and most desktops are 5400 or 7200 RPM. However, when compared to a computer, disk drives are very slow, especially when comparing them to the speed of a CPU and main memory processes. CPU (nanoseconds, one-billionth of a second), Disk accesses (milliseconds, one-thousandth of a second) SSDs are becoming more common. Faster because there are no moving parts, but expensive.

Comparing CPU speed to Disk speed Assume a RAM access is 120 ns Assume a Disk access is 30 ms. How many RAM accesses can be made in the time it takes to do one disk access? Answer: ? Folk and Zoellick (File Structures, An Object-Oriented Approach using C++) mention in human terms that if a RAM access were 20 SECONDS the DISK access take 58 DAYS!

History of File Structures The development of high level languages moved file processing from a physical level (hardware dependent) to a logical level (software dependent with the OS handling the specifics of the hardware). Code became more portable but lost some in the efficiency area.

History of File Structures Today, with shared data everywhere (networks, internets, etc…) efficient file structures are even more crucial. People want data fast. Crowded networks do not need extra bits to transmit.

File Structure Technique Chronology Sequential techniques - sequential search thru a file Indexing – traversing more than one file to access data Tree structures  AVL – self balancing concept, faster access  B-tree – large branching factor from a node Hashing - one access only to desired data achieved by converting a record key to the storage address of the data Techniques continually improved on access time to get to the data. This is the most crucial element in file structure design. A file structure is a combination of data representation on file and the operations for accessing this data.

Understanding Disk Drives Terms:  Seek  Rotational Latency  Read/Write Time  Platter  Read/Write head  Spindle speed  Cylinder  Track  Sector/Cluster Hard Disk Drive Basics

Understanding Disk Drives

Disk Drive Videos Inside a computer disk drive Engineering viewpoint of a disk drive

Review RAMAC Why are disk drives slow? Purpose of file structures File structure techniques