Hardware Technology Trends and Database Opportunities

Slides:



Advertisements
Similar presentations
IT253: Computer Organization
Advertisements

CS61C L13 I/O © UC Regents 1 CS 161 Chapter 8 - I/O Lecture 17.
RAID Technology. Use Arrays of Small Disks? 14” 10”5.25”3.5” Disk Array: 1 disk design Conventional: 4 disk designs Low End High End Katz and Patterson.
CS 430 – Computer Architecture Disks
CS61C L40 I/O: Disks (1) Ho, Fall 2004 © UCB TA Casey Ho inst.eecs.berkeley.edu/~cs61c CS61C : Machine Structures Lecture 39 I/O : Disks Microsoft.
Disk Storage SystemsCSCE430/830 Disk Storage Systems CSCE430/830 Computer Architecture Lecturer: Prof. Hong Jiang Courtesy of Yifeng Zhu (U. Maine) Fall,
CS61C L16 Disks © UC Regents 1 CS61C - Machine Structures Lecture 16 - Disks October 20, 2000 David Patterson
1 Network Performance Model Sender Receiver Sender Overhead Transmission time (size ÷ band- width) Time of Flight Receiver Overhead Transport Latency Total.
1  1998 Morgan Kaufmann Publishers Chapter 8 Storage, Networks and Other Peripherals.
CS61C L40 I/O: Disks (1) Garcia, Fall 2004 © UCB Lecturer PSOE Dan Garcia inst.eecs.berkeley.edu/~cs61c CS61C : Machine Structures.
Prof. John Nestor ECE Department Lafayette College Easton, Pennsylvania ECE Computer Organization Lecture 22 - Input/Output.
1 Outline File Systems Implementation How disks work How to organize data (files) on disks Data structures Placement of files on disk.
Disks.
Disk Technologies. Magnetic Disks Purpose: – Long-term, nonvolatile, inexpensive storage for files – Large, inexpensive, slow level in the memory hierarchy.
Cs 61C L15 Disks.1 Patterson Spring 99 ©UCB CS61C Anatomy of I/O Devices: Magnetic Disks Lecture 15 March 10, 1999 Dave Patterson (http.cs.berkeley.edu/~patterson)
12/3/2004EE 42 fall 2004 lecture 391 Lecture #39: Magnetic memory storage Last lecture: –Dynamic Ram –E 2 memory This lecture: –Future memory technologies.
1 CS222: Principles of Database Management Fall 2010 Professor Chen Li Department of Computer Science University of California, Irvine Notes 01.
CS 61C L41 I/O Disks (1) Garcia, Spring 2004 © UCB Lecturer PSOE Dan Garcia inst.eecs.berkeley.edu/~cs61c CS61C : Machine.
Bandwidth Rocks (1) Latency Lags Bandwidth (last ~20 years) Performance Milestones Disk: 3600, 5400, 7200, 10000, RPM.
Introduction to Database Systems 1 The Storage Hierarchy and Magnetic Disks Storage Technology: Topic 1.
CENG334 Introduction to Operating Systems Erol Sahin Dept of Computer Eng. Middle East Technical University Ankara, TURKEY URL:
UC Berkeley 1 The Datacenter is the Computer David Patterson Director, RAD Lab January, 2007.
Comp 335 – File Structures Why File Structures?. Goal of the Class To develop an understanding of the file I/O process. Software must be able to interact.
CPE 731 Advanced Computer Architecture Technology Trends Dr. Gheith Abandah Adapted from the slides of Prof. David Patterson, University of California,
August 1, 2001Systems Architecture II1 Systems Architecture II (CS ) Lecture 9: I/O Devices and Communication Buses * Jeremy R. Johnson Wednesday,
Programming for GCSE Topic 5.1: Memory and Storage T eaching L ondon C omputing William Marsh School of Electronic Engineering and Computer Science Queen.
Disk Storage SystemsCSCE430/830 Disk Storage Systems CSCE430/830 Computer Architecture Lecturer: Prof. Hong Jiang Courtesy of Yifeng Zhu (U. Maine) Fall,
Csci 136 Computer Architecture II – IO and Storage Systems Xiuzhen Cheng
Disk Basics CS Introduction to Operating Systems.
1 Adapted from UC Berkeley CS252 S01 Lecture 18: Reducing Cache Hit Time and Main Memory Design Virtucal Cache, pipelined cache, cache summary, main memory.
1 Introduction to Hardware/Architecture David A. Patterson EECS, University of California.
COSC 6340: Disks 1 Disks and Files DBMS stores information on (“hard”) disks. This has major implications for DBMS design! » READ: transfer data from disk.
Paper by: Chris Ruemmler and John Wikes Presentation by: Timothy Goldberg, Daniel Sink, Erin Collins, and Tony Luaders.
1 Lecture 16: Data Storage Wednesday, November 6, 2006.
TYPES OF MEMORY.
CHAPTER 10: Computer Peripherals
Computer Architecture Principles Dr. Mike Frank
Berkeley Cluster Projects
Module: Storage Systems
Lecture 16: Data Storage Wednesday, November 6, 2006.
IT 251 Computer Organization and Architecture
Berkeley Cluster: Zoom Project
Hard Drives.
IT 344: Operating Systems Winter 2008 Module 13 Secondary Storage
CS 201 The Memory Heirarchy
Part V Memory System Design
Disks and Files DBMS stores information on (“hard”) disks.
Lecture 11: DMBS Internals
Virtual Memory Main memory can act as a cache for the secondary storage (disk) Advantages: illusion of having more physical memory program relocation protection.
Introduction to I/O Where does the data for our CPU and memory come from or go to? Computers communicate with the outside world via I/O devices. Input.
Department of Health Science Education University of Florida
Introduction I/O devices can be characterized by I/O bus connections
CSE 153 Design of Operating Systems Winter 2018
Lecture 13 I/O.
Lecture 21: Storage Systems
Secondary Storage Devices
Input-output I/O is very much architecture/system dependent
CSE 451: Operating Systems Winter 2006 Module 13 Secondary Storage
CSE 451: Operating Systems Winter 2007 Module 13 Secondary Storage
Persistence: hard disk drive
CSE 451: Operating Systems Secondary Storage
Persistence: I/O devices
Modified from notes by Saeid Nooshabadi
CSE 451: Operating Systems Winter 2009 Module 12 Secondary Storage
CSE 451: Operating Systems Spring 2005 Module 13 Secondary Storage
CSE 451: Operating Systems Autumn 2004 Secondary Storage
CSE 451: Operating Systems Winter 2004 Module 13 Secondary Storage
CPS216: Advanced Database Systems Notes 04: Data Access from Disks
CSE 451: Operating Systems Spring 2007 Module 11 Secondary Storage
IRAM Vision Microprocessor & DRAM on a single chip:
Presentation transcript:

Hardware Technology Trends and Database Opportunities David A. Patterson and Kimberly K. Keeton Early As a result of thinking about 2020: really going to keep spending billions per fab, separate for memory and microprocessor for next 25 years? SLIDES TO ADD: Breakdown RAS/CAS times and where it goes to show hat 60 ns means Put back in DRAM opening chip Get photos/GIFs of boards and chips of Sun Server? History of sizes Excel, Word? Ask Gray? Ask Sites on quote? http://cs.berkeley.edu/~patterson/talks {patterson,kkeeton}@cs.berkeley.edu EECS, University of California Berkeley, CA 94720-1776

Outline Review of Five Technologies: Disk, Network, Memory, Processor, Systems Description / History / Performance Model State of the Art / Trends / Limits / Innovation Following precedent: 2 Digressions Common Themes across Technologies Perform.: per access (latency) + per byte (bandwidth) Fast: Capacity, BW, Cost; Slow: Latency, Interfaces Moore’s Law affecting all chips in system Technologies leading to Database Opportunity? Hardware & Software Alternative to Today Back-of-the-envelope comparison: scan, sort, hash-join

Disk Description / History Embed. Proc. (ECC, SCSI) Track Sector Track Buffer Arm Head Platter 1973: 1. 7 Mbit/sq. in 140 MBytes 1979: 7. 7 Mbit/sq. in 2,300 MBytes Cylinder source: New York Times, 2/23/98, page C3, “Makers of disk drives crowd even more data into even smaller spaces”

Disk History 1989: 63 Mbit/sq. in 60,000 MBytes 1997: 1450 Mbit/sq. in source: New York Times, 2/23/98, page C3

Performance Model /Trends Capacity + 60%/year (2X / 1.5 yrs) Transfer rate (BW) + 40%/year (2X / 2.0 yrs) Rotation + Seek time – 8%/ year (1/2 in 10 yrs) MB/$ > 60%/year (2X / <1.5 yrs) Fewer chips + areal density Latency = Queuing Time + Controller time + Seek Time + Rotation Time + Size / Bandwidth per access per byte { + source: Ed Grochowski, 1996, “IBM leadership in disk drive technology”; www.storage.ibm.com/storage/technolo/grochows/grocho01.htm,

15 vs. 12 chips; 2 chips (head, misc) in 200x? Chips / 3.5 inch Disk: 1993 v. 1994 15 vs. 12 chips; 2 chips (head, misc) in 200x?

State of the Art: Seagate Cheetah 18 6962 cylinders, 12 platters 18.2 GB, 3.5 inch disk 1MB track buffer (+ 4MB optional expansion) 19 watts 0.15 ms controller time avg. seek = 6 ms (seek 1 track = 1 ms) 1/2 rotation = 3 ms 21 to 15 MB/s media (=> 16 to 11 MB/s) deliver 75% (ECC, gaps...) $1647 or 11MB/$ (9¢/MB) Track Sector Cylinder Track Buffer Arm Platter Head Latency = Queuing Time + Controller time + Seek Time + Rotation Time + Size / Bandwidth per access per byte { + source: www.seagate.com; www.pricewatch.com; 5/21/98

Disk Limit: I/O Buses Cannot use 100% of bus Multiple copies of data, SW layers Cannot use 100% of bus Queuing Theory (< 70%) Command overhead (Effective size = size x 1.2) CPU Memory bus C Internal I/O bus Memory C External I/O bus (PCI) Bus rate vs. Disk rate SCSI: Ultra2 (40 MHz), Wide (16 bit): 80 MByte/s FC-AL: 1 Gbit/s = 125 MByte/s (single disk in 2002) C (SCSI) C (15 disks) Controllers

Disk Challenges / Innovations Cost SCSI v. EIDE: $275: IBM 4.3 GB, UltraWide SCSI (40MB/s) 16MB/$ $176: IBM 4.3 GB, DMA/EIDE (17MB/s) 24MB/$ Competition, interface cost, manufact. learning curve? Rising Disk Intelligence SCSI3, SSA, FC-AL, SMART Moore’s Law for embedded processors, too source: www.research.digital.com/SRC/articles/199701/petal.html; www.pricewatch.com

Disk Limit Continued advance in capacity (60%/yr) and bandwidth (40%/yr.) Slow improvement in seek, rotation (8%/yr) Time to read whole disk Year Sequentially Randomly 1990 4 minutes 6 hours 2000 12 minutes 1 week Dynamically change data layout to reduce seek, rotation delay? Leverage space vs. spindles?

Disk Summary Continued advance in capacity, cost/bit, BW; slow improvement in seek, rotation External I/O bus bottleneck to transfer rate, cost? => move to fast serial lines (FC-AL)? What to do with increasing speed of embedded processor inside disk?

Network Description/Innovations Shared Media vs. Switched: pairs communicate at same time Aggregate BW in switched network is many times shared point-to-point faster only single destination, simpler interface Serial line: 1 – 5 Gbit/sec Moore’s Law for switches, too 1 chip: 32 x 32 switch, 1.5 Gbit/sec links, $396 48 Gbit/sec aggregate bandwidth (AMCC S2025)