Performers : Yehuda Krief Assaf Cohen Etay Goldshtein Academic Advisor : Dr’ Eitan Bachmat Storage Management Tools for a Storage System.

Slides:

Advertisements

Similar presentations

Advertisements

1 Parallel Scientific Computing: Algorithms and Tools Lecture #2 APMA 2821A, Spring 2008 Instructors: George Em Karniadakis Leopold Grinberg.

Caches Hakim Weatherspoon CS 3410, Spring 2011 Computer Science Cornell University See P&H 5.1, 5.2 (except writes)

Computer Hardware – Storage Systems.  Storage holds data, instructions, and information for future use  Consists of two parts Storage Device Storage.

Caching IV Andreas Klappenecker CPSC321 Computer Architecture.

Using one level of Cache:

1 Lecture 20 – Caching and Virtual Memory  2004 Morgan Kaufmann Publishers Lecture 20 Caches and Virtual Memory.

Recap. The Memory Hierarchy Increasing distance from the processor in access time L1$ L2$ Main Memory Secondary Memory Processor (Relative) size of the.

1 Chapter Seven Large and Fast: Exploiting Memory Hierarchy.

Characteristics Location Capacity Unit of transfer Access method Performance Physical type Physical characteristics Organisation.

1 Lecture 14: Virtual Memory Today: DRAM and Virtual memory basics (Sections )

1  2004 Morgan Kaufmann Publishers Chapter Seven.

1 SRAM: –value is stored on a pair of inverting gates –very fast but takes up more space than DRAM (4 to 6 transistors) DRAM: –value is stored as a charge.

SSD (Flash-Based) Anthony Bonomi. SSD (Solid State Drive) Commercially available for only a few years Big use in laptops Released the first 512GB last.

1 Presenter: Chien-Chih Chen Proceedings of the 2002 workshop on Memory system performance.

CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.

Storing Data. Memory vs. Storage Storage devices are like file drawers, in that they hold programs and data. Programs and data are stored in units called.

Memory. When we receive some instruction or information we retain them in our memory. Similarly a computer stores the instructions for solving a problem,

Module 8: Monitoring SQL Server for Performance. Overview Why to Monitor SQL Server Performance Monitoring and Tuning Tools for Monitoring SQL Server.

Gordon: Using Flash Memory to Build Fast, Power-efficient Clusters for Data-intensive Applications A. Caulfield, L. Grupp, S. Swanson, UCSD, ASPLOS’09.

Information Technology Ms. Abeer Helwa. Computer Generations First Generation (Vacuum Tubes) -They relied on the machine language to perform operations.

CH05 Internal Memory Computer Memory System Overview Semiconductor Main Memory Cache Memory Pentium II and PowerPC Cache Organizations Advanced DRAM Organization.

Cache Memory By Sean Hunter.

“Five minute rule ten years later and other computer storage rules of thumb” Authors: Jim Gray, Goetz Graefe Reviewed by: Nagapramod Mandagere Biplob Debnath.

Storage. Memory RAM Virtual Memory Cache Memory ROM Motherboard.

CSCI 4717/5717 Computer Architecture

Lecture 4: Secondary Storage. I. Secondary Storage (Hard Drives) Secondary Storage Secondary Storage: holds data and programs for future use by providing.

CS 111 – Aug – 1.3 –Information arranged in memory –Types of memory –Disk properties Commitment for next day: –Read pp , In other.

Module – 4 Intelligent storage system

Memory  Main memory consists of a number of storage locations, each of which is identified by a unique address  The ability of the CPU to identify each.

1  2004 Morgan Kaufmann Publishers Multilevel cache Used to reduce miss penalty to main memory First level designed –to reduce hit time –to be of small.

Types Of Computer- Mainframe Computers. Alla’ Abu-Sultaneh 9B1.

CS 352 : Computer Organization and Design University of Wisconsin-Eau Claire Dan Ernst Memory Systems How to make the most out of cheap storage.

A Detailed Discussion of SRAM Niels Asmussen Maggie Hamill William Hunt.

CS 3410, Spring 2014 Computer Science Cornell University See P&H Chapter: , 5.8, 5.15.

HPSS for Archival Storage Tom Sherwin Storage Group Leader, SDSC

1 Virtual Memory Main memory can act as a cache for the secondary storage (disk) Advantages: –illusion of having more physical memory –program relocation.

CSE 241 Computer Engineering (1) هندسة الحاسبات (1) Lecture #3 Ch. 6 Memory System Design Dr. Tamer Samy Gaafar Dept. of Computer & Systems Engineering.

Computer Architecture Lecture 27 Fasih ur Rehman.

Multilevel Caches Microprocessors are getting faster and including a small high speed cache on the same chip.

Memory Hierarchy: Terminology Hit: data appears in some block in the upper level (example: Block X)  Hit Rate : the fraction of memory access found in.

1 Chapter Seven CACHE MEMORY AND VIRTUAL MEMORY. 2 SRAM: –value is stored on a pair of inverting gates –very fast but takes up more space than DRAM (4.

Am I RAM Or am I ROM?.

66 CHAPTER THE SYSTEM UNIT. © 2005 The McGraw-Hill Companies, Inc. All Rights Reserved. 6-2 Competencies Details about memory Memory Classification Bases.

1  1998 Morgan Kaufmann Publishers Chapter Seven.

What is it and why do we need it? Chris Ward CS147 10/16/2008.

ICC Module 3 Lesson 3 – Storage 1 / 4 © 2015 Ph. Janson Information, Computing & Communication Storage – Clip 0 – Introduction School of Computer Science.

CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.

Computer Performance. Hard Drive - HDD Stores your files, programs, and information. If it gets full, you can’t save any more. Measured in bytes (KB,

COMPUTER SYSTEMS ARCHITECTURE A NETWORKING APPROACH CHAPTER 12 INTRODUCTION THE MEMORY HIERARCHY CS 147 Nathaniel Gilbert 1.

Chapter 11 System Performance Enhancement. Basic Operation of a Computer l Program is loaded into memory l Instruction is fetched from memory l Operands.

Computer Hardware – Storage Systems.  Storage holds data, instructions, and information for future use  Consists of two parts Storage Device Storage.

Characteristics Location Capacity Unit of transfer Access method Performance Physical type Physical characteristics Organisation.

Memory Hierarchy and Cache. A Mystery… Memory Main memory = RAM : Random Access Memory – Read/write – Multiple flavors – DDR SDRAM most common 64 bit.

File organization Secondary Storage Devices Lec#7 Presenter: Dr Emad Nabil.

Computer System Structures Storage

Memory COMPUTER ARCHITECTURE

Ramya Kandasamy CS 147 Section 3

BD-CACHE Big Data Caching for Datacenters

How will execution time grow with SIZE?

Local secondary storage (local disks)

Lecture 14 Virtual Memory and the Alpha Memory Hierarchy

CS 140 Lecture Notes: Technology and Operating Systems

Module IV Memory Organization.

Lecture 20: OOO, Memory Hierarchy

Computer System Design Lecture 9

Memory Principles.

Presentation transcript:

Performers : Yehuda Krief Assaf Cohen Etay Goldshtein Academic Advisor : Dr’ Eitan Bachmat Storage Management Tools for a Storage System

Companies that have a huge amount of data. When a user wants to get data from the Storage System, he will wait a long amount of time to get the data that he desires, and it may cause him to lose money, deals, etc…: - For example, in the NASDAQ stock market computers compete between themselves to buy and sell stocks. The company which has a faster Storage System than their competitors can get the requested information first, and earn more money. Problem definition

Storage System Structure Host A Network Storage System

System Storage Structure Host A Network Storage System Is it in cache? NO

Storage Systems have a huge amount of data to store and manage (in many cases, more then 100 TB). Storage Systems use DRAM memories as cache. DRAM memories are very fast, but they are also very expensive. Storage Systems have a small capacity of cache (usually 16 Giga Bytes). Cache capacity is very small compared to the disk drive capacity that the storage system has. Cache misses lead to poor performance. Current situation:

Research on the extension of the Memory-Cache, of the Storage System, with flash disks (size of 150GB each ). Tracking the trace of the Storage System: - amount of hit ratio before and after adding the Flash memory as extension of the cache. - statistical measures :Kb read/write – in time intervals. Integrate a clustering algorithm with the trace: - cluster the Storage System : which will map the LUNs of the Storage System. - helps organize the caching algorithm. Develop a simulator which the IT manager will use to examine and organize his/her Storage System. Project Requirements

We will implement the UPGMA clustering algorithm with the use of C++ with threads. Build a simulator that will predict and examine the benefits of adding Flash into the Memory- Cache. Investigate the behavior of “local”/”global” caching algorithms for the implementation of the Flash. Method Of Solution

System Storage Structure Host A Network Storage System