The Memory B. Ramamurthy C B. Ramamurthy1. Topics for discussion On chip memory On board memory System memory Off system/online storage/ secondary memory.

Slides:

Advertisements

Similar presentations

Professor Michael J. Losacco CIS 1150 – Introduction to Computer Information Systems Secondary Storage Chapter 7.

Advertisements

C SINGH, JUNE 7-8, 2010IWW 2010, ISATANBUL, TURKEY Advanced Computers Architecture, UNIT 2 Advanced Computers Architecture UNIT 2 CACHE MEOMORY Lecture7.

IiWAS2002, Bandung, Indonesia Teaching and Learning Databases Dr. Stéphane Bressan National University of Singapore.

By: Chris Hayes. Facebook Today, Facebook is the most commonly used social networking site for people to connect with one another online. People of all.

Memory Hierarchy. Smaller and faster, (per byte) storage devices Larger, slower, and cheaper (per byte) storage devices.

High Performance Computing Course Notes High Performance Storage.

Google Bigtable A Distributed Storage System for Structured Data Hadi Salimi, Distributed Systems Laboratory, School of Computer Engineering, Iran University.

IT Systems Memory EN230-1 Justin Champion C208 –

Memory and Storage - Sheetal Gosrani. Overview Memory Hierarchy RAM Memory Chip Organization ROM Flash Memory.

Gowtham Rajappan. HDFS – Hadoop Distributed File System modeled on Google GFS. Hadoop MapReduce – Similar to Google MapReduce Hbase – Similar to Google.

Secondary Storage 7.

Distinguish between primary and secondary storage.

Module 3 - Storage MIS5122: Enterprise Architecture for IT Auditors.

Database Services for Physics at CERN with Oracle 10g RAC HEPiX - April 4th 2006, Rome Luca Canali, CERN.

Memory Main memory consists of a number of storage locations, each of which is identified by a unique address The ability of the CPU to identify each location.

IDK0040 Võrgurakendused I Building a site: Implementation Deniss Kumlander.

CSC 456 Operating Systems Seminar Presentation (11/13/2012) Leon Weingard, Liang Xin The Google File System.

Secondary Storage Chapter 7.

Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,

Chapter 3: Operating-System Structures System Components Operating System Services System Calls System Programs System Structure Virtual Machines System.

Presented by CH.Anusha.  Apache Hadoop framework  HDFS and MapReduce  Hadoop distributed file system  JobTracker and TaskTracker  Apache Hadoop NextGen.

CISC105 General Computer Science Class 1 – 6/5/2006.

© Pearson Education Limited, Chapter 16 Physical Database Design – Step 7 (Monitor and Tune the Operational System) Transparencies.

March 19981© Dennis Adams Associates Tuning Oracle: Key Considerations Dennis Adams 25 March 1998.

Amazon Web Services BY, RAJESH KANDEPU. Introduction  Amazon Web Services is a collection of remote computing services that together make up a cloud.

CSE 451: Operating Systems Section 10 Project 3 wrap-up, final exam review.

MySQL. Dept. of Computing Science, University of Aberdeen2 In this lecture you will learn The main subsystems in MySQL architecture The different storage.

Hive Facebook 2009.

Whirlwind Tour of Hadoop Edward Capriolo Rev 2. Whirlwind tour of Hadoop Inspired by Google's GFS Clusters from systems Batch Processing High.

1 Moshe Shadmon ScaleDB Scaling MySQL in the Cloud.

©2007 · Georges Merx and Ronald J. NormanSlide 1 Chapter 10 Information Management in Java.

The exponential growth of data –Challenges for Google,Yahoo,Amazon & Microsoft in web search and indexing The volume of data being made publicly available.

TheTeacher Computing Data Storage Computing. TheTeacher Computing Primary Storage One of the fundamental properties of a computer is that it can store.

Overview of Physical Storage Media

3 Computing System Fundamentals

Mainframe (Host) - Communications - User Interface - Business Logic - DBMS - Operating System - Storage (DB Files) Terminal (Display/Keyboard) Terminal.

OCR GCSE Computing © Hodder Education 2013 Slide 1 OCR GCSE Computing Chapter 2: Memory.

The Memory B. Ramamurthy C B. Ramamurthy1. Topics for discussion On chip memory On board memory System memory Off system/online storage/ secondary memory.

Computers Operating System Essentials. Operating Systems PROGRAM HARDWARE OPERATING SYSTEM.

+ CS 325: CS Hardware and Software Organization and Architecture Memory Organization.

Boot Sequence, Internal Component & Cisco 3 Layer Model 1.

Parts of the Computer System

Computer Architecture Lecture 24 Fasih ur Rehman.

Introduction: Memory Management 2 Ideally programmers want memory that is large fast non volatile Memory hierarchy small amount of fast, expensive memory.

11 Intel Modular Server Understanding the Storage MFSYS25 MFSYS35.

A.Abhari CPS1251 Topic 1: Introduction to Computers Computer Hardware Computer components Connecting Computers Computer Software Operating System (OS)

Computer Systems. Bits Computers represent information as patterns of bits A bit (binary digit) is either 0 or 1 –binary  “two states” true and false,

Computer Programming (1) Code & No.: CS 102 CREDIT HOURS: 5 UNIT Lecture 3.0 hours/week Lab: 2.0 hour/on every week a. This course introduces the students.

66 CHAPTER THE SYSTEM UNIT. © 2005 The McGraw-Hill Companies, Inc. All Rights Reserved. 6-2 Competencies Details about memory Memory Classification Bases.

A memory is just like a human brain. It is used to store data and instructions. Computer memory is the storage space in computer where data is to be processed.

The Storage B. Ramamurthy C B. Ramamurthy1. Topics for discussion On chip memory On board memory System memory Off system/online storage/ secondary memory.

Introduction To Computer Programming – 1A Computer Parts, Words, and Definition Herriman High School.

BIG DATA/ Hadoop Interview Questions.

CIT 140: Introduction to ITSlide #1 CSC 140: Introduction to IT Operating Systems.

Accessing the Database Server: ODBC, OLE DB, and ADO

Memory Key Revision Points.

Overview of Computers and Programming Chapter 1

Memory Main memory consists of a number of storage locations, each of which is identified by a unique address The ability of the CPU to identify each location.

Memory Main memory consists of a number of storage locations, each of which is identified by a unique address The ability of the CPU to identify each location.

Primary and Secondary Storage Explained

Primary Storage and Secondary Storage Devices Chapter 3

Introduction to Operating Systems

Discovering Computers 2014: Chapter6

The Memory B. Ramamurthy C B. Ramamurthy.

STORAGE – 3 TIERS Key Revision Points.

MICROPROCESSOR MEMORY ORGANIZATION

Computer System Design Lecture 11

Primary Storage 1. Registers Part of the CPU

WJEC GCSE Computer Science

Presentation transcript:

The Memory B. Ramamurthy C B. Ramamurthy1

Topics for discussion On chip memory On board memory System memory Off system/online storage/ secondary memory File system abstraction Offline/ tertiary memory RAID: Redundant Array of Inexpensive Disks NAS: Network Accessible Storage SAN: Storage area networks DB and DBMS: Data base and DB management systems Distributed file system Google file system Hadoop file system C B. Ramamurthy2

Data and Computation Continuum Compute intensive Ex: computation of digits of PI Data intensive Ex: analyzing web logs C B. Ramamurthy3

On chip memory Registers Cache Buffers (instruction pipeline) Characteristics: volatile C B. Ramamurthy4

On board memory Cache – Instructions cache – Data cache – Translation look aside buffers (TLB) Characteristics: content addressable, set- associative organization C B. Ramamurthy5

System memory RAM : Random access memory: main memory Read and write possible volatile ROM: Read only memory: boot programs for operating systems Flash memory: Erasable/writable non-volatile memory SDRAM: synch dynamic RAM others EAROM C B. Ramamurthy6

Off-system storage (Earlier Lectures covered these) Off system/online storage/ secondary memory File system abstraction Offline/ tertiary memory RAID: Redundant Array of Inexpensive Disks NAS: Network Accessible Storage SAN: Storage area networks C B. Ramamurthy7

Database and Database Management System Data source Transactional Data base server Relational db or similar foundation Tables, rows, result set, SQL ODBC: open data base connectivity Very successful business model: Oracle, DB2, MySQL, and others Persistence models: EJB, DAO, ADO (I am not going to expand the abbreviation.. ) C B. Ramamurthy8

Distributed file system(DFS) A dedicated server manages the files for an compute environment For example, nickelback,cse.buffalo.edu is your file server and that is why we did not want you to run your user applications on this machine. DFS addresses various transparencies: location transparency, sharing, performance etc. Examples: NFS, NFS+, AFS (Andrew FS)… (you will study these in Distributed Systems course) C B. Ramamurthy9

On to Google File Internet introduced a new challenge in the form web logs, web crawler’s data: large scale “peta scale” But observe that this type of data has an uniquely different characteristic than your transactional or the “order” data on amazon.com: “write once” ; so is HIPPA protected healthcare and patient information; Google exploited this characteristics in its Google file system: S. GhemavatGoogle file system: S. Ghemavat C B. Ramamurthy10

Hadoop File System (HFS) Hadoop file system is a reverse engineered version of the GFS : this is my first opinion on HFS HFS is a distributed file system for large scale data Data throughput is more important than latency Batch computing than interactive time shared computing C B. Ramamurthy11

Cat Bat Dog Other Words (size: TByte) map split combine reduce part0 part1 part2 MapReduce