Enabling Large-Scale Storage in Sensor Networks with the Coffee File System ISPN 2009 Lawrence.

Slides:



Advertisements
Similar presentations
Storing Data: Disk Organization and I/O
Advertisements

Chapter 12: File System Implementation
CS 346 – April 4 Mass storage –Disk formatting –Managing swap space –RAID Commitment –Please finish chapter 12.
Paging: Design Issues. Readings r Silbershatz et al: ,
Fabián E. Bustamante, Spring 2007
VCRIB: Virtual Cloud Rule Information Base Masoud Moshref, Minlan Yu, Abhishek Sharma, Ramesh Govindan HotCloud 2012.
Kernel memory allocation
Trading Flash Translation Layer For Performance and Lifetime
FlashVM: Virtual Memory Management on Flash Mohit Saxena and Michael M. Swift Introduction Flash storage is the largest change to memory and storage systems.
Mobile Handset Memory Management
CMPT 300: Final Review Chapters 8 – Memory Management: Ch. 8, 9 Address spaces Logical (virtual): generated by the CPU Physical: seen by the memory.
G Robert Grimm New York University Cool Pet Tricks with… …Virtual Memory.
Recap of Feb 25: Physical Storage Media Issues are speed, cost, reliability Media types: –Primary storage (volatile): Cache, Main Memory –Secondary or.
Manajemen Basis Data Pertemuan 2 Matakuliah: M0264/Manajemen Basis Data Tahun: 2008.
CMPT 300: Final Review Chapters 8 – Memory Management: Ch. 8, 9 Address spaces Logical (virtual): generated by the CPU Physical: seen by the memory.
Chapter 13 Embedded Systems
Embedded Real-Time Systems Design Selecting memory.
Device Management.
 2004 Deitel & Associates, Inc. All rights reserved. Chapter 9 – Real Memory Organization and Management Outline 9.1 Introduction 9.2Memory Organization.
Secondary Storage Management Hank Levy. 8/7/20152 Secondary Storage • Secondary Storage is usually: –anything outside of “primary memory” –storage that.
Storage Systems. Main Points File systems – Useful abstractions on top of physical devices Storage hardware characteristics – Disks and flash memory File.
Introduction to Database Systems 1 The Storage Hierarchy and Magnetic Disks Storage Technology: Topic 1.
Basics of Operating Systems March 4, 2001 Adapted from Operating Systems Lecture Notes, Copyright 1997 Martin C. Rinard.
File System. NET+OS 6 File System Architecture Design Goals File System Layer Design Storage Services Layer Design RAM Services Layer Design Flash Services.
Operating Systems CMPSC 473 I/O Management (2) December Lecture 24 Instructor: Bhuvan Urgaonkar.
Measuring zSeries System Performance Dr. Chu J. Jong School of Information Technology Illinois State University 06/11/2012 Sponsored in part by Deer &
Chapter 10 Storage and File Structure Yonsei University 2 nd Semester, 2013 Sanghyun Park.
Introduction to Database Systems 1 Storing Data: Disks and Files Chapter 3 “Yea, from the table of my memory I’ll wipe away all trivial fond records.”
Operating Systems (CS 340 D) Dr. Abeer Mahmoud Princess Nora University Faculty of Computer & Information Systems Computer science Department.
1 I/O Management and Disk Scheduling Chapter Categories of I/O Devices Human readable Used to communicate with the user Printers Video display terminals.
1. Memory Manager 2 Memory Management In an environment that supports dynamic memory allocation, the memory manager must keep a record of the usage of.
Seminar on Linux-based embedded systems
Fall 2000M.B. Ibáñez Lecture 01 Introduction What is an Operating System? The Evolution of Operating Systems Course Outline.
Speaker: 吳晋賢 (Chin-Hsien Wu) Embedded Computing and Applications Lab Department of Electronic Engineering National Taiwan University of Science and Technology,
Author : Chin-Hsien Wu Presenter : kilroy. Outline Introduction Related work Motivation Main idea Evaluation Conclusion Q & A.
Chapter 4 Storage Management (Memory Management).
Infocom’07 Authors:Liqian Luo, Chengdu Huang, Tarek Abdelzaher John Stankovic Presented By Rohini Kurkal Under Guidance of Dr.Bin Tang.
Ji-Yong Shin Cornell University In collaboration with Mahesh Balakrishnan (MSR SVC), Tudor Marian (Google), Lakshmi Ganesh (UT Austin), and Hakim Weatherspoon.
A Detailed Discussion of SRAM Niels Asmussen Maggie Hamill William Hunt.
CS414 Review Session.
Design of Flash-Based DBMS: An In-Page Logging Approach Sang-Won Lee and Bongki Moon Presented by Chris Homan.
ELF: An Efficient Log-Structured Flash File System For Micro Sensor Nodes Hui Dai Michael Neufeld Richard Han University of Colorado at Boulder Computer.
Chapter 4 Memory Management Virtual Memory.
Chapter 8 External Storage. Primary vs. Secondary Storage Primary storage: Main memory (RAM) Secondary Storage: Peripheral devices  Disk drives  Tape.
Design of Flash-Based DBMS: An In-Page Logging Approach Sang-Won Lee and Bongki Moon Presented by RuBao Li, Zinan Li.
Operating Systems CMPSC 473 I/O Management (3) December 07, Lecture 24 Instructor: Bhuvan Urgaonkar.
Introduction: Memory Management 2 Ideally programmers want memory that is large fast non volatile Memory hierarchy small amount of fast, expensive memory.
Energy Efficient Prefetching and Caching Athanasios E. Papathanasiou and Michael L. Scott. University of Rochester Proceedings of 2004 USENIX Annual Technical.
Memory The term memory is referred to computer’s main memory, or RAM (Random Access Memory). RAM is the location where data and programs are stored (temporarily),
Programmer’s View of Files Logical view of files: –An a array of bytes. –A file pointer marks the current position. Three fundamental operations: –Read.
 2004 Deitel & Associates, Inc. All rights reserved. Chapter 9 – Real Memory Organization and Management Outline 9.1 Introduction 9.2Memory Organization.
Transactional Flash V. Prabhakaran, T. L. Rodeheffer, L. Zhou (MSR, Silicon Valley), OSDI 2008 Shimin Chen Big Data Reading Group.
 The emerged flash-memory based solid state drives (SSDs) have rapidly replaced the traditional hard disk drives (HDDs) in many applications.  Characteristics.
Virtual Memory By CS147 Maheshpriya Venkata. Agenda Review Cache Memory Virtual Memory Paging Segmentation Configuration Of Virtual Memory Cache Memory.
CPSC 426: Building Decentralized Systems Persistence
Niosha Behnam CMPE 259 – Fall  Real-time data availability is not required for all sensor networks.  Robust disconnected operation is a needed.
CS222: Principles of Data Management Lecture #4 Catalogs, Buffer Manager, File Organizations Instructor: Chen Li.
Chapter 2: The Linux System Part 4
Virtual Memory Chapter 7.4.
Interpreted languages Jakub Yaghob
Chapter 9 – Real Memory Organization and Management
Operating System I/O System Monday, August 11, 2008.
An Adaptive Data Separation Aware FTL for Improving the Garbage Collection Efficiency of Solid State Drives Wei Xie and Yong Chen Texas Tech University.
CSI 400/500 Operating Systems Spring 2009
Chapter 11: File System Implementation
Filesystems 2 Adapted from slides of Hank Levy
Page Replacement.
Contents Memory types & memory hierarchy Virtual memory (VM)
COMP755 Advanced Operating Systems
Lecture Topics: 11/20 HW 7 What happens on a memory reference Traps
Presentation transcript:

Enabling Large-Scale Storage in Sensor Networks with the Coffee File System ISPN 2009 Lawrence

Introduction  Motivation  Existing storage systems access the flash memory directly and ad hoc, or use too much RAM to handle large flash memories.  Storage abstractions  Meet the need for a generic, high speed, flash- based file system that is feasible for a wide rage of sensor devices.

Storage In Sensor Network  Storage Centricity  From communication-centric to storage-centric  Batching data for saving energy  Delay-tolerant v.s. delay-sensitive(ex. fire alarm)  Storage-centric sensor net require storage facilities.

Storage In Sensor Network(Cont.)  Using Storage as Virtual Memory  Use the flash as swap area.  VM requires faster storage systems.  Require storage manage application: 1. Wear leveling 2. Garbage collection 3. Space allocation  In this paper, there is a storage abstraction allocation that suit for above requirements.

Storage In Sensor Network(Cont.)  Flash memory semantics  Some part (called erase sectors) must be erased before overwriting.  Flash memory: 1.NOR flash (good for read) 2.NAND flash (good for storage)

COFFEE  Coffee is a portable, high-speed file system for sensor device equipped with flash memories.  Micro logs to handle file modifications.  Use a small footprint: each open file O(1) RAM.

COFFEE (Cont.)  Design principles  Memory and code size constraints.  Small memory footprints-regardless of the file sizes.  Rule:  1.divided into erase sectors of size  2.Erease sets all bits to 1  3.Programming switches a subset of the bits in a page from 1 to 0.

COFFEE (Cont.)

 Page Structure  A file is stored as a contiguous group  Page Allocation Algorithm: first-fit policy.

 Minimizing metadata in the RAM  (metadata in first page of file)

 Locating File  File cache for locations.  If not in cache => cache miss (sequentially scan)

 Garbage Collection

 Wear Leveling Policy  What is wear leveling  Erase too much -> memory corrupt  Method: delay garbage collection until a space reservation request cannot be fulfilled.

Evaluation

Conclusion  Coffee’s high throughput and low latency make it a suitable underlying layer for storage abstractions.