Motivation Energy costs are rising –An increasing concern for servers –No longer limited to laptops Energy consumption of disk drives –24% of the power.

Slides:



Advertisements
Similar presentations
RAID Redundant Arrays of Independent Disks Courtesy of Satya, Fall 99.
Advertisements

Redundant Array of Independent Disks (RAID) Striping of data across multiple media for expansion, performance and reliability.
A CASE FOR REDUNDANT ARRAYS OF INEXPENSIVE DISKS (RAID) D. A. Patterson, G. A. Gibson, R. H. Katz University of California, Berkeley.
Destage Algorithms for Disk Arrays with Nonvolatile Caches IEEE TRANSACTIONS ON COMPUTERS, VOL. 47, NO. 2, JANUARY 1998 Anujan Varma, Member, IEEE, and.
Conserving Disk Energy in Network Servers ACM 17th annual international conference on Supercomputing Presented by Hsu Hao Chen.
1 Jason Drown Mark Rodden (Redundant Array of Inexpensive Disks) RAID.
Module – 3 Data protection – raid
Opportunities for Demand Response in California Agricultural Irrigation Gary Marks iP Solutions Corp. 10/15/2012.
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
RAID Redundant Arrays of Inexpensive Disks –Using lots of disk drives improves: Performance Reliability –Alternative: Specialized, high-performance hardware.
1 Conserving Energy in RAID Systems with Conventional Disks Dong Li, Jun Wang Dept. of Computer Science & Engineering University of Nebraska-Lincoln Peter.
R.A.I.D. Copyright © 2005 by James Hug Redundant Array of Independent (or Inexpensive) Disks.
Chapter 3 Presented by: Anupam Mittal.  Data protection: Concept of RAID and its Components Data Protection: RAID - 2.
RAID CS5493/7493. RAID : What is it? Redundant Array of Independent Disks configured into a single logical storage unit.
Lecture 36: Chapter 6 Today’s topic –RAID 1. RAID Redundant Array of Inexpensive (Independent) Disks –Use multiple smaller disks (c.f. one large disk)
Energy Efficient Prefetching with Buffer Disks for Cluster File Systems 6/19/ Adam Manzanares and Xiao Qin Department of Computer Science and Software.
CS533 Concepts of Operating Systems Class 19 File System Reliability.
A Survey of Home Energy Management Systems in Future Smart Grid Communications By Muhammad Ishfaq Khan.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
Reliability Analysis of An Energy-Aware RAID System Shu Yin Xiao Qin Auburn University.
Cloud Data Center/Storage Power Efficiency Solutions Junyao Zhang 1.
Storage and NT File System INFO333 – Lecture Mariusz Nowostawski Noria Foukia.
Redundant Array of Independent Disks
PARAID: The Gear-Shifting Power-Aware RAID Charles Weddle, Mathew Oldham, An-I Andy Wang – Florida State University RuGang Xu, Peter Reiher – University.
PARAID: The Gear-Shifting Power-Aware RAID Charles Weddle, Mathew Oldham, An-I Andy Wang – Florida State University Peter Reiher – University of California,
Exploiting Flash for Energy Efficient Disk Arrays Shimin Chen (Intel Labs) Panos K. Chrysanthis (University of Pittsburgh) Alexandros Labrinidis (University.
Buffalo Data Storage Expansion June As organizations grow the amount of data storage capacity required to support it grows as well Increased data.
Sensor-Based Fast Thermal Evaluation Model For Energy Efficient High-Performance Datacenters Q. Tang, T. Mukherjee, Sandeep K. S. Gupta Department of Computer.
Hadoop Hardware Infrastructure considerations ©2013 OpalSoft Big Data.
4.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 4: Organizing a Disk for Data.
MCTS Guide to Microsoft Windows Vista Chapter 4 Managing Disks.
1 Distributed Energy-Efficient Scheduling for Data-Intensive Applications with Deadline Constraints on Data Grids Cong Liu and Xiao Qin Auburn University.
Energy Aware Consolidation for Cloud Computing Srikanaiah, Kansal, Zhao Usenix HotPower 2008.
1 PARAID: A Gear-Shifting Power-Aware RAID Charles Weddle, Mathew Oldham, Jin Qian, An-I Andy Wang – Florida St. University Peter Reiher – University of.
PARAID: A Gear-Shifting Power-Aware RAID Charles Weddle, Mathew Oldham, Jin Qian, An-I Andy Wang – Florida St. University Peter Reiher – University of.
Windows Server 2003 硬碟管理與磁碟機陣列 林寶森
Redundant Array of Independent Disks.  Many systems today need to store many terabytes of data.  Don’t want to use single, large disk  too expensive.
"1"1 Introduction to Managing Data " Describe problems associated with managing large numbers of disks " List requirements for easily managing large amounts.
Conquest-2: Improving Energy Efficiency and Performance Through a Disk/RAM Hybrid File System An-I Andy Wang Florida State University (NSF CCR ,
RAID Disk Arrays Hank Levy. 212/5/2015 Basic Problems Disks are improving, but much less fast than CPUs We can use multiple disks for improving performance.
RAID Systems Ver.2.0 Jan 09, 2005 Syam. RAID Primer Redundant Array of Inexpensive Disks random, real-time, redundant, array, assembly, interconnected,
1 PARAID: A Gear-Shifting Power-Aware RAID Charles Weddle, Mathew Oldham, Jin Qian, An-I Andy Wang – Florida St. University Peter Reiher – University of.
CHP & DG METERING & MONITORING IN NEW YORK STATE CASE STUDIES AND IMPLEMENTATIONS Presented By: STEPHEN STONE, PE DSM ENGINEERING ASSOCIATES, PC
WINDOWS SERVER 2003 Genetic Computer School Lesson 12 Fault Tolerance.
Best Available Technologies: External Storage Overview of Opportunities and Impacts November 18, 2015.
Ensieea Rizwani An energy-efficient management mechanism for large-scale server clusters By: Zhenghua Xue, Dong, Ma, Fan, Mei 1.
Chapter 14: Mass-Storage Systems Disk Structure. Disk Scheduling. RAID.
GPFS: A Shared-Disk File System for Large Computing Clusters Frank Schmuck & Roger Haskin IBM Almaden Research Center.
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
RAID Technology By: Adarsha A,S 1BY08A03. Overview What is RAID Technology? What is RAID Technology? History of RAID History of RAID Techniques/Methods.
Network-Attached Storage. Network-attached storage devices Attached to a local area network, generally an Ethernet-based network environment.
1 PARAID: A Gear-Shifting Power-Aware RAID Charles Weddle, Mathew Oldham, Jin Qian, An-I Andy Wang – Florida St. University Peter Reiher – University of.
I/O Errors 1 Computer Organization II © McQuain RAID Redundant Array of Inexpensive (Independent) Disks – Use multiple smaller disks (c.f.
Answer to Summary Questions
PARAID: A Gear-Shifting Power-Aware RAID
Green cloud computing 2 Cs 595 Lecture 15.
RAID Redundant Arrays of Independent Disks
Fujitsu Training Documentation RAID Groups and Volumes
System Control based Renewable Energy Resources in Smart Grid Consumer
Storage Virtualization
PARAID: A Gear-Shifting Power-Aware RAID
RAID RAID Mukesh N Tekwani
Xiaoyang Zhang1, Yuchong Hu1, Patrick P. C. Lee2, Pan Zhou1
Bridging the Information Gap in Storage Protocol Stacks
RAID Redundant Array of Inexpensive (Independent) Disks
UNIT IV RAID.
Cloud Computing Architecture
CSE 451: Operating Systems Winter 2007 Module 18 Redundant Arrays of Inexpensive Disks (RAID) Ed Lazowska Allen Center 570.
RAID RAID Mukesh N Tekwani April 23, 2019
IT 344: Operating Systems Winter 2007 Module 18 Redundant Arrays of Inexpensive Disks (RAID) Chia-Chi Teng CTB
Presentation transcript:

Motivation Energy costs are rising –An increasing concern for servers –No longer limited to laptops Energy consumption of disk drives –24% of the power usage in web servers –77% of the power usage in proxy servers –27% of operating costs for data centers PARAID Benefits Conventional RAID: The “One-size-fits-all” approach of convention raid creates a suboptimal strategy for spinning down drives. load time drives load time drives PARAID: The number of disks can be adjusted to meet load with out degrading performance. Performance: Based on the replay of a web server trace, our 2-Gear PARAID-0 prototype consumes 15% less power on average than conventional RAID-0 as shown in the Total Power Consumption graph. The peak PARAID-0 performance is comparable to RAID-0 under the PostMark benchmark. Initial Findings Cyclic fluctuation of loads –RAIDs are configured for peak performance –Uniform striping over-provisions resources for light loads Over-provision of storage capacity –Avoid frequent upgrades Limited power cycles for server-class drives –Cannot power-cycle drives too frequently Observations PARAID: The Gear-Shifting Power-Aware RAID Charles Weddle - Mathew Oldham - An-I A. Wang - Florida State University RuGang Xu - Peter Reiher – University of California, Los Angeles Geoffrey H. Kuenning – Harvey Mudd College PARAID Design PARAID creates tiers of disks within the RAID that can be gear-shifted so that the least number of disks are used to meet system load while not degrading performance. Skewed Striping: By assigning data blocks in a skewed pattern, the number of powered-on disks can vary according to the demands placed on the system. To be able to create the gears, PARAID uses spare storage on the RAID device for soft state replication. Preserving Peak Performance: A RAID-5 layout is used for the primary copy of the data blocks which allows for maximum parallelism between the drives when the load on the system demands it Reliability: Since a RAID-5 layout is used for the primary copy of the data blocks, the distributed parity of RAID-5 will tolerate a single disk failure. PARAID creates a bimodal usage pattern so that busy drives can stay powered on most of the time and idle drives can stay powered down most of the time, leaving only middle range disks to be powered cycled more often, reducing the total number of times a drive is powered cycled. Power: The same file can be delivered with either the lower two-drive gear or the higher four-drive gear settings. Under high loads, all four drives will be powered to meet the performance demand. Under light loads, two drives are sufficient to deliver the data. Tension between energy and performance –Performance Maximize parallelism RAIDs with uniform striping –Energy Minimize powered components Challenges Abstract: The energy consumption of disks is a growing concern. It now contributes 27% to the operating costs for data centers. Unfortunately, existing RAIDs are not designed to conserve energy. This is due to uniform striping in which even light loads generate activities on all drives. Power-Aware RAID (PARAID) introduces a skewed striping pattern that can be gear shifted to a minimum striping level so the performance matches the load. Unused disks are powered down. Based on our “2-gear” prototype, PARAID consumes 15% less power than a traditional RAID, while not compromising performance load time utilization threshold gear 2 gear 1 Soft-State Block Replication gear 2 disk 1disk 2disk 3disk 4 gear 3 RAID-5 Layout