NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University 2011-7-28 Research on Energy Consumption of General Network Storage.

Slides:



Advertisements
Similar presentations
Conserving Disk Energy in Network Servers ACM 17th annual international conference on Supercomputing Presented by Hsu Hao Chen.
Advertisements

Key Metrics for Effective Storage Performance and Capacity Reporting.
Page 1 Dorado 400 Series Server Club Page 2 First member of the Dorado family based on the Next Generation architecture Employs Intel 64 Xeon Dual.
The Zebra Striped Network File System Presentation by Joseph Thompson.
1 Conserving Energy in RAID Systems with Conventional Disks Dong Li, Jun Wang Dept. of Computer Science & Engineering University of Nebraska-Lincoln Peter.
Chapter 3 Presented by: Anupam Mittal.  Data protection: Concept of RAID and its Components Data Protection: RAID - 2.
Objectives Overview Differentiate between storage and memory
A system Performance Model Instructor: Dr. Yanqing Zhang Presented by: Rajapaksage Jayampthi S.
INTRODUCING COMPELLENT – FASTEST GROWING SAN VENDOR Virtualized storage for enterprises and cloud data centers.
OS2-1 Chapter 2 Computer System Structures. OS2-2 Outlines Computer System Operation I/O Structure Storage Structure Storage Hierarchy Hardware Protection.
METU Department of Computer Eng Ceng 302 Introduction to DBMS Disk Storage, Basic File Structures, and Hashing by Pinar Senkul resources: mostly froom.
Cs238 Lecture 3 Operating System Structures Dr. Alan R. Davis.
Copyright © 2007 Ramez Elmasri and Shamkant B. Navathe Chapter 13 Disk Storage, Basic File Structures, and Hashing.
Storage Networking Technologies and Virtualization Section 2 DAS and Introduction to SCSI1.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
SPC-1C / SPC-2C. Page: 2 Storage Performance Council (SPC) SPC-1C / SPC-2C Overview Storage Component Performance  There is a distinct need to provide.
Usage Centric Green Metrics for Storage Doron Chen, Ealan Henis, Ronen Kat and Dmitry Sotnikov IBM Haifa Research Lab Most of the metrics defined today.
Intel® Solid-State Drive Data Center TCO Calculator The data in this presentation is based on your analysis and business assumptions when using the Intel®
Disk and Tape Square Off Again Tape Remains King of Hill with LTO-4 Presented by Heba Saadeldeen.
Reliability Analysis of An Energy-Aware RAID System Shu Yin Xiao Qin Auburn University.
Research on cloud computing application in the peer-to-peer based video-on-demand systems Speaker : 吳靖緯 MA0G rd International Workshop.
Fundamentals of Data Analysis Lecture 7 ANOVA. Program for today F Analysis of variance; F One factor design; F Many factors design; F Latin square scheme.
Module 10 Configuring and Managing Storage Technologies.
Dynamic and Decentralized Approaches for Optimal Allocation of Multiple Resources in Virtualized Data Centers Wei Chen, Samuel Hargrove, Heh Miao, Liang.
Developing PC-Based Automobile Diagnostic System Based on OBD System Authors : Hu Jie, Yan Fuwu, Tian Jing, Wang Pan, Cao Kai School of Automotive Engineer.
PARAID: The Gear-Shifting Power-Aware RAID Charles Weddle, Mathew Oldham, An-I Andy Wang – Florida State University Peter Reiher – University of California,
OPTIMAL SERVER PROVISIONING AND FREQUENCY ADJUSTMENT IN SERVER CLUSTERS Presented by: Xinying Zheng 09/13/ XINYING ZHENG, YU CAI MICHIGAN TECHNOLOGICAL.
Objectives Overview Differentiate between storage and memory
RAPID-Cache – A Reliable and Inexpensive Write Cache for Disk I/O Systems Yiming Hu Qing Yang Tycho Nightingale.
School of EECS, Peking University Microsoft Research Asia UStore: A Low Cost Cold and Archival Data Storage System for Data Centers Quanlu Zhang †, Yafei.
1 26 October 2013 Observation and Reflection on Official Statistics against Big Data Challenge Yuan Pengfei Research Institute of Statistical Sciences.
Tag line, tag line Power Management in Storage Systems Kaladhar Voruganti Technical Director CTO Office, Sunnyvale June 12, 2009.
1 Distributed Energy-Efficient Scheduling for Data-Intensive Applications with Deadline Constraints on Data Grids Cong Liu and Xiao Qin Auburn University.
MSN 数学媒体与信息存储 1/27 Zhuo Liu, Fei Wu, Xiao Qin, Changsheng Xie, Jian Zhou, and Jianzong Wang TRACER: A Trace Replay Tool to Evaluate Energy-Efficiency of.
Bulk Data Movement: Components and Architectural Diagram Alex Sim Arie Shoshani LBNL April 2009.
Data Replication and Power Consumption in Data Grids Susan V. Vrbsky, Ming Lei, Karl Smith and Jeff Byrd Department of Computer Science The University.
02/09/2010 Industrial Project Course (234313) Virtualization-aware database engine Final Presentation Industrial Project Course (234313) Virtualization-aware.
© 2011 IBM Corporation Sizing Guidelines Jana Jamsek ATS Europe.
Embedded Design Using ARM For Strong Room Security System
The Green Grid’s Data Center Maturity Model November 18, 2015.
Module 12: Configuring and Managing Storage Technologies
Big traffic data processing framework for intelligent monitoring and recording systems 學生 : 賴弘偉 教授 : 許毅然 作者 : Yingjie Xia a, JinlongChen a,b,n, XindaiLu.
GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers Dzmitry Kliazovich ERCIM Fellow University of Luxembourg Apr 16, 2010.
Accounting for Load Variation in Energy-Efficient Data Centers
CISC 849 : Applications in Fintech Namami Shukla Dept of Computer & Information Sciences University of Delaware iCARE : A Framework for Big Data Based.
Best Available Technologies: External Storage Overview of Opportunities and Impacts November 18, 2015.
GPFS: A Shared-Disk File System for Large Computing Clusters Frank Schmuck & Roger Haskin IBM Almaden Research Center.
Jérôme Jaussaud, Senior Product Manager
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
CHARACTERIZING CLOUD COMPUTING HARDWARE RELIABILITY Authors: Kashi Venkatesh Vishwanath ; Nachiappan Nagappan Presented By: Vibhuti Dhiman.
© 2006 EMC Corporation. All rights reserved. Section 2 – Storage Systems Architecture Introduction.
By Harshal Ghule Guided by Mrs. Anita Mahajan G.H.Raisoni Institute Of Engineering And Technology.
CHAPTER 6 Digital Storage Copyright © Cengage Learning. All rights reserved.
1 Components of the Virtual Memory System  Arrows indicate what happens on a lw virtual address data physical address TLB page table memory cache disk.
IPEmotion License Management PM (V1.2).
2016 Global Seminar 按一下以編輯母片標題樣式 Sharing Economy, share one NAS storage space to another NAS Tony Lu Product Manager May, 2016.
RAID TECHNOLOGY RASHMI ACHARYA CSE(A) RG NO
Renesas Electronics Europe GmbH A © 2010 Renesas Electronics Corporation. All rights reserved. RL78 AD converter.
System Storage TM © 2007 IBM Corporation IBM System Storage™ DS3000 Series Jüri Joonsaar Tartu.
GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers Dzmitry Kliazovich, Pascal Bouvry, Yury Audzevich, and Samee Ullah Khan.
= Computer Power Consumption and Management on Kansas State’s Campus
Green cloud computing 2 Cs 595 Lecture 15.
Operating Systems (CS 340 D)
Green Software Engineering Prof
EMC DES-1D11 VCE Test Dumps
Migration Strategies – Business Desktop Deployment (BDD) Overview
Examining a Windows NT Infrastructure (2)
Qingbo Zhu, Asim Shankar and Yuanyuan Zhou
The Greening of IT November 1, 2007.
Storage Modeling for Power Estimation Ronen Kat
Presentation transcript:

NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University Research on Energy Consumption of General Network Storage System

Energy Consumption of Network Storage System Outline Background Energy consumption model Experiments Conclusion and Future work NAS2011(2/15)

Energy Consumption of Network Storage System NAS2011 (3/12) Challenge Source: IBM Corporate Strategy analysis of IDC data, Sept Global Annual IT Spending Estimated US$B $0B New Server Spending Server Mgt and Admin Costs Power and Cooling Costs

Energy Consumption of Network Storage System Background Research on Energy Consumption of General Network Storage System Some energy consumption standard has been released in industry China promote the development of network storage technology Huge energy consumption in Network Storage Systems Energy conservation, green storage promote low-carbon economy From the perspective of the whole system accurately reflect real- time energy consumption Analyse, establish the general energy consumption model of networks storage system Reseach purpose Thesis signigicance Thesis background

Energy Consumption of Network Storage System Structure and research method Introduction Reseach on EC of NSS Conclusions Analysis and test EC Verify model validation Establish EC model Server ECDisk array ECSwitch EC Based on system expansion and workload conditions evaluates EC Basic EC Data transmission and Port used number EC Workload EC

Energy Consumption of Network Storage System EC model NAS2011(6/15) A common storage network system is consist of the file system servers, switches and disk arrays Base Energy Consumption Energy Consumption = + Variable Energy Consumption according to workload

Energy Consumption of Network Storage System Detail model NAS2011(7/15) In the complex structure and changing workload of storage network environment, it refines the energy consumption of each functional part as: basic energy consumption Ebase and workload energy consumption Eload. Namely: Servers, switches and disk arrays are the main functional components of the storage network, and also the major components of the energy consumption. Thus, the full energy consumption of the storage network E should include: server energy consumption Es, switch and disk array energy consumption, Esw, Eda, namely: Disk array = Controllers +Disk enclosure + Disks

Energy Consumption of Network Storage System System Extension NAS2011(8/15) Extend typeBasic ECAdditional EC Server Added 1 server 1* E base 1*Port Switch Added 1 1* E swbase 2*Port Disk Array Added 1 disk 1* E dbase ignored Added 15 disks 15* E dbase 1* E daebase Added 1 DE 1* E daebase ignored Added 12 DE 12* E daebase 2*Port+1* E dabase Considering the added energy consumption for the extended structure in the System-A Eadd. Eadd also includes two parts: the basic and additional energy consumption of the added hardware, Ebase, Esub, namely: The below Table lists the added EC pattern caused by extending hardware in the system.

Energy Consumption of Network Storage System Server-basic EC test NAS2011(9/15) 1)Server's Idle Mode energy consumption test: Put the server into the status of single power supply, test the average effective power under the Idle Mode for 10 minutes. The results can be described as follows:

Energy Consumption of Network Storage System Server-Workload EC test NAS2011(10/15) Energy consumption test between server and workload: On the server, we use the SPECpower_ssj2008 quantifies energy consumption and generates workloads, test status of the changing server energy consumption. Obtained the test data can be formatted below the figure:

Energy Consumption of Network Storage System Switch EC test 1)Basic EC : The basic energy consumption test of switch: The method of the basic energy consumption test on switch is identical to that of server Idle Mode. The result in our environment is 17.93W 2) EC per activate port: The energy consumption test between switch and the number of used port: Make the switch in the state of no host accessing, one by one join 8 hosts, each of the states hold for 5 minutes. Test on every added a port leads to energy consumption increase. The result is 1.06W 3)EC change according to data transfer: It's difficult to quantify and control the specific data transferred rate of the switch. So, assuming that the data transmission of the switch has only two states: full-bandwidth data transmission and no data transmission, using the Iperf control full-bandwidth data transmission between a pair ports. EC changes very little. NAS2011(11/15) Switch takes a small role in the whole system

Energy Consumption of Network Storage System Disk array EC test 1)Basic EC Test: The basic energy consumption test on the hardware of disk array: Successively increase components in the disk array (disk block number from 5 to 15, the disk enclosure from 0 to 1), use Power Analyzer to detect the changed information of power, get the energy consumption status by calculated on the various components of the disk array. 2) Workload EC Test: The energy consumption test between disk array and the workload: Read and write IO operation of the disk array is the main workload, usually indicated by the values of ​​ IOPS, which is controlled by IOPSCtrl in this test. In the RAID's organizational model, RAID0 has non-redundant operation and the least impact on disk's energy consumption, so all the disk blocks on disk array is comprised of the RAID0 mode, and the full capacity of which mount to a directory on the server to test the maximum value of IOPS in disk by Iometer. From no IO operation, every 10% of the maximum IOPS until the maximum workload is increased by IOPSCtrl, each state for 10 minutes. NAS2011(12/15) Increasing HWIncreasing EC Per disk11.36W Per disk enclosure109.49W Power and controller312.11W Experiments show workload takes little affect on EC, We think disk keep working even there isn’t any IO operation. But MAID2.0 technology may change this.

Energy Consumption of Network Storage System Verification Use one server and one switch and one disk array to verify the model. According the model, calculate result is W; Test result of W, difference is very little. NAS2011(13/15)

Energy Consumption of Network Storage System General usage If there are X servers, Y disks and L pairs of the ports in the network storage system, the entire system's total energy consumption: NAS2011(14/15)

Energy Consumption of Network Storage System Future work Cooling system EC takes a import role in data center, we need take temperature into consider in the future. New medias such as SSD will have different EC features. Some green technologies need more researches. MAID(massive array of idle disks) slow down the rotation speed of disk to save energy. Need more experiments in big system to verify the model. NAS2011(15/15)

Energy Consumption of Network Storage System NAS2011 Thanks