Tag line, tag line Power Management in Storage Systems Kaladhar Voruganti Technical Director CTO Office, Sunnyvale June 12, 2009.

Slides:



Advertisements
Similar presentations
Key Metrics for Effective Storage Performance and Capacity Reporting.
Advertisements

© 2006 DataCore Software Corp SANmotion New: Simple and Painless Data Migration for Windows Systems Note: Must be displayed using PowerPoint Slideshow.
State Data Center Re-scoped Projects With emphasis on reducing load on cooling systems in OB2 April 4, 2012.
© 2005 DataCore Software Corp SANmelody™ 2.0 IP/SAN FC/SAN Application Support Services Thin Provisioning Automation & Disk Resource Consolidation DataCore,
Study of Hurricane and Tornado Operating Systems By Shubhanan Bakre.
State Data Center Re-scoped Projects With emphasis on reducing load on cooling systems in OB2 April 4, 2012.
An Adaptable Benchmark for MPFS Performance Testing A Master Thesis Presentation Yubing Wang Advisor: Prof. Mark Claypool.
Virtual Memory Deung young, Moon ELEC 5200/6200 Computer Architecture and Design Lectured by Dr. V. Agrawal Lectured by Dr. V.
DNS Arrow Virtualisation and the business opportunity it presents. Steve Pearce Managing Director.
1 Exploring Data Reliability Tradeoffs in Replicated Storage Systems NetSysLab The University of British Columbia Abdullah Gharaibeh Matei Ripeanu.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
Virtualization Performance H. Reza Taheri Senior Staff Eng. VMware.
Darren Strange Head of Environmental Sustainability Microsoft Ltd.
© 2009 Oracle Corporation. S : Slash Storage Costs with Oracle Automatic Storage Management Ara Vagharshakian ASM Product Manager – Oracle Product.
Usage Centric Green Metrics for Storage Doron Chen, Ealan Henis, Ronen Kat and Dmitry Sotnikov IBM Haifa Research Lab Most of the metrics defined today.
Tag line, tag line Virtualisatie op de balans Leaseweb bv IT hosting simplified.
11 Capacity Planning Methodologies / Reporting for Storage Space and SAN Port Usage Bob Davis EMC Technical Consultant.
Disk and Tape Square Off Again Tape Remains King of Hill with LTO-4 Presented by Heba Saadeldeen.
1 © Copyright 2009 EMC Corporation. All rights reserved. Agenda Storing More Efficiently  Storage Consolidation  Tiered Storage  Storing More Intelligently.
1 Exploring Data Reliability Tradeoffs in Replicated Storage Systems NetSysLab The University of British Columbia Abdullah Gharaibeh Advisor: Professor.
MOBILE CLOUD COMPUTING
Green IT and Data Centers Darshan R. Kapadia Gregor von Laszewski 1.
Computing Hardware Starter.
XenDesktop Built on FlexPod Flexible IT Infrastructure for Desktop Virtualization.
Virtual Machine Course Rofideh Hadighi University of Science and Technology of Mazandaran, 31 Dec 2009.
Virtualization. Virtualization  In computing, virtualization is a broad term that refers to the abstraction of computer resources  It is "a technique.
+ CS 325: CS Hardware and Software Organization and Architecture Cloud Architectures.
Copyright © 2014 EMC Corporation. All Rights Reserved. Block Storage Provisioning and Management Upon completion of this module, you should be able to:
Storage Management in Virtualized Cloud Environments Sankaran Sivathanu, Ling Liu, Mei Yiduo and Xing Pu Student Workshop on Frontiers of Cloud Computing,
Improving Network I/O Virtualization for Cloud Computing.
Improving Disk Latency and Throughput with VMware Presented by Raxco Software, Inc. March 11, 2011.
Get More out of SQL Server 2012 in the Microsoft Private Cloud environment Steven Wort, Xin Jin Microsoft Corporation.
Hadoop Hardware Infrastructure considerations ©2013 OpalSoft Big Data.
Mayuresh Varerkar ECEN 5613 Current Topics Presentation March 30, 2011.
FlashSystem family 2014 © 2014 IBM Corporation IBM® FlashSystem™ V840 Product Overview.
Terry Alexander Exec Director, Office of Campus Sustainability.
Computer Emergency Notification System (CENS)
1 Distributed Energy-Efficient Scheduling for Data-Intensive Applications with Deadline Constraints on Data Grids Cong Liu and Xiao Qin Auburn University.
Server Virtualization
Data Replication and Power Consumption in Data Grids Susan V. Vrbsky, Ming Lei, Karl Smith and Jeff Byrd Department of Computer Science The University.
Disco : Running commodity operating system on scalable multiprocessor Edouard et al. Presented by Vidhya Sivasankaran.
NAS 2011 Liang Kai,Xiaofang Zhang, Xiao Zhang Northwestern Polytechnical University Research on Energy Consumption of General Network Storage.
© GCSE Computing Computing Hardware Starter. Creating a spreadsheet to demonstrate the size of memory. 1 byte = 1 character or about 1 pixel of information.
 The End to the Means › (According to IBM ) › 03.ibm.com/innovation/us/thesmartercity/in dex_flash.html?cmp=blank&cm=v&csr=chap ter_edu&cr=youtube&ct=usbrv111&cn=agus.
1  2004 Morgan Kaufmann Publishers Chapter Seven Memory Hierarchy-3 by Patterson.
IBM Systems and Technology Group © 2009 IBM Corporation IBM System Storage – Tape Part 1 This document is for IBM and IBM Business Partner use only. It.
Optimizing Power and Data Center Resources Jim Sweeney Enterprise Solutions Consultant, GTSI.
Best Available Technologies: External Storage Overview of Opportunities and Impacts November 18, 2015.
Ensieea Rizwani An energy-efficient management mechanism for large-scale server clusters By: Zhenghua Xue, Dong, Ma, Fan, Mei 1.
LIOProf: Exposing Lustre File System Behavior for I/O Middleware
Improving Performance using the LINUX IO Scheduler Shaun de Witt STFC ISGC2016.
Thomas Baus Senior Sales Consultant Oracle/SAP Global Technology Center Mail: Phone:
Copyright © 2010 Hitachi Data Systems. All rights reserved. Confidential – NDA Strictly Required Hitachi Storage Solutions Hitachi HDD Directions HDD Actual.
Solving Today’s Data Protection Challenges with NSB 1.
Presenter: Yue Zhu, Linghan Zhang A Novel Approach to Improving the Efficiency of Storing and Accessing Small Files on Hadoop: a Case Study by PowerPoint.
1 Automated Power Management Through Virtualization Anne Holler, VMware Anil Kapur, VMware.
System Storage TM © 2007 IBM Corporation IBM System Storage™ DS3000 Series Jüri Joonsaar Tartu.
Virtualization for Cloud Computing
Green cloud computing 2 Cs 595 Lecture 15.
Fujitsu Training Documentation RAID Groups and Volumes
Lecture 16: Data Storage Wednesday, November 6, 2006.
Ákos Frohner EGEE'08 September 2008
Storage Virtualization
Real IBM C exam questions and answers
11/20/2018 Emerging Technologies in Storage Presented by Ronda McCain
Cloud computing mechanisms
Specialized Cloud Architectures
2.C Memory GCSE Computing Langley Park School for Boys.
The Greening of IT November 1, 2007.
Presentation transcript:

Tag line, tag line Power Management in Storage Systems Kaladhar Voruganti Technical Director CTO Office, Sunnyvale June 12, 2009

© 2008 NetApp. All rights reserved. Outline  Power Consumption Background in Data Centers and Storage Systems  Power Management Strategies for Storage Systems  Power Management Metrics  Impact of Server Power Management Strategies on Storage Systems

© 2008 NetApp. All rights reserved. Storage Consumption Constantly Increasing  More types of information are being digitized and stored persistently (emergence of newer types of applications)  Data is being stored persistently for longer periods of time (for legal and sentimental reasons)  More people are persistently storing their information (computer usage globally is increasing)

© 2008 NetApp. All rights reserved. What is a Storage Controller? Traditional Storage Controller Cluster of thousands of Google Servers Source: IBM Redbook DS8000 Source: CNET News April/2009

© 2008 NetApp. All rights reserved. Where Does the Power Go in a Data Center? Percentages Source: IDC Report 2008

© 2008 NetApp. All rights reserved. Where Does the Power Go in a Storage Controller? Google Box Power Consumption Watts Storage Controller Box Consumption Watts Per Disk Total Power Cost Source: Google Paper, ISCA 2007 Source:NetApp Internal Study

© 2008 NetApp. All rights reserved. Storage Power Management Strategies  Hardware –Can select the appropriate storage architecture –Can select the appropriate storage system –Can select the appropriate hardware features  Software –Storage Efficiency –Migration and Spinning/Shutting Disks Down

© 2008 NetApp. All rights reserved. Power Management Strategies (Hardware)  Hardware Techniques –Architectural Level  DAS versus Storage Controllers  Single Node Battery versus UPS Technology –Storage Box Level  Disks versus SSDs  Efficient Power Sources  Use of higher capacity disks  Use of lower RPM disks

© 2008 NetApp. All rights reserved. DAS versus Storage Controllers  DAS Storage –Application and storage are co-located –Power consumption is efficient if box is used to run applications (e.g. map- reduce applications) –Power consumption is not efficient if the cluster nodes are only used to serve storage –Low powered shared- nothing nodes are being proposed for archival storage (Pergamum work from UC Santa Cruz)

© 2008 NetApp. All rights reserved. Single Node Battery Versus Centralized UPS  Large UPSs can reach 92 to 95 percent efficiency at full load –Operating at lower load results in inefficiency which results in the generation of heat –Need cooling to remove the heat from the data center  By having 12 volt battery at each of the storage nodes, Google is able to get 99.9 percent efficiency Source: CNET.com Article on Google, April, 2009

© 2008 NetApp. All rights reserved. Power Management Strategies (Hardware)  Hardware Techniques –Architectural Level  DAS versus Storage Controllers  Single Node Battery versus UPS Technology –Storage Box Level  Disks versus SSDs  Efficient Power Sources  Use of higher capacity disks  Use of lower RPM disks

© 2008 NetApp. All rights reserved. Efficient Power Supply  Want Power Supplies that are Efficient for a wider range of load –These cost more –But offer savings in power consumption due to less heat generation (less cooling required)  If there are multiple Power Supplies usually each one is run at lesser load, and thus, has higher inefficiency LoadLess Efficient Power Supply (Efficiency) More Efficient Power Supply (Efficiency) 10 % Load50 % Eff80% Eff 50 % Load75% Eff80% Eff 100 % Load75% Eff90% Eff Source: NetApp Internal Study

© 2008 NetApp. All rights reserved. Higher Capacity Disks Source: NetApp White Paper: WP

© 2008 NetApp. All rights reserved. Power Management Strategies (Software)  Software Techniques –Storage Efficiency  Reduce overhead per amount of usable storage  Efficient Copies  Data De-duplication/Compression  Thin Provisioning  Number of copies  Protection Mechanism –Migration and disk shutdown/spin-down

© 2008 NetApp. All rights reserved. Storage Efficiency Techniques  Reducing Storage Overhead  Thin Provisioning  Efficient Protection Mechanisms  Consolidation of Protocols  Efficient Copies  De-duplication/Compression Source: Oliver Wyman Article, Dec 2007 “Making Green IT a Reality”

© 2008 NetApp. All rights reserved. Disk Spin-down/Shut-down Techniques  Migrate less accessed data to lower tiers of storage and shut-down disks  Archival data can be stored on disks that are shut down because of write- once and read-maybe properties  Difficult to shut-down disks for those applications that have strict latency requirements and have long-tailed distribution access patterns  Spinning things down to lower RPM and then spinning them up is difficult because constant spinning up disks can actually result in higher power consumption  COPAN has shown roughly 5x times power savings compared to normal storage controllers in cases where things can be shut down. –Very dense packaging than traditional storage controllers –Keeps application meta-data in cache –Spins disks down but keeps the electronics up

© 2008 NetApp. All rights reserved. SNIA Green Storage Initiative Device Classification

© 2008 NetApp. All rights reserved. SNIA Configuration & Workload Example

© 2008 NetApp. All rights reserved. SNIA Green Power Profile Example  Green Power Profile –Phase 0  Preconditioning phase no power or IO measurements are necessary  5 minutes maximum OLTP workload  5 minutes no workload (idle)  5 minutes maximum OLTP workload –Phase 1  Idle measurement phase. No user initiated commands allowed  60 minutes measurement period –Phase 2  OLTP workload  20 minutes measurement period  5 minutes rest no OLTP workload –Phase 3  Sequential Throughput 50% Read 50% Write 1MB transfer  20 Minutes measurement period

© 2008 NetApp. All rights reserved. SNIA Green Power Profile Example

© 2008 NetApp. All rights reserved. Power Management Metrics I/O Performance (OLTP Type Workloads) IOPs/Watt CapacityGB/Watt Usable CapacityGB/Watt Sequential I/O Throughput MBps/Watt AvailabilityRTO/Watt 9s/Watt

© 2008 NetApp. All rights reserved. Impact of Server Virtualization on Storage  Server Virtualization is being used to consolidate physical servers to obtain cost, space and power efficiencies  Impact of Server Virtualization on Storage –Need for shared storage –Need for efficient storage with de-duplication –I/O interference due to Multi-tenancy –Mis-match of Hypervisor and Storage constructs –Block Mis-alignment due to layers of storage software

© 2008 NetApp. All rights reserved. Conclusion  Key takeaways –Storage Efficiency is the primary mechanism for saving power by having fewer number of disks –Flash is emerging as a power efficient alternative to disks (price is still an issue) –Shutting-down disks is only attractive for archival storage  Need for: –Power Management Metrics Standards –Power aware storage management tools