Spin-down Disk Model Not Spinning Spinning & Ready Spinning & Access Spinning & Seek Spinning up Spinning down Inactivity Timeout threshold* Request Trigger:

Slides:



Advertisements
Similar presentations
2000 Making DADS distributed a Nordunet2 project Jochen Hollmann Chalmers University of Technology.
Advertisements

Reducing Energy Consumption of Disk Storage Using Power Aware Cache Management Qingbo Zhu, Francis M. David, Christo F. Deveraj, Zhenmin Li, Yuanyuan Zhou.
Chapter 11 – Virtual Memory Management
Energy Efficiency through Burstiness Athanasios E. Papathanasiou and Michael L. Scott University of Rochester, Computer Science Department Rochester, NY.
1 Adapted from UCB CS252 S01, Revised by Zhao Zhang in IASTATE CPRE 585, 2004 Lecture 14: Hardware Approaches for Cache Optimizations Cache performance.
Linearly Compressed Pages: A Main Memory Compression Framework with Low Complexity and Low Latency Gennady Pekhimenko, Vivek Seshadri , Yoongu Kim,
Dave Bradley Rick Harper Steve Hunter 4/28/2003 CoolRunnings.
MASSIVE ARRAYS OF IDLE DISKS FOR STORAGE ARCHIVES D. Colarelli D. Grunwald U. Colorado, Boulder.
Energy Conservation in Datacenters through Cluster Memory Management and Barely-Alive Memory Servers Vlasia Anagnostopoulou Susmit.
L-26 Cluster Computer (borrowed from Randy Katz, UCB)
Dynamic Power Management for Systems with Multiple Power Saving States Sandy Irani, Sandeep Shukla, Rajesh Gupta.
Lecture 17 I/O Optimization. Disk Organization Tracks: concentric rings around disk surface Sectors: arc of track, minimum unit of transfer Cylinder:
Improving Proxy Cache Performance: Analysis of Three Replacement Policies Dilley, J.; Arlitt, M. A journal paper of IEEE Internet Computing, Volume: 3.
May 14, Organization Design and Dynamic Resources Huzaifa Zafar Computer Science Department University of Massachusetts, Amherst.
Fair Scheduling in Web Servers CS 213 Lecture 17 L.N. Bhuyan.
SECTIONS 13.1 – 13.3 Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin SECONDARY STORAGE MANAGEMENT.
DPM Dynamic power management. DPM Tree DPM Timeout Adaptive Device dependent Predictive L-shape Exponential average Predictive wakeup Adaptive Disk shutdown.
Prefetching for Visual Data Exploration Punit R. Doshi, Elke A. Rundensteiner, Matthew O. Ward Computer Science Department Worcester Polytechnic Institute.
CS Spring 2012 CS 414 – Multimedia Systems Design Lecture 34 – Media Server (Part 3) Klara Nahrstedt Spring 2012.
CS Reinforcement Learning1 Reinforcement Learning Variation on Supervised Learning Exact target outputs are not given Some variation of reward is.
University of Karlsruhe, System Architecture Group Balancing Power Consumption in Multiprocessor Systems Andreas Merkel Frank Bellosa System Architecture.
By Ravi Shankar Dubasi Sivani Kavuri A Popularity-Based Prediction Model for Web Prefetching.
Uniprocessor Scheduling
Ideas for Cooperative Disk Management with ECOSystem Emily Tennant Mentor: Carla Ellis Duke University.
Continuous Consistency and Availability Haifeng Yu CPS 212 Fall 2002.
I/O – Chapter 8 Introduction Disk Storage and Dependability – 8.2 Buses and other connectors – 8.4 I/O performance measures – 8.6.
Exploiting Flash for Energy Efficient Disk Arrays Shimin Chen (Intel Labs) Panos K. Chrysanthis (University of Pittsburgh) Alexandros Labrinidis (University.
Reducing Energy Consumption of Disk Storage Using Power- Aware Cache Management Q. Zhu, F. David, C. Devaraj, Z. Li, Y. Zhou, P. Cao* University of Illinois.
CPU Scheduling Introduction to Operating Systems: Module 13.
A Dynamic Caching Algorithm Based on Internal Popularity Distribution of Streaming Media 資料來源 : Multimedia Systems (2006) 12:135–149 DOI /s x.
Generating Intelligent Links to Web Pages by Mining Access Patterns of Individuals and the Community Benjamin Lambert Omid Fatemieh CS598CXZ Spring 2005.
Newsjunkie: Providing Personalized Newsfeeds via Analysis of Information Novelty Gabrilovich et.al WWW2004.
Quality of Service Karrie Karahalios Spring 2007.
Real-Time Scheduling CS4730 Fall 2010 Dr. José M. Garrido Department of Computer Science and Information Systems Kennesaw State University.
Energy-Efficient Data Compression for Modern Memory Systems Gennady Pekhimenko ACM Student Research Competition March, 2015.
Cooperative Disk Management with ECOSystem Emily Tennant Mentor: Carla Ellis Duke University.
1 A New Approach to File System Cache Writeback of Application Data Sorin Faibish – EMC Distinguished Engineer P. Bixby, J. Forecast, P. Armangau and S.
1 Scheduling The part of the OS that makes the choice of which process to run next is called the scheduler and the algorithm it uses is called the scheduling.
Efficient Power Management for Memory in Soft Real Time Systems Midterm presentation.
Energy Management in Virtualized Environments Gaurav Dhiman, Giacomo Marchetti, Raid Ayoub, Tajana Simunic Rosing (CSE-UCSD) Inside Xen Hypervisor Online.
ICOM 6115: Computer Systems Performance Measurement and Evaluation August 11, 2006.
Real-Time Scheduling CS4730 Fall 2010 Dr. José M. Garrido Department of Computer Science and Information Systems Kennesaw State University.
Minimizing Energy Consumption in Sensor Networks Using a Wakeup Radio Matthew J. Miller and Nitin H. Vaidya IEEE WCNC March 25, 2004.
FORS 8450 Advanced Forest Planning Lecture 11 Tabu Search.
Uniprocessor Scheduling
Software Engineering Laboratory, Department of Computer Science, Graduate School of Information Science and Technology, Osaka University July 21, 2008WODA.
Schedules of Reinforcement Thomas G. Bowers, Ph.D.
CUHK Learning-Based Power Management for Multi-Core Processors YE Rong Nov 15, 2011.
Tivoli Software © 2010 IBM Corporation 1 Using Machine Learning Techniques to Enhance The Performance of an Automatic Backup and Recovery System Amir Ronen,
Memory Hierarchy Adaptivity An Architectural Perspective Alex Veidenbaum AMRM Project sponsored by DARPA/ITO.
Energy-Efficient Data Caching and Prefetching for Mobile Devices Based on Utility Huaping Shen, Mohan Kumar, Sajal K. Das, and Zhijun Wang P 邱仁傑.
Adaptive Sleep Scheduling for Energy-efficient Movement-predicted Wireless Communication David K. Y. Yau Purdue University Department of Computer Science.
1 Hidra: History Based Dynamic Resource Allocation For Server Clusters Jayanth Gummaraju 1 and Yoshio Turner 2 1 Stanford University, CA, USA 2 Hewlett-Packard.
Outline for Today’s Lecture Administrative: Objective: –Disconnection in file systems –Energy management.
Application Transformations for Energy and Performance-Aware Device Management Taliver Heath, Eduardo Pinheiro, Jerry Hom, Ulrich Kremer, and Ricardo Bianchini.
Best Available Technologies: External Storage Overview of Opportunities and Impacts November 18, 2015.
Energy Efficient Prefetching and Caching Athanasios E. Papathanasiou and Michael L. Scott. University of Rochester Proceedings of 2004 USENIX Annual Technical.
© 2003, Carla Ellis Vague idea “groping around” experiences Hypothesis Model Initial observations Experiment Data, analysis, interpretation Results & final.
Replicated Object Management with Periodic Maintenance in Mobile Wireless Systems By Ding-Chau Wang, In-Ray Chen, Chin-Ping Chu, and I-ling Yen CS5214.
Ensieea Rizwani An energy-efficient management mechanism for large-scale server clusters By: Zhenghua Xue, Dong, Ma, Fan, Mei 1.
Outline Objective for Lecture –Finish up memory issues: Remote memory in the role of backing store Power-aware memory (Duke research)
Jiahao Chen, Yuhui Deng, Zhan Huang 1 ICA3PP2015: The 15th International Conference on Algorithms and Architectures for Parallel Processing. zhangjiajie,
Vague idea “groping around” experiences Hypothesis Model Initial observations Experiment Data, analysis, interpretation Results & final Presentation Experimental.
Dynamic Power Management Using Online Learning Gaurav Dhiman, Tajana Simunic Rosing (CSE-UCSD) Existing DPM policies do not adapt optimally with changing.
15-744: Computer Networking L-12 Data Center Networking I.
Routing Protocols to Maximize Battery Efficiency
CPU Scheduling Chapter 5.
The
Qingbo Zhu, Asim Shankar and Yuanyuan Zhou
Virtual Memory: Working Sets
Presentation transcript:

Spin-down Disk Model Not Spinning Spinning & Ready Spinning & Access Spinning & Seek Spinning up Spinning down Inactivity Timeout threshold* Request Trigger: request or predict Predictive

Spin-down Disk Model Not Spinning Spinning & Ready Spinning & Access Spinning & Seek Spinning up Spinning down T out Inactivity Timeout threshold* Request Trigger: request or predict Predictive ~1- 3s delay E transition = P transition * T transition T down T idle P down P spin E transition = P transition * T transition

Energy = S Power i x Time i Reducing Energy Consumption i e power states Energy = S Power i x Time i To reduce energy used for task: –Reduce power cost of power state I through better technology. –Reduce time spent in the higher cost power states. –Amortize transition states (spinning up or down) if significant. P down  T down + 2*E transition + P spin * T out < P spin *T idle T down = T idle - (T transition + T out )

Power Specs IBM Microdrive (1inch) writing 300mA (3.3V) 1W standby 65mA (3.3V).2W IBM TravelStar (2.5inch) read/write 2W spinning 1.8W low power idle.65W standby.25W sleep.1W startup 4.7 W seek 2.3W

Spin-down Disk Model Not Spinning Spinning & Ready Spinning & Access Spinning & Seek Spinning up Spinning down Request Trigger: request or predict Predictive.2W W 2W 2.3W 4.7W

Spin-Down Policies Fixed Thresholds –T out = spin-down cost s.t. 2*E transition = P spin *T out Adaptive Thresholds: T out = f (recent accesses) –Exploit burstiness in T idle Minimizing Bumps (user annoyance/latency) –Predictive spin-ups Changing access patterns (making burstiness) –Caching –Prefetching

Dynamic Spindown Helmbold, Long, Sherrod (MOBICOM96) Dynamically choose a timeout value as function of recent disk activity Based on machine learning techniques ( for all you AI students!) Exploits bursty nature of disk activity Compares to (related previous work) –best fixed timeout with knowledge of entire sequence of accesses –optimal - per access best decision of what to do –competitive algorithms - fixed timeout based on disk characteristics –commonly used fixed timeouts

Metrics Spindown cost (s): T idle (sec.) s.t. 2*E transition = P spin *T idle Seconds of Energy: 1 unit = P spin * 1sec. - P down  1 sec. Joules Energy used by timeout: idle time if idle time < timeout timeout + spindown cost if idle > timeout P spin *T idle ____________ P spin - P down

Energy used by optimal idle time if idle < spindown cost spindown cost otherwise (immediate spindown) Excess energy: Energy used by timeout - Energy used by opt Loss: Excess energy / idle time.

Share Algorithm Learning algorithm: Each trial, set of experts make prediction Weighted average of experts predictions After each trial update weights of experts –reduce weights of misleading experts –share the slashed weights among good experts

Specifics For Disk Spindown timeout calculation Each expert is a fixed timeout value (100) weights w i initially 1/n Learning rate used to slash misleading experts:  –4.0 Share parameter to recover expert  –. 

For each trial Timeout =  w i x i /  w i Slashes weights for next time w i ’ = w i e -  Loss(xi) Shares remaining weights pool =  w i ’ (1- (1-  ) Loss(xi) ) w i ” = (1-  ) Loss(xi) w i ’ + 1/n pool Claim little sensitivity to parameters Behavior: idleness makes timeout slowly get smaller; busy makes timeout jump to longer

Experiments and Results Used traces of HP C2474s disks (not many details about environment - multiuser?) Most idle times in 0-1 sec range, <1sec next most frequent Results: this algorithm beats everything except optimal Avoids inappropriate spindowns