CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 CS 695 Topics in Virtualization and Cloud Computing Live Migration of Virtual Machines.

Slides:



Advertisements
Similar presentations
Live migration of Virtual Machines Nour Stefan, SCPD.
Advertisements

Live Migration of Virtual Machines Presented by: Edward Armstrong University of Guelph.
Paging: Design Issues. Readings r Silbershatz et al: ,
Live Migration of Virtual Machines Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen, Eric Jul, Christian Limpach, Ian Pratt, Andrew Warfield.
The Who, What, Why and How of High Performance Computing Applications in the Cloud Soheila Abrishami 1.
Page 15/4/2015 CSE 30341: Operating Systems Principles Allocation of Frames  How should the OS distribute the frames among the various processes?  Each.
Virtual Memory Introduction to Operating Systems: Module 9.
Parallelizing Live Migration of Virtual Machines
Computer Organization CS224 Fall 2012 Lesson 44. Virtual Memory  Use main memory as a “cache” for secondary (disk) storage l Managed jointly by CPU hardware.
Exploiting Data Deduplication to Accelerate Live Virtual Machine Migration Xiang Zhang 1,2, Zhigang Huo 1, Jie Ma 1, Dan Meng 1 1. National Research Center.
Live Migration of Virtual Machines Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen, Eric Jul, Christian Limpach, Ian Pratt, Andrew Warfield.
Xen Virtual Machine Monitor Performance Isolation E0397 Lecture 17/8/2010 Many slides based verbatim on “Xen Credit Scheduler Wiki”
1 Cheriton School of Computer Science 2 Department of Computer Science RemusDB: Transparent High Availability for Database Systems Umar Farooq Minhas 1,
Low-Cost Data Deduplication for Virtual Machine Backup in Cloud Storage Wei Zhang, Tao Yang, Gautham Narayanasamy University of California at Santa Barbara.
CloudScale: Elastic Resource Scaling for Multi-Tenant Cloud Systems Zhiming Shen, Sethuraman Subbiah, Xiaohui Gu, John Wilkes.
COMMA: Coordinating the Migration of Multi-tier applications 1 Jie Zheng* T.S Eugene Ng* Kunwadee Sripanidkulchai† Zhaolei Liu* *Rice University, USA †NECTEC,
Post-Copy Live Migration of Virtual Machines Michael R. Hines, Umesh Deshpande, Kartik Gopalan Computer Science, Binghamton University(SUNY) SIGOPS 09’
Predicting The Performance Of Virtual Machine Migration Presented by : Eli Nazarov Sherif Akoush, Ripduman Sohan, Andrew W.Moore, Andy Hopper University.
Towards High-Availability for IP Telephony using Virtual Machines Devdutt Patnaik, Ashish Bijlani and Vishal K Singh.
CS 300 – Lecture 20 Intro to Computer Architecture / Assembly Language Caches.
Cse Feb-001 CSE 451 Section February 24, 2000 Project 3 – VM.
Instructor: Umar KalimNUST Institute of Information Technology Operating Systems Revisiting Virtual Memory.
OS Spring’04 Virtual Memory: Page Replacement Operating Systems Spring 2004.
03/29/2004CSCI 315 Operating Systems Design1 Page Replacement Algorithms (Virtual Memory)
CSE598C Project: Dynamic virtual server placement Yoojin Hong.
Memory-Mapped Files & Unified VM System Vivek Pai.
Virtualization Technology Prof D M Dhamdhere CSE Department IIT Bombay Moving towards Virtualization… Department of Computer Science and Engineering, IIT.
Dependability Models for Designing Disaster Tolerant Cloud Computing Systems.
Virtualization and Cloud Computing Research at Vasabilab Kasidit Chanchio Vasabilab Dept of Computer Science, Faculty of Science and Technology, Thammasat.
Evaluation of Delta Compression Techniques for Efficient Live Migration of Large Virtual Machines Petter Svärd, Benoit Hudzia, Johan Tordsson and Erik.
Dual Stack Virtualization: Consolidating HPC and commodity workloads in the cloud Brian Kocoloski, Jiannan Ouyang, Jack Lange University of Pittsburgh.
22/07/ The MDS Scaling Problem for Cloud Storage Yu-chong Hu Institute of Network Coding.
Page 19/17/2015 CSE 30341: Operating Systems Principles Optimal Algorithm  Replace page that will not be used for longest period of time  Used for measuring.
An Autonomic Framework in Cloud Environment Jiedan Zhu Advisor: Prof. Gagan Agrawal.
Session objectives Discuss whether or not virtualization makes sense for Exchange 2013 Describe supportability of virtualization features Explain sizing.
Live Migration of Virtual Machines
Dynamic Resource Monitoring and Allocation in a virtualized environment.
Live Migration of Virtual Machines Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen†,Eric Jul†, Christian Limpach, Ian Pratt, Andrew Warfield.
Nathanael Thompson and John Kelm
DCIM319. NIC Management Storage Migration Cluster NIC.
Software Defined Networks for Dynamic Datacenter and Cloud Environments.
Core Migration On SCC [keyword : Lookup Table, MPB] Chan Seok Kang 2013/06/19.
Silberschatz, Galvin and Gagne  Operating System Concepts Virtual Memory Virtual memory – separation of user logical memory from physical memory.
Virtual cloud R 陳昌毅 R 顏昭恩 R 黃伯淳 2010/06/03.
CS2100 Computer Organisation Virtual Memory – Own reading only (AY2015/6) Semester 1.
EECS 262a Advanced Topics in Computer Systems Lecture 20 VM Migration/VM Cloning November 13 th, 2013 John Kubiatowicz and Anthony D. Joseph Electrical.
Virtual Memory Questions answered in this lecture: How to run process when not enough physical memory? When should a page be moved from disk to memory?
Live Migration of Virtual Machines Authors: Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen, Eric Jul, Christian Limpach, Ian Pratt, Andrew.
Developing resource consolidation frameworks for moldable virtual machines in clouds Author: Liang He, Deqing Zou, Zhang Zhang, etc Presenter: Weida Zhong.
Chapter 9: Virtual Memory. 9.2 Silberschatz, Galvin and Gagne ©2005 Operating System Concepts Background Virtual memory – separation of user logical memory.
Urgent Virtual Machine Eviction with Enlightened Post-Copy Yoshihisa Abe†, Roxana Geambasu‡, Kaustubh Joshi, and Mahadev Satyanarayanan† †Carnegie Mellon.
Split Migration of Large Memory Virtual Machines
CS161 – Design and Architecture of Computer
Logistics Homework 5 will be out this evening, due 3:09pm 4/14
CS161 – Design and Architecture of Computer
CS352H: Computer Systems Architecture
From Algorithm to System to Cloud Computing
Section 7 Erasure Coding Overview
Kenichi Kourai Hiroki Ooba Kyushu Institute of Technology, Japan
MOM + oVirt: Nurturing our Virtual Machines
Comparison of the Three CPU Schedulers in Xen
How wonderful an IT can look in the near future
Computer Systems Summary
John Kubiatowicz Electrical Engineering and Computer Sciences
Process Migration Troy Cogburn and Gilbert Podell-Blume
CSE 451 Fall 2003 Section 11/20/2003.
A workload-aware energy model for VM migration
System Virtualization
Efficient Migration of Large-memory VMs Using Private Virtual Memory
Presentation transcript:

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 CS 695 Topics in Virtualization and Cloud Computing Live Migration of Virtual Machines Clark et.al., NSDI 2005

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Aspects of virtual machine migration ● Why big deal? – Live, no process migration-type drawbacks – What are process migration issues ? – Virtual machine managment handle (consolidation etc.) ● What are parameters of migration?

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 The pre-copy approach

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Important points ● ARP ● What is ARP? ● Why required? ● Network attached storage ● Why ? ● Reliability guarantee ● What if A's ACK lost?

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Pre-copy Optimizations ● Dynamic rate-limiting – Is this required? – Should be ON by default? ● Skip list – Skip pages dirtied in this iteration ● Stun rougue pages ● Free page-cache pages – What is implication?

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Pre-copy in action

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Positives ● Well written ● Empirical motivation precedes procedures – e.g., dynamic rate limiting ● Experiments presented with clarity – All graphs readable – Several real workloads consider for evaluation – “performance” implications on application (Fig. 8) ● Realistic problem in the virtualization domain ● All VM technologies support migration

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Negatives ● Section 5.3, dynamic-rate limiting, could have been presented as an algorithm ● Pseudo-random scanning order ● What is the ordering procedure?

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Questions #1 ● What is et.al.? ● What is NSDI? ● What is RAID? ● Why is migration-time a parameter? ● What are the resource parameters?

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Extensions ● Experiments – Page dirty rate vs. Migration parameters – CPU resource overheads for migration, if no extra CPU at Dom0 then what? ● Ballooning procedure – How much to balloon before migration ? – Time to balloon =, time to migrate ? – f(writeable working set) – Balloon size vs. Migration parameters (for different page dirty rates, working set sizes)

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Post-Copy Based Live Virtual Machine Migration Using Adaptive Pre-Paging and Dynamic Self-Ballooning Michael R. Hines and Kartik Gopalan VEE 2009 what is VEE?

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Drawbacks of pre-copy?

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Drawbacks of pre-copy? ● Downtime can be high if page dirty rate/writeable working set high – Paper does not quantify this (in motivation)

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Post-copy approach ● Demand Paging + Active push ● + ● Post-copy ● + ● Adaptive pre-paging ● + ● Dynamic self ballooning

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Timeline comparison

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Implications of post-copy approach

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Implications of post-copy approach ● Low downtime, VM up quickly at dest. ● Page-faults go over network ● Number of times each page transmitted = ?fs ● Worst case migration time = ?

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Reliability with post-copy ● What is source VM fails? ● What if destination VM fails?

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Pseudo-Paging (for pre-paging and active pushing)

CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 Dynamic Self Ballooning ● The set_shrinker function ● To clean up dentry cache and the inode cache ● reclaim the pages from the disk cache, then it returns the number of reclaimable pages remaining in the cache ● How does DSB use this?