Post-Copy Live Migration of Virtual Machines Michael R. Hines, Umesh Deshpande, Kartik Gopalan Computer Science, Binghamton University(SUNY) SIGOPS 09’

Slides:



Advertisements
Similar presentations
Remus: High Availability via Asynchronous Virtual Machine Replication
Advertisements

Live migration of Virtual Machines Nour Stefan, SCPD.
Adding the Easy Button to the Cloud with SnowFlock and MPI Philip Patchin, H. Andrés Lagar-Cavilla, Eyal de Lara, Michael Brudno University of Toronto.
Paging: Design Issues. Readings r Silbershatz et al: ,
M. Muztaba Fuad Masters in Computer Science Department of Computer Science Adelaide University Supervised By Dr. Michael J. Oudshoorn Associate Professor.
Virtualization and Cloud Computing. Definition Virtualization is the ability to run multiple operating systems on a single physical system and share the.
Virtual Memory. 2 What is virtual memory? Each process has illusion of large address space –2 32 for 32-bit addressing However, physical memory is much.
XEN AND THE ART OF VIRTUALIZATION Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, lan Pratt, Andrew Warfield.
Live Migration of Virtual Machines Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen, Eric Jul, Christian Limpach, Ian Pratt, Andrew Warfield.
Distributed Process Management
Exploiting Data Deduplication to Accelerate Live Virtual Machine Migration Xiang Zhang 1,2, Zhigang Huo 1, Jie Ma 1, Dan Meng 1 1. National Research Center.
Live Migration of Virtual Machines Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen, Eric Jul, Christian Limpach, Ian Pratt, Andrew Warfield.
Heterogeneous Live Migration of Virtual Machines Pengcheng Liu, Ziye Yang, Xiang Song, Yixun Zhou, Haibo Chen, and Binyu Zang Parallel Processing Institute,
Threads, SMP, and Microkernels Chapter 4. Process Resource ownership - process is allocated a virtual address space to hold the process image Scheduling/execution-
Multithreaded FPGA Acceleration of DNA Sequence Mapping Edward Fernandez, Walid Najjar, Stefano Lonardi, Jason Villarreal UC Riverside, Department of Computer.
COMMA: Coordinating the Migration of Multi-tier applications 1 Jie Zheng* T.S Eugene Ng* Kunwadee Sripanidkulchai† Zhaolei Liu* *Rice University, USA †NECTEC,
Predicting The Performance Of Virtual Machine Migration Presented by : Eli Nazarov Sherif Akoush, Ripduman Sohan, Andrew W.Moore, Andy Hopper University.
CS 333 Introduction to Operating Systems Class 11 – Virtual Memory (1)
Distributed Process Management
1 Regular expression matching with input compression : a hardware design for use within network intrusion detection systems Department of Computer Science.
Inferring the Topology and Traffic Load of Parallel Programs in a VM environment Ashish Gupta Resource Virtualization Winter Quarter Project.
PRASHANTHI NARAYAN NETTEM.
1 Distributed Systems: Distributed Process Management – Process Migration.
MULTICOMPUTER 1. MULTICOMPUTER, YANG DIPELAJARI Multiprocessors vs multicomputers Interconnection topologies Switching schemes Communication with messages.
Virtualization and Cloud Computing Research at Vasabilab Kasidit Chanchio Vasabilab Dept of Computer Science, Faculty of Science and Technology, Thammasat.
Evaluation of Delta Compression Techniques for Efficient Live Migration of Large Virtual Machines Petter Svärd, Benoit Hudzia, Johan Tordsson and Erik.
Department of Computer Science Engineering SRM University
Mac OS X Panther Operating System
Kenichi Kourai (Kyushu Institute of Technology) Takuya Nagata (Kyushu Institute of Technology) A Secure Framework for Monitoring Operating Systems Using.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Improving Network I/O Virtualization for Cloud Computing.
Zero-copy Migration for Lightweight Software Rejuvenation of Virtualized Systems Kenichi Kourai Hiroki Ooba Kyushu Institute of Technology.
RESOURCE MANAGEMENT FOR ISOLATION ENHANCED CLOUD SERVICES Presented by: Yun Liaw Ripal Nathuji Abhishek SinghPaul England ACM Workshop on Cloud Computing.
Transparent Process Migration: Design Alternatives and the Sprite Implementation Fred Douglis and John Ousterhout.
Live Migration of Virtual Machines
Live Migration of Virtual Machines Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen†,Eric Jul†, Christian Limpach, Ian Pratt, Andrew Warfield.
Virtualization Infrastructure Administration
Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters
Threads, SMP, and Microkernels Chapter 4. Process Resource ownership - process is allocated a virtual address space to hold the process image Scheduling/execution-
Chapter 8-2 : Multicomputers Multiprocessors vs multicomputers Multiprocessors vs multicomputers Interconnection topologies Interconnection topologies.
Synchronized Co-migration of Virtual Machines for IDS Offloading in Clouds Kenichi Kourai and Hisato Utsunomiya Kyushu Institute of Technology, Japan.
Latency Reduction Techniques for Remote Memory Access in ANEMONE Mark Lewandowski Department of Computer Science Florida State University.
Min Lee, Vishal Gupta, Karsten Schwan
Precomputation- based Prefetching By James Schatz and Bashar Gharaibeh.
VMWare MMU Ranjit Kolkar. Designed for efficient use of resources. ESX uses high-level resource management policies to compute a target memory allocation.
Efficient Live Checkpointing Mechanisms for computation and memory-intensive VMs in a data center Kasidit Chanchio Vasabilab Dept of Computer Science,
Project Presentation By: Dean Morrison 12/6/2006 Dynamically Adaptive Prepaging for Effective Virtual Memory Management.
Design Issues of Prefetching Strategies for Heterogeneous Software DSM Author :Ssu-Hsuan Lu, Chien-Lung Chou, Kuang-Jui Wang, Hsiao-Hsi Wang, and Kuan-Ching.
Core Migration On SCC [keyword : Lookup Table, MPB] Chan Seok Kang 2013/06/19.
1 Agility in Virtualized Utility Computing Hangwei Qian, Elliot Miller, Wei Zhang Michael Rabinovich, Craig E. Wills {EECS Department, Case Western Reserve.
Virtual cloud R 陳昌毅 R 顏昭恩 R 黃伯淳 2010/06/03.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Technical Reading Report Virtual Power: Coordinated Power Management in Virtualized Enterprise Environment Paper by: Ripal Nathuji & Karsten Schwan from.
Department of Computer Sciences, University of Wisconsin Madison DADA – Dynamic Allocation of Disk Area Jayaram Bobba Vivek Shrivastava.
Live Migration of Virtual Machines Authors: Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen, Eric Jul, Christian Limpach, Ian Pratt, Andrew.
Virtual Memory. 2 Last Week Memory Management Increase degree of multiprogramming –Entire process needs to fit into memory Dynamic Linking and Loading.
Developing resource consolidation frameworks for moldable virtual machines in clouds Author: Liang He, Deqing Zou, Zhang Zhang, etc Presenter: Weida Zhong.
IMPROVEMENT OF COMPUTATIONAL ABILITIES IN COMPUTING ENVIRONMENTS WITH VIRTUALIZATION TECHNOLOGIES Abstract We illustrates the ways to improve abilities.
Urgent Virtual Machine Eviction with Enlightened Post-Copy Yoshihisa Abe†, Roxana Geambasu‡, Kaustubh Joshi, and Mahadev Satyanarayanan† †Carnegie Mellon.
CS 695 Topics in Virtualization and Cloud Computing, Autumn 2012 CS 695 Topics in Virtualization and Cloud Computing Live Migration of Virtual Machines.
Split Migration of Large Memory Virtual Machines
NFV Group Report --Network Functions Virtualization LIU XU →
Group 8 Virtualization of the Cloud
Introduction to Operating Systems
Lecture 39 Syed Mansoor Sarwar
Process Migration Troy Cogburn and Gilbert Podell-Blume
Lecture 9: Caching and Demand-Paged Virtual Memory
Process/Code Migration and Cloning
System Virtualization
Efficient Migration of Large-memory VMs Using Private Virtual Memory
Presentation transcript:

Post-Copy Live Migration of Virtual Machines Michael R. Hines, Umesh Deshpande, Kartik Gopalan Computer Science, Binghamton University(SUNY) SIGOPS 09’ 1

Outline Introduction Performance Gauge Design Evaluation Conclusion 2

Introduction Use post-copy live migration Reduce total migration time and page faults Implement Dynamic Self Ballooning(DSB) to improve performance of both Pre-copy and Post-copy 3

Performance Gauge(1) Preparation Time – The time between initiating migration and transferring the VM’s processor states to the target node Downtime – The time that service on migrated VM is unavailable Resume Time – The time between resuming the VM’s execution at the target and the end of migration 4

5

Performance Gauge(2) Pages Transferred – the total count of memory pages transferred Total Migration Time – the sum of all the above times from start to finish Application Degradation – the extent to which migration slows down the applications running in the VM 6

Design(1) -- Approach 1. Stop the VM on source host 2. Copy processor state to the target host 3. Resume the VM on target host 4. Begin fetching memory pages over the network from the source(Bottleneck) How to improve? 7

Design(2) Demand Paging – If VM’s memory accessed result in page fault, that can be serviced by requesting the referenced page over the network from the source node. – ensures that each page is sent over the network only once – Page fault will slow down the VM – Long-term residual dependency 8

Design(3) Active Push – proactively “push” the VM’s pages from the source to the target even as the VM continues executing at the target – ensures that residual dependencies are removed from the source host as quickly as possible 9

Design(4) Prepaging – using the faulting addresses as hints to estimate the spatial locality of the VM’s memory access pattern – Bubbling algorithm – Reduce page faults and the duration of the resume phase 10

First, set pivot = 0 0Max Pivot Forward Edge of Bubble 0Max Pivot 1 0 Forward Edge of Bubble 0Max Pivot Page Fault ! Set pivot to the fault page Forward Edge of BubbleBackward Edge of Bubble 11

12

Design(5) Dynamic Self-Ballooning (DSB) – Reduce the number of free pages transferred during migration 13

Design(6)—DSB cont. (1) Inflate the balloon: – A kernel-level DSB thread in the VM first allocates as much free memory as possible and hands those pages over to the hypervisor. (2) Detect memory pressure: – Memory pressure indicates that some entity needs to access a page frame right away. – The DSB process must partially deflate the balloon depending on the extent of memory pressure. (3) Deflate the balloon: – Deflation is the reverse of Step 1 14

Evaluation--environment Host – 2.8 GHz multi-core Intel Machine – Gigabit Ethernet Switch – 4 to 16GB memory VM – 2 virtual cores – 512MB memory 15

Evaluation(1)—total time 16

Evaluation(2)--downtime 17

Evaluation(3)—pages transferred 18

19

Conclusion & Comment Another method for live migration In some case, it performs better than pre-copy DSB improve the performance of both pre- copy and post-copy It’s still unreliable 20