1. 1/30/2015 Just-in-Time Virtual Machine Provisioning for Cloud Offload Kiryong Ha (krha@cmu.edu) Carnegie Mellon University

2. Motivation: Cloud Offload Compute-intensive & interactive applications in mobile context Apple’s Siri, AR (Augmented Reality) applications Cloud offload These applications are partitioned into a client/a server – Client program: front-end app installed on a mobile device – Server program : back-end program running on a datacenter (e.g., Amazon EC2) The client program offloads computation to the server program at Cloud 2 Today’s cloud is a suboptimal place; high latency and limited bandwidth

3. Cloud Computing at the edge of the Internet Cloudlet: Micro Datacenter at the edge of the Internet  Bring the cloud closer to the user 3 WAN LAN OS Server prog Client prog … Cloud (Datacenter) Eiffel tower VM Server prog Eiffel tower Nokia Siemens Network & IBM NVIDIA How to provision a back-end server program (VM) at a nearby machine? Augment Reality Cloudlet (local server)

4. Goal: Rapid Just-in-time VM Provisioning Provisioning server program  Just-in-time VM provisioning Preserve the running state of the server by snapshotting Provision ① disk image ② memory snapshot 4 WAN Cloud Cloudlet Goal Goal: Rapid Just-in-time VM provisioning for cloud offload disk.img mem.snap VM OS Server VM OS Server Challenge: the speed of provisioning disk.img mem.snap

5. Approach: VM Synthesis VM Synthesis : dividing a custom VM into two pieces 1)Base VM: Vanilla OS that contains kernel and basic libraries (e.g., Windows7) 2)VM overlay: A binary patch that contains only customized parts  Pre-provision Base VM + just-in-time provision VM overlay Base VM Customized VM (Launch VM) Binary delta Overlay Memory Overlay Disk VM overlay Compress Base Disk Base Memory 5 disk.. mem …

6. VM Synthesis Steps for VM synthesis VM overlay Synthesize VM - Decompress - Apply delta Resume the VM User Offload operations ready Cloudlet pre-populated base VM 6 VM synthesis time VM overlay Base Disk Base Memory VM OS Server Eiffel tower

7. OpenStack Implementation Implementation – Grizzly (at Ubuntu 12.04 LTS) – Icehouse (at Ubuntu 14.04 LTS) – Standalone version Main Features 1.Create a custom VM overlay (nova-compute extension) 2.Store Base VM and VM overlay (glance) 3.Perform VM synthesis 7

8. OpenStack Implementation 8

9. 9

10. Overview of Optimizations 1.Creating VM overlay: Minimize VM overlay size 2.VM Synthesis: Accelerate VM Synthesis 10 WAN Cloud Cloudlet VM OS Server VM OS Server 2. Deduplication 1. Reducing Semantic Gaps 3. Pipelining 4. Early Start VM overlay

11. First Response Time of the Application Time between starting VM synthesis and receiving the first offload result at client First-response within 10 seconds except AR Time between starting VM synthesis and receiving the first offload result at client First-response within 10 seconds except AR [intro][background][optimization] [result] [conclusion] 11 10

12. References Cloudlet project page – http://elijah.cs.cmu.edu/ http://elijah.cs.cmu.edu/ Paper 1)Kiryong Ha, Padmanabhan Pillai, Wolfgang Richter, Yoshihisa Abe, Mahadev Satyanarayanan, “Just-in-Time Provisioning for Cyber Foraging”, In MobiSys 2013 http://krha.kr/data/pubs/vmsynthesis2013.pdf http://krha.kr/data/pubs/vmsynthesis2013.pdf 2)Satyanarayanan, M., Bahl, P., Caceres, R., Davies, N. ‘‘The Case for VM-based Cloudlets in Mobile Computing’’ IEEE Pervasive Computing 2009. http://www.cs.cmu.edu/~satya/docdir/satya-ieeepvc-cloudlets-2009.pdf http://www.cs.cmu.edu/~satya/docdir/satya-ieeepvc-cloudlets-2009.pdf Source code 1)https://github.com/cmusatyalab/elijah-provisioninghttps://github.com/cmusatyalab/elijah-provisioning 2)https://github.com/cmusatyalab/elijah-openstackhttps://github.com/cmusatyalab/elijah-openstack 12