nanoHUB.org online simulations and more Network for Computational Nanotechnology 1 Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure Paul Ruth, Junghwan Rhee, Dongyan Xu Department of Computer Science and Center for Education and Research in Information Assurance and Security (CERIAS) Rick Kennell, Sebastien Goasguen Rosen Center for Advanced Computing Purdue University West Lafayette, Indiana, USA IEEE International Conference on Autonomic Computing (ICAC’06)

nanoHUB.org online simulations and more Network for Computational Nanotechnology 2 Outline of Talk Motivations Overall architecture Design and implementation Real-world deployment in nanoHUB Related work Conclusion Demo

nanoHUB.org online simulations and more Network for Computational Nanotechnology 3 Motivations Formation of shared distributed cyberinfrastructure (CI)  Spanning multiple domains  Serving users/user communities with diverse computation needs  Exhibiting dynamic resource availability and workload Need for virtual distributed environments (VIOLINs), each with  Customizability and legacy application compatibility  Administrative privileges  Isolation, security, and accountability  Autonomic adaptation capability - A unique opportunity brought by virtualization (VMs and VNs)

nanoHUB.org online simulations and more Network for Computational Nanotechnology 4 Adaptive VIOLINs Internet Duke U. U. Florida nanoHUB Physical cluster Virtual clusters (VIOLINs)

nanoHUB.org online simulations and more Network for Computational Nanotechnology 5 Autonomic VIOLIN Adaptation Adaptation triggers:  Dynamic availability of infrastructural resources  Dynamic resource needs of applications running inside Adaptation actions:  Resource re-allocation  Scale adjustment (adding/deleting virtual machines)  Re-location (migrating virtual machines) Adaptation goals:  Improving application performance  Increasing infrastructural resource utilization  Maintaining user/application transparency  Minimizing infrastructure administrator attention

nanoHUB.org online simulations and more Network for Computational Nanotechnology 6 Research Challenges Autonomic live adaptation mechanisms  VM Resource monitoring and scaling  Application profiling and non-intrusive sensing of application needs  Live VIOLIN re-location across domains Adaptation policies  VIOLIN adaptation model  Infrastructure resource availability and topology  Application resource needs  Application configuration and topology  Optimal VIOLIN adaptation decision-making  Goals (cost vs. gains)?  When to adapt?  How and how much to adapt?  Where to migrate?

nanoHUB.org online simulations and more Network for Computational Nanotechnology 7 Dom0 Overall Architecture VIOLIN Switch Monitoring Daemon VIOLIN Switch Monitoring Daemon VIOLIN Switch Monitoring Daemon Adaptation Manager Dom0 VMs Physical Network Scale Up CPU Update Migrate VIOLIN Switch VMM

nanoHUB.org online simulations and more Network for Computational Nanotechnology 8 VIOLIN Adaptation Policies Maintain desirable resource utilization level Reclaim resource if under-utilized over a period Add resource if over-utilized over a period  Scale up local resource share  Migrate to other host(s)  Balance host workload  Intra-domain migration first  Minimize migration Re-adjust resource according to application needs

nanoHUB.org online simulations and more Network for Computational Nanotechnology 9 Implementation and Deployment Extension to non-adaptive VIOLIN  Based on Xen 3.0 (w/ VM Live migration capability)  Enabling live VIOLIN migration across domains  IP addresses of VMs  Root file systems of VMs  Leveraging Xen libraries for VM resource monitoring (xenstat, xentop)  Extending VIOLIN switch for inter-VM bandwidth monitoring Deployment in nanoHUB  On-line, on-demand simulation service for nanotechnology community  Web interface for regular users  “My workspace” interface for advanced users  Local infrastructure: two clusters in two subnets

nanoHUB.org online simulations and more Network for Computational Nanotechnology 10 nanoHUB Deployment Overview Delegated trust Local Virtual Machines Migratable Isolated from Local infrastructure VIOLIN Virtual Cluster Virtual Infrastructure over WAN

nanoHUB.org online simulations and more Network for Computational Nanotechnology 11 VIOLIN in nanoHUB Simulation job VIOLIN In the backround:

nanoHUB.org online simulations and more Network for Computational Nanotechnology 12 VIOLIN in nanoHUB Autonomic property: Users focus on simulation semantics and results, unaware of VIOLIN creation, setup, and adaptation.

nanoHUB.org online simulations and more Network for Computational Nanotechnology 13 Impact of Migration on App. Execution End-to-end execution time of NEMO3D w/ and w/o live VIOLIN migration

nanoHUB.org online simulations and more Network for Computational Nanotechnology 14 VIOLIN Adaptation Scenario Without AdaptationWith Adaptation Domain 1Domain 2 1. Initially VIOLIN 1, 2, 3 are computing, VIOLIN 2 is about to be finished. Domain 1Domain 2 2. After VIOLIN 2 is finished, before adaptation VIOLIN 1 VIOLIN 4 VIOLIN 5VIOLIN 3 VIOLIN 2

nanoHUB.org online simulations and more Network for Computational Nanotechnology After VIOLIN 2 is finished, before adaptation 3. After adaptation VIOLIN Adaptation Scenario Without AdaptationWith Adaptation Domain 1Domain 2Domain 1Domain 2 VIOLIN 1 VIOLIN 4 VIOLIN 5VIOLIN 3 VIOLIN 2

nanoHUB.org online simulations and more Network for Computational Nanotechnology 16 VIOLIN Adaptation Scenario 4. After VIOLIN 4, 5 are created Without AdaptationWith Adaptation Domain 1Domain 2Domain 1Domain 2 3. After adaptation VIOLIN 1 VIOLIN 4 VIOLIN 5VIOLIN 3 VIOLIN 2

nanoHUB.org online simulations and more Network for Computational Nanotechnology After VIOLIN 4, 5 are created5. After VIOLIN 1, 3 are finished VIOLIN Adaptation Scenario Without AdaptationWith Adaptation Domain 1Domain 2Domain 1Domain 2 VIOLIN 1 VIOLIN 4 VIOLIN 5VIOLIN 3 VIOLIN 2

nanoHUB.org online simulations and more Network for Computational Nanotechnology ALL VIOLINs are finished5. After VIOLIN 1, 3 are finished VIOLIN Adaptation Scenario Without AdaptationWith Adaptation Domain 1Domain 2Domain 1Domain 2 VIOLIN 1 VIOLIN 4 VIOLIN 5VIOLIN 3 VIOLIN 2

nanoHUB.org online simulations and more Network for Computational Nanotechnology 19 Limitations and Future Work Simple, heuristic adaptation policy  Application of machine learning and data mining techniques Centralized adaptation manager  Hierarchical or peer-to-peer adaptation managers Imprecise application resource demand inference  Multi-dimensional, fine-grain resource demand profiling Campus-wide infrastructure  Evaluation and deployment in wide-area infrastructure

nanoHUB.org online simulations and more Network for Computational Nanotechnology 20 Related Work VNET (Northwestern U.) Cluster-on-Demand (COD) (Duke U.) Virtual Workspaces on Grid (Argonne National Lab) SoftUDC (HP Labs) WOW and IPOP (U. Florida)

nanoHUB.org online simulations and more Network for Computational Nanotechnology 21 Conclusions Autonomically adaptive virtual infrastructures (VIOLINs)  A new opportunity brought by virtualization technologies  Decoupled from underlying shared infrastructure  Intelligent, first-class entities with user-transparent resource provisioning Key benefits  Application performance improvement  Infrastructure resource utilization  Management convenience (at both virtual and physical levels) “The Cray motto is: adapt the system to the application - not the application to the system.” - Steve Scott, CTO, Cray Inc. on “adaptive supercomputing”, March 2006

nanoHUB.org online simulations and more Network for Computational Nanotechnology 22 Thank you. For more information: URL: Google: “Purdue VIOLIN FRIENDS”