1. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Evolution of virtual infrastructure with Hyper-V Juraj Sucik, Slavomir Kubacka Internet Services Group CERN IT

2. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Let’s continue… 2 2006  Microsoft Virtual Server 2005 2008  Hyper–V 2008  SCVMM 2008 2009 Sep  Hyper–V 2.0 + SCVMM 2008 R2

3. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Hyper-V Features 3 Hypervisor feature of WS 2008 32 and 64-bit virtual machines Up to 4 CPUs per VM Max 32 GB of memory per VM Snapshots Failover clustering Scriptable interface

4. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t SCVMM 2008 Features 4 Enterprise management solution Windows Powershell API V2V and P2V capabilities Web portal Intelligent placement Library and templates Delegated management roles Job history Support for highly available VM VM Migration

5. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Hyper-V Infrastructure 5

6. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t System Architecture 6 Microsoft Virtual Machine Manager Windows Powershell SOAP Services Virtual Machine Manager Admin Console Virtual Machine Manager Admin Console CERN Virtual Infrastructure Web Interface CERN Virtual Infrastructure Web Interface Backups OS Maintenance LAN DB Application Management 6

7. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t CERN Virtual Infrastructure 7

8. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t CERN Virtual Infrastructure 8

9. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Enhancements

10. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Hyper-V 2.0 Features Live migration Cluster Shared Volume (CSV)  Enables multiple nodes in a cluster to access a single shared LUN  Dynamic I/O redirection Network optimizations TCP/IP Traffic in a VM can be offloaded to a physical NIC on the host computer Processor compatibility mode Allows live migration across different CPU versions within the same processor family 10

11. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Hyper-V 2.0 Features Logical Processor Support  Support for 32 logical processors on host computer Hot Add/Remove Storage  Add and remove VHD disks to a running VM without requiring a reboot Second Level Translation (SLAT) Leverage new processor features to improve performance and reduce load on Windows Hypervisor Better SMP support for Linux 11

12. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t SCVMM 2008 R2 Features Manage WS 2008 R2 Hyper-V Live Migration Detects if Live migration can be done Maintenance mode Placement of new VM not allowed Existing VMs migrated off or saved Multiple VM per LUN using CSV Supports CSV feature of HV 2.0 V2P feature 12

13. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t SCVMM 2008 R2 Features SAN related enhancements Promote non-HA VM to HA VM by migrating it to a clustered host, and vice versa to “demote” the VM Network optimizations If enabled, VMM will configure the VM to use VMQ or Chimney, if available on the host Rapid provisioning Avoids copying VHD from library VDI integration 13

14. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Why Migration? Maintenance reasons Load balancing Green IT Fast migration SOAP interface 14

15. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Live Migration No dropped network connections No perceived loss of service Clustered Shared Volumes facilitates LM Leverages Failover Clustering 15

16. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Quick vs. Live Migration Quick Migration (Windows Server 2008 Hyper-V) Host 1 Host 2 1. Save state Create VM on the target Write VM memory to shared storage 2. Move virtual machine Move storage connectivity from source host to target host via Ethernet 3. Restore state & Run Take VM memory from shared storage and restore on Target Run 16

17. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Quick vs. Live Migration Live Migration (WS08R2 Hyper-V) Host 1 Host 2 17 1. VM State/Memory Transfer Create VM on the target Move memory pages from the source to the target via Ethernet 2. Final state transfer and virtual machine restore Pause virtual machine Move storage connectivity from source host to target host via Ethernet 3. Un-pause & Run

18. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t VMware vs. Hyper-V R2 AspectvSphere 4Hyper-V R2 # CPU core64 Memory1TB2TB # nodes in cluster3216 # virtual CPU84 # guest per host256192 Virtual memory256GB64GB Hot-add diskYesSCSI only VM moveLive # of snapshots3250 HA via clusteringYes Market share44%23% Source: Login, USENIX Magazine, Oct 2009 18

19. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Hyper-V Linux VM RHEL supported as guest OS Open source drivers (GPL) in 2.6.32 CPU Benchmark 19

20. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Linux in VM Time synchronization  Kernel parameters, e.g. notsc divider=10 Virtual serial console Admin privileges 5 Linux templates 20

21. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Consolidation vs. batch 21 AspectService consolidation Batch virtualization Scale (machines)~ 100~ 1000 CPU usageLittleHigh HardwareReliableCheap ServicesCriticalNon-critical MigrationLiveNot required VM life timeLongLimited

22. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t ELFms Integration 22 Microsoft Virtual Machine Manager Windows Powershell SOAP Services Virtual Machine Manager Admin Console Virtual Machine Manager Admin Console Perl SOAP client HMS AIMS Lemon Perl SOAP client HMS AIMS Lemon Backups OS Maintenance LAN DB Application Management 22

23. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Experiment use case VOBox service – dedicated servers for experiments: 222 and growing rapidly! 23

24. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t CC Virtualization Future Consolidation of servers on critical power supply as the power is very limited Development resources for IT-FIO 24

25. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t What’s next? CERN fabric management integration  LEAF  Lemon  Quattor  SLS Integrate Hyper-V drivers with SLC Rapid provisioning 25

26. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Virtual Desktop Infrastructure 26 OfficeComputer Centre Thin Client PC Blade PCs Terminal Services Cluster Hyper-V servers with Virtual Desktops Connection Broker

27. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t VDI Use Cases 27 Propose Virtual Desktop self service  for experiment developers  as an alternative to dual-boot  as an alternative to Terminal Services Evaluate a thin client technology, which could be solution for  public computers  basic office users Jack PC Thin Client

28. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Conclusion Latest editions of Hyper-V + SCVMM in production Better Linux support Live migration Integration with CERN IT services  Fabric management tools Visit our website CERN Virtual Infrastructure: http://cern.ch/cvi http://cern.ch/cvi 28

29. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Virtual Desktop Infrastructure 29

30. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Quick vs. Live Migration Quick Migration (Windows Server 2008 Hyper-V) 1. Save state  Create VM on the target  Write VM memory to shared storage 2. Move virtual machine  Move storage connectivity from source host to target host via Ethernet 3. Restore state & Run  Take VM memory from shared storage and restore on Target  Run Live Migration (WS08R2 Hyper-V) 1. VM State/Memory Transfer  Create VM on the target  Move memory pages from the source to the target via Ethernet 2. Final state transfer and virtual machine restore  Pause virtual machine  Move storage connectivity from source host to target host via Ethernet 3. Un-pause & Run Host 1 Host 2 Host 1 Host 2 30

31. CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t SOAP method calls 1)Request VM 2)Delete VM 3)Start VM 4)Stop VM 5)Save State of VM 6)Migrate Virtual Machine Request (Create) / Delete Migrate Save State Start / Stop 31