Virtualization for autonomous administration of servers

Plan Context Client Specifications Xen setting up Preliminary study Requirements Architecture Test Scheme Integration in TUNe Introduction to TUNe Architecture Wrappers and Reconf diagrams Project Management Conclusion

Context

Servers costElectrical ConsumptionDistributed Servers MetricServer reservation price Per server electrical consumption Network load and servers distances Goal Minimizing costs = Bringing together low CPU consumers minimizing electrical consumption = Shutting down low CPU consumers minimizing communication times = Bringing together highly communicating servers

Context Virtual Machine 1 Virtual Machine 2 Expansion Criteria Shrink Criteria

Clients Specification

Client Specifications Xen Paravirtualization Tools TUNe NFS A working scenario

Client Specifications Virtual Machine 1 Virtual Machine 2 Request number rising Request number reduction

Hardware Domain 0 Abstraction Layer Xen Control Interface Xen Control Interface Modified Drivers User Applications Xen Control Software Xen Control Software Preliminary Study User Domain 1 Abstraction Layer Modified Drivers User Applications Xen Hypervisor User Domain 2 Abstraction Layer Modified Drivers User Applications

Dom0-1 DomU Dom0-2 xm migrate Preliminary Study

Physical Machine DomU-1 Dom0 xenbr0 vif2.0vif1.0vif2.0 vif0.0 eth0 DomU-2 eth0eth1eth0 peth0 Preliminary Study

Dom0-1 DomU Dom0-2 xm migrate NFS server

Requirements Migration requirements: no task interruption TCP connection keeping Results consistency CPU load independence Migration performance study: Interruption duration Migration duration Delay Integration in TUNe

A DHCP Server NFS Server Switch A DNS Server NTP Server Architecture A A A

Architecture dom0 Ubuntu Gutsy Gibbon / Xen ManagementXend Daemon domU-1 Ubuntu Dapper Drake / NFS root domU-1 GNU/Linux Debian Etch / NFS root

Tests

Test Scheme TCP connections preservation Migration of streaming server Results integrity Writting in a file CPU load independency Migration with different CPU loads Interruption duration Ping probing Delay Comparison with local execution of LU factorizations Migration duration Comparison with equivalent RMI calls

Migration Test Scheme Results consistency Dom0-1 DomU Dom0-2 Writting in a file

Migration Test Scheme CPU Load Independence Dom0-1 DomU Dom0-2 CPU loading

Migration Test Scheme Interruption Duration Dom0-1 DomU Dom0-2 Pings Results: 1s Monitor Computer

Migration Test Scheme Delay DomU Dom0-2 Dom0-1 LU Factorizations

Test Scheme Delay DomU Dom0-2 Dom0-1 Chrono Ping pong Migration

Migration Test Scheme TCP Connection Preservation Dom0-1 DomU Dom0-2 StreamingServer Streaming Client

Test Scheme TCP Connection Preservation Streaming Client Output Dom0 Source Dom0 Destination Network Traffic Monitor

TUNe

TUNe Presentation Component-Based Architecture Fractal Components ADL Architecture Description Languague

TUNe Presentation High Level management tools Tune Wrapper Stubs Legacy Software Wrappers

TUNe Presentation Deployment diagrams S1.configure S2.configure S1.start S2.start S2 +wrapper : String = S2.xml +legacyFile : String = S2.tgz +host-family : String = localhost +wrapper : String = S2.xml +legacyFile : String = S2.tgz +host-family : String = localhost 1 1 S2 +wrapper : String = S2.xml +legacyFile : String = S2.tgz +host-family : String = localhost +wrapper : String = S2.xml +legacyFile : String = S2.tgz +host-family : String = localhost

TUNe Presentation Reconfiguration diagrams this.stop this.start this.reconfigure event

Migration Pool Architecture Dom0-1 Dom0-2 DomU Event Migrate TUNe Administrator

Pool Architecture TUNe wrappers domU wrapper StartStop Migrate domU Probe wrapper StartStop

Pool Architecture TUNe Diagrams this.probed.migrate Migrate etch1-1.start etch1-1-Probe.start Start etch1-1.stop etch1-1-Probe.stop Stop

Project Management

Google Code version control software Specification document Architecture document Risk Analysis Action List Schedule Tutorials Project Management

Project Management Specification document R3 Requirement Formulation Calculation results will not be affected by virtual machine migration. Rational Migration should keep virtual machine memory state and hosted applications execution background. Priority P0 Demand Reference D4 Test Reference T3

Project Management Risk Analysis RiskProbabilityCriticalityProductPreventive ActionsCorrective Actions Data loss (large size)212 Copy on external hard drive Backup Data loss (small size)236 Copy on SVN repository Backup Network breakdown122 Local copy of documentation and API Schedule adaptation System crash (OS, VM)122Installation guideReinstall

Project Management Action List DeadlineWhole team (Xen Attitune Team) Julien C (Doudou) Julien L (Juju) Ezequiel (L’Argentin) HeryMathieu (Le J)

Project Management Schedule

Project Management Tutorials Xen installation and setting up NFS server DNS server DHCP server NTP server TUNe

Conclusion

Further improvements Total Autonomy Kdeploy -> Grid J2EE Other administration policies

Conclusion Tests TUNe Improvements CPU LoadOK MigrationOK InterruptionOK IntegrityOK DelayNOK StreamingNOK Network Architecture Hardware Architecture Xen 3.1 Kernel 19-6 Kernel 18.8 NFS root (domU) DHCP Server NFS Server Bug Filesystem NFS Boot on DomU Functionnal configuration Kernel Kernel 18.8 Xen (dom0) Wrappers, Deployment diagram Reconf Diagram, Probe TUNe modifications Streaming scenario kdeploy J2EE Policies NTP Server DNS Server Clock issues Synchronisation issues Issues resolved Name resolution DelayOK StreamingOK

Network Architecture Hardware Architecture Tests CPU LoadOK MigrationOK InterruptionOK IntegrityOK DelayNOK StreamingNOK Kernel 18.8 Xen (dom0) NTP Server Clock issues Synchronisation issues Issues resolved Functionnal configuration DelayOK StreamingOK Conclusion TUNe Improvements Wrappers, Deployment diagram Reconf Diagram, Probe TUNe modifications Streaming scenario kdeploy J2EE Policies DNS Server Name resolution Xen 3.1 Kernel 19-6 Kernel 18.8 NFS root (domU) DHCP Server NFS Server Bug Filesystem NFS Boot on DomU Kernel 22-14

Network Architecture Tests TUNe Improvements Wrappers, Deployment diagram Reconf Diagram, Probe TUNe modifications Streaming scenario kdeploy J2EE Policies DNS Server Name resolution DelayOK StreamingOK Conclusion Hardware Architecture CPU LoadOK MigrationOK InterruptionOK IntegrityOK DelayNOK StreamingNOK Kernel 18.8 Xen (dom0) NTP Server Clock issues Synchronisation issues Issues resolved Xen 3.1 Kernel 19-6 Kernel 18.8 NFS root (domU) DHCP Server NFS Server Bug Filesystem NFS Boot on DomU Functionnal configuration Kernel 22-14

Network Architecture Conclusion Hardware Architecture Tests TUNe Improvements CPU LoadOK MigrationOK InterruptionOK IntegrityOK DelayNOK StreamingNOK Kernel 18.8 Xen (dom0) Wrappers, Deployment diagram Reconf Diagram, Probe TUNe modifications Streaming scenario kdeploy J2EE Policies NTP Server DNS Server Clock issues Synchronisation issues Issues resolved Name resolution Xen 3.1 Kernel 19-6 Kernel 18.8 NFS root (domU) DHCP Server NFS Server Bug Filesystem NFS Boot on DomU Functionnal configuration Kernel DelayOK StreamingOK

Questions