2007/05/22 Integration of virtualization software Pierre Girard ATLAS 3T1 Meeting

2007/05/22Pierre Girard / ATLAS 3T1 Meeting at CCIN2P32 Content What needs for virtualization at CC Virtualization infrastructure at CC –VM technology –VM deployment –VM use cases Perspectives –Spare grid service –Testbed grid –« VM on demand » framework

2007/05/22Pierre Girard / ATLAS 3T1 Meeting at CCIN2P33 What needs for virtualization at CC Grid context –3 grid sites (T1, T2 and PPS) –~30 machines (20 different services) to be administrated –Frequent middleware updates –Dealing with the Middleware Some major lacks –Accurate and/or up-to-date documentation –Administration tools –“uninstall” abilities –Messed-up logs Some difficulties –Undetermined behavior of YAIM –Hardcoded configuration within YAIM that hides other possible deployment options Adaptation to CCIN2P3’s specificities –BQS, HPSS, AFS  Needs for testing (out of production !!) –To discover the latest novelties of each release –To acquire experience (what is better than an autopsy for that ?) –To try some alternative solutions  Grid activity is very machine-consuming

2007/05/22Pierre Girard / ATLAS 3T1 Meeting at CCIN2P34 Operating System What needs for virtualization at CC CCIN2P3 workflow context –Every CCIN2P3’s machine is delivered by system administrators Hardware, OS and network configuration CCIN2P3 environment set-up Common monitoring set-up –Middleware is set up afterwards by grid administrators  Stop bugging system administrators with frequent (re-)installations for test purposes CCIN2P3 environment Grid middleware Grid Team administrate administrate deliver Sys Admin Other one please ? Reboot please ? new partition please ?

2007/05/22Pierre Girard / ATLAS 3T1 Meeting at CCIN2P35 Virtualization infrastructure at CC VM technology –VMWare workstation 5.5 (Desk/Laptop) Paying software Running as an application Optimizing disk space use –snapshots, linked clones, etc. Useful to test different options of installation –VMWare Server 1.0 (Server) Free software Running as a daemon Useful to run grid services and then to get a testbed infrastructure –VMWare issues Synchronization problem with ntp (fixed by setting up a ntpdate cron) VMWare server unstability at times Ongoing XEN tests

2007/05/22Pierre Girard / ATLAS 3T1 Meeting at CCIN2P36 Virtualization infrastructure at CC VM deployment –5 VM servers (Opteron 2.2Ghz – 2GB) –40 pre-allocated hostnames/IPs 20 for test nodes, 10 for PPS nodes, 10 for a future french testbed –CCIN2P3 VM image provided by system administrators Hostnames repository VMware server

2007/05/22Pierre Girard / ATLAS 3T1 Meeting at CCIN2P37 Virtualization infrastructure at CC VM use cases at CCIN2P3 –Test of new release before updating production nodes –BQS Interface development for gLite CE WMS was deployed to test and to understand the system Different configurations were tested to debug: Torque/Maui, OS with or without the CCIN2P3 environment, etc. –PPS nodes are progressively migrating to VM –Use of VMs to keep alive our production FTS and Local LFC during a scheduled electrical outage –Use of VMs for “Grid administrator/user training sessions” ~20 trainees 3 node profiles (Site-BDII, LCG CE, DPM SE) to be deployed by every administrator trainee RB, Top BDII, UIs were pre-deployed to use the grid VM use cases from french sites –IN2P3-SUBATECH is running VMs for LCG CE and Site-BDII VMWare ESX server –IN2P3-LAPP is running VMs for RBs and Top BDIIs VMWare ESX server

2007/05/22Pierre Girard / ATLAS 3T1 Meeting at CCIN2P38 Perspectives Spare grid service –Maintaining a VM image by critical production service to temporary switch on it in case of problem with the real machine Testbed grid –Propose essential grid services to french sites/users that need To make some tests out of production To organize training sessions –But non production quality « VM on demand » framework –VM is being a success story at CC Number of VM users is increasing Pool of VMs is being a mess  Rationalizing VM resources use is now needed  Development of a framework to manage those new resources  Reservation of VM slots (amount of memory, running time)  Defining VM priorities

2007/05/22Pierre Girard / ATLAS 3T1 Meeting at CCIN2P39 The end Thank you