1. 2012 Objectives for CernVM

2. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part of group’s baseline activities Since the project resulted in several spinoffs where each has somewhat different customers and deployment schedule we are trying to treat them as separate subprojects: CernVM  The original project that aims to deliver Virtual Machine to LHC experiments  Actively used by 3 LHC experiments CernVM/FS  CernVM File System, the biggest success story and the most widely deployed on many (if not all) WLCG sites/worker nodes CernVM/Copilot  Enabling volunteer cloud, used by LHC@Home 2.0 and Test4Theory project CERN, Jan 16, 2012

3. PH/SFT Technical Group Meeting CernVM Objectives (1) Release CernVM 2.5.0/2.6.0  overdue task from last year Take full ownership and control of SL repository  Used to be managed by rPath, now done by us but the synchronization procedures still not fully automatized Put into production new Web site where each sub project will have its public space and identity  Improved and extended documentation Continue improving the contextualization tools and procedures  Full compatibility with Hepix recommendations  Test OpenStack/StrtusLab as potential deployment targets xrootd server contextualization CERN, Jan 16, 2012

4. PH/SFT Technical Group Meeting CernVM Objectives (2) Develop and deploy CernVM/Online portal  Online portal to manage contextualization profiles  Easy way to configure one or thousands of CernVM instances Develop and deploy CernVM Virtual Machine Lifecycle management tools  Built around new image building tool that functionally replaces rBuilder  Define OS platforms, build additional packages, build VM images, deploy for testing, continuously test and report problems, publish releases, deploy images on various Clouds, monitor, suspend, terminate  Supports various user interfaces including mobile devices and tablets CERN, Jan 16, 2012

5. PH/SFT Technical Group Meeting CernVM Objectives (3) Prepare CHEP presentations and write proceedings  3 oral presentations and one poster Prepare GSOC 2011 proposals  Very good experience last year Prepare CSC2012 exercises  Improve exercise based on student’s feedback from the previous years Develop and release SL6 compatible CernVM  Originally planned for 2011  SL6 still in beta, no pressure from the experiments  Should be based on rpm packages encapsulated by conary or alternative such as yum  Should address the needs for full accountability of image content CERN, Jan 16, 2012

6. PH/SFT Technical Group Meeting CernVM Objectives (4) Long Term Data Preservation project  Demonstrate usability in NA61 context by running production on lxCloud using contextualized CernVM images Migrate as many as possible services to IT  Web, configuration, package repositories Deploy testing infrastructure  Developed last year by GSOC student Participate in Concurrency Project  Develop tools to benchmark application performance and resource consumption while running in virtualized environment  Integrate LHC application benchmarks into standard test suite for regression testing  Investigate potential for memory sharing across virtual machines  Investigate possibilities to use GPU/MIC resource from virtual machine CERN, Jan 16, 2012

7. PH/SFT Technical Group Meeting CernVM/FS Objectives (1) Continue support for CVMFS 2.0.x  Aim to provide the stable version for deployment across WLCG  Finalize move of services to CERN/IT Transform CVMFS into community project  Lots of interest for deployment outside WLCG and input in terms of bug reports, patches, requirements…  The challenge is to accommodate other potential use cases without risking the stability of our software Client improvements  port to MacOS (CMS request)  "libcvmfs" interface for customized (command line) tools beyond the file system interface (LHCb,CMS)  alternartive algorithms for file compression and hashing CERN, Jan 16, 2012

8. PH/SFT Technical Group Meeting CernVM/FS Objectives(2) Simplify and improve performance of CVMFS server  Replacing redirfs kernel module with an overlay file system  Using low level fuse interface based in inodes  Shared cache over NFS for clusters or many core servers  Self organizing cluster cache (diskless servers)  "Archive Catalogs", a mechanism to combine all files of a catalog in one (or a few) large file(s)  Monitoring tool set for CernVM-FS replica servers Reduce latency for publishing new changes  Deploy orchestrated stratum 0->1 mirroring and monitoring  GSOC 2011 Project, needs to be finalized and deployed Continue development in 2.1.x branch  Code refactoring to make it easier to implement new features  Deploy 2.1.x by the end of 2012 CERN, Jan 16, 2012

9. PH/SFT Technical Group Meeting CernVM/Copilot Objectives(1) Integrate CernVM/CoPilot with batch systems such as Condor Improve security  introduce TLS, write module for integrating authentication with BOINC  Investigate possibility to use storage contributed by the volunteers  Prepare visit to Rio de Janeiro in the context of e-Planet project CERN, Jan 16, 2012