Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Grid Technology SL Section Software Lifecycle Duarte Meneses

CERN IT Department CH-1211 Geneva 23 Switzerland t GT Overview Alberto Aimar Andres Abad Rodriguez Andrew Elwell David Smith Duarte Meneses Maria Alandes Pradillo IT-GT-SL- 2 EMI Quality Assurance Development and test infrastructure Collaboration with other sections People Activities Software Lifecycle

Grid Technology EMI IT-GT-SL - 3 Participate in European Middleware Initiative –In charge of Quality Assurance for entire project –Goal: Define and establish a common software quality assurance process and metrics for all engineering activities QA Tasks –Policies –Metrics –Tools –Testbeds bit.ly/emisa2

Grid Technology QA Policies IT-GT-SL - 4 –Software quality assurance plans; All verifications and criterias to fullfil Quality control –Definition of several QA policies: release certification packaging testing documentation

Grid Technology QA Policies IT-GT-SL - 5 –Examples: How to prepare EMI software packages (structure, metadata,..) How to certify components for release Templates of various QA reports Which are Key Performance Indicators for all activities Code/KPIWPDescriptionMethodologyEstimated Targets KSA1.1 Number of incidents SA1Number and trends of incidents registered by the Service Desk (in total and per category) GGUS report or queryThe trend should follow a standard Rayleigh curve

Grid Technology Verification Dashboard IT-GT-SL - 6

Grid Technology Metrics –Metrics specifications on all EMI What to measure and how. Examples: EPEL compliance (with Rpmlint), Regression tests for major bugs –QA reports With charts produced automatically based on the specs IT-GT-SL - 7

Grid Technology ETICS Service IT-GT-SL - 8 ETICS: Infrastructure used to automate build and test of software and to help manage and release it. Used by all EMI product teams and release manager

Grid Technology ETICS Service IT-GT-SL - 9 ETICS – Some features: Configuration management; Build, test and packaging infrastructure for all EMI, Supports various platforms (SL5, SL6, Debian, 32/64bit) Analyses packages and generates automatically Yum or Apt repositories from the builds. Report generator, metrics generation plugins, verification dashboard, maven repository

Grid Technology ETICS Service IT-GT-SL - 10 Some numbers about ETICS:  70k jobs executed in 2012  30k configurations  >100k packages (rpm/deb) in the repository  30 Hypervisors, 50 VMs running (300 available) Post EMI: –Bamboo evaluated for future build and integration –Data Management user case reproduced successfully –Provide a build/test service for DM

Grid Technology Devel. and test infrastructure Testbeds Management of virtual machines for various users All EMI products installed and tested on them GT testbeds: for product teams (DPM, FTS,..) and individual users Characteristics: Running ~50VMs of several platforms (Debian, SL5, SL6) OS config managed by Puppet Running on CVI (testing it on Openstack) IT-GT-SL - 11

Grid Technology Other collaboration Applications AreaApplications Area Maintain reference installation of EMI software on AFS Used by experiments at CERN Nightly validation for SAMNightly validation for SAM Using CVI DPM development and supportDPM development and support dpm-xrootd plugin Information system developmentInformation system development UI, WN and VOBOX integrationUI, WN and VOBOX integration GGUS and SNOW integrationGGUS and SNOW integration IT-GT-SL- 12

Grid Technology IT-GT-SL - 13