1. INFSO-RI-223782 SA1 Status Report Status and Progress of the ETICS-SA1 Activity ETICS2 All Hands Meeting Alberto AIMAR CERN Bologna 9-11 November 2009

2. INFSO-RI-223782 Planning at AHM Budapest (I) The planning in Budapest was followed by SA1 Plugins, metrics, report 17 July JRA2 Joseph - Checkstyle, pmd, jccn. Send them as soon as each is ready SA1 - Plugins Integration A-QCM: 10 July SA1 - Include in the AQCM reports: cccc, wsi, ipv6. To follow: Checkstyle, pmd, jccn 2 July - Verification of vera++ and clear status of CodeWizard (report to TC)CodeWizard Disseminator 24 July SA1 MC - Integrate and test for delivery ETICS 2.5.0 2 ETICS2 All Hands MeetingSA1 Status Report

3. INFSO-RI-223782 Planning at AHM Budapest (II) Multi-Node 17 July SA1 - Adapt methods to use overridden objects, split jobs for submission. Modification to the webapp. Client adapt methods to use overridden objects 10 July Write tests: 1- httpd example 2- arc example 15 August SA1 - Repository. Collect results and generate reports. Job Submitters 3 July - SA1 - Hypervisor at CERN, find a node to be used, where are images stored, etc SA1 - Using NMI and WN at CERN (ask help to Marian) SA1+SA2 - Integration of gLite job submitter and Unicore job submitter Dashboard 24 July Integration in 2.5.0 3 ETICS2 All Hands MeetingSA1 Status Report

4. INFSO-RI-223782 Planning at AHM Budapest (III) Privacy Mid August Specifications, design and disable anonymous access (guest = no access) Early Sept - Username, password: portal, configuration, admin Only implemented a solution (for VEGA) that does not allow access to ETICS unless the certificate is registered in the system Not Started (YET) SLA’s with 2 projects Accounting, logging, costs Import/Export from other systems 4 ETICS2 All Hands MeetingSA1 Status Report

5. INFSO-RI-223782 Summary of Ongoing Work (I) Infrastructure of the ETICS Services Maintenance and support. Updates Several improvements and maintenance web services, repository, web interface editors, client, etc Multi-node Testing Defined, configure deploy and launch distributed tests Plug-ins development Findbugs, CCC, CKJM, etc all integrated Jobs Submitters interface in order to be able to submit to other “batch” systems 5 ETICS2 All Hands MeetingSA1 Status Report

6. INFSO-RI-223782 Ongoing Work (II) Dynamic Virtualization. WNs on demand Start a VM of the platform needed and execute client, send back results AQCM Reports Generating the report Metrics Disseminator Display the metrics collected by the plugins Dashboard Shows last builds, direct links to metrics and reports 6 ETICS2 All Hands MeetingSA1 Status Report

7. INFSO-RI-223782 All SA1 information is here 7 ETICS2 All Hands MeetingSA1 Status Report

8. INFSO-RI-223782 EU Review: Conclusions and Outlook Main Objectives (and Additional Achievements) of the First Year Automation, Performance, Virtualization, High Availability Small delays will be recovered in Year 2, resources now available. Maintenance and Upgrade of the Services Platforms, Updates, Virtual Images, External Software Urgent Requests for Main User Projects Year 2 Outlook: Focus on Sustainability Usage of External Resources for CPU (WN) and Storage Privacy, Authorization, Security Integrate Submission Engines, Testing and Metrics Plugins, A-QCM Certification 8 Brussels, 3 April 2009SA1 - Service Management

9. INFSO-RI-223782 SA1 Deliverables DSA1.1 – Execution plan for 12 months of infrastructure operation M03 This deliverable describes the execution plan for the first half of the ETICS 2 project, including the core service roadmap and the infrastructure deployment plan. DSA1.2 – ETICS Core Services Design Specification M06 This deliverable describes the overall ETICS 2 core services. DSA1.3 – ETICS Site Service Level Agreement M09 This deliverable describes the Service Level Agreements upon which the ETICS service will be provided. The SLAs will define the service level the users can expect from the service in terms of availability, accessibility and support. DSA1.4 – Execution plan for second 12 months of infrastructure operation M12 This deliverable describes the execution plan for the second half of the ETICS 2 project, including the core service roadmap and the infrastructure deployment plan. DSA1.5 – Infrastructure and core services certification and usage report M21 This deliverable reports on the release management cycles and certification of the ETICS 2 infrastructure and core services, including lessons learned and corrective action to apply. 9 ETICS2 All Hands MeetingSA1 Status Report

10. INFSO-RI-223782 SA1 Perspective Sustainability of the ETICS Services Be deployable in other environments than CERN Prepare transition to end of the ETICS project For Open Organizations (EMI) vs. for Private Commercial uses Most improvements are common (logging, accounting, metrics), others are not (privacy, encryption, etc) We must aim at scenarios that are feasible Invest (partners) resources in their preferred scenarios New prototypes must start now (privacy, import export, etc) but we have no resources, fully committed to current development. 10 ETICS2 All Hands MeetingSA1 Status Report

11. INFSO-RI-223782 Collaboration with Other Activities New Submission Engines  SA2  Integration of gLite and UNICORE submitter EC2 prototype New plug-ins + Integration  JRA2 Mostly done Multi-node Distr. Testing  JRA2  Integration of workflow and test designer A-QCM + Metrics  NA2  Complete reports and certify gLite and d4Science Cross Submission  JRA1 Keep it running Dissemination Material  NA2  User Survey Documentation & Support  SA2 11 ETICS2 All Hands MeetingSA1 Status Report

12. INFSO-RI-223782 Backup and More Details for the Technical Sessions 12 ETICS2 All Hands MeetingSA1 Status Report

13. INFSO-RI-223782 13 Multi Node Distributed Testing Material from L.Dini ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009

14. INFSO-RI-223782 14 Issues Service Synchronization ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009

15. INFSO-RI-223782 15 Issues Information Interchange ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009

16. INFSO-RI-223782 16 Issues: Flow Monitoring ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009

17. INFSO-RI-223782 Benefits Automation of complex processes Automatic setup of complex environment Automatic generation of reports Save on resources and time More scenarios can be explored Less human errors Form the foundation for more advanced system tests 17 ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009

18. INFSO-RI-223782 The PING Example (1/3) ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009

19. INFSO-RI-223782 The PING Example (2/3) ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009

20. INFSO-RI-223782 The PING Example (3/3) CLIENT ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009 SERVER

21. INFSO-RI-223782 21 VMLoader On-Demand Dynamic Virtualization Manager Material from L.Dini ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009

22. INFSO-RI-223782 ETICS Infrastructure - Static Platforms The Job is queued even though there are IDLE WNs SL5 / 64 Mac OSX SL4 / 32 SL5 / 32 VIRTUAL STATIC PHYSICAL SL5 / 64 The composition of the pool is fixed

23. INFSO-RI-223782 ETICS Infrastructure - Static Platforms Rarely used platforms are IDLE most of the time SL5 / 64 RH 7 SL4 / 32 SL5 / 32 VIRTUAL STATIC PHYSICAL The composition of the pool is fixed

24. INFSO-RI-223782 ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009 Dynamic Loaded Platforms VIRTUAL DYNAMIC

25. INFSO-RI-223782 Deploying multiple virtual machines on the same node

26. INFSO-RI-223782 26 Benefits ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009 Increase availability and capability Reduce maintenance Offer privileged access (VM, not the host) Enable post build analysis (VM snapshots) Virtual machine image customization Provide reproducible environments

27. INFSO-RI-223782 27 Benefits: Local Testing ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009 Developers can test locally Testing on multiple platforms Official platforms made available Provide reproducible environments Virtual Machines can be provided with already installed and running software

28. INFSO-RI-223782 28 Project Dashboard and Metrics Disseminator Material from C.Galli and M.Canaparo ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009

29. INFSO-RI-223782 29 Palermo October 2008 The ETICS Dashboard The Etics2 Dashboard intends to offer a simple way to take control of builds and tests results, the quality of code and other useful information at project level. At this time, is possible to configure the Dashboard using an XML file that contains some information like the page layout, the widget's type, position and dimensions (width-heigth). For each project is possible to define a different configuration file named “project-name”.conf.xml (eg org.etics.conf.xml)

30. INFSO-RI-223782 30 Palermo October 2008 The Widgets At this time the available Widgets are: ProjectSummary Show some useful information about the current project. (like repository url, homepage, logo etc...) JobHistory Show in a table the list of lasts N Jobs submitted, their type (test, build or both) and the results. Portability Show the last build result and last reachable success per platform, for a list of configurations. Disseminator Make available some type of charts from the ETICS Disseminator. URL Show in a box a useful link like GGUS, Savannah, some Wiki page or others. AQCM Show in a chart the metrics obtained from the AQCM plugin.

31. INFSO-RI-223782 31 Rome, May 2008Titolo

32. INFSO-RI-223782 32 Rome, May 2008Titolo

33. INFSO-RI-223782 33 Palermo October 2008 Future Improvements Extend the Dashboard's working area (now work only at the project level), to make available the widgets results like the “portability per platform” also for specific subsystems and components. Some graphical improvement in charts and widgets New Widget “AQCM-History” that show evolution in the time of the AQCM metrics results for subsystems and components. But once refined the appearance it can be ready in a couple of weeks for a first release.

34. INFSO-RI-223782 34 Bologna, Novermber 2009 ETICS Disseminator for trend-analysis ETICS Disseminator for Trend-Analysis is a component that can be used to obtain plots starting from the data collected on systems and modules registered in ETICS System https://etics-dev.cern.ch/eticsPortal/#QA

35. INFSO-RI-223782 35 Bologna, Novermber 2009 ETICS Disseminator for trend-analysis ETICS Disseminator is currently installed both in etics- dev at CERN and in etics-02 machine at CNAF. https://etics-dev.cern.ch/eticsPortal/#QA http://etics-02.cnaf.infn.it:8080/eticsPortal/#QA Composed of three panels: A form where you can specify the metrics you want to be shown and some options to filter the results range of time, platforms, and the repository location A Tree Panel where the ETICS tree is shown (all the projects, subsystems, components, configurations registered in ETICS System)‏ A Plot Panel, where the images are shown In order to see a plot you should select at least one node of the tree and one metric

36. INFSO-RI-223782 36 Bologna, Novermber 2009 New Features WRT the Disseminator shown at AHM in Budapest. Enhacements to Disseminator interface in order to improve usability and to increase the space dedicated to plot panel Testing and bug fixing New metrics added. These metrics are generated by Findbugs, Junit and CKJM plugings Metrics: Findbugs, Findbugs rate, Junit, Junit rate, WMC, DIT, NOC, CBO, RFC, LCOM, Ca, NPM

37. INFSO-RI-223782 37 Bologna, Novermber 2009 Integration with Dashboard The Disseminator for trend-analysis can be used by Etics Dashboard in order to show charts about one project (org.etics, org.glite,...). Every chart shown by the Dashboad is clickable and allows user to go to the Disseminator URL Improvements Adding the new metrics generated by A-QCM plugins Maintainability Reliability Portability Functionality Can be released through the Dashboard in next release

38. INFSO-RI-223782 38 A-QCM Reports Material from A.Turli ETICS Testing ToolsEGEE 09 - Barcelona, 23 September 2009

39. INFSO-RI-223782 The Automated Quality Certification Model Defines metrics Runs measures Define thresholds Metrics analysis ETICS grid infrastructure at CERN, INFN, UoW (NMI)

40. INFSO-RI-223782 The Quality Model The Automated Quality Certification Model A-QCM is a stand alone model for Software Quality verification and validation A-QCM certifies the Quality of the software by objective analysis A-QCM provides a powerful support to a set of standards and best practice schemes A-QCM was developed considering most of the common models: ISO/IEC 25000, 14598: for the description ISO/IEC 25041: for the structure ISO/IEC 9126: for the quality attributes A-QCM supports software developers in being compliant against: ISO/IEC 9001, ISO/IEC 9126, ISO/IEC 12207:2008 CMMi

41. INFSO-RI-223782 A-QCM: Structure A-QCM is structured in 5 Evaluation Modules (EM). The set of evaluation techniques are grouped in families. Every family is an Evaluation Module. EMs contributes to get quality evaluation against 4 Quality Aspects Quality Aspects Evaluation Modules Static Analysis Coding Style Structural Testing Functional Testing Standards compliance Functionality Reliability Maintainability Portability

42. INFSO-RI-223782 Plugins and Metrics Available plugins in ETICS eticsdev: sloccount PyUnit, Junit Findbugs CCCC Ipv6 WSI CKJM Checkstyle PMD

43. INFSO-RI-223782 A-QCM: Web interface report idea Project level results Subsystem level results Component level results The result can be expanded to reach the metrics output related to the specific classes

44. INFSO-RI-223782 Example of AQCM report Certification of a component The QAs are buttons: click on them to see more details

45. INFSO-RI-223782 QA expanded Details for Reliability QA: - (metric, value, report) should help the developer of this component to improve the value of this QA - all metrics involved in “Reliability” evaluation are showed