1. WP5 Dissemination, training, certification and web tools
Marc-Elian Bégin (CERN)
WP5 Leader
ETICS Final Review
CERN, Geneva - 15 February 2008

2. Contents Goals Major Achievements Challenges Metrics and Statistics
Conclusions
ETICS Final Review - WP5 - CERN, 15 February 2008 2 2

3. Goals
ETICS Final Review - WP5 - CERN, 15 February 2008

4. Goals Dissemination of ETICS results and best practices
Training on the ETICS Service and Tools
Certification study: ‘WP5 will conduct a feasibility study about the possibility of establishing a “Quality Certification” for software produced by research projects’
ETICS Final Review - WP5 - CERN, 15 February 2008 4 4

5. Goals Web applications: one of the main user interface of ETICS
Central location to build the community, attract new users and used as first tool for distance training
Allow users to register their software, specify configuration information, compare the configuration with other registered software in order to identify interoperability issues
Register test suites
Launch build and test jobs
Collect results
Provide a generic reporting tool that projects can use to collect detailed information about their software, the test results, quality metrics, etc.
ETICS Final Review - WP5 - CERN, 15 February 2008

6. Major Achievements
ETICS Final Review - WP5 - CERN, 15 February 2008

7. Branding Dissemination Strong graphical identity
ETICS Final Review - WP5 - CERN, 15 February 2008 7 7

8. Branding ETICS is an international brand
Present in a number of European events, and mentioned as a companion service by our partners: EGEE and DILIGENT
Relationships with:
EuChinaGrid (IPv6 work)
Condor team
Globus
Standard bodies
ETSI
OGF
World-wide promotion: Asia (Japan, China), Americas (Canada, USA, Brazil)
ETICS Final Review - WP5 - CERN, 15 February 2008

9. Web site
ETICS Final Review - WP5 - CERN, 15 February 2008

10. 1st when searching “grid quality process” in google.com
Google.com ranks
1st when searching “grid quality process” in google.com
ETICS Final Review - WP5 - CERN, 15 February 2008

11. 1st when searching “grid quality process” in yahoo.com
Yahoo ranks
1st when searching “grid quality process” in yahoo.com
ETICS Final Review - WP5 - CERN, 15 February 2008

12. ETICS in the News Web Search ETICS in the news
Google and Yahoo show ETICS portal first for
‘ETICS’
‘Grid Quality Process’
ETICS in the news
Feature in Science Grid This Week
(re-print in) Grid Today
Details in:
ETICS Final Review - WP5 - CERN, 15 February 2008

13. Paper material produced
ETICS Final Review - WP5 - CERN, 15 February 2008

14. Standardisation
Co-chair of new Open Grid Forum (OGF) Build, Test and Certification Community Group, with Peter Couvares (WP2 Leader/UoW)
Grid-QCM
Prepared first version of the model
Plan to propose Grid-QCM for ISO standardisation during ETICS-2
IPv6
EuChinaGrid / EGEE/SA2
Definition of testing framework for IPv6 compliance tests
IPv6 plugin for static source code analysis
IPv6 resources for dynamic tests
ETSI
Started to discuss with ETSI about standardisation work
Discussions took place during OGF20 and the 4th e-Infrastructure Concertation event
ETICS Final Review - WP5 - CERN, 15 February 2008

15. Community We have grown the ETICS Users Community
Several types of users:
Using ETICS
Experimenting ETICS
Interested in ETICS evolution and services
Currently registered projects: 18 ‘production’ projects (+ a number of evaluation projects)
org.glite: gLite is the next generation middleware for grid computing developed by the EGEE project
org.glite.testsuites: This project contains testsuites for the gLite project
org.diligentproject: A DIgital Library Infrastructure on Grid ENabled Technology
org.etics: The ETICS System
etics-contrib: Tools and extensions to the ETICS system
externals: This project contains all externals components that are not part of any ETICS project, but are used somewhere as dependencies
quattor-compiler: java implementation of pan language compiler
ETICS Final Review - WP5 - CERN, 15 February 2008

16. Community (2)
Currently registered projects: 18 ‘production’ projects (cont.)
torquemaui: Maui scheduler and Torque resource manager
OMII-Europe: The Open Middleware Infrastructure Institute for Europe
gLite-ipv6: A Pilot project to test the IPv6 compliance of the gLite middleware
gridway: Metascheduling Technologies for the Grid
Grid-Ireland: Grid-Ireland
grid-testbed: Automatic tools for testing Grid software
Metronome: The NMI Build & Test software
mpi: components to support MPI use of the grid
psnc: Contains software developed, maintained or hosted in Poznan Supercomputing and Networking Center (GridSphere)
ETICS Final Review - WP5 - CERN, 15 February 2008

17. Community (3) Evaluation projects:
CASTOR: The CERN Advanced Storage Manager system
Condor: Testing Condor
dicom: DICOM Servers and Clients
EGRID: Italian national Grid infrastructure for financial and economic research
glite-release: glite-release
gridice: Distributed Monitoring Tool for Grid Systems
myproject: ETICS Test project, used for unit ant system tests
ppt-apt: AIS project for the PPT/APT application
quattor: The ELFMS/Quattor Project
SAGA: The Simple API for Grid Applications (SAGA) is a OGF standard for a high level API for developers of grid applications. This project covers the SAGA reference implementations
tutorialProject: The ETICS tutorialProject
vdt: The Virtual Data Toolkit (VDT) is an ensemble of grid middleware that can be easily installed and configured
VL-e: The Virtual Laboratory for e-Science tries to bridge the technology gap
ETICS Final Review - WP5 - CERN, 15 February 2008

18. Getting ETICS known Conferences and events participated to: 46
Qualipso Conference January, Rome
HICSS January, Hilton Waikoloa Village Resort
EELA 3rd Conference - e-Infrastrucure - Grid Conference December Catania, Italy
Open Grid Forum October, Grand Hyatt Seattle
EGEE'07 Conference 1-5 October, Budapest, Hungary
CHEP September, Victoria, British Columbia, Canada
5th International Summer School on Grid Computing July Mariefred, Sweden
First ETICS User Workshop 28 June, CERN, Switzerland
BELIEF-EELA e-Infrastructures Conference June, Rio de Janeiro, Brazil
ETICS All Hands May, University of Wisconsin Madison, Madison, USA
Training: Interoperability testing on the Grid using OMII-Europe components and ETICS tools May, Manchester Central
Open Grid Forum May, Manchester Central
1st International Conference April Beijing, China
EGEE / EUChinaGrid / ETICS IPv6 meeting 17 April CC-IN2P3, Lyon, France
EGEE JRA1 All Hands March, University of Catania, Italy
EGEE Industry Day 23 February, Budapest, Hungary
EGEE IPv6 meeting February, GARR headquarters, Rome, Italy
EUChinaGrid WP2 - Network planning and interoperability study February, Madrid, Spain
ETICS Final Review - WP5 - CERN, 15 February 2008

19. Getting ETICS known (2)
ETICS 1st Year Review 9 February, CERN, Switzerland
Open Grid Forum January-2 February, Chapel Hill, NC, USA
EGEE SA3 All Hands November, CERN , Switzerland
3rd Concertation meeting on e-Infrastructure, Specific theme: FP6-funded test-beds November, Helsinki, Finland
Super Computing November, Tampa, Florida, USA
EGEE JRA1 All Hands November, Abingdon, UK
ETICS All Hands October, Bologna, Italy
eInfrastructure Reflection Group (eIRG) Workshop October, Espoo, Finland
ETICS Training (DILIGENT Technical Coordination Meeting) October, University of Basel, Basel, Switzerland
EGEE '06 Conference September, Geneva, Switzerland
ETICS Training (as part of the EGEE'06 Conference) September, Cern, Switzerland
RISE 2006 International Workshop on Rapid Integration of Software Engineering techniques September, University of Geneva, Switzerland
Open Grid Forum September, Congress Center, Washington, USA
EGEE JRA1 All Hands meeting July, Pilsen, Czech Republic
International Grid Summer School on Grid Computing July, Ischia, Italy
ETICS Final Review - WP5 - CERN, 15 February 2008

20. Getting ETICS known (3)
Europython July, CERN, Switzerland
DILIGENT Technical Coordination Meeting June, Frascati (Rome) - Italy
European Condor Week June, INFN - Milano, Italy
HP Event: CERN openlab/EGEE/ETICS gLite Industry Readiness Workshop June, Meyrin, Switzerland
Global Grid Forum May Tokyo International Forum,
Condor Week April University of Wisconsin
Belief brainstorming event: Future Knowledge Infrastructures - Scientific Repositories and content management over the grid April Johannes Kepler University Linz, Austria
e-Infrastructure Reflection Group Workshop April Johannes Kepler University Linz, Austria
DILIGENT Technical Coordination meeting March CERN, Switzerland
EGEE JRA1 All-Hands meeting March CERN, Switzerland
3ème Cycle Romand d'Informatique 10 March Montana, Switzerland
EGEE User Forum March CERN, Switzerland
ETICS Kick-off meeting 20 January CERN, Switzerland
ETICS Final Review - WP5 - CERN, 15 February 2008

21. Web Interfaces Web applications
Application Portal / MyETICS
Configuration Editor
Repository Service
Trend analysis
More details in the dedicated demos in the afternoon
ETICS Final Review - WP5 - CERN, 15 February 2008

22. Web Interfaces: Application Portal
ETICS Final Review - WP5 - CERN, 15 February 2008

23. Web Interfaces: Configuration Editor
ETICS Final Review - WP5 - CERN, 15 February 2008

24. Web Interfaces: Repository Service
ETICS Final Review - WP5 - CERN, 15 February 2008

25. Trend Analysis
ETICS Final Review - WP5 - CERN, 15 February 2008

26. Training
In collaboration with all other activities, WP5 has developed a flexible and modular training program, including presentations, tutorials and demos
8 Training events
October 2007: ETICS workshop
September 2007: ETICS workshop for the OMII-Europe community
28 June 2007: First ETICS User Workshop
12 May 2007: Interoperability testing on the Grid using OMII-Europe components and ETICS tools
10 May 2007: ETICS Service Presentation for OGF BTC Community Group
07 March 2007: ETICS Service
04 October 2006: ETICS Service
24 September 2006: ETICS Service
For details:
~90 people trained
~ in the mailing list, although not training nor WP5 specific, still represents an important aspect of getting users to better understand the system
ETICS Final Review - WP5 - CERN, 15 February 2008

27. Exploitable results ETICS Software ETICS Service Grid-QCM
The “Plug-in Framework” allows it to integrate external tools, even commercial ones!
It’s licensed as Open Source in Apache 2.0 compliance
A great opportunity to create an active Open Source Community (helped by re-hosting source code in SourceForge)
ETICS Service
Can be hosted on publicly funded institutions owning infrastructures (e.g. CERN, UoW, INFN) or other ad-hoc consortia/projects
Independent from any development environment
Suitable for a pay-per-use model
We’re investigating any support to EGI ( European Grid Initiative)
Grid-QCM
Quality assurance model for software products
Good foundations, standardisation could be possible in 2009
ETICS Final Review - WP5 - CERN, 15 February 2008

28. Sustainability
CERN and ENG will promote the Open Source nature of ETICS
This will be eased by hosting the source code to SourceForge, joining thousands of other open source projects
ENG will experiment using Grid-QCM and ETICS as part of its CMMi level 3 certification
Great opportunity to improve the software and the services during ETICS 2 (under negotiation)
EGEE and DILIGENT pledged to continue using ETICS for automating their build and test procedures
4DSOFT to include ETICS in their commercial strategy as consultancy
ETICS Final Review - WP5 - CERN, 15 February 2008

29. Metrics and Statistics
ETICS Final Review - WP5 - CERN, 15 February 2008

30. Metrics and Statistics
Deliverables, including intermediate requested versions for D5.7 and D5.9
> Including early drafts requested during 1st EU Review: D5.7 and D5.9
D5.1 – ETICS portal – Community support
PM03
Completed
D5.2 – Promotional Material
D5.3 – Dissemination and training plan
PM04
D5.4 – Plan for using and disseminating Knowledge (first draft)
PM06
D5.5 – Plan for using and disseminating Knowledge (second draft)
PM12
D5.6 – ETICS portal – testing support service (prototype)
D5.7 – Quality Certification feasibility study and sustainability strategy
PM20
Submitted
D5.8 – ETICS portal – testing support service (final)
PM22
D5.9 – Plan for using and disseminating Knowledge (final)
PM23
ETICS Final Review - WP5 - CERN, 15 February 2008

31. Metrics and Statistics (2)
Milestones
M5.1 – Promotional package, logos, brochures available
PM03
Completed
M5.2 – Training course and demos available on-line
PM12
M5.3 – ETICS Service fully operational
PM22
ETICS Final Review - WP5 - CERN, 15 February 2008

32. Metrics and Statistics (3)
SIZE OF THE ETICS USER COMMUNITY
Description: The user confidence plays an important role for the ETICS results. Hence the goal is to attract as many users of the ETICS Service as possible. During the project lifetime a large community will be build (hopefully).
Metric: Number of registered members
Metrics: Number of registered projects
Statistics from Repository: 24 Projects, 774 Modules, Packages, 765 Main Reports, Module Reports, 9746 Metrics
Expected
4-8
Current
>20
Expected
>100
Current
>200
ETICS Final Review - WP5 - CERN, 15 February 2008 32 32

33. Metrics and Statistics (4)
COMMUNITY WEB SITE IMPACT
Description: The web site ( is one of the main ways for ETICS to reach out and disseminate results. This indicator tries to measure the impact of this tool by calculating the number of accesses, files downloaded, etc.
Metric: Number of accesses (not hits):
* Unique visitors
Expected
300/month
Current
~510/month*
ETICS Final Review - WP5 - CERN, 15 February 2008

34. Metrics: Number of accesses
ETICS Final Review - WP5 - CERN, 15 February 2008

35. Metrics and Statistics (6)
NEWS ECHOES
Description: Press/news echoes and articles on ETICS show the relevance of the project to the press and news media.
Metric: Number of press/news releases:
Metrics: Number of press echoes at national/European or overseas level:
Expected 2
Current
Expected 8
Current 6
ETICS Final Review - WP5 - CERN, 15 February 2008

36. Metrics and Statistics (7)
NUMBER OF CONFERENCES, WORKSHOPS AND EVENTS
Description: the participation to and/or organisation of conference, workshops and other events indicates the coverage area ETICS has.
Metric: Number of training events organised and/or participated to:
Metric: Number of dissemination/workshop events organised and/or participated to:
Metric: Number of papers published:
Expected
4-8
Current 8
Expected
2-4
Current 46
Expected 1
Current 6
ETICS Final Review - WP5 - CERN, 15 February 2008

37. Metrics and Statistics (8)
DISSEMINATION MATERIAL
Description: Different dissemination material is required to attract attention on ETICS and to reach a critical mass of users and supporters of ETICS.
Metric: Number of flyers and fact sheets:
Metric: Number of posters:
Expected
2/year
Current 4
Expected
2/year
Current 3
ETICS Final Review - WP5 - CERN, 15 February 2008

38. Metrics and Statistics (9)
WEB INTERFACE QUALITY OF SERVICE
Description: In order to maintain high level of satisfaction from ETICS users, we need to offer a high service availability and quality of service.
Metric: Percentage of up-time of the ETICS service, based on service instrumentation and collection using CERN’s SLS Service:
Metric: Number of unexpected server behaviour (e.g. crash), resulting in total or partial loss of service availability, based on service instrumentation (without permanent lost of data)
*Number of unexpected server behaviour: 0 (only problems experienced where related to incompatible browser versions, and once slow performance, due to server issues)
Expected
95%
Current
>99%
Expected
1/months
Current 0*
ETICS Final Review - WP5 - CERN, 15 February 2008

39. Challenges
ETICS Final Review - WP5 - CERN, 15 February 2008

40. Challenges
Growing community means large usage of infrastructure and deployed software, with direct consequences on all WP5 delivered subsystems
Repository requirements are much more challenging than originally expected
New design required
Needed to use new technologies (e.g. REST, Jack Rabbit, Web 2.0) – harder to manage development schedule
Larger user community also means larger usecase spectrum, which led to a redesign of the Build and Test Web Client
Increasing richness of plugins means more metrics collected, generating more data for Repository service
Sustainability is hard for project with short term funding
No comparative model existed for Certification of complex and distributed software (e.g. Grid) -> we had to create Grid-QCM
ETICS Final Review - WP5 - CERN, 15 February 2008 40 40

41. ETICS is the Grid Quality Process!
Conclusions
ETICS has established itself as the “Grid Quality Process” in the e-Infrastructure arena
With over 200 registered users and 20+ projects, the system has exceeded all growth targets
ETICS is leading a world-wide standardisation effort, through an Open Grid Forum “Build, Test and Certification Community Group” and with the proposed Grid-QCM model
ETICS provides a rich and user friendly web user interface
ETICS is the Grid Quality Process!
ETICS Final Review - WP5 - CERN, 15 February 2008

42. Thanks http://www.eu-etics.org
ETICS Final Review - WP5 - CERN, 15 February 2008 42 42