1. © 2006 Open Grid Forum Build, Test and Certification of Grid and distributed software Community Group Current practices and short term plans in Building, Testing and Certifying Grid software Marc-Elian Bégin ETICS Project CERN

2. © 2006 Open Grid Forum 2 Content Agenda Charter and Group definition State-of-the-art in Build, Test and Certification

3. © 2006 Open Grid Forum 3 Agenda Title: Current practices and short term plans in build, testing and certifying Grid software Introduction VDT/Condor (Becky Gietzel – UoW) Globus (Charles Bacon – University of Chicago) gLite (Laurence Field – CERN) Discussion

4. © 2006 Open Grid Forum 4 Presentation topics Here are the topics proposed to the presenters: Challenges in building and testing complex Grid software Overview of current release procedure, focusing on how current Grid software is being built and tested Does automation play a role in current build and test procedures? If yes, what? If we had more time and effort to invest, where should we invest it? Is there anything our community could do to help improving participants build and test system and procedures?

5. © 2006 Open Grid Forum 5 Charter definition Focus/Purpose provide a platform for exchange and gather best practices on the topic of build, test and certification of Grid software Co-chairs: Peter Couvares: University of Wisconsin- Madison, Condor/NMI Marc-Elian Bégin: CERN, ETICS Project Looking for a Co-chair from Industry

6. © 2006 Open Grid Forum 6 Roadmap

7. © 2006 Open Grid Forum 7 Milestones MilestoneTitleDate M1Workshop on current practices and short term plans in building and testing Grid middleware and Grid applications GGF19 M2Presentation of summary of current practices and short term plans in building and testing Grid middleware and Grid applications – Draft Best practices in building and testing Grid middleware and Grid applications document GGF20 M3Workshop on current practices and short term plans in certifying Grid middleware and Grid applications GGF21 M4Presentation of summary of current practices and short term plans in certifying Grid middleware and Grid applications – Draft Best practices in building and testing Grid middleware and Grid applications document GGF22 M5Final document on best practices in building, testing and certifying Grid middleware and Grid application software GGF23 This needs to be updated/reviewed!!

8. © 2006 Open Grid Forum 8 Scope Focused on current practices and short term plans Discuss latest tools and techniques This group is not there to mandate how Grid middleware and application software should be built, tested and certified We hope that through its group member, the group will both represent academia and industry

9. © 2006 Open Grid Forum 9 Deliverable Final output of the group will be a single document: Best practices in building, testing and certifying Grid middleware and Grid application software

10. © 2006 Open Grid Forum 10 Exit Strategy The mission of this group is to report on current knowledge in the field of build, test and certification for Grid software Once the document is released and accepted, the goal of this group will have being reached At that point, the group will either be dissolved or a new charter will have to be defined

11. © 2006 Open Grid Forum 11 State-of-the-art Different efforts are taking place regarding Build, test and certification: ETICS NMI OMII-Europe/UK

12. INFSOM-RI-026753 Build, test and certification of Grid software - OGF19, Chapel Hill, USA ETICS in a nutshell ETICS stands for e-Infrastructure for Testing, Integration and Configuration of SoftwareETICS stands for e-Infrastructure for Testing, Integration and Configuration of Software Project started on January 1 st, 2006 and has a duration of two yearsProject started on January 1 st, 2006 and has a duration of two years Goal is to provide efficient automated tools for building and testingGoal is to provide efficient automated tools for building and testing ETICS is born from the experience of developing, integrating and testing grid and distributed softwareETICS is born from the experience of developing, integrating and testing grid and distributed software

13. INFSOM-RI-026753 Build, test and certification of Grid software - OGF19, Chapel Hill, USA The ETICS partners Build system, software configuration, service infrastructure, dissemination, EGEE, gLite, project coord. Software configuration, service infrastructure, dissemination Web portals and tools, quality process, dissemination, DILIGENT Test methods and metrics, unit testing tools, EBIT The Condor batch system, distributed testing tools, service infrastructure, NMI

14. INFSOM-RI-026753 Build, test and certification of Grid software - OGF19, Chapel Hill, USA Service Architecture Build/Test Artefacts Web Application Report DB Project DB NMI Execution Engine Clients Web Service NMI Client Wrapper Via browser WNs ETICS Infrastructure

15. INFSOM-RI-026753 Build, test and certification of Grid software - OGF19, Chapel Hill, USA Features of the ETICS Service Out-of-the-box automatic build/test systemOut-of-the-box automatic build/test system Multiplatform support for development and testingMultiplatform support for development and testing Powerful and flexible automatic dependency management (internal and external dependencies)Powerful and flexible automatic dependency management (internal and external dependencies) Trigger coding convention checks, unit test, documentation tools and collect and publish the resultsTrigger coding convention checks, unit test, documentation tools and collect and publish the results Possible to build everything from source or use pre-built binary packagesPossible to build everything from source or use pre-built binary packages Designed to support several Version Control SystemsDesigned to support several Version Control Systems Possible to register artefacts on the repositoryPossible to register artefacts on the repository Publishes run-time configuration information such as environment variables, runtime dependencies, etc …Publishes run-time configuration information such as environment variables, runtime dependencies, etc … Produce different package formats (rpms, tar, msi, debs)Produce different package formats (rpms, tar, msi, debs) Produces rich build and test reportsProduces rich build and test reports

16. INFSOM-RI-026753 Build, test and certification of Grid software - OGF19, Chapel Hill, USA Reports

17. OGF19 - Chapel Hill, NC 2006 OpenGridForum NMI execution engine NMI is an execution engine internally used by ETICS to manage remote build and test jobs on different platforms NMI is a layer built on the top of Condor Condor is a middleware distribution that provides mechanisms and policies supporting High Throughput Computing (HTC) on large collections of distributed computing resources Both NMI and Condor are developed and supported by our partner, the University of Wisconsin in Madison, USA

18. OGF19 - Chapel Hill, NC 2006 OpenGridForum NMI Web interface

19. OMII-UK Mission… OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its international collaborators Promote the use of good-quality open-source software Reduce the risk of moving to new e-infrastructure world Recognise distinct user communities: by domain and function

20. Need A Support Infrastructure… Collaborative Open-Source Software Developer focussed: Sourceforge, NeSCForge Community Repository (http://www.omii.ac.uk)http://www.omii.ac.uk Software being used by the community Contributed software from community May have variable quality (e.g. Freshmeat) May claim standards compliance Portability and dependencies key for Grid deployment

21. 21 Metrics to aid software selection Portability: Build on different platforms Deploy and run on dynamically deployed infrastructure Standards Compliance: WSDL, XML, … Jobs: OGSA-BES, JSDL, HPCP Accounting: RUS, UR Data Access: WS-DAI, WS-DAIX, WS-DAIR Collaboration with OMII-Europe, ETICS & NMI