A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects Status and work plan for H2 2003 16 July 2003 A.Aimar.

Slides:



Advertisements
Similar presentations
Single Sign-On with GRID Certificates Ernest Artiaga (CERN – IT) GridPP 7 th Collaboration Meeting July 2003 July 2003.
Advertisements

Project Management Summary Castor Development Team Castor Readiness Review – June 2006 German Cancio, Giuseppe Lo Presti, Sebastien Ponce CERN / IT.
D. Düllmann - IT/DB LCG - POOL Project1 POOL Release Plan for 2003 Dirk Düllmann LCG Application Area Meeting, 5 th March 2003.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
1 CMPT 275 Software Engineering Revision Control.
Professional Informatics & Quality Assurance Software Lifecycle Manager „Tools that are more a help than a hindrance”
Quality Assurance and Testing in LCG CHEP 2004 Interlaken, Switzerland 30 September 2004 Manuel Gallas, Jakub MOSCICKI CERN
SPI Software Process & Infrastructure GRIDPP Collaboration Meeting - 3 June 2004 Jakub MOSCICKI
M. Gallas IT-API LCG SPI project: testing1 Software Testing Infrastructure status LCG Software Process & Infrastructure (CERN, 10/23/02)
Framework for Automated Builds Natalia Ratnikova CHEP’03.
SPI Software Process & Infrastructure EGEE France - 11 June 2004 Yannick Patois
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing LCG Applications Area GridPP 7 th Collaboration Meeting LCG/SPI LCG.
M.Ellis 17th August MICE Software School Aims Course content –Management –Specifications –Design –Production –Testing –Use Information –Operation.
SPI Software Process & Infrastructure Project Status Application Area Review – 30 March 2005.
EMI INFSO-RI EMI SA2 Report Quality Assurance Alberto Aimar (CERN) SA2 WP Leader.
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
1 Software Development Configuration management. \ 2 Software Configuration  Items that comprise all information produced as part of the software development.
J.T Moscicki CERN LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Software Packaging and Distribution LCG Application.
NICOS System of Nightly Builds for Distributed Development Alexander Undrus CHEP’03.
INFSO-RI Enabling Grids for E-sciencE The gLite Software Development Process Alberto Di Meglio CERN.
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 Software Process panel SPI GRIDPP 7 th Collaboration Meeting 30 June – 2 July 2003 A.Aimar -
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
The LCG SPI project in LCG Phase II CHEP’06, Mumbai, India Feb. 14, 2006 Andreas Pfeiffer -- for the SPI team
L. Mancera IT/API LCG SPI project: Code documentation1 Code Documentation Luis Mancera LCG Software Process & Infrastructure (CERN, 10/23/02)
Nightly System Growth Graphs Abstract For over 10 years of development the ATLAS Nightly Build System has evolved into a factory for automatic release.
Continuous Integration and Code Review: how IT can help Alex Lossent – IT/PES – Version Control Systems 29-Sep st Forum1.
EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Quality Assurance Alberto AIMAR (CERN) SA2 Leader EMI Second EC.
LCG-SPI: SW-Testing LCG AppArea internal review (20/10/03)
20/09/2006LCG AA 2006 Review1 Committee feedback to SPI.
Feedback from the POOL Project User Feedback from the POOL Project Dirk Düllmann, LCG-POOL LCG Application Area Internal Review October 2003.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects Overview A.Aimar EP/SFT CERN LCG Software Process.
SEAL Project Core Libraries and Services 18 December 2002 P. Mato / CERN Shared Environment for Applications at LHC.
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing QMTest test framework LCG AppArea meeting (16/07/03) LCG/SPI LCG Software.
Feedback from LHC Experiments on using CLHEP Lorenzo Moneta CLHEP workshop 28 January 2003.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
SEAL Project Overview LCG-AA Internal Review October 2003 P. Mato / CERN.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
LCG CERN David Foster LCG WP4 Meeting 20 th June 2002 LCG Project Status WP4 Meeting Presentation David Foster IT/LCG 20 June 2002.
CHEP ' 2003David Chamont (CMS - LLR)1 OVAL A testing tool for CMS software
EMI INFSO-RI EMI Quality Assurance Tools Lorenzo Dini (CERN) SA2.4 Task Leader.
Geant4 is a toolkit to simulate the passage of particles through matter, and is widely used in HEP, in medical physics and for space applications. Ongoing.
CERN IT Department CH-1211 Genève 23 Switzerland t Migration from ELFMs to Agile Infrastructure CERN, IT Department.
1 Comments to SPI. 2 General remarks Impressed by progress since last review Widespread adoption by experiments and projects Savannah, ExtSoft Build system.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects GRIDPP 7 th Collaboration Meeting 30 June – 2 July.
News from EP SFT John Harvey FOCUS Meeting – October 3 rd 2003.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.
D. Duellmann, IT-DB POOL Status1 POOL Persistency Framework - Status after a first year of development Dirk Düllmann, IT-DB.
A. Aimar - IT/API LCG - Software Process & Infrastructure1 SPI - News and Status Update CERN,
J.T Moscicki CERN LCG - Software Process & Infrastructure1 Quality Assurance LCG Application Area Internal Review October 2003 Jakub T. Moscicki.
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
EMI INFSO-RI SA2: Quality Assurance Status Report Alberto Aimar(SA2) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure SPI Infrastructure for LCG Software Projects CHEP 2003 A.Aimar EP/SFT CERN LCG Software Process.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview (38 slides, 22 screen dumps)
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
INFSOM-RI WP3: WP3: Software configuration tools and methodologies Status Report ETICS All-Hands – 23 May 2007 E. Ronchieri.
SPI Report for the LHCC Comprehensive Review Stefan Roiser for the SPI project.
SPI Infrastructure for LCG Software Projects
SPI external software build tool and distribution mechanism
SPI Software Process & Infrastructure
LCG Generator Services project
LCG Software Quality Assurance
Leanne Guy EGEE JRA1 Test Team Manager
User Feedback from SEAL
First Internal Pool Release 0.1
Presentation transcript:

A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects Status and work plan for H July 2003 A.Aimar - CERN

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 2 CVS service Status In use and stable On safe servers in computer center -Lcgapp servers Hosting the LCG projects, App. Area and also others Discussed and agreed to move to IT service when ready (end of Summer) To do Continue user and project support Pass the service to IT, follow-up the needs of the LCG projects when this is done Who A.Pfeiffer

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 3 Code documentation Status Doxygen, LXR and ViewCVS are in place More customization is being added to Doxygen -Allow projects to choose what to publish -Customize where and how to publish Making the scripts available to to the LCG developers -so anyone can Doxygen and see how it looks before it is seen publicly and committed To do Complete the changes above and stabilize Who L.Mancera

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 4 Scram Status Used by the LCG projects Implemented fixes and improvements Improvements and and new features are going on -Improve performance -Configuration of the order of build -Generation of a standalone makefile -Working on Windows -Generation of MSVC++ project files To do Uniform the way in which Scram is used in projects Deliver the new features of Scram Scram tutorial and adequate training Who S.Ashby, I.Roman

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 5 Testing See next talk… Status Simple but useful frameworks are available -CppUnit, PyUnit -Oval Tools, templates and policies are in place User support is available To do User support and feedback will continue Integration of QMtest Provide training material and stabilize Who M. Gallas Torreira

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 6 Automatic builds Status Nicos is being adapted to be a general tool Collecting the needs of the LGC projects For now is mostly being implemented specifically for Pool and for Seal builds To do Provide a general tools that is customizable by the projects to run Provide standard configuration with the tools provided to LCG by SPI (for build and test) Who A.Undrus

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 7 External software libraries Status The service is in place and stable Making available now: -External software for the LCG compilers/platforms -Gcc, icc and ecc compilers -external software on these compilers Lot of software is installed with the help of the people in LCG or experiments, thanks ! To do Keep the service at pace with the needs of the projects Deliver the external software for Windows and for new compilers/platforms, as decided by the AF (gcc 3.2.3, OSX, …?) Who E.Poinsignon

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 8 QA and Policies Status Policies are agreed and public Templates are available and are really very simple QA check lists are under definition To do QA is still a difficult topic, but at least is present Help and verify follow-up of the policies Policies, naming, templates: to be used in the projects Provide the projects with QA check list so everybody knows about his/her own work Will be done more collecting numbers on the status of testing, policies and providing the result to the project QA checklists will used and then fixed, as usual Who M.Lamanna, J.Moscicki

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 9 Project Portal and Bug Tracker Status Savannah is available and there are more the -> 50 projects, > 200 users The service is stable and is shown to be useable Transition between people that will support and develop it Lot of work needed to be able to start merging the improvement To do Transition to new people responsible of the service Merge back our changes with the open source Implement the changes that are mostly needed by the projects Who D.Feichtinger,F. Orellana,Y.Perrin

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 10 Documentation Status We have a web site that is used quite often, but more from people outside the projects We do lot of personal meetings and coaching Several How-To and templates are available, some more used than others Other documentation is probably sufficient or not easily reachable and known To do This is one of the major work in providing a workbook (long awaited, sorry) for each function in the projects Training tutorial needed (Scram, Testing, etc) Who A.Aimar, E. Tumbarello, and others

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 11 Status: People (from Aug 2003) Full time Y.Perrin (savannah) E.Poinsignon (ext. libraries) I.Roman (scram) Part time (but fully in charge) M.Gallas (testing) L.Mancera (code documentation) J.Moscicki (quality and policies) A.Pfeiffer (cvs and lcgapp servers) E.Tumbarello (web) Will continue to help SPI S.Ashby (scram) D.Feichtinger (savannah) F.Orellana (savannah) M.Lamanna (quality and policies) Lot of help by the people in the LCG projects. Thank you.

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 12 SPI Services (I) CVS service and servers administration Support and maintain the current CVS server and provide help to the users and projects A.Pfeiffer External Software Service Install on the LCG platforms all external software needed the projects. E. Poinsignon LCG Librarian Provide configuration and build for the software projects (Toolbox) I. Roman Scram Service User support. Maintenance, development of the Scram software I. Roman Savannah Service User support. Maintenance, development with the open source of Savannah Y. Perrin

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 13 SPI Services (II) QA and Policies QA and verification of the policies in all projects. Define new policies and templates on the existing activities; foster the definition of new standards looking at how projects develop and what they use. J. Moscicki Code Documentation User support. Maintenance, configuration, development of the tools used for the code documentation (Doxygen, lxr, viewcvs) L. Mancera Software Distribution Basic release management. Tarfiles only for the moment. J. Moscicki and E. Poinsignon Automatic nightly build system User support. Maintenance, configuration, development of the tools used (Nicos) A. Undrus Testing Frameworks User support. Maintenance, configuration, development of the tools used for testing (CppUnit, PyUnit, Oval, QmTest) M. Gallas

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 14 SPI Services (III) Web management Basic web templates for SPI and for LCG App.Area in general. Web support and editing E.Tumbarello SPI infrastructure and management Manage the project, collect user feedback, define and steer the project. Represent the project in CERN ad in the LCG. A.Aimar Workbook and documentation, training material. Develop and help the development of documentation for SPI and for the other projects. But not contribute to the contents or the verification of the contents of the projects documentation. A.Aimar et al. Each role must have two backup people for all needed activities during absence

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 15 Conclusions For later, unless new resources or simpler needs Some solution will be very basic for now:e.g. packaging and distribution mechanism There will be no new major tools and support on: e.g. no software design, specifications, no more automatized procedure and no some process. SPI will provide the services agreed People transitions and “fire-fighting mode” are a problem Some activities move faster or slower than foreseen often due to need (and help!) from the users Making people collaborate and work together is our job Less trivial than it seems, and is more work than it seems.

A. Aimar - EP/SFT LCG - Software Process & Infrastructure 16 Thanks Thanks to the people that helped SPI to get going and best wishes for their future work Use some SPI stuff in your new job Keep helping us when needed Thanks to the users in the LCG projects, in LHC experiments and in IT They know on the subjects Helped us in many situation to get going or in some difficult cases Not in any order: Lassi, Ioannis, Jacek, Lorenzo, Fons, Lucas, Stephan, Giacomo, Ilka, David, Maria, John, Tim, Jan, Ian, Markus, Vincenzo, Rene, Matthias, Dirk, Pere, and many more.