Feedback from the POOL Project User Feedback from the POOL Project Dirk Düllmann, LCG-POOL LCG Application Area Internal Review 20-22 October 2003.

Slides:



Advertisements
Similar presentations
Software change management
Advertisements

Configuration management
Project Management Summary Castor Development Team Castor Readiness Review – June 2006 German Cancio, Giuseppe Lo Presti, Sebastien Ponce CERN / IT.
HP Quality Center Overview.
D. Düllmann - IT/DB LCG - POOL Project1 POOL Release Plan for 2003 Dirk Düllmann LCG Application Area Meeting, 5 th March 2003.
Requirements Analysis 5. 1 CASE b505.ppt © Copyright De Montfort University 2000 All Rights Reserved INFO2005 Requirements Analysis CASE Computer.
CSC 395 – Software Engineering Lecture 25: SCM –or– Expecting Change From Everything But Vending Machines.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
EC Review – 01/03/2002 – G. Zaquine – Quality Assurance – WP12 – CS-SI – n° 1 DataGrid Quality Assurance Gabriel Zaquine Quality Engineer - WP12 – CS-SI.
Chapter 25 – Configuration Management 1Chapter 25 Configuration management.
Quality Assurance and Testing in LCG CHEP 2004 Interlaken, Switzerland 30 September 2004 Manuel Gallas, Jakub MOSCICKI CERN
SPI Software Process & Infrastructure GRIDPP Collaboration Meeting - 3 June 2004 Jakub MOSCICKI
SEAL V1 Status 12 February 2003 P. Mato / CERN Shared Environment for Applications at LHC.
M. Gallas IT-API LCG SPI project: testing1 Software Testing Infrastructure status LCG Software Process & Infrastructure (CERN, 10/23/02)
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
SPI Software Process & Infrastructure EGEE France - 11 June 2004 Yannick Patois
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing LCG Applications Area GridPP 7 th Collaboration Meeting LCG/SPI LCG.
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
 To explain the importance of software configuration management (CM)  To describe key CM activities namely CM planning, change management, version management.
J.T Moscicki CERN LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Software Packaging and Distribution LCG Application.
NICOS System of Nightly Builds for Distributed Development Alexander Undrus CHEP’03.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
The LCG SPI project in LCG Phase II CHEP’06, Mumbai, India Feb. 14, 2006 Andreas Pfeiffer -- for the SPI team
The huge amount of resources available in the Grids, and the necessity to have the most up-to-date experimental software deployed in all the sites within.
Planning for security Microsoft View
CERN-PH-SFT-SPI August Ernesto Rivera Contents Context Automation Results To Do…
JIRA usage in the DAQ An overview.
LCG-SPI: SW-Testing LCG AppArea internal review (20/10/03)
POOL Status and Plans Dirk Düllmann IT-DB & LCG-POOL Application Area Meeting 10 th March 2004.
20/09/2006LCG AA 2006 Review1 Committee feedback to SPI.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects Overview A.Aimar EP/SFT CERN LCG Software Process.
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing QMTest test framework LCG AppArea meeting (16/07/03) LCG/SPI LCG Software.
The POOL Persistency Framework POOL Project Review Introduction & Overview Dirk Düllmann, IT-DB & LCG-POOL LCG Application Area Internal Review October.
ATLAS Experience with GGUS Guido Negri INFN – Milano Italy.
Confidential Continuous Integration Framework (CIF) 5/18/2004.
14th Oct 2005CERN AB Controls Development Process of Accelerator Controls Software G.Kruk L.Mestre, V.Paris, S.Oglaza, V. Baggiolini, E.Roux and Application.
Providing a coherent view of SFT products to potential new users Stefan Roiser PH/SFT.
Feedback from LHC Experiments on using CLHEP Lorenzo Moneta CLHEP workshop 28 January 2003.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
UHCS 2005, slide 1 About Continuous Integration. UHCS 2005, slide 2 Why do you write Unit Test ? Improve quality/robustness of your code Quick feedback.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Datagrid Software Repository Presentation CVS, packages and automatic.
F. Carbognani Software Engineering for the Virgo Project at EGOGeneva-iCALEPCS 14/10/2005 Software Engineering for the Virgo Project at EGO F. Carbognani.
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
1 Comments to SPI. 2 General remarks Impressed by progress since last review Widespread adoption by experiments and projects Savannah, ExtSoft Build system.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects GRIDPP 7 th Collaboration Meeting 30 June – 2 July.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects Status and work plan for H July 2003 A.Aimar.
D. Duellmann, IT-DB POOL Status1 POOL Persistency Framework - Status after a first year of development Dirk Düllmann, IT-DB.
A. Aimar - IT/API LCG - Software Process & Infrastructure1 SPI - News and Status Update CERN,
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure SPI Infrastructure for LCG Software Projects CHEP 2003 A.Aimar EP/SFT CERN LCG Software Process.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview (38 slides, 22 screen dumps)
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
SPI Report for the LHCC Comprehensive Review Stefan Roiser for the SPI project.
Chapter 25 – Configuration Management 1Chapter 25 Configuration management.
How to Contribute to System Testing and Extract Results
Continuous Delivery- Complete Guide
SPI Infrastructure for LCG Software Projects
SPI external software build tool and distribution mechanism
3D Application Tests Application test proposals
SPI Software Process & Infrastructure
Leanne Guy EGEE JRA1 Test Team Manager
User Feedback from SEAL
First Internal Pool Release 0.1
Porting LCG to IA64 Andreas Unterkircher CERN openlab May 2004
Presentation transcript:

Feedback from the POOL Project User Feedback from the POOL Project Dirk Düllmann, LCG-POOL LCG Application Area Internal Review October 2003

Feedback from the POOL ProjectD.Duellmann2 SPI Services used by POOL POOL was the first project using SPI servicesPOOL was the first project using SPI services –POOL has actively contributed to the definition of SPI services and LCG policies maintained by SPI POOL is relying on many (almost all) SPI servicesPOOL is relying on many (almost all) SPI services –SCRAM Support –External Software Library –S/W distribution kits and installation scripts –Documentation Tools –CVS repository –Testing Tools –Nightly Builds

Feedback from the POOL ProjectD.Duellmann3Savannah POOL relies on Savannah as project portalPOOL relies on Savannah as project portal –Problem reporting and tracking –Support call tracking –Internal task allocation and tracking Experience with problem tracking is positiveExperience with problem tracking is positive –Support call tracking misses some of the functionality (eg cc list, notification on call assignment to developers) –Some enhancements could even further improve the system Eg automatic escalation after some timeout Insuring that calls have a originator or name –No real showstoppers found FAQ feature found too simple for larger FAQsFAQ feature found too simple for larger FAQs –(Un)fortunately not our problem yet… Few additions would make Savannah also useful for service projects (in contrast to s/w development)Few additions would make Savannah also useful for service projects (in contrast to s/w development) –Eg Meeting minutes and intervention logs

Feedback from the POOL ProjectD.Duellmann4 SCRAM Support SCRAM and LCG ToolBoxSCRAM and LCG ToolBox –Common ToolBox for all projects is essential to insure compatibility across the project –Need to include definition of all supported platforms – including compilation flags which may affect the C++ ABI –Usually quick response to change requests Coverage during the vacation period and toolbox testing before release are essential and are now addressed CVS RepositoryCVS Repository –Works without any problems… NICOS build systemNICOS build system –POOL has been integrated –Not too much benefit so far, but expect this to become important as soon as more platforms are deployed and used in development

Feedback from the POOL ProjectD.Duellmann5 Testing Framework Oval has been adopted throughout POOL for integration testingOval has been adopted throughout POOL for integration testing CppUnit used in some areas but pure unit testing harder to apply generally in POOL because of interdependenciesCppUnit used in some areas but pure unit testing harder to apply generally in POOL because of interdependencies So far still rely on specialized python script to fully automate the POOL testing for partial releasesSo far still rely on specialized python script to fully automate the POOL testing for partial releases –POOL has non-trivial dependencies between different test via their data files –Also Data format regression tests impose additional requirement specific to POOL Plan to move to QMtestPlan to move to QMtest –First experience is positive

Feedback from the POOL ProjectD.Duellmann6 External Software Library Professional installation and documentation of all available softwareProfessional installation and documentation of all available software Library is getting quite large alreadyLibrary is getting quite large already –Should maybe reflect the difference between build- for-test and build-for-production platforms Eagerly updating all packages on “for test” platforms may generate a lot of effort –Keep a reference count for who has requested/is using a particular package Keeping packages forever without at least a single clear requestor/owner is resource consuming

Feedback from the POOL ProjectD.Duellmann7 LCG Software Distribution Useful end user installation scripts for local installationUseful end user installation scripts for local installation –Facilitates development eg on a laptop –Used successfully eg for the Computing School in Karlsruhe Installing all possible dependencies results in 1.5GB installation - some streamlining requiredInstalling all possible dependencies results in 1.5GB installation - some streamlining required –May want to strip server components –May want more customized partial installations Several tar / rpm based formats in preparationSeveral tar / rpm based formats in preparation –Integration with LCG-1 mechanisms required In close collaboration with LCG GD Area

Feedback from the POOL ProjectD.Duellmann8 Documentation Tools POOL Reference Documentation is based on doxygen service provided by SPIPOOL Reference Documentation is based on doxygen service provided by SPI –POOL developers just follow the doxygen guidelines defined by SPI –After a release has been tagged the complete documentation shows up “automatically” within a day Positive experience with this SPI servicePositive experience with this SPI service –Only minor problems still to be sorted out Remove test applications from the documentation parsing (duplicate classes and types) ViewCVSViewCVS –Very useful not only for developers but also project admins Use regularly the check-in database to find out what happens inside the larger POOL CVS tree

Feedback from the POOL ProjectD.Duellmann9Summary POOL fully relies on many SPI servicesPOOL fully relies on many SPI services –And actively participates in their definition –Service level for POOL is found very adequate POOL has followed the evolution of LCG policies maintained and checked by SPIPOOL has followed the evolution of LCG policies maintained and checked by SPI –Being the first project is sometimes a disadvantage Insuring a consistent/identical build and testing procedure between the LCG AA projects is non-trivialInsuring a consistent/identical build and testing procedure between the LCG AA projects is non-trivial –Because of different project requirements –The task would be simplified by centralizing the task –The load generated by the frequent internal releases in POOL is significant