20/09/2006LCG AA 2006 Review1 Committee feedback to SPI.

Slides:



Advertisements
Similar presentations
Project Management Summary Castor Development Team Castor Readiness Review – June 2006 German Cancio, Giuseppe Lo Presti, Sebastien Ponce CERN / IT.
Advertisements

HP Quality Center Overview.
System Center Configuration Manager Push Software By, Teresa Behm.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
EC Review – 01/03/2002 – G. Zaquine – Quality Assurance – WP12 – CS-SI – n° 1 DataGrid Quality Assurance Gabriel Zaquine Quality Engineer - WP12 – CS-SI.
Software Configuration Management
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
Release & Deployment ITIL Version 3
Configuration Management Process and Environment MACS Review 1 February 5th, 2010 Roland Moser PR a-RMO, February 5 th, 2010 R. Moser 1 R. Gutleber.
Quality Assurance and Testing in LCG CHEP 2004 Interlaken, Switzerland 30 September 2004 Manuel Gallas, Jakub MOSCICKI CERN
SPI Software Process & Infrastructure GRIDPP Collaboration Meeting - 3 June 2004 Jakub MOSCICKI
Abstract The automated multi-platform software nightly build system is a major component in the ATLAS collaborative software organization, validation and.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
SPI Software Process & Infrastructure EGEE France - 11 June 2004 Yannick Patois
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing LCG Applications Area GridPP 7 th Collaboration Meeting LCG/SPI LCG.
SPI Software Process & Infrastructure Project Status Application Area Review – 18 Sep 2006.
SPI Software Process & Infrastructure Project Status Application Area Review – 30 March 2005.
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
EMI INFSO-RI EMI Quality Assurance Processes (PS ) Alberto Aimar (CERN) CERN IT-GT-SL Section Leader EMI SA2 QA Activity Leader.
J.T Moscicki CERN LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Software Packaging and Distribution LCG Application.
ETICS2 All Hands Meeting VEGA GmbH INFSOM-RI Uwe Mueller-Wilm Palermo, Oct ETICS Service Management Framework Business Objectives and “Best.
NICOS System of Nightly Builds for Distributed Development Alexander Undrus CHEP’03.
INFSO-RI Enabling Grids for E-sciencE The gLite Software Development Process Alberto Di Meglio CERN.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
The LCG SPI project in LCG Phase II CHEP’06, Mumbai, India Feb. 14, 2006 Andreas Pfeiffer -- for the SPI team
LCG Applications Area – Overview, Planning, Resources Torre Wenaus, BNL/CERN LCG Applications Area Manager LHCC Comprehensive Review.
C. Arnault – ATLAS RPMs- 14/03/ n° 1 ATLAS RPMs from CMT C. Arnault & C. Loomis
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
CERN-PH-SFT-SPI August Ernesto Rivera Contents Context Automation Results To Do…
LCG-SPI: SW-Testing LCG AppArea internal review (20/10/03)
Organization and Management of ATLAS Nightly Builds F. Luehring a, E. Obreshkov b, D.Quarrie c, G. Rybkine d, A. Undrus e University of Indiana, USA a,
GGUS at PEB – –- page 1 LCG Klaus-Peter Mickel, GridKa Karlsruhe LCG-PEB-Meeting ( ) The Global Grid User Support Model (Report of GDB.
Feedback from the POOL Project User Feedback from the POOL Project Dirk Düllmann, LCG-POOL LCG Application Area Internal Review October 2003.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing QMTest test framework LCG AppArea meeting (16/07/03) LCG/SPI LCG Software.
EGEE MiddlewareLCG Internal review18 November EGEE Middleware Activities Overview Frédéric Hemmer EGEE Middleware Manager EGEE is proposed as.
Providing a coherent view of SFT products to potential new users Stefan Roiser PH/SFT.
Firmware - 1 CMS Upgrade Workshop October SLHC CMS Firmware SLHC CMS Firmware Organization, Validation, and Commissioning M. Schulte, University.
Servicing HEP experiments with a complete set of ready integrated and configured common software components Stefan Roiser 1, Ana Gaspar 1, Yves Perrin.
Software Release Procedure Session MANAGEMENT and FUTURE directions Form ongoing ‘empowered’ Technical Discussion Group (TDG) Any future project definitions(resources.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
SEAL Project Overview LCG-AA Internal Review October 2003 P. Mato / CERN.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
LCG – AA review 1 Simulation LCG/AA review Sept 2006.
State of Georgia Release Management Training
Software Deployment & Release 26/03/2015 1EN-ICE.
1 Comments to SPI. 2 General remarks Impressed by progress since last review Widespread adoption by experiments and projects Savannah, ExtSoft Build system.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects Status and work plan for H July 2003 A.Aimar.
Savannah to Jira Migration LHCb Computing Workshop 19 th of May 2014.
J.T Moscicki CERN LCG - Software Process & Infrastructure1 Quality Assurance LCG Application Area Internal Review October 2003 Jakub T. Moscicki.
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Grid Deployment Technical Working Groups: Middleware selection AAA,security Resource scheduling Operations User Support GDB Grid Deployment Resource planning,
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
Configuration & Build Management. Why Software Configuration Management ? The problem: Multiple people have to work on software that is changing More.
SPI Report for the LHCC Comprehensive Review Stefan Roiser for the SPI project.
How to Contribute to System Testing and Extract Results
Regional Operations Centres Core infrastructure Centres
SPI Infrastructure for LCG Software Projects
SPI external software build tool and distribution mechanism
SPI Software Process & Infrastructure
User Feedback from SEAL
LCG Operations Workshop, e-IRG Workshop
Leigh Grundhoefer Indiana University
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
Presentation transcript:

20/09/2006LCG AA 2006 Review1 Committee feedback to SPI

20/09/2006LCG AA 2006 Review2 Management and planning Need to identify or establish coordination body for interface to middleware/fabric for testing and standardization –Concern about heterogeneity among computing centers Work-plan reasonable (see concerns on SCRAM to CMT migration) but grave concerns as to manpower situation which seems critical –Some descoping proposed in context of build and release process and documentation BUT –Cannot afford further manpower decrease CERNLIB situation –Need to review what is still needed, by whom (e.g. generators), as well as by whom it is to be maintained, packaged and distributed

20/09/2006LCG AA 2006 Review3 Development and bug tracking Savannah –A success story… –Replace cookbook by Twiki page (de facto standard for HowTo documents)? query and link savannah items directly from Wiki documents useful for writing release notes –Provide regular (WWW-based?) project tracking reports May help project managers to identify problematic areas –No need for G4 migration to Savannah Collaboration agreement with KEK guaranteeing support of current system BUT still need for some gateway mechanism to allow single-entry point for end users Bug prioritization –Additional input from experiments? Use Savannah “voting” mechanism? Will need policy as to who “votes”…

20/09/2006LCG AA 2006 Review4 Configuration management SCRAM to CMT migration –Clarify LCGCMT status; extend support agreement? –Clarify “internal” vs “experiment-visible” configuration with CMT will CMT users see packages as CMT projects? –Dependency handling and granularity ability to build and distribute ONLY what one needs and declare dependencies at such granularity that no global recompilation is triggered –CMS concerns about timing gradual migration anyway… Proposal migration to be handled in close collaboration with Architects Forum taking into account limitations due to descoping

20/09/2006LCG AA 2006 Review5 Release, packaging and installation Further steps to speed up procedure essential; various proposals –Outsource package installation to developers Must however ensure uniformity –Centralize and automate re-build system –Deploy nightly builds –Deploy a continuous build system that follows package dependencies, carries out unit testing, packages build products, produces reports (and alerts in case of failures) –Automate test result checking –Revisit/rationalize platform support and “retirement” –Consider use of auxiliary release management procedures and tools (open vs closed releases, tag collectors etc) Clarify situation wrt external packages –Dependency handling –Automated build procedure? –Maintain version publication for all external packages; important for experiment integration as well as several Grid middleware tools

20/09/2006LCG AA 2006 Review6 Quality assurance, documentation, training Automate build WWW page updates Clarify situation wrt QMTest –Concerns about automation capabilities? –Plan to further advocate its use? Maintenance and support? Launch automated testing facility that would constantly run high level functional tests (some of which could be provided by the experiments) –To a large extent project-specific; may not be feasible under SPI given descoping… ROOT doxygen documentation –Port existing doc or provide links to native ROOT documentation by generation of doxygen compatible TAG files by the ROOT system Reinstate popular Python course in collaboration with outside (experiment) experts