First Internal Pool Release 0.1

Slides:



Advertisements
Similar presentations
The POOL Persistency Framework POOL Summary and Plans.
Advertisements

D. Düllmann - IT/DB LCG - POOL Project1 POOL Release Plan for 2003 Dirk Düllmann LCG Application Area Meeting, 5 th March 2003.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
Emerging Platform#4: Android Bina Ramamurthy.  Android is an Operating system.  Android is an emerging platform for mobile devices.  Initially developed.
SPI Software Process & Infrastructure GRIDPP Collaboration Meeting - 3 June 2004 Jakub MOSCICKI
SEAL V1 Status 12 February 2003 P. Mato / CERN Shared Environment for Applications at LHC.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
SPI Software Process & Infrastructure EGEE France - 11 June 2004 Yannick Patois
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing LCG Applications Area GridPP 7 th Collaboration Meeting LCG/SPI LCG.
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
Conditions DB in LHCb LCG Conditions DB Workshop 8-9 December 2003 P. Mato / CERN.
The LCG SPI project in LCG Phase II CHEP’06, Mumbai, India Feb. 14, 2006 Andreas Pfeiffer -- for the SPI team
POOL Status and Plans Dirk Düllmann IT-DB & LCG-POOL Application Area Meeting 10 th March 2004.
Feedback from the POOL Project User Feedback from the POOL Project Dirk Düllmann, LCG-POOL LCG Application Area Internal Review October 2003.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
SEAL Project Core Libraries and Services 18 December 2002 P. Mato / CERN Shared Environment for Applications at LHC.
The POOL Persistency Framework POOL Project Review Introduction & Overview Dirk Düllmann, IT-DB & LCG-POOL LCG Application Area Internal Review October.
DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.
Franco Carbognani, EGO LSC-Virgo Meeting May 2007 Status and Plans LIGO-G Z Software Management.
2012 Objectives for CernVM. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
D. Duellmann - IT/DB LCG - POOL Project1 The LCG Pool Project and ROOT I/O Dirk Duellmann What is Pool? Component Breakdown Status and Plans.
APT Configuration Management May 25th, 2004 APT Configuration Management Jesse Doggett.
Data Placement Intro Dirk Duellmann WLCG TEG Workshop Amsterdam 24. Jan 2012.
D. Duellmann - IT/DB LCG - POOL Project1 The LCG Dictionary and POOL Dirk Duellmann.
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
1 Comments to SPI. 2 General remarks Impressed by progress since last review Widespread adoption by experiments and projects Savannah, ExtSoft Build system.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects Status and work plan for H July 2003 A.Aimar.
28 June 2000P. Mato, CERN1 Software Checklist Proposal for controlling and documenting all the steps in developing software Program of Work Meeting, June.
K. Harrison CERN, 21st February 2005 GANGA: ADA USER INTERFACE - Ganga release Python client for ADA - ADA job builder - Ganga release Conclusions.
David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.
D. Duellmann - IT/DB LCG - POOL Project1 Internal Pool Release V0.2 Dirk Duellmann.
D. Duellmann, IT-DB POOL Status1 POOL Persistency Framework - Status after a first year of development Dirk Düllmann, IT-DB.
A. Aimar - IT/API LCG - Software Process & Infrastructure1 SPI - News and Status Update CERN,
D. Düllmann - IT/DB LCG - POOL Project1 POOL Release V1.0 Dirk Düllmann LCG Application Area Meeting, 14 th May 2003.
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
WP3 WP3 at Budapest 2/9/2002 Steve Fisher / RAL. WP3 Steve Fisher/RAL - 2/9/2002WP3 at Budapest2 Summary News –EDG Retreat –EDG Tutorials –Quality –Release.
POOL Based CMS Framework Bill Tanenbaum US-CMS/Fermilab 04/June/2003.
Persistency Project (POOL) Status and Work Plan Proposal
LCG Applications Area Milestones
How to Contribute to System Testing and Extract Results
(on behalf of the POOL team)
Project Center Use Cases Revision 2
Project Center Use Cases
Marc-Elian Bégin ETICS Project, CERN
More Interfaces Workplan
SPI external software build tool and distribution mechanism
Project Center Use Cases
Database Readiness Workshop Intro & Goals
SPI Software Process & Infrastructure
WP4-install status update
Generator Services planning meeting
POOL File Catalog: Design & Status
NIGHTLY BUILD SCRIPT FOR THE LEVEL-1 TRIGGER ONLINE SOFTWARE
Dirk Düllmann CERN Openlab storage workshop 17th March 2003
Project Center Use Cases Revision 3
FESA evolution and the vision for Front-End Software
Project Center Use Cases Revision 3
Software Version System Part1: Subversion at CERN
GIFT / Fiscal Data Package Iteration 3
What’s new in version 5 of GAUDI
CSE 303 Concepts and Tools for Software Development
Chapter 7 –Implementation Issues
POOL Status & Release Plan for V0.4
SEAL Project Core Libraries and Services
PyWBEM Python WBEM Client: Overview #2
Presentation transcript:

First Internal Pool Release 0.1 Dirk Duellmann D. Duellmann - IT/DB LCG - POOL Project

Release Platform POOL V0.1 has been released on October 3rd the cvs release tag is POOL_0_1_0 Single supported platform so far RedHat 7.2 using gcc 2.95.2 Code should also work on rh61 and (partially) on win32/VC6 Require several external packages hosted by SPI see /afs/cern.ch/sw/lcg/external MySQL (4.0.1-alpha) MySQL++ (1.7.9) Root (3.03) Xerces-C (1.6.0) Supported build systems scram and (less complete) cmt D. Duellmann - IT/DB LCG - POOL Project

Release Content Storage Service File Catalog Refs and Cache two operation modes objects in a tree or objects named into directory structure provides coherent access to the two very different root optimisation models with the user same code File Catalog two implementation based on mysql and xml provide api & admin tools Refs and Cache simplistic cache implementation testbed for Ref classes – example for integration with experiment caches Reflection & Conversion Full reflection interface some refactoring of the interface going on (not yet in the tagged release) D. Duellmann - IT/DB LCG - POOL Project

Release Content II Release Target: Provide component implementations for pool core component and show basic navigation between persistent objects Test Programs – eg /pool/test/Pool_1 write a few interrelated objects into a root file read them back using pool object references keep objects available for repeated local access in pool object cache register and lookup files as required by the navigation from either of the two available catalog implementations But… rather bare bones component integration so far! Pool_1 test shows not the expected end user code in many cases still calling low level component api which is to be hidden behind a proper end user facade (Refs/PersistencySvc) D. Duellmann - IT/DB LCG - POOL Project

Building POOL Libraries and Executables … is not as easy yet as it should be. Because of bugs… weaknesses in our integration testing (no automised test yet) too little time for thorough integration testing in this cycle not yet existing documentation Plan to tag a bug fix release Complicated setup because conflicting build system conventions include directory names path prefixing conventions CVS tag conventions compiler settings (GNU_SOURCE) All minor issues but hard to resolve in a single development system D. Duellmann - IT/DB LCG - POOL Project

POOL development on CMT and SCRAM? Was this useful? yes, at least during the project start-up phase it allowed developers to work in their “home development environment” Should we keep release support for both or even extend this to other build mechanisms definitely not! this is convenient for single component development but would likely turn into a nightmare for more serious integration testing and release QA D. Duellmann - IT/DB LCG - POOL Project

Next Steps Code review starts now in 3 teams of 2 pool developers for 2 half days SPI provides one external person for the review Tagged reflection code will be send to Tyng-Ruey Chuang To be finished by end of next week (also ROOT ws week!) Standarise and simplify cvs structure Flatten sub directory structure to /pool/component Use “pool” for component interface directories and #include “pool/ISomeThing.h” for inclusion Working with SPI project On code documentation (cvsview) Move asap to automatised unit and integration testing (cpp_unit/oval?) D. Duellmann - IT/DB LCG - POOL Project

Communication Pool work package meetings will be announced on our web and email list Everybody contributing to pool development is welcome to attend WARNING: Don’t expect to leave without a development task assigned to you The pool list became after the release quite active Propose to setup an dedicated developer list for bug reporting traffic and internal developer discussions Spare the traffic on the main list for architectural discussions interesting to a wider community D. Duellmann - IT/DB LCG - POOL Project

Next release In only less than a month … Collection support is coming Planning discussions for the release content started Collection support is coming Commit of first prototype is expected soon Steve Eckman replaces Chris Lain as of now One day planning & integration meeting with Collection WP will be held tomorrow in Orsay Expect Storage Svc requirement for container and file level iterators Object Conversion and Foreign Class Support gcc-xml, ADL, XML based reflection & conversions prototype? Need to improve the manpower problems in this work package Move to MySQL 4.0.3-beta Alexandre Vaniachine has taken over from Zhen the responsibility for MySQL and MySQL++ (external packages used by pool) D. Duellmann - IT/DB LCG - POOL Project

Next release - Ideas Data extraction and publishing tools take a few file home publish file generated in a decoupled setup Catalog browser & admin tool? complement command line tools developed by Zhen eg Python based rather decoupled - could be done eg outside CERN Move release platform to RedHat 7.3? CERN will be moving soon – we should as well either for V0.2 or V0.3 Provide additional support for gcc 3.2? Only if we can get rid of one build system by end of October D. Duellmann - IT/DB LCG - POOL Project

Summary The internal POOL V0.1 release took place with planned content and only minor delay Thanks to the full commitment of all pool developers and significant help from outside! This is the FIRST DEVELOPER release report bugs/problems to the developer list – we left enough  we’ll create a pool developer list if traffic becomes unbearable even better: fix bugs – most of them are still easy to fix  Many lessons learned from the very first cycle We will try to fix the observed setup problems The CVS structure will be simplified and standardised Plan to drop release support either scram or cmt as soon as possible LCG POOL as a project is up an running a growing fraction of the pool software is as well … D. Duellmann - IT/DB LCG - POOL Project