Offline framework for conditions data

Slides:



Advertisements
Similar presentations
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
Advertisements

March 24-28, 2003Computing for High-Energy Physics Configuration Database for BaBar On-line Rainer Bartoldus, Gregory Dubois-Felsmann, Yury Kolomensky,
André Augustinus ALICE Detector Control System  ALICE DCS is responsible for safe, stable and efficient operation of the experiment  Central monitoring.
Software Summary Database Data Flow G4MICE Status & Plans Detector Reconstruction 1M.Ellis - CM24 - 3rd June 2009.
1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
Peter Chochula, January 31, 2006  Motivation for this meeting: Get together experts from different fields See what do we know See what is missing See.
Quality Control B. von Haller 8th June 2015 CERN.
Conditions DB in LHCb LCG Conditions DB Workshop 8-9 December 2003 P. Mato / CERN.
Experience with analysis of TPC data Marian Ivanov.
LHC: ATLAS Experiment meeting “Conditions” data challenge Elizabeth Gallas - Oxford - August 29, 2009 XLDB3.
ALICE Upgrade for Run3: Computing HL-LHC Trigger, Online and Offline Computing Working Group Topical Workshop Sep 5 th 2014.
Real data reconstruction A. De Caro (University and INFN of Salerno) CERN Building 29, December 9th, 2009ALICE TOF General meeting.
Offline shifter training tutorial L. Betev February 19, 2009.
4/5/2007Data handling and transfer in the LHCb experiment1 Data handling and transfer in the LHCb experiment RT NPSS Real Time 2007 FNAL - 4 th May 2007.
ALICE, ATLAS, CMS & LHCb joint workshop on
Offline report – 7TeV data taking period (Mar.30 – Apr.6) ALICE SRC April 6, 2010.
Clara Gaspar, March 2005 LHCb Online & the Conditions DB.
Introduction CMS database workshop 23 rd to 25 th of February 2004 Frank Glege.
Databases in CMS Conditions DB workshop 8 th /9 th December 2003 Frank Glege.
ALICE Condition DataBase Magali Gruwé CERN PH/AIP Alice Offline week May 31 st 2005.
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
Planning and status of the Full Dress Rehearsal Latchezar Betev ALICE Offline week, Oct.12, 2007.
4 Oct 2005 / Offline week Shuttle program for gathering conditions data from external DB Boyko Yordanov 4 October 2005 ALICE Offline week.
AliRoot survey P.Hristov 11/06/2013. Offline framework  AliRoot in development since 1998  Directly based on ROOT  Used since the detector TDR’s for.
1 SDD: DA and preprocessor Francesco Prino INFN Sezione di Torino ALICE offline week – April 11th 2008.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
Alberto Colla - CERN ALICE off-line week 1 Alberto Colla ALICE off-line week Cern, May 31, 2005 Table of contents: ● Summary of requirements ● Description.
Computing for Alice at GSI (Proposal) (Marian Ivanov)
M. Oldenburg GridPP Metadata Workshop — July 4–7 2006, Oxford University 1 Markus Oldenburg GridPP Metadata Workshop July 4–7 2006, Oxford University ALICE.
Status of the Shuttle Framework Alberto Colla Jan Fiete Grosse-Oetringhaus ALICE Offline Week October 2006.
Workflows and Data Management. Workflow and DM Run3 and after: conditions m LHCb major upgrade is for Run3 (2020 horizon)! o Luminosity x 5 ( )
Summary of User Requirements for Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Offline Week Alignment and Calibration Workshop February.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
Summary of Workshop on Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Computing Day February 28 th 2005.
Alignment in real-time in current detector and upgrade 6th LHCb Computing Workshop 18 November 2015 Beat Jost / Cern.
ALICE RRB-T ALICE Computing – an update F.Carminati 23 October 2001.
ALICE experiences with CASTOR2 Latchezar Betev ALICE.
Report on database work for INB in ALICE Latchezar Betev (ALICE) Information Session INB – June 8, 2006.
Database Issues Peter Chochula 7 th DCS Workshop, June 16, 2003.
AliRoot Classes for access to Calibration and Alignment objects Magali Gruwé CERN PH/AIP ALICE Offline Meeting February 17 th 2005 To be presented to detector.
Maria del Carmen Barandela Pazos CERN CHEP 2-7 Sep 2007 Victoria LHCb Online Interface to the Conditions Database.
ALICE Physics Data Challenge ’05 and LCG Service Challenge 3 Latchezar Betev / ALICE Geneva, 6 April 2005 LCG Storage Management Workshop.
Some topics for discussion 31/03/2016 P. Hristov 1.
AliRoot survey: Calibration P.Hristov 11/06/2013.
ALICE Full Dress Rehearsal ALICE TF Meeting 02/08/07.
Barthélémy von Haller CERN PH/AID For the ALICE Collaboration The ALICE data quality monitoring system.
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
L1Calo Databases ● Overview ● Trigger Configuration DB ● L1Calo OKS Database ● L1Calo COOL Database ● ACE Murrough Landon 16 June 2008.
CT-PPS DB Info (Preliminary) DB design will be the same as currently used for CMS Pixels, HCAL, GEM, HGCAL databases DB is Oracle based A DB for a sub-detector.
Database Replication and Monitoring
(on behalf of the POOL team)
CMS High Level Trigger Configuration Management
ALICE Monitoring
ALICE analysis preservation
Summary of first LHC logging DB meeting
TPC Commissioning: DAQ, ECS aspects
News on the CDB Framework
Calibrating ALICE.
TOF CALIBRATION DATABASE
Offline shifter training tutorial
Commissioning of the ALICE HLT, TPC and PHOS systems
POOL persistency framework for LHC
Dirk Düllmann CERN Openlab storage workshop 17th March 2003
ProtoDUNE SP DAQ assumptions, interfaces & constraints
Offline shifter training tutorial
Analysis framework - status
Corr framework Computing in High Energy and Nuclear Physics
QA tools – introduction and summary of activities
Stephen Burke, PPARC/RAL Jeff Templon, NIKHEF
Presentation transcript:

Offline framework for conditions data L.Betev TPC commissioning meeting Geneva, February 17, 2006

Outline Conditions data in Offline Content and access Status of offline framework and plans

Conditions DB relations in ALICE Conditions data in Offline Conditions data are stored and accessible by the applications on the GRID Treating all source databases as potentially containing conditions information and as “closed”, i.e. only accessible at CERN It would be difficult to provide access methods to all DBs from the production and analysis code The conditions DB framework is providing access methods to all external DBs Conditions data stored as read only ROOT files: Object store technology already incorporated in the ALICE offline

Conditions DB relations in ALICE (2) Conditions data access in a Grid distributed production and analysis environment: The root files are registered in the Grid Distributed File Catalogue: No need for distributed DBMS in a traditional sense and with all accompanying problems (remote access, replication, authentication, load) – a very big plus Assures worldwide access to all files and associated tags Drawbacks: Replication of information – potentially large parts of ‘external’ DBs have to be put in the offline conditions DB However the same is true for all LHC experiments

External sources of conditions data and relations to offline DAQ Trigger DCS ECS Physics data DCDB GRID FC: metadata file store calibration procedures calibration files AliRoot Calibration classes API files HLT

Conditions DB – content and access Update frequency: The condition DB will have rather infrequent updates (max: once per run) The objects themselves can have rich internal structure with finer granularity, depending on the detector calibration / alignment needs Access framework: Simple user interface and data identification (strings) Automatically get the right valid object Modification of the objects is handled through versioning Same interface for different types of data sources (local file, Grid)

Data organisation - simple filesystem-like storage: Calibration/DETECTOR/FirstRun-LastRun.version

Status of the access framework AliRoot implementation: Classes to put/get conditions objects are ready and tested by all ALICE detector groups Access methods: GRID file and metadata storage (AliEn GRID File catalogue) – deployed Conditions data dump in local files - expert use, new versions of conditions, ‘disconnected from the GRID’ mode – deployed Combination of the above - deployed

Status of the access framework (2) Current issues: Availability of conditions data ‘Quasi-online’ first pass reconstruction – good enough version of the conditions data should be available almost immediately Who provides what: offline is a pure consumer of conditions data – should make sure that the methods and procedures exist to store the data in the relevant ‘external’ DBs APIs to external sources Access to some of the DBs not solved yet (especially LHC machine information)

Conditions DB – automatic information gathering Automated system – Shuttle: Collecting conditions data from external DB at predetermined time intervals (for example at the end of every run) Processing collected data using detector-specific preprocessor Storing conditions data in the Conditions DB

Conditions DB – information gathering (2) Similar systems can be used to process conditions data from other sources: Only new interfaces needed The processing of the data is done in AliRoot (no change of framework) Allows detector groups to do analysis and reduction of the raw data volume before storing it in the Conditions DB The Shuttle program access to DCS and DAQ DBs is deployed and tested: Real life test (Summer 2006) running with detector data – ALICE TPC cosmic ray tests

Summary on status and plans GRID/ROOT based Conditions DB framework ready Implementation in detector reconstruction and analysis code ongoing Automatic gathering of conditions data from external sources – prototype ready Tests with real detector data – Sumer 2006 Continuous tests ‘on the GRID’ as part of the ALICE PDC’06/LCG SC4 Current issues Availability of conditions data to offline from external sources ‘good enough’ conditions data available for the first round of ‘quasi-online’ processing

Status of TPC