Summary of User Requirements for Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Offline Week Alignment and Calibration Workshop February.

Slides:



Advertisements
Similar presentations
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
Advertisements

1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
Peter Chochula, January 31, 2006  Motivation for this meeting: Get together experts from different fields See what do we know See what is missing See.
HLT & Calibration.
1 Analysis code for KEK Test-Beam M. Ellis Daresbury Tracker Meeting 30 th August 2005.
1 HLT – a source of calibration data One of the main tasks of HLT (especially in the first years) –Monitoring of the detector performance –Analysing calibration.
DATA PRESERVATION IN ALICE FEDERICO CARMINATI. MOTIVATION ALICE is a 150 M CHF investment by a large scientific community The ALICE data is unique and.
Chiara Zampolli in collaboration with C. Cheshkov, A. Dainese ALICE Offline Week Feb 2009C. Zampolli 1.
Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.
Alignment Strategy for ATLAS: Detector Description and Database Issues
LHC: ATLAS Experiment meeting “Conditions” data challenge Elizabeth Gallas - Oxford - August 29, 2009 XLDB3.
Framework for Raw Data Thomas Kuhr Offline Week 29/06/2004.
Real data reconstruction A. De Caro (University and INFN of Salerno) CERN Building 29, December 9th, 2009ALICE TOF General meeting.
André Augustinus 10 September 2001 DCS Architecture Issues Food for thoughts and discussion.
1 CTP offline software status (Offline week) A.Jusko and R.Lietava.
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
DANIELE MIRARCHI CERN FOR UA9 COLLABORATION Data reduction and analysis of SPS data.
Summary of the First Database Survey J.N. Butler Oct. 11, 2001.
Clara Gaspar, March 2005 LHCb Online & the Conditions DB.
Introduction CMS database workshop 23 rd to 25 th of February 2004 Frank Glege.
Databases in CMS Conditions DB workshop 8 th /9 th December 2003 Frank Glege.
Infrastructure for QA and automatic trending F. Bellini, M. Germain ALICE Offline Week, 19 th November 2014.
ALICE Condition DataBase Magali Gruwé CERN PH/AIP Alice Offline week May 31 st 2005.
4 th Workshop on ALICE Installation and Commissioning January 16 th & 17 th, CERN Muon Tracking (MUON_TRK, MCH, MTRK) Conclusion of the first ALICE COSMIC.
PWG3 Analysis: status, experience, requests Andrea Dainese on behalf of PWG3 ALICE Offline Week, CERN, Andrea Dainese 1.
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
C. Oppedisano, 9 October 2007, ALICE Offline Week 1 RECONSTRUCTION ALGORITHM CALIBRATION OBJECT ESD STRUCTURE ONGOING TASKS.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
Online System Status LHCb Week Beat Jost / Cern 9 June 2015.
Integration of the ATLAS Tag Database with Data Management and Analysis Components Caitriana Nicholson University of Glasgow 3 rd September 2007 CHEP,
Michele de Gruttola 2008 Report: Online to Offline tool for non event data data transferring using database.
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
Development of the CMS Databases and Interfaces for CMS Experiment: Current Status and Future Plans D.A Oleinik, A.Sh. Petrosyan, R.N.Semenov, I.A. Filozova,
ITS Calibration Database Requirements Updated By Bjørn S. Nilsen On behalf of the ALICE ITS Sub-detector Group.
Alberto Colla - CERN ALICE off-line week 1 Alberto Colla ALICE off-line week Cern, May 31, 2005 Table of contents: ● Summary of requirements ● Description.
Database David Forrest. What database? DBMS: PostgreSQL. Run on dedicated Database server at RAL Need to store information on conditions of detector as.
Computing for Alice at GSI (Proposal) (Marian Ivanov)
M. Oldenburg GridPP Metadata Workshop — July 4–7 2006, Oxford University 1 Markus Oldenburg GridPP Metadata Workshop July 4–7 2006, Oxford University ALICE.
1 Offline Week, October 28 th 2009 PWG3-Muon: Analysis Status From ESD to AOD:  inclusion of MC branch in the AOD  standard AOD creation for PDC09 files.
Status of the Shuttle Framework Alberto Colla Jan Fiete Grosse-Oetringhaus ALICE Offline Week October 2006.
11th November Richard Hawkings Richard Hawkings (CERN) ATLAS reconstruction jobs & conditions DB access  Conditions database basic concepts  Types.
ALICE Offline Week October 4 th 2006 Silvia Arcelli & Chiara Zampolli TOF Online Calibration - Strategy - TOF Detector Algorithm - TOF Preprocessor.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
Summary of Workshop on Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Computing Day February 28 th 2005.
A. De Caro for the ALICE TOF Offline Group (University of Salerno and INFN)
Alignment in real-time in current detector and upgrade 6th LHCb Computing Workshop 18 November 2015 Beat Jost / Cern.
Calorimeter global commissioning: progress and plans Patrick Robbe, LAL Orsay & CERN, 25 jun 2008.
Summary of TPC/TRD/DCS/ECS/DAQ meeting on FERO configuration CERN,January 31 st 2006 Peter Chochula.
Database Issues Peter Chochula 7 th DCS Workshop, June 16, 2003.
 offline code: changes/updates, open items, readiness  1 st data taking plans and readiness.
AliRoot Classes for access to Calibration and Alignment objects Magali Gruwé CERN PH/AIP ALICE Offline Meeting February 17 th 2005 To be presented to detector.
ATLAS The ConditionDB is accessed by the offline reconstruction framework (ATHENA). COOLCOnditions Objects for LHC The interface is provided by COOL (COnditions.
ACO & AD0 DCS Status report Mario Iván Martínez. LS1 from DCS point of view Roughly halfway through LS1 now – DCS available through all LS1, as much as.
1 Calice TB Review DESY 15/6/06D.R. Ward David Ward Post mortem on May’06 DESY running. What’s still needed for DESY analysis? What’s needed for CERN data.
AliRoot survey: Calibration P.Hristov 11/06/2013.
10/8/ HMPID offline status D. Di Bari, A. Mastroserio, L.Molnar, G. Volpe HMPID Group Alice Offline Week.
ATLAS Distributed Computing Tutorial Tags: What, Why, When, Where and How? Mike Kenyon University of Glasgow.
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
DB and Information Flow Issues ● Selecting types of run ● L1Calo databases ● Archiving run parameters ● Tools Murrough Landon 28 April 2009.
V4-18-Release P. Hristov 21/06/2010.
F. Bellini for the DQM core DQM meeting, 04th October 2012
DCS Status and Amanda News
ALICE analysis preservation
Calibrating ALICE.
TOF CALIBRATION DATABASE
ALICE – First paper.
Level 1 (Calo) Databases
Experience between AMORE/Offline and sub-systems
HLT & Calibration.
Offline framework for conditions data
Presentation transcript:

Summary of User Requirements for Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Offline Week Alignment and Calibration Workshop February 22 nd 2005

2 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Layout  Context  Call for User Requirements  Outcome of questionnaire  Answers  Remaining questions  Conclusion

3 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Context  The ALICE off-line group is:  Compiling an extensive set of user requirements  Evaluating the various data sources, relation with other DB or raw data  Estimating the volume, update frequency, access pattern and run-time environment  We need to have a fair understanding of :  Use cases  DB content  Implementation of tools for DB population, query, information retrieval and communications with other DB  Definition of development responsibilities  Design and building of the necessary computing infrastructure

4 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Layout  Context  Call for User Requirements  Outcome of questionnaire  Answers  Remaining questions  Conclusion

5 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Call for user requirements  Essential parameters of the Alignment and Calibration DBs:  Access pattern and frequency  Only offline reconstruction?  Typical record size  Very difficult to estimate from first principles  Frequency of updates  We expect the majority of the updates to be infrequent  This probably will not be the case  Validity range parameters  Run, event, time, version – what else?  These all have to come from the user community More details/explanations in next slides…

6 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Questions to be answered by detector community (I):  Context:  The alignment and calibration constants will be ROOT files, registered in a distributed file catalogue. The files will have proper tags, described in the AliEn (gLite) metadata catalogue:  validity period – run, event, time  Version  Questions:  What type and size of Root objects will be needed for the alignment and calibration procedures?  For example:  One calibration object could be a set of gain constants of a calorimeter, written in a root file. This object will have a certain size and will be valid for a given period of time, until the next calibration is taken or the present one is refined (new version).

7 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Questions to be answered by detector community (II):  Questions (cont’d)  How frequently will these root objects have to be updated (new version produced)?  How frequently will these root objects have to be accessed?  What kind of and how much access to external databases will be needed?  External databases could be:  Construction database (DCDB)  ECS  DAQ  DCS  Trigger  HLT

8 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Layout  Context  Call for User Requirements  Outcome of questionnaire  Answers  Remaining questions  Conclusion

9 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Answers to questionnaire  Answers received from all 14 detectors  Some by mail  Last ones during the workshop Thank you all!!  But:  Some are still preliminary:  Need update  Most are incomplete:  Need to be thought about and completed  Some show misunderstanding:  Need clarifications from both sides

10 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Outcome of questionnaire (I)  Three types of objects:  Calibration related  Alignment related  Dead/bad channel maps  Note:  Some detectors specify “one object per channel”  This will NOT happen: there will be ONE object for all channels  Examples:  One “gain” object being an array containing all gains of all channels  One calibration object being and array of all gains and pedestals of all channels

11 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Outcome of questionnaire (II)  Size: (rough counting, from information sent by )  ITS: ~80 MB  TRD: few MB  PHOS: ~1MB  EMCAL: ~1MB  RICH: ~1MB?  CRT: few kB  MUON: ~70MB  ZDC: few kB  V0: 2.4 kB  PMD: ~9MB  TOF: ~7MB  TPC: ???

12 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Outcome of questionnaire (III)  Update frequency:  In general: anything between 1/run and 1/year  Note:  Some parameters vary quickly, but update frequency will not be higher than once per run. Stored objects would be histograms for example.  Example:  One drift velocity object being a histogram with the time dependence of the drift velocity within a run

13 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Outcome of questionnaire (IV)  Access pattern/frequency:  For most detectors: no answer, or there seems to be confusion with update frequency  Questions:  How often do you need the data?  Only in reconstruction jobs?  Is there an iterative procedure?  Clearly, there is better understanding thanks to workshop

14 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Outcome of questionnaire (V)  External Database access:  Very little input from detectors:  Most detectors said:  No external database access needed  Or did/could not answer  Other detectors:  FMD:  Need to know how the detector was operated at the time of data acquisition, beam species, etc…  ITS:  Construction/geometry/calibration databases???  TRD:  ESD only?  CRT:  Need run header  ZDC:  General run conditions  Machine Database!  V0:  General trigger  T0:  DCDB

15 Magali Gruwé CERN PH/AIP ALICE Offline Week, February 22 nd, 2005 Conclusions  Thanks again to detector representatives for the answers to the questionnaire  s/discussions/presentations  We received a lot more information during the workshop than via s  These give us an excellent starting point  Problem with respect to size of objects needed for some detectors:  Need to find a way to reduce it  A note is being written summarizing our understanding of detectors requirements. It will be circulated soon.  Home work for detector groups:  Think again about requirements (with the highlight of the other detectors’ presentations)  And more specifically about External Database access