Some topics for discussion 31/03/2016 P. Hristov 1.

Slides:



Advertisements
Similar presentations
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
Advertisements

1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
ATLAS Analysis Model. Introduction On Feb 11, 2008 the Analysis Model Forum published a report (D. Costanzo, I. Hinchliffe, S. Menke, ATL- GEN-INT )
Swami NatarajanJune 17, 2015 RIT Software Engineering Reliability Engineering.
Software Configuration Management
Trains status&tests M. Gheata. Train types run centrally FILTERING – Default trains for p-p and Pb-Pb, data and MC (4) Special configuration need to be.
Chiara Zampolli in collaboration with C. Cheshkov, A. Dainese ALICE Offline Week Feb 2009C. Zampolli 1.
Experience with analysis of TPC data Marian Ivanov.
ALICE Upgrade for Run3: Computing HL-LHC Trigger, Online and Offline Computing Working Group Topical Workshop Sep 5 th 2014.
Analysis infrastructure/framework A collection of questions, observations, suggestions concerning analysis infrastructure and framework Compiled by Marco.
Software Status  Last Software Workshop u Held at Fermilab just before Christmas. u Completed reconstruction testing: s MICE trackers and KEK tracker.
Offline report – 7TeV data taking period (Mar.30 – Apr.6) ALICE SRC April 6, 2010.
A Technical Validation Module for the offline Auger-Lecce, 17 September 2009  Design  The SValidStore Module  Example  Scripting  Status.
DQM status report Y. Foka (GSI) Offline week from pp to PbPb.
Infrastructure for QA and automatic trending F. Bellini, M. Germain ALICE Offline Week, 19 th November 2014.
ALICE Condition DataBase Magali Gruwé CERN PH/AIP Alice Offline week May 31 st 2005.
Organisation of the Beatenberg Trigger Workshop Ricardo Gonçalo Higgs WG Meeting - 22 Jan.09.
PWG3 Analysis: status, experience, requests Andrea Dainese on behalf of PWG3 ALICE Offline Week, CERN, Andrea Dainese 1.
Andrei Gheata, Mihaela Gheata, Andreas Morsch ALICE offline week, 5-9 July 2010.
Analysis trains – Status & experience from operation Mihaela Gheata.
AliRoot survey P.Hristov 11/06/2013. Offline framework  AliRoot in development since 1998  Directly based on ROOT  Used since the detector TDR’s for.
Debugging of # P. Hristov 04/03/2013. Introduction Difficult problem – The behavior is “random” and depends on the “history” – The debugger doesn’t.
TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.
1 A first look at the KEK tracker data with G4MICE Malcolm Ellis 2 nd December 2005.
Moritz Backes, Clemencia Mora-Herrera Département de Physique Nucléaire et Corpusculaire, Université de Genève ATLAS Reconstruction Meeting 8 June 2010.
Technical Validation The Technical Validation is a testing framework of the AUGER offline to monitor the code development process. It is not a validation.
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
Separate distribution of the analysis code (and more) P. Hristov 19/03/2014.
Computing for Alice at GSI (Proposal) (Marian Ivanov)
A. Gheata, ALICE offline week March 09 Status of the analysis framework.
AliRoot survey: Analysis P.Hristov 11/06/2013. Are you involved in analysis activities?(85.1% Yes, 14.9% No) 2 Involved since 4.5±2.4 years Dedicated.
Predrag Buncic CERN Future of the Offline. Data Preparation Group.
Predrag Buncic CERN ALICE Status Report LHCC Referee Meeting 01/12/2015.
Data processing Offline review Feb 2, Productions, tools and results Three basic types of processing RAW MC Trains/AODs I will go through these.
M. Gheata ALICE offline week, October Current train wagons GroupAOD producersWork on ESD input Work on AOD input PWG PWG31 (vertexing)2 (+
06/2006I.Larin PrimEx Collaboration meeting  0 analysis.
CWG7 (reconstruction) R.Shahoyan, 12/06/ Case of single row Rolling Shutter  N rows of sensor read out sequentially, single row is read in time.
PHOS offline status report Yuri Kharlov ALICE offline week 7 July 2008.
Analysis experience at GSIAF Marian Ivanov. HEP data analysis ● Typical HEP data analysis (physic analysis, calibration, alignment) and any statistical.
V5-01-Release & v5-02-Release Peter Hristov 20/02/2012.
1 Reconstruction tasks R.Shahoyan, 25/06/ Including TRD into track fit (JIRA PWGPP-1))  JIRA PWGPP-2: Code is in the release, need to switch setting.
Calibration algorithm and detector monitoring - TPC Marian Ivanov.
20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.
AliRoot Classes for access to Calibration and Alignment objects Magali Gruwé CERN PH/AIP ALICE Offline Meeting February 17 th 2005 To be presented to detector.
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
AliRoot survey: Reconstruction P.Hristov 11/06/2013.
Analysis framework plans A.Gheata Offline week 13 July 2011.
D. Elia (INFN Bari)Offline week / CERN Status of the SPD Offline Domenico Elia (INFN Bari) Overview:  Response simulation (timing info, dead/noisy.
Algorithms in Programming Computer Science Principles LO
AliRoot survey: Calibration P.Hristov 11/06/2013.
AAF tips and tricks Arsen Hayrapetyan Yerevan Physics Institute, Armenia.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Barthélémy von Haller CERN PH/AID For the ALICE Collaboration The ALICE data quality monitoring system.
V4-19-Release P. Hristov 11/10/ Not ready (27/09/10) #73618 Problems in the minimum bias PbPb MC production at 2.76 TeV #72642 EMCAL: Modifications.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
HYDRA Framework. Setup of software environment Setup of software environment Using the documentation Using the documentation How to compile a program.
CALIBRATION: PREPARATION FOR RUN2 ALICE Offline Week, 25 June 2014 C. Zampolli.
V4-18-Release P. Hristov 21/06/2010.
Jan Fiete Grosse-Oetringhaus
Analysis trains – Status & experience from operation
DPG Activities DPG Session, ALICE Monthly Mini Week
ALICE analysis preservation
MICE Collaboration Meeting Saturday 22nd October 2005 Malcolm Ellis
fields of possible improvement
New calibration strategy – follow-up from the production review
Offline shifter training tutorial
Analysis framework - status
ALICE Computing Upgrade Predrag Buncic
QA tools – introduction and summary of activities
Offline framework for conditions data
Presentation transcript:

Some topics for discussion 31/03/2016 P. Hristov 1

"Wish list" for offline week (ALIROOT- 6598) Thanks to Laurent for preparing this list: 1.Release validation : – what it is exactly ? how long does it takes ? can it be tailored for other purposes (e.g. validation the muon_calo passes ?) 2.Concerning the muon_calo passes. – Those has been acknowledged as regular passes for a while now, which is good. What's is less good is the state of the corresponding macros (for reconstruction, AOD filtering and QA) : what is the status here ? (e.g. can we have systematically something like a "is_muon_calo" to run only what's needed for those passes ?) 3.AliRoot tagging and deployment procedure. – I'm unclear of what's the procedure to get a fast deployment if ever needed (for instance for the Shuttle). Could that be clarified ? 4.Shuttle testing – I understand (and agree) that to get a change validated in the Pt2 Shuttle one has to pass the Shuttle Test first. For that one needs to commit to aliroot master. But during the time the test is performed if a tag is made (for whatever other reason) from the head of the master, then the still-in-testing-phase-shuttle-code can end up in the release, and might be used at Pt2 if the version used is changed there (I understand it's not automatic but it can happen). 5.c++11 allowed in AliRoot (HLT in particular) : when ? 6.ROOT 6 before Run3 ? (in particular vs an alice-specifc-root-5) 2

Release validation See the presentation of Dario My summary: – Different levels of validation (the longest is ~6h) Compilation on different platforms Technical tests (i.e. coverage analysis, profiling, Coverity) Simulation/reconstruction/AOD using the AliRoot/test CPass0/CPass1/PPass/AOD filtering of selected pp, pPb and PbPb runs – We plan to integrate everything relevant to the ALICE processing SHUTTLE Validation analysis train(s) – We would like to expose the results in a nice way Automatic alarms Trending plots Root file We are open to proposals and contributions ( i.e. test suits) 3

AliRoot tagging and deployment procedure. My summary – We profit from the validation cluster and after some initial checks tag release candidates (i.e. v rc3) from the master. Then we start the full validation chain; – In case of successful validation we convert the release candidate to release tag: v rc3 -> v ; – In case of unsuccessful validation we fix the issue and tag the next release candidate from the master. We start the release validation. – The process usually converges after 3-4 iterations; – When we have productions with a given set of tags and a problem is discovered, we branch from the relevant tag and cherry-pick the fix. This assumes the fix has no influence on the physics results; – If a serious problem is discovered in a production, we scratch it and use newer release to repeat it; – The deployment is done only for release tags, the release candidates are not exposed on CVMFS. 4

SHUTTLE testing My summary – So far we use dedicated machine to test the DA; – We plan to include it in the validation chain. Normally SHUTTLE will follow the release cycle of AliRoot; – SHUTTLE depends marginally on mainly on RAW data code, detector decoding, different maps, etc. and since these are relatively stable, may need its own release schedule; – In case of urgent needs for changes we can: Cherry-pick in a branch from existing release tag Make dedicated tag from the master 5

C++11 allowed in AliRoot (HLT in particular) The compilation with –std=c++11 is working and we are using it on a regular basis. The next step would be to add it “officially” to the options. The usage of C++11 extensions is not supported by CINT and Root5 I/O, so most probably they will not work in macros and for persistent data members. 6

ROOT 6 before Run3 Our software has been working with Root6 since 2013 My summary of Predrag’s opinion – Switching to ROOT 6 before we have consolidated our software and achieved desired functionality and precision (i.e. TPC reconstruction and calibration) would be too risky (in particular possible increase in memory requirements) – The practical benefit of switching to ROOT 6 is marginal (more precise error reporting and handling by the interpreter and possibility to use C++11) – Make sure that our software works with ROOT 6 so, once the preconditions in terms of s/w stability are met, we might switch to ROOT 6 but certainly not during current data taking period – For the moment we should use Root6 only in ALICE O2 My proposal – Add Root6 validation and measure regularly its performance – Try Root6 in test GRID production/train to compare with Root5 – We may soon get memory reduction wrt Root5 with Root6 modules 7