V5-01-Release & v5-02-Release Peter Hristov 20/02/2012.

Slides:



Advertisements
Similar presentations
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
Advertisements

Trains status&tests M. Gheata. Train types run centrally FILTERING – Default trains for p-p and Pb-Pb, data and MC (4) Special configuration need to be.
QA train tests M. Gheata. Known problems QA tasks create too many histograms – Pushing resident memory limit above 3GB – Train gets kicked out by some.
ALICE Operations short summary LHCC Referees meeting June 12, 2012.
Chiara Zampolli in collaboration with C. Cheshkov, A. Dainese ALICE Offline Week Feb 2009C. Zampolli 1.
Experience with analysis of TPC data Marian Ivanov.
Use of Coverity & Valgrind in Geant4 Gabriele Cosmo.
V4-20-Release P. Hristov 08/08/ Changes: v4-20-Rev-38 #85151 Memory leak in T0 DQM agent. From rev #85276 AliGRPPreprocessor.cxx: Port to.
DQM status report Y. Foka (GSI) Offline week from pp to PbPb.
PWG3 Analysis: status, experience, requests Andrea Dainese on behalf of PWG3 ALICE Offline Week, CERN, Andrea Dainese 1.
Andrei Gheata, Mihaela Gheata, Andreas Morsch ALICE offline week, 5-9 July 2010.
Analysis trains – Status & experience from operation Mihaela Gheata.
V4-16-Release: bug reports, committed fixes and proposed changes P. Hristov 14/05/2009 Weekly offline meeting.
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
Planning and status of the Full Dress Rehearsal Latchezar Betev ALICE Offline week, Oct.12, 2007.
AliRoot survey P.Hristov 11/06/2013. Offline framework  AliRoot in development since 1998  Directly based on ROOT  Used since the detector TDR’s for.
Debugging of # P. Hristov 04/03/2013. Introduction Difficult problem – The behavior is “random” and depends on the “history” – The debugger doesn’t.
1 Outline: Update on muon/dimuon AOD production (R. Arnaldi/E. Scomparin) Other ongoing activities: MUON correction framework (X. Lopez) MUON productions.
Features needed in the “final” AliRoot release P.Hristov 26/10/2006.
A. Gheata, ALICE offline week March 09 Status of the analysis framework.
AliRoot survey: Analysis P.Hristov 11/06/2013. Are you involved in analysis activities?(85.1% Yes, 14.9% No) 2 Involved since 4.5±2.4 years Dedicated.
1 Offline Week, October 28 th 2009 PWG3-Muon: Analysis Status From ESD to AOD:  inclusion of MC branch in the AOD  standard AOD creation for PDC09 files.
Summary of User Requirements for Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Offline Week Alignment and Calibration Workshop February.
Javier Castillo 1 Muon Embedding Status & Open Issues PWG3 - CERN - 15/02/2011.
Predrag Buncic CERN ALICE Status Report LHCC Referee Meeting 01/12/2015.
Data processing Offline review Feb 2, Productions, tools and results Three basic types of processing RAW MC Trains/AODs I will go through these.
M. Gheata ALICE offline week, October Current train wagons GroupAOD producersWork on ESD input Work on AOD input PWG PWG31 (vertexing)2 (+
PWG3 Analysis: status, experience, requests Andrea Dainese on behalf of PWG3 ALICE Offline Week, CERN, Andrea Dainese 1.
Physics selection: online changes & QA M Floris, JF Grosse-Oetringhaus Weekly offline meeting 30/01/
M. Gheata ALICE offline week, 24 June  A new analysis train macro was designed for production  /ANALYSIS/macros/AnalysisTrainNew.C /ANALYSIS/macros/AnalysisTrainNew.C.
Massimo Masera, Andrea Dainese, Domenico Elia, Francesco Prino Offline Week – 15/11/2010 ITS offline status.
RAW and MC production cycles ALICE Offline meeting June 21, 2010.
1 Reconstruction tasks R.Shahoyan, 25/06/ Including TRD into track fit (JIRA PWGPP-1))  JIRA PWGPP-2: Code is in the release, need to switch setting.
V4-20-Release P. Hristov 21/02/ Changes: v4-20-Rev-14 #78385 Please port AliTPCPreprocessor.cxx Rev to Release #78344 Request to port changes.
V5-02-Release Peter Hristov 23/04/ Changes: v5-01-Rev-32 #93585 Request of porting in the release (AliTOFTrigger). From rev ,55583,55694.
AliRoot survey: Reconstruction P.Hristov 11/06/2013.
Some topics for discussion 31/03/2016 P. Hristov 1.
D. Elia (INFN Bari)Offline week / CERN Status of the SPD Offline Domenico Elia (INFN Bari) Overview:  Response simulation (timing info, dead/noisy.
AliRoot survey: Calibration P.Hristov 11/06/2013.
AAF tips and tricks Arsen Hayrapetyan Yerevan Physics Institute, Armenia.
D. Elia (INFN Bari)ALICE Offline week / CERN Update on the SPD Offline Domenico Elia in collaboration with H. Tydesjo, A. Mastroserio Overview:
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
V4-19-Release P. Hristov 11/10/ Not ready (27/09/10) #73618 Problems in the minimum bias PbPb MC production at 2.76 TeV #72642 EMCAL: Modifications.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
CALIBRATION: PREPARATION FOR RUN2 ALICE Offline Week, 25 June 2014 C. Zampolli.
1 14th June 2012 CPass0/CPass1 status and development.
AliRoot status Peter Hristov 25/06/2012.
January 2009 offline detector review - 2 nd go 1 ● Offline – Geometry – Material budget – Simulation – Raw data – OCDB parameters – Reconstruction ● Calibration.
V4-18-Release P. Hristov 21/06/2010.
Jan Fiete Grosse-Oetringhaus
Calibration: preparation for pa
Analysis trains – Status & experience from operation
PWG2 Analysis status Adam Kisiel, CERN for the PWG2 group.
Developments of the PWG3 muon analysis code
DPG Activities DPG Session, ALICE Monthly Mini Week
CPass0/CPass1 on LHC12d/c Updated at 08:45 on 02/08
Production status – christmas processing
ALICE analysis preservation
v4-19-Release & v4-20-Release
fields of possible improvement
Run2 reconstruction status and plans R.Shahoyan for PWGPP, 02/07/2015.
v4-18-Release: really the last revision!
New calibration strategy – follow-up from the production review
Analysis Trains - Reloaded
AliRoot status and PDC’04
Experience between AMORE/Offline and sub-systems
V5-02-Release Peter Hristov 21/05/2012.
Analysis framework - status
TPC status - Offline Q&A
Presentation transcript:

v5-01-Release & v5-02-Release Peter Hristov 20/02/2012

Changes: v5-01-Rev-22 #88827: Request for porting updates to TOF QA task into release. From rev #90320: Request to port additional consistency checks in HLT TPC cluster decoding to v5-01-Release. From rev ,54056 #90546: Filtering crashes when processing 2010 MC data. From rev #90738 Request to port a fix to the release in AliZDCDigitizer. From rev #90749 ESD Porting Request: GetTPCClusterInfo with additional switch. From rev #90812 Porting overlap fixes to the release. From rev

Changes: v5-01-Rev-24 #24646 Re-produce AODs for cascades in pass2 PbPb 2010 (data & MC). Change in the configuration of vertexingHF from rev ,54561 #90456: Request for modification of AliSimulation::ConvertRaw2Sdigits to select events for embedding. From rev Technical fixes for Root From rev Technical fixes for Coverity 11390, 11389, From rev

v5-01-Rev-25 Technical fix from rev : Patch for recent TRefArray->TObjArray usage. Needed for the MC AOD filtering

Requests: v5-01-Release Adding protection against not initialized corrected ZDCTDC values from reconstruction. From rev #91648 To be ported to the release: Fix needed for simulation of strange baryons in HIJING+Signals. From rev #91695 Request to port AliQAThresholds.h to the Release. From rev

v5-02-Release Max 262 modifications to be ported (20/02) – some selection will be applied – this makes the new release suitable for AOD filtering with tenders Issues – Creation of AliMDC RPM with shared libraries. In progress – Creation of PAR files. In progress – Merging of raw tags.

Requests: v5-02-Release #91482 EMCAL: Port fix for new 2 SM 1/3 to release 5.02 #91465 Moved calibration object for ESD initialization #91421 Request to port PHOS trigger QA task to the Release #91322 Request to port bugfix in the AliPHOSReconstructor.cxx to the v5-02-Release #91253 Request to port bugfix in the AliAnalysisTaskPHOSPbPbQA.cxx to the v5-02-Release #91071 Running on AODs very slow on AAF

Other reports #91699 Request on more detailed ITS cluster information in the ESDs #91685 ITS QA porting request #91592 ZDC: new geometry to be implemented #91512 Trigger aliases for reconstruction #91510 Reconstruction able to deal with different triggers #91500 stored TPC only information in AOD049 - LHC10h

Old slides

v5-02-Release Branch v5-02-Release is created on 03/02 All tests OK (Root v patches) Tests with Root v patches: ongoing Several modifications to be ported Issues – Creation of AliMDC RPM with shared libraries – Creation of PAR files – Merging of raw tags

v5-01-Rev-23 #91061: AOD production very slow. From rev

Changes: v5-01-Rev-22 #90817 Please commit PHOS trigger part in the AliAnalysisTaskESDfilter.cxx. From rev #90870 Request to port ZDC code to the release. From rev #90916 Request: porting to v5-01-Release of the new ESD- >AOD filter. From rev ,53853,54188,54210 #91005 Fix in AliCTPRawStream.cxx. From rev #91126: Request to commit a patch for AMPT. From rev #91159: Vertex generation in AliGenCorrHF. From rev #91030: 2.76 TeV LHC11a pass3 dca problem. From rev

Other reports #90615 Problems in the material budget, eta<0.9 and 0.9<eta<1.4 #90944 adding alignment objects for the additional supermodules in the geometry setup 2012 #90939 Request to include (anti)hypertriton in ALICE GEANT3

Requests/Additional fixes #90625 Memory problem in AliTPCtrackerMI #90622 Logic flaw in AliTPCseed. From rev #90616 Worrying message from TPC reconstruction. From rev Changes in RAW (TClonesArray usage)

v5-02-Release Coverity: 129 defects to be fixed AliRoot tests: mostly OK Root v patches: needs tests PWGs transition: PWG0 and PWG2 still ongoing One library per subdirectory: not yet ready Savannah bug reports: many old bugs are still open

GDB on Grid Some potential problems detected and fixed (ITS, TPC, HLT) Some jobs fail in the beginning (event 0-10), ~4% – Not reproducible locally, even if we run many reconstruction jobs in parallel – Always caused by std_badalloc in different places Other jobs are killed by the system (memory) ~20%

Changes: v5-01-Rev-21 #90324: Exception in AliITStrackerMI::FollowProlongationTree. From rev #90549: Request to port r53948 to the release (MUON small leak fix) #90658: For v5-01: Option to isolate heavy flavor part of a Pythia event. From rev #84578: Request to extend AliGenBox for using Yrange. From rev Optional RB/PX 24 shielding and scoring. From rev ,53956

Changes: v5-01-Rev-21 #90461: Request to port a new feature for ZDC to the release. From rev #90504: EVE muon_init.C update r53875 #25142: Commit and porting to Release of the new ESD->AOD filter. From rev #90540: Port 53910,53911 and to the Release (Full MC Header in the AOD)

Changes: OCDB #90756 Request to port object in RAW OCDB (for realistic MUON simulations) #90736 Calibration of the TRD cosmics of May,Jun and August

Reconstruction of RAW (LHC11h) Back trace problem solved Clean-up of the PATH and LD_LIBRARY_PATH on the GRID Clean-up of the AliEn libraries Deterministic splitting of the failed jobs (in preparation) New tests in parallel with the Grid production

Changes: v5-01-Rev-20 #90319: Segmentation violation in AliPHOSRawFitterv1::~AliPHOSRawFitterv1. From rev #90053: Request: Port bug fix TRD calibration code to release. From rev #90292: Add line ConvertZDC() in AliAnalysisTaskESDfilter::ConvertESDtoAOD(). From rev #90307: ZDC QA update. From rev ,53081,53271 #90309: ZDC request to port code to the release. From rev #90024: port changes in PYTHIA6 for pyquen production (pyquen- 1.5.F,CMakelib pkg updated), rev #90359: Request: fix cached values in ESD. From rev #90013: Vertexing task crashing in trunk. From rev Additional protection. From rev

LHC11h Pass2 – reconstruction details Use v5-01-Rev-19 in the production Start in inverse time order (last runs first, “LIFO”): OK Use MB trigger for CPass0: OK Exercise the full production setup on runs from “grey area”: special “gdb” production, run : OK Run with TPC pools: OK Work on a local raw file: OK Use OCDB snapshot: OK Keep only the rec. points for the current event: OK Switch off QA: OK Switch off MUON, if the memory consumption is still too high 22

23 Results CPass0: 185 jobs, 523,509 out of 539,890 raw files successfully reconstructed => 97% efficiency All runs with mag.field configuration (+ +) ready ( ) Details on losses follow Pass2 current status: 131 jobs, 225,568 out of 362,790 files successfully reconstructed => 62.2% efficiency

24 Losses – Pass2 G_exception – average 6.5% Strong run dependency

25 Losses – Pass2 (2) Memory overrun – average 16.8% Strong run dependency Function of number of events/chunk and data taking configuration

26 Losses G_exception Debugging hard as there is no traceback Seems to be random (from syswatch.log) Irreproducible in local tests No related issues shown by Valgrind Appears in the first events of the chunks Working with ROOT experts, at least to get the exception in the logs => special “gdb” run Memory overrun Additional profiling ongoing All external sources are out – gain only possible through changes in reconstruction

Special “gdb” run “catch throw” mode Several problems discovered, to be submitted to Savannah. Most probably uninitialized memory is used as index in an array – TClonesArray new with placement, where the index come from GetEntriesFast – corrupted (?) raw data – deletion of arrays

Plans Continue the investigation of G__exception on the GRID Understand the difference between CPass0 and Pass2 (MB trigger, V0s, cascades?) Try to reproduce completely the GRID execution flow on a local machine Resubmit the failed jobs in “split” mode

v5-02-Release Complete the transition of the analysis code to the new modules Move every library to a sub-directory and get rid of *.pkg (native CMake) Fix the Coverity defects and compilation warnings Solve as much as possible Savannah issues Create the branch at the end of January First stable tag in February