RAW and MC production cycles ALICE Offline meeting June 21, 2010.

Slides:



Advertisements
Similar presentations
ETH. Ongoing activities Fixing Geant 4 MC  Crash when producing more than 300 events in one run -> solved  Crash when producing more than 700.
Advertisements

1 Using Subversion: Nirav Dave Computer Science & Artificial Intelligence Lab Massachusetts Institute of Technology.
S. Ritz1 Checking Out What is Checked In  Need to optimize balance of checking between users and developers. –infuse more of a culture of detailed checking.
Increasing Field Integral between Velo and TT S. Blusk Sept 02, 2009 SU Group Meeting.
QA train tests M. Gheata. Known problems QA tasks create too many histograms – Pushing resident memory limit above 3GB – Train gets kicked out by some.
CalRecon Moments Analysis Studies I Tracy Usher1/17 A Brief History of Glast Release GR (Friday, July 15) –Effectively, the first DC-2 2M all-gamma.
ALICE Operations short summary LHCC Referees meeting June 12, 2012.
ALICE Operations short summary and directions in 2012 WLCG workshop May 19-20, 2012.
Gauss: Generator Status Patrick Robbe, LAL Orsay, 6 Oct 2009.
Large scale data flow in local and GRID environment V.Kolosov, I.Korolko, S.Makarychev ITEP Moscow.
Real data reconstruction A. De Caro (University and INFN of Salerno) CERN Building 29, December 9th, 2009ALICE TOF General meeting.
Status of the production and news about Nagios ALICE TF Meeting 22/07/2010.
Costin Grigoras ALICE Offline. In the period of steady LHC operation, The Grid usage is constant and high and, as foreseen, is used for massive RAW and.
ATLAS Liquid Argon Calorimeter Monitoring & Data Quality Jessica Levêque Centre de Physique des Particules de Marseille ATLAS Liquid Argon Calorimeter.
Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.
Production status Preparation for HI running ALICE TF+AF November 14, 2010.
LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001.
CCRC’08 Weekly Update Jamie Shiers ~~~ LCG MB, 1 st April 2008.
V4-20-Release P. Hristov 08/08/ Changes: v4-20-Rev-38 #85151 Memory leak in T0 DQM agent. From rev #85276 AliGRPPreprocessor.cxx: Port to.
Concurrency Control. Objectives Management of Databases Concurrency Control Database Recovery Database Security Database Administration.
Offline report – 7TeV data taking period (Mar.30 – Apr.6) ALICE SRC April 6, 2010.
DQM status report Y. Foka (GSI) Offline week from pp to PbPb.
Monday h00: End of fill #1640: 3.7 pb h14: RB S12 and S23 tripped before loading rampdown table, active filter. MPE piquet. Fip_Com_Lost.
Analysis trains – Status & experience from operation Mihaela Gheata.
Debugging of # P. Hristov 04/03/2013. Introduction Difficult problem – The behavior is “random” and depends on the “history” – The debugger doesn’t.
T0 offline status Alla Maevskaya for T0 team 8 March 2011 ALICE offline week.
MultiJob pilot on Titan. ATLAS workloads on Titan Danila Oleynik (UTA), Sergey Panitkin (BNL) US ATLAS HPC. Technical meeting 18 September 2015.
LM Feb SSD status and Plans for Year 5 Lilian Martin - SUBATECH STAR Collaboration Meeting BNL - February 2005.
+ Hbd Software Update By Sky Rolnick 8/04/09 Hbd Group Meeting 1/9/2016.
Michele de Gruttola 2008 Report: Online to Offline tool for non event data data transferring using database.
Status of global tracking and plans for Run2 (for TPC related tasks see Marian’s presentation) 1 R.Shahoyan, 19/03/14.
TrigSim Status ● What is TrigSim? ● How do I run it? ● How does it compare to actual hardware? ● Where can I get more info? ● What version do I use? ●
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
1 SDD offline status Francesco Prino INFN sezione di Torino ALICE offline week – March 15th 2010.
Large scale data flow in local and GRID environment Viktor Kolosov (ITEP Moscow) Ivan Korolko (ITEP Moscow)
Computing for Alice at GSI (Proposal) (Marian Ivanov)
1 Offline Week, October 28 th 2009 PWG3-Muon: Analysis Status From ESD to AOD:  inclusion of MC branch in the AOD  standard AOD creation for PDC09 files.
Predrag Buncic CERN ALICE Status Report LHCC Referee Meeting 01/12/2015.
SSD STATUS Enrico Fragiacomo – INFN Trieste. Outlook  MC-data comparison  Cluster finder  dE/dx  Material budget in geometry ITS alignment&offline.
Data processing Offline review Feb 2, Productions, tools and results Three basic types of processing RAW MC Trains/AODs I will go through these.
CWG7 (reconstruction) R.Shahoyan, 12/06/ Case of single row Rolling Shutter  N rows of sensor read out sequentially, single row is read in time.
08:30 Machines in stand-by 12:30 Access in LHC for QPS and PC:  QPS quench heater power supply RB.A12  EPC for RSF2.A67B2 and RQ9.R8B1.  RCBH27.L1B2.
PHOS offline status report Yuri Kharlov ALICE offline week 7 July 2008.
Analysis experience at GSIAF Marian Ivanov. HEP data analysis ● Typical HEP data analysis (physic analysis, calibration, alignment) and any statistical.
8 August 2006MB Report on Status and Progress of SC4 activities 1 MB (Snapshot) Report on Status and Progress of SC4 activities A weekly report is gathered.
V5-01-Release & v5-02-Release Peter Hristov 20/02/2012.
Massimo Masera, Andrea Dainese, Domenico Elia, Francesco Prino Offline Week – 15/11/2010 ITS offline status.
Offline Weekly Meeting, 24th April 2009 C. Cheshkov & C. Zampolli.
1 Reconstruction tasks R.Shahoyan, 25/06/ Including TRD into track fit (JIRA PWGPP-1))  JIRA PWGPP-2: Code is in the release, need to switch setting.
Masahiro Konno for the Aerogel groupDC Meeting, Apr/14/04 1 Status of Aerogel Reconstruction –Track association implemented in CGL. –Raw data (ADC, TDC)
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Alice terms Chapter 2. camelCase CamelCase is the practice of writing compound names without spaces, but capitalizing the first letter of each name that.
V4-19-Release P. Hristov 11/10/ Not ready (27/09/10) #73618 Problems in the minimum bias PbPb MC production at 2.76 TeV #72642 EMCAL: Modifications.
Predrag Buncic CERN Plans for Run2 and the ALICE upgrade in Run3 ALICE Tier-1/Tier-2 Workshop February 2015.
QA process for Business Catalyst projects.. Starting a project What QA needs to start testing::  Specifications – A detailed description of the product,
1 14th June 2012 CPass0/CPass1 status and development.
Hough-4-14.
V4-18-Release P. Hristov 21/06/2010.
Analysis trains – Status & experience from operation
CPass0/CPass1 on LHC12d/c Updated at 08:45 on 02/08
Production status – christmas processing
ALICE analysis preservation
fields of possible improvement
v4-18-Release: really the last revision!
New calibration strategy – follow-up from the production review
Offline data taking and processing
Disk capacities in 2017 and 2018 ALICE Offline week 12/11/2017.
Analysis framework - status
Summary of Week 11: 14 – 21 March
Concurrency Control.
Presentation transcript:

RAW and MC production cycles ALICE Offline meeting June 21, 2010

2 RAW processing (1) LHC10b Pass 2 – since Friday The processing will be ready by tomorrow 4% ESDFriends filtering is on The gain is as expected – we are at 9% of the RAW data volume

3 RAW processing – 900 GeV Data almost perfectly recovered, 2.8% lost “integrity” check pass running now Rev-21 and OCDB “as is” Still to be updated for a proper Pass2 (Yves’ table)

4 Issues - memory Large ‘global’ memory leak in every job Since the 900 GeV chunks contain more events than 7TeV chunks, the leak is larger

5 Issues – memory (affects every job) Large ‘global’ memory leak in every job Since the 900 GeV chunks contain more events than 7TeV chunks, the leak is larger

6 Issues – various crashes Affect about 3% of the jobs Re-submission sometimes work – the bug(s) is intermittent and depends on the concurrent jobs/memory status Will make a coherent list at the end of processing