MC/OFFLINE meeting News since the last meeting

Slides:



Advertisements
Similar presentations
1 Offline status report LNF 19 Sep News:  MC04  all LSF=1 completed (~535 pb -1 )  mrc dst of 2005 with correct   +  - e + e - ~completed.
Advertisements

Stripping Plans for 2014 and 2015 Laurence Carson (Edinburgh), Stefano Perazzini (Bologna) 2 nd LHCb Computing Workshop,
Status report on EMC simulation... Part 3 The plan is to:  SURVEY the existing situation over the runs - Validation of plots using  and.
Work finished M. Antonelli ISR and f decay simulation M. MoulsonBank-reduction code for DST’s M. Palutan et al.Trigger simulation parameters S. GiovannellaGEANFI.
AMOD Report Doug Benjamin Duke University. Hourly Jobs Running during last week 140 K Blue – MC simulation Yellow Data processing Red – user Analysis.
Notes on offline data handling M. Moulson Frascati, 29 March 2006.
KLOE Offline Status Report Data Reconstruction MonteCarlo updates MonteCarlo production Computing Farm C.Bloise – May 28th 2003.
GLAST LAT ProjectDOE/NASA Baseline-Preliminary Design Review, January 8, 2002 K.Young 1 LAT Data Processing Facility Automatically process Level 0 data.
Offline Discussion M. Moulson 22 October 2004 Datarec status Reprocessing plans MC status MC development plans Linux Operational issues Priorities AFS/disk.
MC/Offline Planning M. Moulson Frascati, 21 March 2005 MC status Reconstruction coverage and data quality Running time estimates MC & reprocessing production.
Offline/MC status report M. Moulson 6th KLOE Physics Workshop Sabaudia, May 2006.
9 February 2000CHEP2000 Paper 3681 CDF Data Handling: Resource Management and Tests E.Buckley-Geer, S.Lammel, F.Ratnikov, T.Watts Hardware and Resources.
KLOE Computing Update Paolo Santangelo INFN LNF KLOE General Meeting University of Rome 2, Tor Vergata 2002, December
Computing Resources for ILD Akiya Miyamoto, KEK with a help by Vincent, Mark, Junping, Frank 9 September 2014 ILD Oshu City a report on work.
DST status Ready for production Analysis of sample ksl DST’s in progress for ~1 week ksl DST event size: 2.8 MB/nb GB for 200 pb -1 Other streams.
Update on MC-04(05) –New interaction region –Attenuation lengths vs endcap module numbers –Regeneration and nuclear interaction –EMC time resolution –
Status of the KLOE experiment M. Moulson, for the KLOE collaboration LNF Scientific Committee 23 May 2002 Data taking in 2001 and 2002 Hardware and startup.
Status of K S   e analysis C. GattiT. Spadaro Selection on data Selection on MC Efficiencies from data, K L   e, K S    ,      , bhabha.
The KLOE computing environment Nuclear Science Symposium Portland, Oregon, USA 20 October 2003 M. Moulson – INFN/Frascati for the KLOE Collaboration.
Offline meeting Outcome of Scientific Committee Status of MC04 Proposal for a minimum bias EvCl sample Other offline activies: –Reprocessing –Dead wires.
Offline meeting  Status of MC/Datarec  Priorities for the future LNF, Sep
Offline Status Report A. Antonelli Summary presentation for KLOE General Meeting Outline: Reprocessing status DST production Data Quality MC production.
Status report of the KLOE offline G. Venanzoni – LNF LNF Scientific Committee Frascati, 9 November 2004.
NA62 computing resources update 1 Paolo Valente – INFN Roma Liverpool, Aug. 2013NA62 collaboration meeting.
COMPASS Computerized Analysis and Storage Server Iain Last.
20 Dec Peter Clarke Computing production issues 1.Disk Space – update from high-mu workshop 2.Disk planning 3.Use of T2s NCB meeting 20-Dec-2010.
Computing Resources for ILD Akiya Miyamoto, KEK with a help by Vincent, Mark, Junping, Frank 9 September 2014 ILD Oshu City a report on work.
MC sign-off and running plans M. Moulson, 1 March 2004 Offline discussion Outline: Results of tests on new MC files Sign-off on production version What.
GridKa Summer 2010 T. Kress, G.Quast, A. Scheurer Migration of data from old to new dCache instance finished on Nov. 23 rd almost 500'000 files (600.
ALICE Offline Week October 4 th 2006 Silvia Arcelli & Chiara Zampolli TOF Online Calibration - Strategy - TOF Detector Algorithm - TOF Preprocessor.
Offline Status Review M. Moulson, P. Valente, for the Offline Group 16 March 2001 Outline: Status update FILFO: new developments (G. Finocchiaro) Questions.
Data processing Offline review Feb 2, Productions, tools and results Three basic types of processing RAW MC Trains/AODs I will go through these.
Offline resource allocation M. Moulson, 11 February 2003 Discussion Outline: Currently mounted disk space Allocation of new disk space CPU resources.
Physics selection: online changes & QA M Floris, JF Grosse-Oetringhaus Weekly offline meeting 30/01/
1 LPC Data Organization Robert M. Harris Fermilab With contributions from Jon Bakken, Lothar Bauerdick, Ian Fisk, Dan Green, Dave Mason and Chris Tully.
1 Reminder: Why reprocess? data Reconstruction: DBV DSTs: DBV data DBV-19 for reconstruction & DSTs, Run < DBV-20 for.
ALICE Computing Model A pictorial guide. ALICE Computing Model External T1 CERN T0 During pp run i (7 months): P2: data taking T0: first reconstruction.
1 Ch 11. Backup your data. 2 Backup Device An object contain location of backup device Location can be a file or a tape device.
Feb. 3, 2007IFC meeting1 Beam test report Ph. Bruel on behalf of the beam test working group Gamma-ray Large Area Space Telescope.
Status Report on Data Reconstruction May 2002 C.Bloise Results of the study of the reconstructed events in year 2001 Data Reprocessing in Y2002 DST production.
LHCb LHCb GRID SOLUTION TM Recent and planned changes to the LHCb computing model Marco Cattaneo, Philippe Charpentier, Peter Clarke, Stefan Roiser.
Roberto Versaci-MC-Offline status report -KPW-Ponza 2008 MC-Offline status report Graziano Venanzoni & Roberto Versaci.
MC/OFFLINE meeting  Status  Request by Ke2 group  aob LNF
MC/OFFLINE meeting Status of data reprocessing
Calibration: preparation for pa
BESIII data processing
Update on the false-dead DC wire problem
WP18, High-speed data recording Krzysztof Wrona, European XFEL
KLOE offline & computing: Status report
Tracking performances & b-tagging commissioning
Production status – christmas processing
H. Rème, I.Dandouras and A. Barthe IRAP, Toulouse, France
MC ’04-’05 objectives                                                       
ATLAS activities in the IT cloud in April 2008
Offline Report Outline: Status update DST Proposal P. de Simone
The Data Lifetime model
LHCb Computing Model and Data Handling Angelo Carbone 5° workshop italiano sulla fisica p-p ad LHC 31st January 2008.
Philippe Charpentier CERN – LHCb On behalf of the LHCb Computing Group
RUCIO Consistency Status
Disk capacities in 2017 and 2018 ALICE Offline week 12/11/2017.
Project Status Report Computing Resource Review Board Ian Bird
KLOE Drift Chamber Review L.N.F. – March 9, 2001
jeudi 13 septembre 2018jeudi 13 septembre 2018 CMS Tapes Farida Fassi
G. Venanzoni-LNF KGM Frascati, 19 Dec 2006
ILD Ichinoseki Meeting
KLOE General Meeting - LNF March,
GLAST Large Area Telescope
Roadmap for Data Management and Caching
Charge to the Validation Review
Agenda SICb Session Status of SICb software migration F.Ranjard
Presentation transcript:

MC/OFFLINE meeting News since the last meeting LNF 23-04-2008 News since the last meeting Pending requests: what to do next? Status of tape space aob

News Data reprocessing finished: the whole 2005 dataset is now available in dbv-26 1.2 fb-1 in run range 34280-41902, rate=35pb-1/day (144 pb-1 weren't available before) Some dedicated MC have been produced (2weeks): wp off-peak 2006 (200pb-1) omegapi → ok Bhabha 2002 (240pb-1) bha20bab Bhabha off-peak 2006 (200pb-1) eeg10 → ok On going (2 weeks): Bhabha 2004-2005 eeg100

Requests Other possibilities Nguyen: 2006 data reprocessing (i.e. 240 pb-1) with new  selection (~10 days only reprocessing) algorithm ready: to be discussed (see presentation) Meola: MC production for Kl4 measurement containing Kl4 (signal) and K3p and Kl4 (backgrounds) 2004-2005 with LSF ≥ 3 Other possibilities Produce more MC for 2004-2005, i.e. all_phys4 Reprocess 2001-2002 with DBV-26 (uniform dataset)

Tape space status Used ~ 700 TB ~ 30 TB available before next Data 2000/01/02 (TB) 101 RAW 60 Recon 8 DST data 169 Total Data 2004 (TB) 54 RAW 35 Recon 7 DST 96 Total Used ~ 700 TB Calibration files not included Data 2005/06 (TB) 95 RAW 167 Recon 38 DST 300 Total MC dst’s (TB) 10 2001/02 16 2004 39 2005 65 Total MC mcr’s (TB) 66 Total Bhabha (TB) 72 Total ~ 30 TB available before next no space left on device

How to find tape space Delete old unused MC dst (if any...) 1 TB Delete old unused MC mcr 1 TB Delete MC mcr when dst available 64 TB Delete 2005 Data old DBV (reconstructed) 55 TB Delete 2005 Data old DBV (dst) 22 TB Remove other multiversion runs (not trivial, should be done “cum grano salis”) A census has been done

MC census: dst Size in MB in use unknown - all_phys 26 5.90048e+07 mkc kpm04 18 3.34258e+06 mk0 neu_kaon 18 2.05118e+06 m3p phirp_3p 23 797118 mba eeg10 26 744101 mrc ppgphok3 23 577980 mkc kpmrare07 26 517890 mrc ppgphok5 26 498936 mrn rad04 18 481203 mkc kp10pct 18 405850 mkc km10pct 18 397356 mba eeg100 26 318880 mk0 ksrare07 26 311862 mk0 klrare07 26 297793 mk0 k0r04 18 294224 mrc pho5mmg 26 263819 mrc ppgisr3 18 153370 mba bha20bab 26 152819 mrn all_scan 18 151246 m3p filt_3p 24 42504.8 Size in MB in use unknown

MC census: mcr Size in MB no dst & in use no dst & unknown kpm04 18 19.4671e+06 neu_kaon 18 11.8252e+06 all_phys 18 7.2965e+06 eeg10 25 4.62117e+06 phirp_3p 23 3.93621e+06 ppgphok3 23 3.13613e+06 kpmrare07 26 2.74603e+06 kp10pct 18 2.28861e+06 km10pct 18 2.24401e+06 ksrare07 26 2.04644e+06 k0r04 18 1.97603e+06 rad04 18 1.80446e+06 ppgphok5 26 1.75497e+06 pho5mmg 26 1.69187e+06 gg04 26 1.34362e+06 klrare07 26 1.25884e+06 all_scan 18 846833 ppgisr3 18 829904 filt_3p 24 247636 bha20bab 18 125974 bha20ber 14 64336.1 etpg_ero 10 34209.4 etag_2gm 14 15758.8 etag_cpi 8 9585.9 etag_npi 10 9489.7 etapigam 14 6279 a0g_phid 8 2098.6 f0g_neu4 8 1150.9 etag_3gm 14 1128.5 all_phid 16 6 no dst & in use no dst & unknown dst available & unknown

Data census: dst Size in pb-1 Year vs DBV Total 1064 Run available in N versions enter N times

Data census: datarec Size in pb-1 Year vs DBV Total 1163 Run available in N versions enter N times

Run in multiple versions datarec 15071 7887 613 86 2 dst 14877 7248 411 datarec: “multiversion” run mainly spread in 2002 dst: 2002 (23546-26000) in two versions 14 and 22 2002 (26000-26900) in three versions 14, 22 and 26 2005 (1000 spread runs) only in version 26

Proposal Immediately 1- Delete 2005 Data old DBV (datarec) 55 TB 2- Delete old unused MC dst (if any...) 1 TB 3- Delete old unused MC mcr 1 TB 4- Delete MC mcr when dst available 64 TB After KGM-Ponza 5- Delete 2005 Data old DBV (dst) 22 TB 6- Remove other multiversion runs

Proposal Next offline programs: 1- 2006 data reprocessing 2- MC production for Kl4 measurement 3- MC all_phys4 (?) 4- 2001-2002 data reprocessing (?)

Backup slides

Difference between versions