Large scale MC production II

Slides:



Advertisements
Similar presentations
Status reports: Production environment Trigger simulationM. Palutan, B. Sciascia EmC responseS. Miscetti Background selectionS. Miscetti, M. Moulson DC.
Advertisements

Status reports/Discussion items S. DellAgnello DC geometry review DC wire sag measurements P. de SimoneDC s-t relations with new sag model S. Miscetti.
Status reports Trigger simulationM. Palutan, B. Sciascia DC GeometryA. Antonelli, S. Dell’Agnello DC wire sag measurementS. Dell’Agnello, C. Forti DC s-t.
KLOE GM Capri May 2003 K charged status report DE/Dx development vs PiD (next talk by E.De Lucia) →K e3 studies: initial design of efficiency measurement.
Offline Status Report M. Moulson, 20 December 2001 Summary presentation for KLOE General Meeting Outline: Processing of 2001 data History of datarec executable.
Status report on EMC simulation... Part 3 The plan is to:  SURVEY the existing situation over the runs - Validation of plots using  and.
Measurement of the absolute BR(K  +  -  + ) : an update Patrizia de Simone KLOE Kaon meeting – 21 May 2009.
Work finished M. Antonelli ISR and f decay simulation M. MoulsonBank-reduction code for DST’s M. Palutan et al.Trigger simulation parameters S. GiovannellaGEANFI.
Status of  b Scan Jianchun Wang Syracuse University Representing L b scanners CLEO Meeting 05/11/02.
KLOE Offline Status Report Data Reconstruction MonteCarlo updates MonteCarlo production Computing Farm C.Bloise – May 28th 2003.
Realistic, large-scale MC production M. Moulson, 20 December 2002 Summary presentation for KLOE General Meeting Outline: Production proposal Refinements.
Status reports M. Antonelli ISR and f decay simulation S. Dell’AgnelloDC geometry review P. de SimoneDC s-t relations with new sag model A. AntonelliDC.
MC/Offline Planning M. Moulson Frascati, 21 March 2005 MC status Reconstruction coverage and data quality Running time estimates MC & reprocessing production.
Progress on BR(K L  p + p - ) using a double-tag method A. Antonelli, M. Antonelli, M. Dreucci, M. Moulson CP working group meeting, 25 Feb 2003.
STATUS OF KLOE F. Bossi Capri, May KLOE SHUTDOWN ACTIVITIES  New interaction region  QCAL upgrades  New computing resources  Monte Carlo.
DST status Ready for production Analysis of sample ksl DST’s in progress for ~1 week ksl DST event size: 2.8 MB/nb GB for 200 pb -1 Other streams.
K  group activities K + K - retracking features New vs Old : resolution future planning. Conclusion and outlook K + K - retracking features New vs Old.
V.Patera – KLOE GM – Otranto – 10 June 2002 K  reconstruction status K + K - retracking features New vs Old : resolution New vs Old : efficiencies Conclusion.
Update on MC-04(05) –New interaction region –Attenuation lengths vs endcap module numbers –Regeneration and nuclear interaction –EMC time resolution –
Status of the KLOE experiment M. Moulson, for the KLOE collaboration LNF Scientific Committee 23 May 2002 Data taking in 2001 and 2002 Hardware and startup.
The KLOE computing environment Nuclear Science Symposium Portland, Oregon, USA 20 October 2003 M. Moulson – INFN/Frascati for the KLOE Collaboration.
Dead or alive ??!! … Erika & Patrizia …. … this story begins when … … we were trying to produce the KMP dst’s for 2004 data … reproduce the List oh the.
Offline meeting Outcome of Scientific Committee Status of MC04 Proposal for a minimum bias EvCl sample Other offline activies: –Reprocessing –Dead wires.
Offline meeting  Status of MC/Datarec  Priorities for the future LNF, Sep
A proposed plan for fine tuning of EMC MC The plan is to :  SURVEY the existing situation over the runs - Validation of plots using  and.
Offline Status Report A. Antonelli Summary presentation for KLOE General Meeting Outline: Reprocessing status DST production Data Quality MC production.
Barbara Sciascia July,29 th - LNF 1 Barbara Sciascia K  semileptonic decays Charged Kaon Meeting July, 29 th - LNF Single photon efficiency in KPM events.
Status report of the KLOE offline G. Venanzoni – LNF LNF Scientific Committee Frascati, 9 November 2004.
STAR Collaboration Meeting, BNL – march 2003 Alexandre A. P. Suaide Wayne State University Slide 1 EMC Update Update on EMC –Hardware installed and current.
Work finished M. Antonelli ISR and f decay simulation M. MoulsonBank-reduction code for DST’s.
MC sign-off and running plans M. Moulson, 1 March 2004 Offline discussion Outline: Results of tests on new MC files Sign-off on production version What.
Offline Status Review M. Moulson, P. Valente, for the Offline Group 16 March 2001 Outline: Status update FILFO: new developments (G. Finocchiaro) Questions.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
Offline resource allocation M. Moulson, 11 February 2003 Discussion Outline: Currently mounted disk space Allocation of new disk space CPU resources.
Tuning of trigger simulation parameters (Bossi, Moulson, Palutan, Sciascia) Calorimeter trigger thresholds calibration using prompt photons from K S 
Status report on analysis of BR(K S  p + p - p 0 ) A. Antonelli, M. Moulson, Second KLOE Physics Workshop, Otranto, June 2002.
1 Reminder: Why reprocess? data Reconstruction: DBV DSTs: DBV data DBV-19 for reconstruction & DSTs, Run < DBV-20 for.
Stano Tokar, slide 1 Top into Dileptons Stano Tokar Comenius University, Bratislava With a kind permissison of the CDF top group Dec 2004 RTN Workshop.
1 Reconstruction tasks R.Shahoyan, 25/06/ Including TRD into track fit (JIRA PWGPP-1))  JIRA PWGPP-2: Code is in the release, need to switch setting.
DST data structures: Status report M. Moulson, CP working group 25 October 2001.
M. Martemianov, ITEP, October 2003 Analysis of ratio BR(K     0 )/BR(K    ) M. Martemianov V. Kulikov Motivation Selection and cuts Trigger efficiency.
Status Report on Data Reconstruction May 2002 C.Bloise Results of the study of the reconstructed events in year 2001 Data Reprocessing in Y2002 DST production.
MC/OFFLINE meeting  Status  Request by Ke2 group  aob LNF
11 Sep 2007Tracking - Paul Dauncey1 Tracking Code Paul Dauncey, Imperial College London.
Parameterization of EMC response for
DCS Status and Amanda News
Update on the false-dead DC wire problem
Modifications to the DRS4’s code
KLOE offline & computing: Status report
analisys: Systematics checks
Developments of the PWG3 muon analysis code
Status report on   f0  00
DPG Activities DPG Session, ALICE Monthly Mini Week
Salvatore Fiore Università di Roma “La Sapienza”
Migration of reconstruction and analysis software to C++
MC ’04-’05 objectives                                                       
Offline Report Outline: Status update DST Proposal P. de Simone
TOF CALIBRATION DATABASE
LHCb Computing Model and Data Handling Angelo Carbone 5° workshop italiano sulla fisica p-p ad LHC 31st January 2008.
Philippe Charpentier CERN – LHCb On behalf of the LHCb Computing Group
Kloe plans for 500 pb-1 Since now up to mid/end 2003
Global PID MICE CM43 29/10/15 Celeste Pidcott University of Warwick
KLOE General Meeting - LNF March,
NIKHEF / Universiteit van Amsterdam
Rare and Forbidden Charm Meson Decays in FOCUS
Search for (3770) non-DD-bar Decays
Samples and MC Selection
Agenda SICb Session Status of SICb software migration F.Ranjard
Susan Burke, University of Arizona
Problems in π0 Reconstruction
Presentation transcript:

Large scale MC production II M. Moulson Offline Discussion, 30 October 2002 Outline Status reports Logistics: a proposal Combine or separate channels? Timescale and checklist

Status reports M. Antonelli ISR in the MC A. Antonelli, S. Dell’Agnello DC geometry review S. Miscetti, M. Palutan EmC geometry review M. Moulson Bank-reduction code for DST’s C. Bloise, S. Miscetti QCAL banks for MC DST’s M. Moulson, S. Miscetti, V. Patera Background insertion S. Giovannella GEANFI on IBM I. Sfiligoi DB modifications for DST’s

MC DST’s: A/C path If an identified KL tag, recalculate t0 and re-run NVR code: talk kloe_drop DROP VNVO 0 DROP KNVO 0 DROP INVO 0 talk eclsfilt sel kltag yes ret ret use/path=1 kbkmdd emcdbini dcdbini eclsfilt kloe_drop t0_find/par=2 clufixtim/par=2 eclmod/par=2 filter/path=1 eclsfilt on Compress banks (all events, including unclassified events and KL tags) use/path=2 mc_dst clu2trig track_dst trig_dst output select event/path=(1,2) Zip output (level 4) Specify bank list output select drop output select kept

MC DST’s: banks currently present Headers, etc. LRID HEAD EVCL BRIN MC truth KINE VERT t0-related T0MC T0GL EmC recon. CLPS CLLS CSPS EmC truth CFHI Event class. ECLS ECLO VNVO INVO KNVO DC recon. DCNH DTFS DVFS TCLO DC truth MKIN MDTF Trigger TCOE TDST CTRG QCAL QCAE QWRK QIHI QCKA

MC DST summary banks for tracking MKIN: MC details for KINE tracks One bank per charged KINE track, 20 words: Number of DHIT hits and layers x, p at first and last DHIT hits Path length and TOF MDTF: MC truth for DTFS tracks One bank per DTFS track, 28 words: Indices of 3 main KINE contributors Number of hits and number consecutive hits contributed by each Index of KINE at first DTFS hit; layer, x, p for first hit Index of KINE at last DTFS hit; layer, x, p for last hit PROD2NTU routines to be modified: getdhitval, tfmctrue, tfmchit, mainkineintrk, getfirstlastdhit

MC DST’s: banks currently dropped Trigger TMON TELE TPIE PZZA TCAF TPAS EmC recon. MCEL CWRK CPPS CPLS CELE DC recon. MDTC DTCE DHRE DPRS DHSP DCHD MC run init. PART MATE TMED MC truth DHIT CHIT CEKA DTKA DTHA Additionally, all lower-case MC banks compressed with sqzlib

MC DST’s: status and size estimate Output size estimate: 1000 KS  all, KL  all events Generated and reconstructed on AIX w/ standard path .mcr 23.9 MB (i.e., KB/evt) .dst 4.2 MB Target size: 6 KB/evt  500 pb-1 = 500 M evts = 3 TB Work to be done: Summary banks for EmC, trigger, QCAL Need assistance with definition of these banks! Time to complete development: 1 week full-time; 2 weeks realistically

Background insertion: status S. Miscetti: Selection criteria for clean gg events Nearly done Isolation of gg clusters/fragments In progress M. Moulson: A/C module for event insertion 1st version working V. Patera (A. Ventura): Installation of MBCKADD routines In progress to merge DC hits; testing

A/C module for background insertion New A/C module: insert Opens background file Reads events from the file into secondary YBOS array, reusing events appropriately Decompresses (unzips) events from the secondary file Gracefully handles EOF of the secondary file Proof of principle: no analysis at present Only copies LRID from 'background' file into BRID in the 'MC' file Next step: open the secondary file using KID Straightforward, just drop-in subroutine replacements.

Proposal for production logistics Goal: Best possible reproduction of time-variable conditions Mainly background, but also s, pf, dead channels, etc. These quantities available by run Proposal: generate an MC file for each run Need to simulate chunks of runs for which L dt available s(KSKL) = 750 nb: Max MC file size 25000 evts  33 nb-1 Run size in 2001-2002 data 20  200 nb-1 Have L dt for each raw file!

Proposal for production logistics Generate MC files with number of events in proportion to luminosity in each raw file: Tailor generation to each run: s, pf, xf (others?) Tailor reconstruction to each run: dead channels, trigger (others?) Insert background from each raw file All necessary information should already exist Relatively easy to implement; database driven No need to define data set a priori Individual analyses can use different MC data sets specific to their data

Proposal for production logistics Number of reconstructed raw files 2001-2002: 84237 Raw file size: 2-6 nb-1 in 2001, 6-15 nb-1 in 2002; tails extend to zero Problems can arise when individual raw files too small (N = Ls dt  0) Absurdly small number of events per MC file, fluctuations to zero Not a problem for KSKL: s = 750 nb Rare channels have to be generated with something non-rare Fluctuations to zero in number of background events to insert Can solve all of above problems by: Not generating rare channels alone (KSKL slightly preferable here) Summing f05-f07 for 2001 (reduce number of MC files) Don’t generate very small files: Ngg < 10  L dt < ~0.3 nb-1 Cut assumes gg sampling limiting factor: s(MC) >> s(gg background) Error on total luminosity = 0.04%

Miscellaneous upgrades to MC Generators: Any that need to be checked? Branching ratios? Is it time to review and update these? Other issues?

Combine or separate neutral kaon runs? Combined production KS  all, KL  all Separate production KS  p0p0, KL  all KS  p+p-, KL  all Also differentiated by KL decay in DC? Simpler to produce Simpler to analyze Fewer files Smaller files Less disk turnover? (if people cooperate) (if one KS channel dominates interest) No need to prioritize Possible to prioritize Naturally treats channels with small BR Well-suited for background studies for rare KS decays

Task list ISR in the MC M. Antonelli DC geometry review A. Antonelli, S. Dell’Agnello EmC geometry review S. Miscetti, M. Palutan Bank-reduction code for DST’s M. Moulson Assistance w/ EmC DST structures Assistance w/ trigger DST structures Assistance w/ QCAL structures Background insertion S. Miscetti, M. Moulson, V. Patera DC dead channel simulation EmC dead channels, thresholds, etc. Trigger simulation by run F. Bossi GEANFI on IBM S. Giovannella Other MC tuning (BR’s, etc) DB modifications for DST’s I. Sfiligoi