Download presentation
Presentation is loading. Please wait.
Published byWilfrid Johnson Modified over 9 years ago
1
Re-Reconstruction Of Generated Monte Carlo In a McFarm Context D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.
2
Objective Manage MC reprocessing with McFarm –No massive changes – flexible –D0RunII, ups/upd environment sufficient – packages, rcp’s, data –mc_runjob handle reprocessing –Scriptable procedure –File outputs certified for SAM storage D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.
3
Status August 1 U. Michigan – NPACI cluster 3 scripts –Job submission, SAM project handling (make_npaci.py splitProject.py, ) –Run control – referred to other scripts that provided job creation (npaci_jobs.sh) –Not exactly applicable to McFarm –Left out crucial info (binaries, rcp’s) –Yet were still informative (nothing exotic needed, adaptable to McFarm) D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.
4
Further Investigation RCP’s crucial –Where do the come from? –What are they? –Can they and their parameters be user specified like Request system used with mc_runjob? Or have to craft mc_runjob macro and use reg_job? D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.
5
Action Plan Make job dir on farm node. Locate RCP’s and alter for single input file and output files with no SAM use. Run re-reco to completion Inspect output, logs Shows SAM not needed during running, no non-MC database or binary is needed, and that the job can be encapsulated to one input/output. D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.
6
Release p14.02.00 Copy McFarm run directory in the d0reco phase to a test area Modify file list to use McFarm generated reco file Copy runD0reco_mc_reprocess.rcp and DropChunks_ReprocessDST.rcp to d0reco rcp dir Modify run_d0reco.sh rcp file to runD0reco_mc_reprocess.rcp, rename to run_d0rereco.sh, run it D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.
7
p14.02.00 Results Job completed producing reco and tmb files Great! No extra stuff, just D0RunII. Where’s the metadata? Right RCP’s? Only >p14.03.00 certified for re- reco. Try it again. D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.
8
p14.03.02 Results Reprocess rcp's for detector subsystems –Find them all and place in the proper sub dir of the re-reco test area Job completes producing reco and tmb files Where’s the metadata? Right RCP’s? Also shown that can re-reco in mc_runjob structure D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.
9
CAB/NPACI Style Use d0tools package –rund0exe runs d0reco –cabSubmit.py submits job, SAM handling –Still where’s the metadata? Not d0reco rund0exe takes USERPOSTSCRIPT argument – provided by env. var. at NPACI Still unknown how it’s produced(?) Need script(?) D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.
10
Developments & Status mc_runjob version re-reco specifically enabled available No apparent structural incompatibilities for McFarm to be able to re-reco Has metadata producer been found? Anybody know the latest? D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.