Re-Reconstruction Of Generated Monte Carlo In a McFarm Context 2003/09/26 Joel Snow, Langston U.

Objective Manage MC reprocessing with McFarm –No massive changes – flexible  –D0RunII, ups/upd environment sufficient – packages, rcp’s, data –mc_runjob handle reprocessing –Scriptable procedure –File outputs certified for SAM storage 2003/09/26 Joel Snow, Langston U.

Status August 1 U. Michigan – NPACI cluster  3 scripts –Job submission, SAM project handling (make_npaci.py splitProject.py, ) –Run control – referred to other scripts that provided job creation (npaci_jobs.sh) –Not exactly applicable to McFarm –Left out crucial info (binaries, rcp’s) –Yet were still informative (nothing exotic needed, adaptable to McFarm) 2003/09/26 Joel Snow, Langston U.

Further Investigation RCP’s crucial –Where do the come from? –What are they? –Can they and their parameters be user specified like Request system used with mc_runjob? Or have to craft mc_runjob macro and use reg_job? 2003/09/26 Joel Snow, Langston U.

Action Plan Make job dir on farm node. Locate RCP’s and alter for single input file and output files with no SAM use. Run re-reco to completion Inspect output, logs Shows SAM not needed during running, no non-MC database or binary is needed, and that the job can be encapsulated to one input/output. 2003/09/26 Joel Snow, Langston U.

Release p Copy McFarm run directory in the d0reco phase to a test area Modify file list to use McFarm generated reco file Copy runD0reco_mc_reprocess.rcp and DropChunks_ReprocessDST.rcp to d0reco rcp dir Modify run_d0reco.sh rcp file to runD0reco_mc_reprocess.rcp, rename to run_d0rereco.sh, run it 2003/09/26 Joel Snow, Langston U.

p Results Job completed producing reco and tmb files Great! No extra stuff, just D0RunII. Where’s the metadata? Right RCP’s? Only >p certified for re- reco. Try it again. 2003/09/26 Joel Snow, Langston U.

p Results Reprocess rcp's for detector subsystems –Find them all and place in the proper sub dir of the re-reco test area Job completes producing reco and tmb files Where’s the metadata? Right RCP’s? Also shown that can re-reco in mc_runjob structure 2003/09/26 Joel Snow, Langston U.

CAB/NPACI Style Use d0tools package –rund0exe runs d0reco –cabSubmit.py submits job, SAM handling –Still where’s the metadata? Not d0reco rund0exe takes USERPOSTSCRIPT argument – provided by env. var. at NPACI Still unknown how it’s produced(?) Need script(?) 2003/09/26 Joel Snow, Langston U.

Developments & Status mc_runjob version re-reco specifically enabled available No apparent structural incompatibilities for McFarm to be able to re-reco Has metadata producer been found? Anybody know the latest? 2003/09/26 Joel Snow, Langston U.