Presentation is loading. Please wait.

Presentation is loading. Please wait.

Re-Reconstruction Of Generated Monte Carlo In a McFarm Context 2003/09/26 Joel Snow, Langston U.

Similar presentations


Presentation on theme: "Re-Reconstruction Of Generated Monte Carlo In a McFarm Context 2003/09/26 Joel Snow, Langston U."— Presentation transcript:

1 Re-Reconstruction Of Generated Monte Carlo In a McFarm Context D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.

2 Objective Manage MC reprocessing with McFarm –No massive changes – flexible  –D0RunII, ups/upd environment sufficient – packages, rcp’s, data –mc_runjob handle reprocessing –Scriptable procedure –File outputs certified for SAM storage D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.

3 Status August 1 U. Michigan – NPACI cluster  3 scripts –Job submission, SAM project handling (make_npaci.py splitProject.py, ) –Run control – referred to other scripts that provided job creation (npaci_jobs.sh) –Not exactly applicable to McFarm –Left out crucial info (binaries, rcp’s) –Yet were still informative (nothing exotic needed, adaptable to McFarm) D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.

4 Further Investigation RCP’s crucial –Where do the come from? –What are they? –Can they and their parameters be user specified like Request system used with mc_runjob? Or have to craft mc_runjob macro and use reg_job? D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.

5 Action Plan Make job dir on farm node. Locate RCP’s and alter for single input file and output files with no SAM use. Run re-reco to completion Inspect output, logs Shows SAM not needed during running, no non-MC database or binary is needed, and that the job can be encapsulated to one input/output. D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.

6 Release p14.02.00 Copy McFarm run directory in the d0reco phase to a test area Modify file list to use McFarm generated reco file Copy runD0reco_mc_reprocess.rcp and DropChunks_ReprocessDST.rcp to d0reco rcp dir Modify run_d0reco.sh rcp file to runD0reco_mc_reprocess.rcp, rename to run_d0rereco.sh, run it D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.

7 p14.02.00 Results Job completed producing reco and tmb files Great! No extra stuff, just D0RunII. Where’s the metadata? Right RCP’s? Only >p14.03.00 certified for re- reco. Try it again. D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.

8 p14.03.02 Results Reprocess rcp's for detector subsystems –Find them all and place in the proper sub dir of the re-reco test area Job completes producing reco and tmb files Where’s the metadata? Right RCP’s? Also shown that can re-reco in mc_runjob structure D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.

9 CAB/NPACI Style Use d0tools package –rund0exe runs d0reco –cabSubmit.py submits job, SAM handling –Still where’s the metadata? Not d0reco rund0exe takes USERPOSTSCRIPT argument – provided by env. var. at NPACI Still unknown how it’s produced(?) Need script(?) D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.

10 Developments & Status mc_runjob version re-reco specifically enabled available No apparent structural incompatibilities for McFarm to be able to re-reco Has metadata producer been found? Anybody know the latest? D0SAR@OUD0SAR@OU, 2003/09/26 Joel Snow, Langston U.


Download ppt "Re-Reconstruction Of Generated Monte Carlo In a McFarm Context 2003/09/26 Joel Snow, Langston U."

Similar presentations


Ads by Google