Presentation is loading. Please wait.

Presentation is loading. Please wait.

Code Management James N. Bellinger University of Wisconsin at Madison 8 December 2010 1.

Similar presentations


Presentation on theme: "Code Management James N. Bellinger University of Wisconsin at Madison 8 December 2010 1."— Presentation transcript:

1 Code Management James N. Bellinger University of Wisconsin at Madison 8 December 2010 1

2 Current Work Backup/Restore – Need to test and document restore procedure Glitches in code browser: at least one library is missing src – Donatella is testing Large file support investigations 8 December 20102

3 Large File Support Has implications for job timing, staging, and so on Votava and Fuess are in the loop to study this Simple compilation flag not adequate: changes to FrameMods and Edm (at minimum) Simple hacks let me create a readable 9.3 GB file Automatically tried to open a new (X_1.root) file and died: not sure why it thought it had to try This was a third generation file: Created 3.9GB file, read that and added others to create 4.7GB file, read that in turn and added others to try to create 10GB 8 December 20103

4 Large File Support 2 Known problems: rcp bookkeeping doesn’t handle 64-bit int Integer overflow will happen in a couple of places: Experiment with –ftrapv flag Production/Stntupling reportedly takes up only 20% of our tape activity Large file support won’t give largest effect here Do we want to try to merge Stntuples? Catalog headaches, manpower 8 December 20104

5 Code Tasks 1 8-December 20105 Product-1 perl_dbd_oracle DONE, now need to make sure everybody gets it Product-2 diskcache_i DONE Product-3 rootd TAuthenticate Partial list of incompatible versions Product-4tcsh bugSOLVED Product-5 Two names for each product Expertise loss => need backup:IN PROGRESS Tools-1 Code Browser, new version DONE Tools-2 Code Browser non-CDF Browse non-CDF utilities too, optionally? Tools-3 Expanded validation suite Code-1 CosmicMods crash Think we’ve found it. Another week to be confident Code-2 Uninitialized variables A couple of libraries were examined Code-3 Program Speedup Possible approaches: Code-3A look for hot spots 1) single routine Code-3B Modules run several times! 2) investigate consolidation when running Code-3CProgram Speedup: partition3) Partitioning does not look promising

6 Code Tasks2 8-December 20106 Code-4 Frontierize remote sites Persuade remote sites to update/patch, Frontier from main Code-5 Get complete list of managers Have 2/3, or all but a dozen of the official ones Code-6 Frontier should use main branch Support-1Non-RHEL support Volunteers work on it, but no support? Support-2 cdf.code rebuildable on failure? Stephan has backup procedures, need to test restoration Support-3 6.1.4int11.m W-analysis will probably never stop using this version Support-4 SL6 RHEL ready, SL6 by spring, then test?

7 Wish List 1 10-December 20107 Wish-1 Large file support in root File storage issues reduced if we use this Wish-2 New release has working Stntuple Wish-3 Joint MC + Production release ONE RELEASE TO RULE THEM ALL… Wish-3A Decide on base: 6.1.6 or 7.0.1 Tracking is main question? Wish-3B Combine BMC and regular MC DONE Wish-4 new root 7.0.1 is proof of principle Wish-5 Use xrootd? See Wish-4 Wish-6 EDM validation running test utility Wish-7 New MC engines in new release Wish-8 Test with different compilers long-term support issue Let me know of others

8 Wish List 2 8-December 20108 Wish-9 code cleanup See Wish-8 and Code-5 and Code-2 Wish-10 Frontier: use current version? long-term support issue Wish-11 CAF submit tools in product Problem, data needs to be updated regularly Wish-12 package pruning See Code-5, list in progress Wish-13 Optimizing for 64-bit SL5 Wish-14 Products compiled 64-bit Only standalones, not li braries Wish-15 64-bit CDF code/Stntuple/root Wish-16 cdfprd in future frozen releases Let me know of others

9 Wish List: Priorities Assuming 2019 as last analysis gasp 8-December 20109 Combination MC+Production+Stntuple 2? Code cleanup for longterm use2 Packages pruned, longterm support identified 3 Use new tracking, MC engines? CAF submit tools as product? New root, xrootd? Large file support1?


Download ppt "Code Management James N. Bellinger University of Wisconsin at Madison 8 December 2010 1."

Similar presentations


Ads by Google