James N. Bellinger University of Wisconsin at Madison 3 November 2010

Slides:



Advertisements
Similar presentations
COM vs. CORBA.
Advertisements

O. Stézowski IPN Lyon AGATA Week September 2003 Legnaro Data Analysis – Team #3 ROOT as a framework for AGATA.
DBA Meeting December Supporting the MINOS MySQL Database at FNAL Nick West.
Source Code Management Or Configuration Management: How I learned to Stop Worrying and Hate My Co-workers Less.
Debugging techniques in Linux Debugging Techniques in Linux Chetan Kumar S Wipro Technologies.
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
Code Management James N. Bellinger University of Wisconsin at Madison 19 January
JAS3 + AIDA LC Simulations Workshop SLAC 19 th May 2003.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
1 Lecture 19 Configuration Management Software Engineering.
1 Software Development Configuration management. \ 2 Software Configuration  Items that comprise all information produced as part of the software development.
CMSBrownBag,05/29/2007 B.Mangano How to “use” CMSSW on own Linux Box and be happy In this context “use” means: - check-out pre-compiled CMSSW code - run.
Module 13 Implementing Business Continuity. Module Overview Protecting and Recovering Content Working with Backup and Restore for Disaster Recovery Implementing.
1 / 22 AliRoot and AliEn Build Integration and Testing System.
Code Management James N. Bellinger University of Wisconsin at Madison 16 March
Release Management Configuration management. Release Management Goal Coordinate the processes through the project development life cycle Ensure the.
Code Management James N. Bellinger University of Wisconsin at Madison 11 May
Migration from SL4 to SL5 at CC-Lyon J ü rgen Brunner.
2-Dec Offline Report Matthias Schröder Topics: Scientific Linux Fatmen Monte Carlo Production.
CSC 480 Software Engineering Test Planning. Test Cases and Test Plans A test case is an explicit set of instructions designed to detect a particular class.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Software Deployment & Release 26/03/2015 1EN-ICE.
LHCbDirac and Core Software. LHCbDirac and Core SW Core Software workshop, PhC2 Running Gaudi Applications on the Grid m Application deployment o CVMFS.
Code Management James N. Bellinger University of Wisconsin at Madison 8 December
Migration to SL5 James Bellinger University of Wisconsin at Madison 7-Apr
Migration to SL5 James Bellinger University of Wisconsin at Madison 21-Apr
Code Management James N. Bellinger University of Wisconsin at Madison 1 June
Code Migration James N. Bellinger University of Wisconsin at Madison 7 July
+ AliEn status report Miguel Martinez Pedreira. + Touching the APIs Bug found, not sending site info from ROOT to central side was causing the sites to.
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
How To Get Involved In Open Source Nick Burch Senior Developer, Alfresco Software VP ConCom, ASF Member.
New Tools Used by the Scientific Linux Team
Online Database Work Overview Work needed for OKS database
Constructing Deploying and Maintaining Enterprise Systems
ATLAS Software Distribution
University of Wisconsin at Madison
Testing for patch certification
glexec/SCAS pilot service
James N. Bellinger University of Wisconsin at Madison 3-August-2011
Fun with Reporting Services Tools
June 2011 David Front Weizmann Institute
Migrating Oracle Forms Using Oracle Application Express
CDA 3100 Summer 2011.
University of Wisconsin at Madison
Introduction of Week 3 Assignment Discussion
University of Wisconsin at Madison
University of Wisconsin at Madison
James N. Bellinger University of Wisconsin at Madison 10 November 2010
University of Wisconsin at Madison
James N. Bellinger University of Wisconsin at Madison 13 October 2010
University of Wisconsin-Madison
University of Wisconsin at Madison
University of Wisconsin at Madison
James N. Bellinger University of Wisconsin at Madison 21 July 2010
James N. Bellinger University of Wisconsin at Madison 6 October 2010
Genome Workbench Chuong Huynh NIH/NLM/NCBI New Delhi, India
“All Lawson, All the Time!”
University of Wisconsin at Madison
University of Wisconsin at Madison
Discussing an OVS/OVN Split
NAVIGATING THE MINEFIELD
University of Wisconsin at Madison
Perl in RPM-Land Dave Cross Magnum Solutions Ltd YAPC::Europe
James N. Bellinger University of Wisconsin at Madison 18-January-2012
James N. Bellinger University of Wisconsin at Madison 11-January-2012
James N. Bellinger University of Wisconsin at Madison 28 July 2010
CS-Status Results from workshop 2008 Statistics Miscellaneous
James N. Bellinger University of Wisconsin at Madison 4 August 2010
University of Wisconsin at Madison
Presentation transcript:

James N. Bellinger University of Wisconsin at Madison 3 November 2010 Code Migration James N. Bellinger University of Wisconsin at Madison 3 November 2010 3 November 2010

Current Work Backup/Restore wget-based procedures: test shortly Stephan provided a backup scheme Need to exercise and document restore procedure wget-based procedures: test shortly CosmicMods crash Camarda found un-initialized variable New oracle_instant_client under test 3 November 2010

Code Tasks perl_dbd_oracle diskcache_i rootd TAuthenticate Product-1 perl_dbd_oracle DONE, now need to make sure everybody gets it Product-2 diskcache_i New version built against v5_14_00g: TESTING: Is testing done? Product-3 rootd TAuthenticate Partial list of incompatible versions Product-4 tcsh bug SOLVED Product-5 Two names for each product Expertise loss => need backup:IN PROGRESS Tools-1 Code Browser New location, new code Tools-2 Code Browser non-CDF Browse non-CDF utilities too, optionally? Tools-3 Expanded validation suite Code-1 CosmicMods crash Think we’ve found it. PATCH? Code-2 Uninitialized variables A couple of libraries were examined Code-3 Program Speedup Possible approaches: Code-3A look for hot spots 1) single routine Code-3B Modules run several times! 2) investigate consolidation when running Code-3C Program Speedup: partition 3) Partitioning does not look promising Code-4 Frontierize remote sites Persuade remote sites to update/patch Code-5 Get complete list of managers Have 2/3, or all but a dozen of the official ones Support-1 Non-RHEL support Volunteers work on it, but no support? Support-2 cdf.code rebuildable on failure? Stephan has backup procedures, need to test restoration Support-3 6.1.4int11.m W-analysis will probably never stop using this version 3-November 2010

Wish List Let me know of others Large file support in root File storage issues reduced if we use this Wish-2 New release has working Stntuple Wish-3 Joint MC + Production release ONE RELEASE TO RULE THEM ALL… Wish-3A Decide on base: 6.1.6 or 7.0.1 Tracking is main question? Wish-3B Combine BMC and regular MC in progress Wish-4 new root 7.0.1 is proof of principle Wish-5 Use xrootd? See Wish-4 Wish-6 EDM validation running test utility Wish-7 New MC engines in new release Wish-8 Test with different compilers long-term support issue Wish-9 code cleanup See Wish-8 and Code-5 and Code-2 Wish-10 Frontier: use current version? Wish-11 CAF submit tools in product Problem, data needs to be updated regularly Wish-12 package pruning See Code-5 Wish-13 Optimizing for 64-bit SL5 Wish-14 Products compiled 64-bit Wish-15 64-bit CDF code/Stntuple/root Let me know of others 3-November 2010

Products Mixed bag Critical items: cern, sam, etc “Why do we bother with this ourselves?” gnuplot, dddebugger, imagelib, etc (available in rpms) Actually, I think our dddebugger had a special patch, or perhaps it was our gdb Somebody once thought it was a good idea: numpy, rrdtools, etc http://www.hep.wisc.edu/~jnb/cdfcode/current/productManagers.xls Many products just have some ups info added to make it into a ups package: easy to make a new one 3-November-2010

Notes on 64-bit CDF code We have a request for 64-bit neurobayes I’ve been told of queries about 64-bit CDF code Why 64-bit? Less hackiness to interface w/ root; maybe faster But: parts of CDF code are chained to 32-bit, thanks to Geant3 (and probably other libraries too) No tsunami of calls to move to Geant4 May be possible to have Stntuple analysis be 64-bit If people want to make it work themselves, OK But—there are subtleties in working up a new framework to support partial compilation—or a new release May be more work than we can justify, even if volunteers do the heavy lifting No bar to some of the products being 64-bit perl bit size has to match that of the libraries it loads, though Validation? Who is going to verify that even something simple like Stntuple analysis is unchanged when running 64-bit RHEL, or Ubuntu? 3-November-2010