Thoughts on How to Distribute the Bare Minimum for Analysis Natalia Ratnikova, Fermilab 16 May, 2006 Software Development Tools Meeting.

Slides:



Advertisements
Similar presentations
05/11/2001 CPT week Natalia Ratnikova, FNAL 1 Software Distribution in CMS Distribution unitFormContent Version of SCRAM managed project.
Advertisements

German Cancio – WP4 developments Partner Logo WP4-install plans WP6 meeting, Paris project conference
Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.
The Unified Software Development Process - Workflows Ivar Jacobson, Grady Booch, James Rumbaugh Addison Wesley, 1999.
VisIt Software Engineering Infrastructure and Release Process LLNL-PRES Lawrence Livermore National Laboratory, P. O. Box 808, Livermore,
Source Code Version Management and Configuration Control Art Amezcua Status 11/5/2007.
Siemens’ 4 View Model (props to My-An Nguyen for giving me her 344 notes on which this lecture is based)
Big Projects  Part of this class is about picking a cool software project and building it 1.
Deployment and Configuration Management Solution
Matlab, R and Other Jobs in CHTC. chtc.cs.wisc.edu No suitable R No Matlab runtime Missing shared libraries Missing compilers … Running On Bare Bones.
M. Gallas IT-API LCG SPI project: testing1 Software Testing Infrastructure status LCG Software Process & Infrastructure (CERN, 10/23/02)
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing LCG Applications Area GridPP 7 th Collaboration Meeting LCG/SPI LCG.
COMP-14: Automating your deployments using ANT Gary S Clink Business Consultant.
C. Loomis – Testbed Status – 28/01/2002 – n° 1 Future WP6 Tasks Charles Loomis January 28, 2002
J.T Moscicki CERN LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Software Packaging and Distribution LCG Application.
NICOS System of Nightly Builds for Distributed Development Alexander Undrus CHEP’03.
INFSOM-RI Juelich, 10 June 2008 ETICS - Maven From competition, to collaboration.
Distribution After Release Tool Natalia Ratnikova.
LIGO-G9900XX-00-M ITR 2003 DMT Sub-Project John G. Zweizig LIGO/Caltech.
Database Change Management One solution to an often complex problem Kevin Hurwitz Headspring Systems
Michael Still Google Inc. October, Managing Unix servers the slack way Tools and techniques for managing large numbers of Unix machines Michael.
Secure Systems Research Group - FAU SW Development methodology using patterns and model checking 8/13/2009 Maha B Abbey PhD Candidate.
LCG-SPI: SW-Testing LCG AppArea internal review (20/10/03)
Software Engineering – University of Tampere, CS DepartmentJyrki Nummenmaa Configuration management.
20/09/2006LCG AA 2006 Review1 Committee feedback to SPI.
Feedback from the POOL Project User Feedback from the POOL Project Dirk Düllmann, LCG-POOL LCG Application Area Internal Review October 2003.
System Construction System Construction is the development, installation and testing of system components.
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing QMTest test framework LCG AppArea meeting (16/07/03) LCG/SPI LCG Software.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
Software Development A Proposed Process and Methodology.
4 December 2003 Natalia Ratnikova Natalia Ratnikova 1 Software Packaging with DAR Natalia Ratnikova, Anzar Afaq, Greg Graham Fermilab Tony Wildish, Veronique.
Configuration Management CSCI 5801: Software Engineering.
GLite build and integration system Building and Packaging Robert HARAKALY
INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.
J.P. Wellisch, CERN/EP/SFT SCRAM Information on SCRAM J.P. Wellisch, C. Williams, S. Ashby.
Software Release Procedure Session MANAGEMENT and FUTURE directions Form ongoing ‘empowered’ Technical Discussion Group (TDG) Any future project definitions(resources.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Datagrid Software Repository Presentation CVS, packages and automatic.
JavaScript 101 Introduction to Programming. Topics What is programming? The common elements found in most programming languages Introduction to JavaScript.
Software Testing Process
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
 Introduction  Tripwire For Servers  Tripwire Manager  Tripwire For Network Devices  Working Of Tripwire  Advantages  Conclusion.
1 Software Workshop Report Malcolm Ellis MICE Video Conference Wednesday 9 th November 2005.
11/01/2012B.Couturier - Core Software Workshop 1 Software Development Infrastructure Main Topics Development tools Build and Release tools Tracking/Management.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.
Integration TestBed (iTB) and Operations Provisioning Leigh Grundhoefer.
Using Docker in a CyVerse World The main portion of this tutorial should take about 45 minutes to go through, and assumes you have already gone through.
Maite Barroso – WP4 Workshop – 10/12/ n° 1 -WP4 Workshop- Developers’ Guide Maite Barroso 10/12/2002
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
GLAST CHEP 03 March T.Burnett1/14 User-friendly tools for Managing Software Development Projects User-friendly tools for Managing Software Development.
SPI Report for the LHCC Comprehensive Review Stefan Roiser for the SPI project.
Development Environment
Licenses and Interpreted Languages for DHTC Thursday morning, 10:45 am
SAP Business One B1iF Training
Generator Services planning meeting
4th Forum How to easily offer your application as a self-service template by using OpenShift and GitLab-CI 4th Forum Alberto.
GLAST Release Manager Automated code compilation via the Release Manager Navid Golpayegani, GSFC/SSAI Overview The Release Manager is a program responsible.
A451 Theory – 7 Programming 7A, B - Algorithms.
User Feedback from SEAL
School of EE and Computer Science
Applied Software Implementation & Testing
X in [Integration, Delivery, Deployment]
Module 01 ETICS Overview ETICS Online Tutorials
Baseline – IEEE definition
FEniCS = Finite Element - ni - Computational Software
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
Presentation transcript:

Thoughts on How to Distribute the Bare Minimum for Analysis Natalia Ratnikova, Fermilab 16 May, 2006 Software Development Tools Meeting.

Use Case Physicist wants to run root-based analysis on his/her laptop without installing full CMSSW development environment. Goal: –Let users easily install a light version of CMSSW software containing data classes and corresponding dictionaries on their laptops Examples: FWLite based tutorials at:

General Requirements Package includes a bare minimum for analysis Package is built as a subset of the CMSSW release: –Based on the same configuration version (SCRAMToolBox tag), and selects a subset of required external tools (CMSSW/config/requirements). –Based on the same source code –Package is considered a part of the release provided functionality and thus undergoes all standard release procedures: nightlies, integration, validation, release notes, packaging, etc… –Downloaded/installed via standard CMSSW tool More ???

Possible Solutions Distribution with build capabilities OR Runtime based distribution ???

Distribution With Build Capabilities Identify a bare minimum subset of external tools (using tag in config/requirements ) Identify a bare minimum list of subsystems to build, e. g.: DataFormats, SimDataFormats. Bootstrap/setup/build/test and create rpm as usual, but only for bare minimum. Review the internal dependencies (BuildFiles),e.g. if unwanted subsystems are pulled out during the build, and external dependencies (selected tools), e.g. if unresolved. Package/install using new project name but the global version : FWLite CMSSW_0_6_0

Runtime Based Distribution Package only “bare minimum” of environment that you get when executing scram runtime. –Runtime based distribution will be even more compact without unneeded sources, binaries and build tools –No external dependencies: all in one package; no scram –User only needs to source some setup.sh/csh script to be ready to run the application, or even have a wrapper around the root.exe put in $HOME/bin/fwlite, which can be executed directly. Runtime based package can be built from FWLite to be self contained by construction. Or from the full CMSSW release, with additional validity check( e.g. touch each object type).

Realization Prototyping would take a week or so Need to prioritize wrt other tasks