05/11/2001 CPT week Natalia Ratnikova, FNAL 1 Software Distribution in CMS Distribution unitFormContent Version of SCRAM managed project.

Slides:



Advertisements
Similar presentations
Ch-11 Project Execution and Termination. System Testing This involves two different phases with two different outputs First phase is system test planning.
Advertisements

Low level CASE: Source Code Management. Source Code Management  Also known as Configuration Management  Source Code Managers are tools that: –Archive.
Platforms, installation, configuration; accessing example collections Course material prepared by Greenstone Digital Library Project University of Waikato,
Professional Informatics & Quality Assurance Software Lifecycle Manager „Tools that are more a help than a hindrance”
Julie McEnery1 Installing the ScienceTools The release manager automatically compiles each release of the Science Tools, it creates a set of wrapper scripts.
7/17/2009 rwjBROOKDALE COMMUNITY COLLEGE1 Unix Comp-145 C HAPTER 2.
Introduction to The Linaro Toolchain Embedded Processors Training Multicore Software Applications Literature Number: SPRPXXX 1.
1 Introduction to Tool chains. 2 Tool chain for the Sitara Family (but it is true for other ARM based devices as well) A tool chain is a collection of.
Managing Software using RPM. ♦ Overview In Linux, Red Hat Package Manager referred as RPM is a tool used for managing software packages and its main function.
M. Gallas IT-API LCG SPI project: testing1 Software Testing Infrastructure status LCG Software Process & Infrastructure (CERN, 10/23/02)
Linux Operations and Administration
M. Taimoor Khan * Java Server Pages (JSP) is a server-side programming technology that enables the creation of dynamic,
Input/Output Controller (IOC) Overview Andrew Johnson Computer Scientist, AES Controls Group.
OCLC Online Computer Library Center CONTENTdm Migration Training Craig Yamashita Vice President, Technology and Product Development DiMeMa, Inc. July 2005.
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing LCG Applications Area GridPP 7 th Collaboration Meeting LCG/SPI LCG.
CCA Port, Component & Application Build Skeleton Templates “A new script toolkit for generating CCA build skeletons” Torsten Wilde and James Kohl Oak Ridge.
Project Source Code Structure and Build Process ● Remember consistency matters as source code structure, build process, and release processes are all intertwined.
SUSE Linux Enterprise Server Administration (Course 3037) Chapter 4 Manage Software for SUSE Linux Enterprise Server.
COMP-14: Automating your deployments using ANT Gary S Clink Business Consultant.
DIFFERENCE BETWEEN ORCAD AND LABVIEW
1 Dynamic Application Installation (Case of CMS on OSG) Introduction CMS Software Installation Overview Software Installation Issues Validation Considerations.
April 6, 2010GMQS Meeting1 Optional Feature Support in HDF5 Tools Albert Cheng The HDF Group.
Compiled Matlab on Condor: a recipe 30 th October 2007 Clare Giacomantonio.
Install Software. UNIX Shell The UNIX/LINUX shell is a program important part of a Unix system. interface between the user & UNIX kernel starts running.
Scons Writing Solid Code Overview What is scons? scons Basics Other cools scons stuff Resources.
Python – Part 1 Python Programming Language 1. What is Python? High-level language Interpreted – easy to test and use interactively Object-oriented Open-source.
Distribution After Release Tool Natalia Ratnikova.
Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.
UNIX Commands. Why UNIX Commands Are Noninteractive Command may take input from the output of another command (filters). May be scheduled to run at specific.
Microsoft ® Business Solutions–Navision ® 4.0 Development II - C/SIDE Solution Development Day 5.
Guide to Linux Installation and Administration1 Chapter 4 Running a Linux System.
Linux Introduction What is Linux? How do you use it?
Managing SX.e and TWL with MARC and Scripts Jeremiah Curtis
LCG-SPI: SW-Testing LCG AppArea internal review (20/10/03)
Disk Layout/Productization Proposal Ron Rechenmacher and Geoff Savage.
GRID Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa.
4 December 2003 Natalia Ratnikova Natalia Ratnikova 1 Software Packaging with DAR Natalia Ratnikova, Anzar Afaq, Greg Graham Fermilab Tony Wildish, Veronique.
LHCb-ATLAS GANGA Workshop, 21 April 2004, CERN 1 DIRAC Software distribution A.Tsaregorodtsev, CPPM, Marseille LHCb-ATLAS GANGA Workshop, 21 April 2004.
Dissecting the Windows CE Build Process James Y. Wilson Principal Engineer, Windows Embedded MVP CalAmp, Inc. James Y. Wilson Principal Engineer, Windows.
Marco Cattaneo - DTF - 28th February 2001 File sharing requirements of the physics community  Background  General requirements  Visitors  Laptops 
GLite build and integration system Building and Packaging Robert HARAKALY
J.P. Wellisch, CERN/EP/SFT SCRAM Information on SCRAM J.P. Wellisch, C. Williams, S. Ashby.
CERN IT Department t LHCb Software Distribution Roberto Santinelli CERN IT/GS.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
ASIS + RPM: ASISwsmp German Cancio, Lionel Cons, Philippe Defert, Andras Nagy CERN/IT Presented by Alan Lovell.
Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Datagrid Software Repository Presentation CVS, packages and automatic.
CHEP ' 2003David Chamont (CMS - LLR)1 OVAL A testing tool for CMS software
Disk Layout/Productization Proposal Ron Rechenmacher and Geoff Savage.
Thoughts on How to Distribute the Bare Minimum for Analysis Natalia Ratnikova, Fermilab 16 May, 2006 Software Development Tools Meeting.
GLite build and integration system Building and Packaging Robert HARAKALY
Use of CMT in LHCb CMT Workshop, LAL (Orsay) 28 th February - 1 st March 2002 P. Mato / CERN.
An Introduction to Ant. What is Ant? How do you use it? Why would you want to?
Installation and environment variables. Simple Installation 1 The latest sources can always be obtained from the CDAT website:
Installation of the ALICE Software
Install external command line softwares
CMS OSG Motivation and Introduction Overview
Pipeline Execution Environment
GLAST Release Manager Automated code compilation via the Release Manager Navid Golpayegani, GSFC/SSAI Overview The Release Manager is a program responsible.
(Chapter 2) John Carelli, Instructor Kutztown University
Design and Programming
Cmake Primer.
ns-3 Waf build system ns-3 Annual Meeting June 2017
Software Installation
Software Installation, release 4.0
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
VirgoStaging Status F.Carbognani, S. Cortese, E. Pacaud.
Computational Environment Management
Framework Anil
Presentation transcript:

05/11/2001 CPT week Natalia Ratnikova, FNAL 1 Software Distribution in CMS Distribution unitFormContent Version of SCRAM managed project SCRAMsources + requirements Applications of the SCRAM managed project DAR binaries Consistent set of versions of products ORCA standalone on CD (CERN)binaries including required external products CMS Software on Hard Disk (FNAL) + sources Version of non- SCRAM project (cmsim, cernlib) Set of tar-files(CERN) and rpm files (INFN) binaries + sources Set of versions of the non-CMS products LHCXX tar-ball with installation scripts (CERN) binaries

05/11/2001 CPT week Natalia Ratnikova, FNAL 2 What is DAR DAR stands for Distribution After Release. This is a CMS software distribution tool which allows to create and install binary distributions of SCRAM managed projects. It may be also considered as a SCRAM extension for the CMS software distribution needs. DAR is not intended to substitute any of existing functionalities of SCRAM. DAR distribution is based on a completely built and validated installation of the SCRAM managed project release available through the scram database. Currently DAR provides applications distribution. It replicates executables from the project bin directory, all required shared libraries and runtime environment. DAR sources consist of bash written framework and Perl module library, including DAR distribution, installation function and interface to SCRAM.

05/11/2001 CPT week Natalia Ratnikova, FNAL 3 How It Works Synopsis: dar - c For example: dar – c $CMS_PATH/Releases/ORCA/ORCA_5_3_2 /scratch/dar_tmp DAR analyses the output from scram runtime –sh command and creates export script for each environment variable that refers to file, directory or a set of directories (PATH-like variables). It also creates a template, which is used to create runtime_env.csh and runtime_env.sh scripts during installation. Unless in test mode, dar executes export scripts and creates a tar-file, including all auxiliary information.

05/11/2001 CPT week Natalia Ratnikova, FNAL 4 How It Works Installation: The installation of the dar created distribution does not imply any special privileges except for the write access in the installation directory. DAR will create directory named version, containing bin/, lib/ and other directories corresponding to the runtime environment and scripts to set environment. The configurable (external) directories have the name of the corresponding environment variable; the directories relative to the release top directory (from the Runtime file) keep their internal directory structure. dar - i version_dar.tar.gz

05/11/2001 CPT week Natalia Ratnikova, FNAL 5 DAR General Features DAR does not require any compilation or installation. All that is needed is a read access to dar (framework) and dar.pm (perl module library) files. You can call dar from any location, just specifying the path to it; the only requirement is that both dar and dar.pm files reside at the same directory. In addition to mandatory –c (create) or –i (install) options dar supports –h (help), -v(version), -t (test); prints out available space in the installation directory; checks libraries to be exported with ldd (optional); saves output from executing export scripts in a log file. This provides additional verifications of the configuration. DAR is platform independent, project independent.

05/11/2001 CPT week Natalia Ratnikova, FNAL 6 Summary Automatic binary distribution of applications in SCRAM managed projects is provided and works. It is extendable, flexible, easy to use and to maintain. Platform and project independent Applications can be used anywhere where the build is not required. It is especially crucial for the mass production, as it insures that the same set of programs is used. It can provide additional checks of configuration and saves time on distribution and installation. The code is designed to be extendible and flexible Dar creates distribution of the basic release as well as private applications from the development space

05/11/2001 CPT week Natalia Ratnikova, FNAL 7 Nearest Plans (dar 1) : Create distributions and provide for public use (license issues need to be clarified). Prepare distribution for the Big MinBias production Implement self-upgrade of DAR versions. Future plans: (dar 2) : Automate binary distribution of the external tools; Export SCRAM managed projects including build system Other suggestions?