Yannick Patois - Datagrid Software Repository Presentation - March, 5 2001 - n° 1 Datagrid Software Repository Presentation CVS, packages and automatic.

Slides:



Advertisements
Similar presentations
Andrew McNab - Manchester HEP - 24 May 2001 WorkGroup H: Software Support Both middleware and application support Installation tools and expertise Communication.
Advertisements

Makefiles. makefiles Problem: You are working on one part of a large programming project (e. g., MS Word).  It consists of hundreds of individual.c files.
LINUX-WINDOWS INTERACTION. One software allowing interaction between Linux and Windows is WINE. Wine allows Linux users to load Windows programs while.
27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,
Low level CASE: Source Code Management. Source Code Management  Also known as Configuration Management  Source Code Managers are tools that: –Archive.
Apache : Installation, Configuration, Basic Security Presented by, Sandeep K Thopucherela, ECE Department.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
EC Review – 01/03/2002 – G. Zaquine – Quality Assurance – WP12 – CS-SI – n° 1 DataGrid Quality Assurance Gabriel Zaquine Quality Engineer - WP12 – CS-SI.
Julie McEnery1 Installing the ScienceTools The release manager automatically compiles each release of the Science Tools, it creates a set of wrapper scripts.
SEEM4570: XAMPP, Eclipse, Summary of Html Kangfei Zhao Room 711,ERB
Installing Linux softwares Sirak Kaewjamnong. 2 Software packets  When Linux developers create their software they typically bundle all the executable.
Introduction to The Linaro Toolchain Embedded Processors Training Multicore Software Applications Literature Number: SPRPXXX 1.
1 Introduction to Tool chains. 2 Tool chain for the Sitara Family (but it is true for other ARM based devices as well) A tool chain is a collection of.
Version control Using Git 1Version control, using Git.
Linux Operations and Administration
Partner Logo German Cancio – WP4-install LCFG HOW-TO - n° 1 WP4 hands-on workshop: EDG LCFGng exercises
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
Dustin Harman VM Workshop 2015 RPM Basics. What is RPM? Red Hat Package Manager Native package manager on RHEL, Fedora, SUSE, some Mandriva RPM/SRPM files.
Project Source Code Structure and Build Process ● Remember consistency matters as source code structure, build process, and release processes are all intertwined.
Trilinos 101: Getting Started with Trilinos November 7, :30-9:30 a.m. Mike Heroux Jim Willenbring.
Introduction to Android. Android as a system, is a java based operating system that runs on the Linux kernel. The system is very lightweight and full.
C. Loomis – Testbed Status – 28/01/2002 – n° 1 Future WP6 Tasks Charles Loomis January 28, 2002
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
Yannick Patois – CVS and Autobuild tools at CCIN2P3 – hepix - October, n° 1 CVS setup at CC-IN2P3 and Datagrid edg- build tools CVS management,
Apache Web Server v. 2.2 Reference Manual Chapter 1 Compiling and Installing.
Makefiles. makefiles Problem: You are working on one part of a large programming project (e. g., MS Word).  It consists of hundreds of individual.cpp.
Crossgrid kick-off meeting, Cracow, March 2002 Santiago González de la Hoz, IFIC1 Task 3.5 Test and Integration (
Yannick Patois – Datagrid Repository Presentation- 2001/11/21 - n° 1 Partner Logo DataGrid Software Repository presentation A short presentation of the.
INFSOM-RI Juelich, 10 June 2008 ETICS - Maven From competition, to collaboration.
The Basics of Javadoc Presented By: Wes Toland. Outline  Overview  Background  Environment  Features Javadoc Comment Format Javadoc Program HTML API.
Version control Using Git Version control, using Git1.
CERN Manual Installation of a UI – Oxford July - 1 LCG2 Administrator’s Course Oxford University, 19 th – 21 st July Developed.
Netbeans 6.0 version control configuration for AUV Workbench & various XMSF projects TODO: check changes in all Netbeans 5 screens Don Brutzman
The LCG SPI project in LCG Phase II CHEP’06, Mumbai, India Feb. 14, 2006 Andreas Pfeiffer -- for the SPI team
Netbeans 5.0 cvs configuration for AUV Workbench & various XMSF projects Don Brutzman 14 July 2006.
An Intro to Concurrent Versions System (CVS) ECE 417/617: Elements of Software Engineering Stan Birchfield Clemson University.
1Offline Weekly Meeting May May 2006 AliRoot Build Integration and (Testing) System Peter Hristov Vagner Morais.
Partner Logo German Cancio – WP4-install LCFG HOW-TO - n° 1 LCFGng configuration examples Updated 10/2002
1 / 22 AliRoot and AliEn Build Integration and Testing System.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
Netbeans 5.5 version control: cvs, svn configuration for AUV Workbench & various X3D, XMSF projects Don Brutzman 1 December 2007.
Installation of packages Objectives –Using software packaging tools Contents –Application delivered as –Where to get commonly used rpm’s –Autofs on! –Getting.
An overview of EUSO publicaly available software SLAST (Shower Initiated Light Attenuated to the Space Telescope) STAR (Space Telescope Analysis and Reconstruction)
SWGData and Software Access - 1 UCB, Nov 15/16, 2006 THEMIS SCIENCE WORKING TEAM MEETING Data and Software Access Ken Bromund GST Inc., at NASA/GSFC.
Configuring and Troubleshooting Identity and Access Solutions with Windows Server® 2008 Active Directory®
GLite build and integration system Building and Packaging Robert HARAKALY
J.P. Wellisch, CERN/EP/SFT SCRAM Information on SCRAM J.P. Wellisch, C. Williams, S. Ashby.
12 CVS Mauro Jaskelioff (originally by Gail Hopkins)
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Maite Barroso - 10/05/01 - n° 1 WP4 PM9 Deliverable Presentation: Interim Installation System Configuration Management Prototype
ASIS + RPM: ASISwsmp German Cancio, Lionel Cons, Philippe Defert, Andras Nagy CERN/IT Presented by Alan Lovell.
Milan, 15 June 2001WP1 Meeting - F. Donno1 GRID Packaging and Code Management for WP1 F. Donno INFN - Pisa.
Separate distribution of the analysis code (and more) P. Hristov 19/03/2014.
How to configure, build and install Trilinos November 2, :30-9:30 a.m. Jim Willenbring.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
GLite build and integration system Building and Packaging Robert HARAKALY
DataGrid is a project funded by the European Commission under contract IST EDG Baseline API Document Document build description and current.
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
Maite Barroso – WP4 Workshop – 10/12/ n° 1 -WP4 Workshop- Developers’ Guide Maite Barroso 10/12/2002
CACI Proprietary Information | Date 1 PD² v4.2 Increment 2 SR13 and FPDS Engine v3.5 Database Upgrade Name: Semarria Rosemond Title: Systems Analyst, Lead.
An Introduction to Ant. What is Ant? How do you use it? Why would you want to?
1 April 2, Software Packaging and Releasing Best Practices William Cohen NCSU CSC 591W April 2, 2008.
bitcurator-access-webtools Quick Start Guide
Installation of the ALICE Software
SPI external software build tool and distribution mechanism
Version control, using Git
GLAST Release Manager Automated code compilation via the Release Manager Navid Golpayegani, GSFC/SSAI Overview The Release Manager is a program responsible.
More Scripting & Chapter 11
slides borrowed and adapted from Alex Mariakis and CSE 390a
Presentation transcript:

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Datagrid Software Repository Presentation CVS, packages and automatic building Yannick Patois

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Summary  Introduction The repositories Packages and code  Packages Repository Presentation Downloading softwares  Code Repository Browsing the code (CVSweb) Anonymous CVS access Read/Write CVS access  Autobuild system Presentation D6.2 validation page

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Introduction  The Datagrid Software Repository Hosted at CC-IN2P3 Main services:  Source code management for developers (CVS)  Packages distribution (RPMS)  The autobuild/check system Web interface for package download located on

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 r Documentation: See the European Datagrid Installation Guide Download area Packages and CVS access

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Dowloading Software  Lists contains RH linux RPMS  Sorted by: Items (a Globus release) Functionalities (a Computing Element) Version numbered  LCFG A tool to install and upgrade a datagrid farm (automatic upgrade and replication) CVS module 'edg-release' Link to RPMS lists (curently being updated next edg release)

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Package repository  Package type rpm, rpms tar.gz  Package origin RH 6.2 and updates Globus rpms (packaged by edg) Some external packages EDG middleware Some edg applications (wp8, 9 & 10)  Under applications applications/wp10 applications/wp8 applications/wp9 applications/common config datagrid/wp1 datagrid/wp2...6 datagrid/wp7 datagrid/security rh6.2 external globus/beta-20 globus/beta-21 globus/edgconfig rpmlists rpmlists/edg-release rpmlists/ftp.redhat.com

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Browsing the code - CVSweb  CVSweb access Fast access for a quick look on code Host all code from WPs Is up-to-date with the most recent changes Can also host code for some applications

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Anonymous CVS access  Anonymous CVS access is enabled through an ssh tunneling on a non- standard port (2222).  To use anonymous CVS access, you first have to setup CVSROOT and CVS_RSH: $ setenv CVS_RSH ssh $ setenv CVSROOT  The configuration of the ~/.ssh/config should be as follow: Host datagrid.in2p3.fr Protocol 2 Port 2222 PasswordAuthentication yes PubkeyAuthentication no Compression no User anoncvs  You can now access the repository with usual CVS commands, but only read-only operations will be allowed (checkout, log, etc).

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Read/Write CVS access

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Autobuild System  Purpose Build on a standard platform Create packages for distribution Check functionalities  Some of what is currently done: Identify and checkout the latest tagged version of a module Try to compile it, install it, generate the API documentation and generate packages (RPM, SPRM and tar.zg sources). Check various points regarding D6.2 conformance.

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Autobuild System : result page Note: a few (questionable) modules removed from this figure

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 D6.2 conformance: result Note: a few (questionable) modules removed from this table

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 D6.2 conformance: what is checked (1)  The module name list is manually generated from the list of rpms packages, following the concept of "One package, one module".  CVS tag Tag against which the build attempt was made. HEAD means "latest CVS version", and it's bad If the tag is not in the recommended form (vx_y_z), a warning is issued Important note: Tags cannot be retrieved properly if there is no README file !  README, INSTALL and LICENSE An error appears if the requested file was not found at the module root For the LICENSE item, LICENSE or COPYING file name can be used  Virtual Module Every module should be top-level (at the CVS root) really or virtually (through CVSROOT/modules). An error is reported if it's not the case.

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 D6.2 conformance: what is checked (2)  Autotools, Configure, Make, Make install, Make dist, Make RPM, Make apidoc, Make userdoc, Make check Success or failed attempt when running the corresponding build command The test is quite basic at this point, and success show only that the target does exist in the Makefile and produced no errors when run, but absolutely not that the object has been successfully generated  Build Method Which build method was deduced by the script as being appropriated to this module. Right now there are:  Unknown  AutoTools+ Autotools with a "recursive_bootstrap" script  AutoTools Autotools with a "bootstrap" script  Configure Only a "configure" script  Makefile A Makefile  Ant Ant script (Java build tool)

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 D6.2 conformance: what is checked (3)  Task for each target: all  Compile what has to be compiled, create executable install  Install executables, and library to it's proper location dist  Create a tag.gz archive of the source code that can be distributed rpm  Create rpm and srpm archives. As a side effect, it should also create a source tar.gz archive in $TOPDIR/SOURCES  Task for each target (... continuing) apidoc  Generate API auto-documentation (usually through doxygen for C/C++ and JavaDoc for Java). A directory called 'apidoc' should contain this doc check  Not yet defined  RPMS, SRPMS, tar.gz Check the existence of the generated packages (binary rpms, source rpms and source tarball) in the $TOPDIR directory

Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 D6.2 conformance: result Note: a few (questionable) modules removed from this table