NIGHTLY BUILD SCRIPT FOR THE LEVEL-1 TRIGGER ONLINE SOFTWARE

Slides:



Advertisements
Similar presentations
TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.
Advertisements

Introduction to JavaScript
Optinuity Confidential. All rights reserved. C2O Configuration Requirements.
Chapter Apache Installation in Linux- Mandrake. Acknowledgment The following information has been obtained directly from
CGI and Perl MSc Publishing on the WWW. What is CGI ? (1) User Buying and selling Playing games Customised web pages Developer Means to run external programs.
APACHE SERVER By Innovationframes.com »
SEEM4570: XAMPP, Eclipse, Summary of Html Kangfei Zhao Room 711,ERB
C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.
Software Tools and Processes Training and Discussion October 16, :00-4:30 p.m. Jim Willenbring.
Trilinos 101: Getting Started with Trilinos November 7, :30-9:30 a.m. Mike Heroux Jim Willenbring.
Business Unit or Product Name © 2007 IBM Corporation Introduction of Autotest Qing Lin.
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
Yannick Patois – CVS and Autobuild tools at CCIN2P3 – hepix - October, n° 1 CVS setup at CC-IN2P3 and Datagrid edg- build tools CVS management,
NICOS System of Nightly Builds for Distributed Development Alexander Undrus CHEP’03.
INFSO-RI Enabling Grids for E-sciencE The GENIUS Grid portal Tony Calanducci INFN Catania - Italy First Latin American Workshop.
TEAM Basic TotalElectrostatic ManagementAwareness&
C.Combaret, L.Mirabito Lab & beamtest DAQ with XDAQ tools.
CERN Manual Installation of a UI – Oxford July - 1 LCG2 Administrator’s Course Oxford University, 19 th – 21 st July Developed.
Overview of LHCb applications and software environment LHCb software tutorial - March
1 © Netskills Quality Internet Training, University of Newcastle HTML Forms © Netskills, Quality Internet Training, University of Newcastle Netskills is.
ALICE, ATLAS, CMS & LHCb joint workshop on
CERN-PH-SFT-SPI August Ernesto Rivera Contents Context Automation Results To Do…
Servicing HEP experiments with a complete set of ready integrated and configured common software components Stefan Roiser 1, Ana Gaspar 1, Yves Perrin.
Module: Software Engineering of Web Applications Chapter 2: Technologies 1.
Scripting Languages Client Side and Server Side. Examples of client side/server side Examples of client-side side include: JavaScript Jquery (uses a JavaScript.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Datagrid Software Repository Presentation CVS, packages and automatic.
Understand Windows Services Software Development Fundamentals LESSON 5.3.
K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
Benchmark 2 progress report and future directions Sergey Lyskov
Outline Server side Dependencies Installing it Configuring it Client side coding Browser setup.
Geant4 is a toolkit to simulate the passage of particles through matter, and is widely used in HEP, in medical physics and for space applications. Ongoing.
1. Starting 1 Let’s Learn Saenthong School, January – February 2016 Teacher: Aj. Andrew Davison, CoE, PSU Hat Yai Campus
How to configure, build and install Trilinos November 2, :30-9:30 a.m. Jim Willenbring.
CERN Tutorial, September Overview of LHCb applications and software environment.
7/8/2016 OAF Jean-Jacques Gras Stephen Jackson Blazej Kolad 1.
SPI Report for the LHCC Comprehensive Review Stefan Roiser for the SPI project.
WampServer 2 Installation WAMP is a solution stack of open source programs used together to run dynamic Web sites or servers Most common expansion:  Windows,
1 Chapter 1 INTRODUCTION TO WEB. 2 Objectives In this chapter, you will: Become familiar with the architecture of the World Wide Web Learn about communication.
Architecture Review 10/11/2004
Fundamental of Databases
IWS/Graph – Product Presentation
Build and Test system for FairRoot
Installation of the ALICE Software
How to Contribute to System Testing and Extract Results
Connect:Direct for UNIX v4.2.x Silent Installation
Marc-Elian Bégin ETICS Project, CERN
SPI external software build tool and distribution mechanism
Cross Platform Development using Software Matrix
ATLAS Software Distribution
Generator Services planning meeting
LCGAA nightlies infrastructure
GLAST Release Manager Automated code compilation via the Release Manager Navid Golpayegani, GSFC/SSAI Overview The Release Manager is a program responsible.
The ATLAS software in the Grid Alessandro De Salvo <Alessandro
Managing Software.
The ETICS Build and Test Service
Chapter 10: Device Discovery, Management, and Maintenance
PHP / MySQL Introduction
First Internal Pool Release 0.1
Database Driven Websites
Testing REST IPA using POSTMAN
Let's Learn Python and Pygame
Chapter 10: Device Discovery, Management, and Maintenance
Cmake Primer.
BSc in Digital Media, PSUIC
Time Gathering Systems Secure Data Collection for IBM System i Server
Web Servers (IIS and Apache)
Web Application Development Using PHP
Presentation transcript:

NIGHTLY BUILD SCRIPT FOR THE LEVEL-1 TRIGGER ONLINE SOFTWARE 14th October 2010 Wolfgang Schlichtner

Introduction Aim: Build and test all the source code together Execute automatically every night Show the results via web interface > So the developers can take a look at the build results of the whole system every morning 14th October 2010 Wolfgang Schlichtner

Conditions Based on LCG Nightly Builds Runs on SLC4 32bit, gcc-3.4 Language: Python 14th October 2010 Wolfgang Schlichtner

Steps of the nightly script • Setup of the environment for build and installation • Checkout of the source code from the CVS Repository • Installation of XDAQ • Compilation of the source codes • Generation of RPMs (Red Hat Package Manager software packages) • Installation of the RPMs • Execution of SOAP-tests • Uninstallation of everything 14th October 2010 Wolfgang Schlichtner

Incorporate other L1TS subsystems Requirements: makefile to compile code and make RPMs test scripts (e.g. SOAP-Tests) 14th October 2010 Wolfgang Schlichtner

Client / Server structure One configuration.xml file How LCG nightlies work ... Client / Server structure One configuration.xml file Clients send their capabilities (architecture, OS, …) to the server, server starts the build jobs according to the configuration … 14th October 2010 Wolfgang Schlichtner

specify projects, platforms,… to build configuration.xml specify projects, platforms,… to build : <slot name="CMS-l1ts" description="CMS L1 Online Software"> <paths> <path name="builddir" value="/build/nightlies/%SLOT%/%DAY%" /> <path name="buildersdir" value="/build/nightlies/%SLOT%/%DAY%/LCGCMT..." /> <path name="releasedir" value="/afs/cern.ch/sw/lcg..." /> <path name="wwwdir" value="/afs/cern.ch/sw/lcg/app/nightlies/www..." /> </paths> <platforms> <platform name="slc4_ia32_gcc34" priority="1"/> </platforms> <days mon="true" tue="true" wed="true" thu="true" fri="true" ... /> <projects> <project name="CMS-l1ts" tag="CMS-l1ts-HEAD" /> </projects> </slot> 14th October 2010 Wolfgang Schlichtner

Ignore warnings/errors <warning value="PUT HERE WARNING MESSAGES IF YOU WANT TO IGNORE THEM"/> <error value="PUT HERE ERROR MESSAGES IF YOU WANT TO IGNORE THEM"/> </ignore> 14th October 2010 Wolfgang Schlichtner

Implementation to the LCG scripts There is just one main Builder class for all the LCG projects Therefore Karol from LHCb changed the scripts, so that external Builder classes can be used, this work is still in progress No documentation!  try & error 14th October 2010 Wolfgang Schlichtner

How to get our builder loaded by the server... export NIGHTLIES_EXTENSIONS=L1TS_Nightlies (name of the builder-module) export PYTHON_PATH=/path/to/the/builder/module:$PYTHON_PATH add line: __lcgnightlies_extenions__ = {“builder”}: [Name-of-builder-class]} at the bottom of the builder file method canBuild is needed to specify which projects the builder class can build to start the build-process, the server starts the buildProject() method of the builder class 14th October 2010 Wolfgang Schlichtner

after the build steps finished: checkLogFiles.checkBuildLogs: creates the build-html file and a summary file with the numbers of warnings/errors for the website WebUpdater.updateWeb: copies the html, summary and test-log file to the afs-dir for the webpage WebUpdater.updateDB: sends the results to the DB of the webpage, also checkLogFiles.checkTestLogs is called from within here checkTestLogs: had to be changed for our needs checkBuildLogs: I rewrote and simplified this html generator 14th October 2010 Wolfgang Schlichtner

How to start the nightly builds ... by acrontab: 0 0 * * * machine exec /afs-path/check_server.sh <machine> <port> /afs-path/configuration.xml 0 2 * * * machine exec /afs-path/resetServer.py –-machine=<machine> –-port=<port> 0 5 * * * machine exec /afs-path/launch_client.sh <machine> <port> the build-user (which defined the acron-jobs) needs rights for all of the used afs-dirs, the build-dir on the build-machine and a sudo without password request 14th October 2010 Wolfgang Schlichtner

The results of the nightly build ... are sent to the developers by email: 2010-08-26 15:23:30,400 INFO (WebUpdater.py:122) Errors found in log file for CMS-l1ts-HEAD slot CMS-l1ts while building for slc4_ia32_gcc34 Number of Warnings 0 Number of Errors 0 Number of Make Errors 0 Number of CMT  Errors 0 are shown on the nightly webpage 14th October 2010 Wolfgang Schlichtner

Thanks for your attention! 14th October 2010 Wolfgang Schlichtner