Jenkins Work-Flow Improvements and CMake Find-Module Standardization

Slides:



Advertisements
Similar presentations
Jenkins User Conference San Francisco, Sept #jenkinsconf Business Process Model & Notation (BPMN) Workflows in Jenkins Max Spring Cisco
Advertisements

Building ontologies using Jenkins. Changing requirements for ontology engineering Original ontology build pipeline – What pipeline? – Life on the bleeding.
SOFTWARE PRESENTATION ODMS (OPEN SOURCE DOCUMENT MANAGEMENT SYSTEM)
Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
Automating Drupal Deployment Dominique De Cooman.
First Indico Workshop Conversion Server Thomas Baron May 2013 CERN.
Windows.Net Programming Series Preview. Course Schedule CourseDate Microsoft.Net Fundamentals 01/13/2014 Microsoft Windows/Web Fundamentals 01/20/2014.
What’s New in Kinetic Task 3.0 Ben Christenson 3 About Me  Ben Christenson  Employee at Kinetic Data for 13 years and a member of the Product Development.
Apache Server The Apache Server Apache is a WWW server that implements the HTTP protocol. Apache runs as a daemon. This means that it is a resident.
Tools and software process for the FLP prototype B. von Haller 9. June 2015 CERN.
AUTOBUILD Build and Deployment Automation Solution.
09/04/2008 Wallops Institutional Information Management System WIIMS An Overview.
Business Unit or Product Name © 2007 IBM Corporation Introduction of Autotest Qing Lin.
CERN IT Department CH-1211 Genève 23 Switzerland t Service Management GLM 15 November 2010 Mats Moller IT-DI-SM.
CMDB Ticketing Billing Management Systems VIRTUAL MACHINE CLOUDS 12 SQL SERVER 9 PLANS 12 WEBSITE CLOUD 12 MYSQL SERVERS 0 NOTIFICATIONS 0 USER.
Eric Holtel.  Introduction  Project Description  Demonstration  Deliverables  Conclusion.
Development Environment Matthew Sell, CSSE Student MASS Research Participant, October 2014.
Continuous Integration and Code Review: how IT can help Alex Lossent – IT/PES – Version Control Systems 29-Sep st Forum1.
What’s new in Kentico CMS 5.0 Michal Neuwirth Product Manager Kentico Software.
ESafe Open Modules Overview Open modules implementing the eSafe document exchange protocol.
Wordpress with Mina Automated Deployment Solution Jonathan Gravato DIG 4104c.
B. Hegner, P. Mato, P. Mendez CERN, PH-SFT Group 1 ST FORUM CERN 28-SEP-2015 THE QUALITY AND TESTING INFRASTRUCTURE OF PH-SFT.
Isolated Database Environments Kevin Howell February 2014.
Optimal Pipeline Using Perforce, Jenkins & Puppet Nitin Pathak Works on
CERN IT Department t LHCb Software Distribution Roberto Santinelli CERN IT/GS.
BODY From Source Code Management to Daily Build Soren Klemmensen, Kamil Sacek & Luc van Vugt
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Build automation. Prerequisites for Continuous Integration (CI)  Version Control System  Build automation  Notification on build result sent to related.
A python-based testing infrastructure Colin Bernet (IPNL)
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
Software Deployment & Release 26/03/2015 1EN-ICE.
SFT Summer Student Proposals 9 th February CERN Summer Student Programme  PH has been allocated 91 MS students (SFT quota 6-7)  submit request.
Interactions & Automations
EWS Redesign Business Case A look at creating a reports client for new or small market participants.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
Briefing and Planning meeting on INSPIRE validator implementation – Discussion 16/12/2015.
Configuration Services at CERN HEPiX fall Ben Jones, HEPiX Fall 2014.
Jenkins Configuration Build Jobs Build Jobs Cogniteam jobBeersheva jobTechnion Job 1. Copy repository from Github to Jenkins server 2. Makefile Compile+link+
Instrumenting CernVM-FS Code José Molina Colmenero CERN PH-SFT 1June 29th 2015.
HEPiX Virtualisation working group Andrea Chierici INFN-CNAF Workshop CCR 2010.
#! Phil Norton Getting Started With Jenkins and Drupal DrupalCampNW 2013.
Open-O Integration Project Introduction
Jason Bury Dylan Drake Rush Corey Watt
StackStorm: DevOps to ChatOps
ArcGIS Workflow Manager: Advanced Workflows and Concepts
ADVANCED BATCH.
z/Ware 2.0 Technical Overview
Integration Methodology and Procedures
Marc-Elian Bégin ETICS Project, CERN
IW2D migration to HTCondor
Mr. Gerkins InnerSource's first open tool
Work report Xianghu Zhao Nov 11, 2014.
Automatic RElease Service
IT Atoumation / Conf. Mgmt...
Say Hello to my Little Friend - Fedora Messaging Infrastructure
Zanata Translation platform Alex Eng Presented by
Using Jenkins for your DSC CI Pipeline
April Webinar: Advanced Configuration of Order Forms in Workflow
Simplified Development Toolkit
Exploring the Power of EPDM Tasks - Working with and Developing Tasks in EPDM By: Marc Young XLM Solutions
Presented By - Avinash Pawar
Module 01 ETICS Overview ETICS Online Tutorials
JENKINS TIPS Ideas for making your life with Jenkins easier
We Design Your Success....
Configuration management suite
Node.js Test Automation using Oracle Developer Cloud- Simplified
Status and plans for bookkeeping system and production tools
PyWBEM Python WBEM Client: Overview #2
Overview on CI Use JJB (Jenkins Job Builder) to manage Jenkins jobs.
Interoperability Testing
Presentation transcript:

Jenkins Work-Flow Improvements and CMake Find-Module Standardization Martin Storø Nyfløtt CERN Summer Student 01.08.2016 Supervisor: Patricia Mendez Lorenzo

Outline Jenkins-GitHub Workflow Today Automating of CMake external packages update process CMake find-modules Jenkins email templates Conclusion

Jenkins-GitHub Workflow Today You push something to GitHub Jenkins realizes there is a change by polling e.g. each 10th minute Executes job: Pull changes, compile, run tests, etc. Publish result If failed, email is sent with build log

Jenkins and GitHub Integration Problem: Single Sign-On (SSO) Configuring resources outside SSO Stack: CentOS 7, Apache, Jenkins Reviewing with IT-security (Sebastian Lopienski) Suggested modules: mod_security and mod_evasive Implementation of shared secret mechanism with GitHub (Pull request) Pull request: https://github.com/jenkinsci/github-plugin/pull/129 How to set up: https://ep-dep-sft.web.cern.ch/Jenkins-HowTo

Automating CMake External Package Updating On new version of external module: Clone repo Tar repo Upload to AFS Update version numbers in CMake files Start job in Jenkins Fully automated in Python Script triggers on logged events from GitHub web-hooks https://gitlab.cern.ch/mstorony/lcgcmake-module-updater

CMake Find Modules Inconsistency: File names, variable names, flow Lack of documentation Deprecation of APIs/directives Proposal of guidelines and actions

Jenkins Email Templates Need for better email notifications Implemented with Email-ext plugin Implemented in Groovy, tap directly into the Jenkins API Tight cooperation with Axel Neumann Being used at root-incremental, lcg_ext_dev2, lcg_ext_dev3, lcg_ext_dev4, cling-generic-build Configurable for each project (Commit linking) https://gitlab.cern.ch/mstorony/phsft-jenkins-email-template/

Jenkins GitHub Workflow Future You push something to GitHub GitHub tells Jenkins there is a change Executes job: Pull changes, compile, run tests, etc. Publish result If failed, human-readable email is sent out

Conclusion Misleading documentation OSS contribution More efficient work-flow with GitHub Improved email notifications Automation of time-consuming tasks (CMake) Fun times

Questions martin.storo.nyflott@cern.ch Happy Swiss national holiday!