Transactional Grid Deployment

Slides:



Advertisements
Similar presentations
Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway.
Advertisements

Geoff Quigley, Stephen Childs and Brian Coghlan Trinity College Dublin
Configuration management
1 Multi-Grid and Multi-VO Job Submission based on a Unified Computational Model Krakow Grid Workshop, November 22nd 2005 Trinity College Dublin Mr. Oliver.
Validata Release Coordinator Accelerated application delivery through automated end-to-end release management.
INFSO-RI Enabling Grids for E-sciencE Irish ROC - Report John Walsh Stephen Childs Eamonn Kenny Kathryn Cassidy Brian Coghlan.
27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Release Process Maria Alandes Pradillo.
70-294: MCSE Guide to Microsoft Windows Server 2003 Active Directory Chapter 12: Deploying and Managing Software with Group Policy.
WP4-install task report WP4 workshop Barcelona project conference 5/03 German Cancio.
EGEE is a project funded by the European Union under contract IST JRA1 Testing Activity: Status and Plans Leanne Guy EGEE Middleware Testing.
The National Computational Grid for Ireland OpsCentre Infrastructure Staff TestGrid Porting Current Issues Future Plans Grid-Ireland OpsCentre.
Combining a Virtual Grid Testbed and eLearning Courseware Kathryn Cassidy, Jason McCandless, Stephen Childs, John Walsh, Brian Coghlan, Declan Dagger Department.
INFSO-RI Enabling Grids for E-sciencE Status of LCG-2 porting Stephen Childs, Brian Coghlan and Eamonn Kenny Grid-Ireland/EGEE October.
J.T Moscicki CERN LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Software Packaging and Distribution LCG Application.
Configuration Management (CM)
GridPP DB 12 th July 2007 Enabling Grids for E-sciencE Grid-Ireland Status John Walsh Date: 12 th July 2007Imperial College London.
Cracow Grid Workshop Grid Software Installation Tools
05/29/2002Flavia Donno, INFN-Pisa1 Packaging and distribution issues Flavia Donno, INFN-Pisa EDG/WP8 EDT/WP4 joint meeting, 29 May 2002.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
DataGRID WPMM, Geneve, 17th June 2002 Testbed Software Test Group work status for 1.2 release Andrea Formica on behalf of Test Group.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
Preparation for Integration Organized access to the code WP6 infrastructure (MDS-2, RC, …) Input from WPs on requirements,... Acquire experience with Globus.
Universal Acessibility to the Grid via Metagrid Infrastructure Soha Maad, Brian Coghlan, Eamonn Kenny, Gabriele Pierantoni, Oliver Lyttleton, David O'Callaghan.
Alain Roy Computer Sciences Department University of Wisconsin-Madison Condor & Middleware: NMI & VDT.
LCG LCG-1 Deployment and usage experience Lev Shamardin SINP MSU, Moscow
Maite Barroso - 10/05/01 - n° 1 WP4 PM9 Deliverable Presentation: Interim Installation System Configuration Management Prototype
WLCG Software Lifecycle First ideas for a post EMI approach 0.
Continuous Integration CruiseControl.Net. Best Practices Use version control; Automate the build; Build should be self tested; Developers must commit.
LCG CERN David Foster LCG WP4 Meeting 20 th June 2002 LCG Project Status WP4 Meeting Presentation David Foster IT/LCG 20 June 2002.
EGEE-II INFSO-RI Enabling Grids for E-sciencE YAIM Overview MiMOS Grid tutorial HungChe, ASGC OPS Team.
David Foster LCG Project 12-March-02 Fabric Automation The Challenge of LHC Scale Fabrics LHC Computing Grid Workshop David Foster 12 th March 2002.
OSG Deployment Preparations Status Dane Skow OSG Council Meeting May 3, 2005 Madison, WI.
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
Grid testing using virtual machines Stephen Childs*, Brian Coghlan, David O'Callaghan, Geoff Quigley, John Walsh Department of Computer Science Trinity.
Grid-Ireland test facilities Stephen Childs Dept. of Computer Science Trinity College Dublin.
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Stephen Childs Trinity College Dublin &
GridPP2 Data Management work area J Jensen / RAL GridPP2 Data Management Work Area – Part 2 Mass storage & local storage mgmt J Jensen
CERN Openlab Openlab II virtualization developments Havard Bjerke.
Enterprise Wide Information Systems SAP R/3 Overview & Basis Technology Instructor: Richard W. Vawter.
Packaging and Deploying Windows Applications
Testbed: Status & Plans
Grid-Ireland Gateway Architecture
SAP Overview.
Status & Strategy for gLite multi-platform Support
Regional Operations Centres Core infrastructure Centres
Operations Status Report
Universal Acessibility to the Grid via Metagrid Infrastructure
Current deployment status
EO Applications Parallel Session
Overview – SOE PatchTT November 2015.
WP4 Fabric Management 3rd EU Review Maite Barroso - CERN
Overview – SOE PatchTT December 2013.
Grid related projects CERN openlab LCG EDG F.Fluckiger
Unix Provisioning Manager
WP4-install status update
Stephen Childs Trinity College Dublin
LCGAA nightlies infrastructure
WP1 activity, achievements and plans
Leanne Guy EGEE JRA1 Test Team Manager
James Miller, Julia John
LCG experience in Integrating Grid Toolkits
Leigh Grundhoefer Indiana University
Making the System Operational Implementation & Deployment
Porting LCG to IA64 Andreas Unterkircher CERN openlab May 2004
The EU DataGrid Fabric Management Services
gLite The EGEE Middleware Distribution
Presentation transcript:

Transactional Grid Deployment Geoff Quigley*, Brian Coghlan, John Walsh, David O’Callaghan, Stephen Childs and Eamonn Kenny

Grid-Ireland Transactional Deployment Overview Grid-Ireland Need for Transactional Deployment Design and implementation Infrastructure availability December 2004 Grid-Ireland Transactional Deployment

Grid-Ireland Transactional Deployment Irish National Computational Grid 6 sites now, 17 sites by Feb’05 Production environment LCG-2.2.0 Middleware Grid Operations Centre in TCD Homogeneous infrastructure Grid-Ireland owns infrastructure Heterogeneous compute resources Sites own their resources December 2004 Grid-Ireland Transactional Deployment

Grid-Ireland Infrastructure Infrastructure = grid gateway per site Gateway = fw/LCFG/CE/SE/UI/MON/NM LCFGng used to manage gateway Install/maintain the correct packages Configure some software LCFGng can be used to maintain site Sites mostly do not use the gateway LCFG to manage their resources (WNs) In Grid Ireland we are actually using an EDG version of LCFGng. December 2004 Grid-Ireland Transactional Deployment

Grid-Ireland Transactional Deployment Why Transactional? Quickly move the whole infrastructure between consistent states 2-phase transactions = prepare + commit Commit can be very quick Changes can be rolled back Automation reduces deployment errors Increases availability of infrastructure December 2004 Grid-Ireland Transactional Deployment

Transactional Deployment Distributes profiles, RPMs and RPM lists to LCFGng servers Automates the building of new profiles Detects errors Has rollback capability Automatically rollback if deployment fails Option to rollback successful deployments December 2004 Grid-Ireland Transactional Deployment

Grid-Ireland Transactional Deployment Architecture December 2004 Grid-Ireland Transactional Deployment

Grid-Ireland Transactional Deployment Web Client December 2004 Grid-Ireland Transactional Deployment

Grid-Ireland Transactional Deployment Deployment Delay s Delay in sites deploying release Shown here for CrossGrid production and development testbeds MTTC=Mean Time To Consistency December 2004 Grid-Ireland Transactional Deployment

Grid-Ireland Transactional Deployment Release Intervals MTBR=Mean Time Between Releases Availability: A=MTBR/(MTBR+MTTC) A = 94% [prod.TB] A = 87% [dev.TB] Too early to measure availability with transactional deployment December 2004 Grid-Ireland Transactional Deployment

Grid-Ireland Transactional Deployment Current Status We estimate availability of the core infrastructure increases to >99.8% Transactional Deployment under intensive test/evaluation on Grid-Ireland Automation reduces errors Very easy to use Intend to extend to include Quattor 5 mins to see change + time to update Will try to be involved in community effort on Quattor - if necessary will put the transactional deploy stuff into Quattor rather than the other way around December 2004 Grid-Ireland Transactional Deployment