A DΙgital Library Infrastructure on Grid EΝabled Technology Release Beta Deployment Testing Plans Pedro Andrade

Slides:



Advertisements
Similar presentations
TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.
Advertisements

Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
Configuration management
Introduction to Maven 2.0 An open source build tool for Enterprise Java projects Mahen Goonewardene.
Project Management Summary Castor Development Team Castor Readiness Review – June 2006 German Cancio, Giuseppe Lo Presti, Sebastien Ponce CERN / IT.
A DΙgital Library Infrastructure on Grid EΝabled Technology Release BETA Release BETA Build Plan Geneva - 1 March 2007 Paolo Fabriani
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
Software Frameworks for Acquisition and Control European PhD – 2009 Horácio Fernandes.
Microsoft Visual Source Safe 6.01 Microsoft Visual Source Safe (MVSS) Presented By: Rachel Espinoza.
31/10/2000NT Domain - AD Migration - JLab 2000 NT DOMAIN - ACTIVE DIRECTORY MIGRATION Michel Jouvin LAL Orsay
This chapter is extracted from Sommerville’s slides. Text book chapter
Configuration Management Process and Environment MACS Review 1 February 5th, 2010 Roland Moser PR a-RMO, February 5 th, 2010 R. Moser 1 R. Gutleber.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
High-Speed, High Volume Document Storage, Retrieval, and Manipulation with Documentum and Snowbound March 8, 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Release Process Maria Alandes Pradillo.
AUTOBUILD Build and Deployment Automation Solution.
Copyright © 2011 EMC Corporation. All Rights Reserved. MODULE – 6 VIRTUALIZED DATA CENTER – DESKTOP AND APPLICATION 1.
 To explain the importance of software configuration management (CM)  To describe key CM activities namely CM planning, change management, version management.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
Configuration Management (CM)
INFSOM-RI Juelich, 10 June 2008 ETICS - Maven From competition, to collaboration.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
A DΙgital Library Infrastructure on Grid EΝabled Technology ETICS Usage in DILIGENT Pedro Andrade
How to Install and Use the DQ2 User Tools US ATLAS Tier2 workshop at IU June 20, Bloomington, IN Marco Mambelli University of Chicago.
A. Sim, CRD, L B N L 1 OSG Applications Workshop 6/1/2005 OSG SRM/DRM Readiness and Plan Alex Sim / Jorge Rodriguez Scientific Data Management Group Computational.
DORII Joint Research Activities DORII Joint Research Activities Status and Progress 6 th All-Hands-Meeting (AHM) Alexey Cheptsov on.
A DΙgital Library Infrastructure on Grid EΝabled Technology Release Beta Build and Deployment Testing.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks General relationships with EGEE JRA1 SA3.
Luminance.  Major group refactoring.  Development Lead: Stephen Damm.  Project Manager: Martina Nagy.  Test team member: Chet Collins.  A lot of.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GStat 2.0 Joanna Huang (ASGC) Laurence Field.
INFSO-RI Enabling Grids for E-sciencE SCDB C. Loomis / Michel Jouvin (LAL-Orsay) Quattor Tutorial LCG T2 Workshop June 16, 2006.
SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Development Tools Andres Abad Rodriguez SA2.4 Tools Activity Leader.
CERN IT Department t LHCb Software Distribution Roberto Santinelli CERN IT/GS.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
1 Object-Oriented Analysis and Design with the Unified Process Figure 13-1 Implementation discipline activities.
Nanbor Wang, Balamurali Ananthan Tech-X Corporation Gerald Gieraltowski, Edward May, Alexandre Vaniachine Argonne National Laboratory 2. ARCHITECTURE GSIMF:
D4Science and ETICS Building and Testing gCube and gCore Pedro Andrade CERN EGEE’08 Conference 25 September 2008 Istanbul (Turkey)
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
© 2005 Global Grid Forum The information contained herein is subject to change without notice Leading the pervasive adoption of grid computing for research.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
EGEE-III INFSO-RI Enabling Grids for E-sciencE JRA1 and SA3 All Hands Meeting December 2009, CERN, Geneva Product Teams –
Maven. Introduction Using Maven (I) – Installing the Maven plugin for Eclipse – Creating a Maven Project – Building the Project Understanding the POM.
Pedro Andrade > IT-GD > D4Science Pedro Andrade CERN European Organization for Nuclear Research GD Group Meeting 27 October 2007 CERN (Switzerland)
Gang Chen, Institute of High Energy Physics Feb. 27, 2012, CHAIN workshop,Taipei Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures.
M.-E. Bégin¹, S. Da Ronco², G. Diez-Andino Sancho¹, M. Gentilini³, E. Ronchieri ², and M. Selmi² ¹CERN, Switzerland, ² INFN-Padova, Italy, ³INFN-CNAF,
DGAS Distributed Grid Accounting System INFN Workshop /05/1009, Palau Giuseppe Patania Andrea Guarise 6/18/20161.
Oracle HFM Implementation Boot Camp Presented by Saravanan Singaravadivelan Developed by Saravanan Singaravadivelan Senior Consultant Qubix International.
1 Tutorial Outline 30’ From Content Management Systems to VREs 50’ Creating a VRE 80 Using a VRE 20’ Conclusions.
Enabling Grids for E-sciencE Claudio Cherubino INFN DGAS (Distributed Grid Accounting System)
11 DEPLOYING AN UPDATE MANAGEMENT INFRASTRUCTURE Chapter 6.
Platform & Maven2 David Šimonek. Certified Engineer Course Agenda What is Maven? Why Maven? NB IDE & Maven NB Platform & Maven.
Joonas Sirén, Technology Architect, Emerging Technologies Accenture
Chris Gavanas 31/08/2016 Summer Student Report.
NA4/medical imaging. Medical Data Manager Installation
Marc-Elian Bégin ETICS Project, CERN
Release BETA Integration Tool Status Geneva – 1 March 2007
Accounting at the T1/T2 Sites of the Italian Grid
Future Test Activities SA3 All Hands Meeting Dublin
ETICS Services Management
Virtualization in the gLite Grid Middleware software process
Module 01 ETICS Overview ETICS Online Tutorials
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
PyWBEM Python WBEM Client: Overview #2
Presentation transcript:

A DΙgital Library Infrastructure on Grid EΝabled Technology Release Beta Deployment Testing Plans Pedro Andrade

Digital Libraries Powered by the Grid Release Beta Meeting - Geneva 2 Outline  Strategy  Deployment Test Tool  ETICS Usage  Infrastructure  Integration Builds  System Deployment Testing

Digital Libraries Powered by the Grid Release Beta Meeting - Geneva 3 Expected Time  Execution times:  Build whole DILIGENT project: approximately 4 hours  Duilb individual subsystems: 10 mins to 1 hour  Deploy test whole DILIGENT poject> approximatly 6 hours (services only!)  Fixing bugs requires some time:  Even using Savane to increase the bigs publication speed  Even with normal developer support

Digital Libraries Powered by the Grid Release Beta Meeting - Geneva 4 Strategy  Libraries:  automatically assigned the status “integrated”  Services  tested using the Deployment Test tool and applied on the Service Archives produced by the build activity  Portlets:  cannot be automatically deployed by the the DL Mgmt  should be cancelled ?  should be manually tested ?  deployment script has to be provided  by whom ?

Digital Libraries Powered by the Grid Release Beta Meeting - Geneva 5 Deployment Test Tool  Based on the Collective Layer functionalities  Using the DL Management client to:  automatically deploy the services to be tested  solve the services dependencies  REQ: undeployment of services  BUG: clients have a different input parameters order  Using the Package Repository client to:  store/get the integration services to be tested  REQ: method to get the Service Archives ID giving the service name  REQ: support the storage of different versions of the same archive  BUG: a local copy of the Service Profile is required by the PR client  ????: should the Service Archive be retrieved from ETICS build server

Digital Libraries Powered by the Grid Release Beta Meeting - Geneva 6 Deployment Test Tool  Is composed by:  Java app to be executed from ETICS  sets up the environment  deploys and starts the DHN  gets service ID from PR  asks DL Management to deploy the service  queries DL Management for the success of the deployment  asks DL Management to undeploy the service (missing)  DL Management and PR clients  Dependent libraries  The Service Profiles are not included in the deployment test tool since now they are available in the Service Archive.

Digital Libraries Powered by the Grid Release Beta Meeting - Geneva 7 ETICS Usage  ETICS usage will be simplified:  dependencies are now solved by the CL  no need to have service-specific testing information  Only one ETICS subsystem/component is needed to host the deployment test tool  Each Service Archive configuration:  sets a dependency over the deployment test tool  ! ! ! test tool will be checked out at each build  defines a test command  REQ: a subsystem configuration to group service archives is needed 7

Digital Libraries Powered by the Grid Release Beta Meeting - Geneva 8 Infrastructure  Use an independent infrastructure to avoid conflicts with the development and pre-prod infrastructures  Can be shared with testing activity:  only “startup” services are shared  each activity registers and uses its own DHNs  deployment testing doesn’t need a gLite infrastructure  But:  which components can be shared without problems ?  DIS-IC, DIS-Register, DIS-Broker  DL Management, Package Repository  which version should be installed ?

Digital Libraries Powered by the Grid Release Beta Meeting - Geneva 9 Integration Builds  Execution of subsystem and project integration builds  REQ: submission of builds from the web app available  REQ: daily project builds automatically executed  REQ: no overwrite of previous results  Build repository and deploy test repository  ????: can have only one repository ?  Time estimation for project level deployment testing:  Services:  project build and deploy test = 1 day  subsystem build and deploy test + bug fixing = 2 cycles in 1 day  major progresses = 1 week (with normal support from developers)  Portlets: ?? (for manual deployment)  Libraries: automatic

Digital Libraries Powered by the Grid Release Beta Meeting - Geneva 10 System Deployment Testing  Is system deployment testing needed ?  no major requirements identified  However, it can be useful to:  understand the limitations of the deployment of the whole system from scratch  produce a list of possible services incompatibilities  provide input for the BMM service deployment strategy  This costs significant effort !