Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has.

Slides:

Advertisements

Similar presentations

LNL M.Biasotto, Roma, 22 novembre Some notes on WP6 INFN Testbed.

Advertisements

GridPP Meeting, Cambridge, 15 Feb 2002 Paul Mealor, UCL UCL Testbed 1 status report Paul Mealor.

Andrew McNab - Manchester HEP - 10 May 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –What are other sites doing? –What are.

Andrew McNabTestbed / HTTPS, GridPP6, 30 Jan 2003Slide 1 UK Testbed Status Andrew McNab High Energy Physics University of Manchester.

Status Report University of Bristol 3 rd GridPP Collaboration Meeting 14/15 February, 2002Marc Kelly University of Bristol 1 Marc Kelly University of Bristol.

User Board - Supporting Other Experiments Stephen Burke, RAL pp Glenn Patrick.

Stephen Burke - WP8 Status - 14/2/2002 Partner Logo WP8 Status Stephen Burke, PPARC/RAL.

Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.

Partner Logo UK GridPP Testbed Rollout John Gordon GridPP 3rd Collaboration Meeting Cambridge 15th February 2002.

Andrew McNab - Manchester HEP - 24 May 2001 WorkGroup H: Software Support Both middleware and application support Installation tools and expertise Communication.

Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.

Presenter Name Facility Name EDG Testbed Status Moving to Testbed Two.

Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.

Andrew McNab - Manchester HEP - 31 January 2002 Testbed Release in the UK Integration Team UK deployment TB1 Job Lifecycle VO: Authorisation VO: GIIS and.

Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.

Andrew McNab - EDG Access Control - 14 Jan 2003 EU DataGrid security with GSI and Globus Andrew McNab University of Manchester

Andrew McNab - Manchester HEP - 6 November Old version of website was maintained from Unix command line => needed (gsi)ssh access.

BaBarGrid: Some UK developments Roger Barlow Imperial College 13th September 2002.

DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.

Joining the Grid Andrew McNab. 28 March 2006Andrew McNab – Joining the Grid Outline ● LCG – the grid you're joining ● Related projects ● Getting a certificate.

EC Review – 01/03/2002 – G. Zaquine – Quality Assurance – WP12 – CS-SI – n° 1 DataGrid Quality Assurance Gabriel Zaquine Quality Engineer - WP12 – CS-SI.

Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps.

Andrew McNab - Manchester HEP - 26 June 2001 WG-H / Support status Packaging / RPM’s UK + EU DG CA’s central grid-users file grid “ping”

WP3 RGMA Deployment Laurence Field / RAL Steve Fisher / RAL.

5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)

Don Quijote Data Management for the ATLAS Automatic Production System Miguel Branco – CERN ATC

Grid Canada CLS eScience Workshop 21 st November, 2005.

Andrew McNab - Manchester HEP - 5 July 2001 WP6/Testbed Status Status by partner –CNRS, Czech R., INFN, NIKHEF, NorduGrid, LIP, Russia, UK Security Integration.

EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,

Support for system administrators Feedback from site admins after Testbed1 experience 05/03/2002 4th EDG WS Paris G. Merino, IFAE.

LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001.

Lessons for the naïve Grid user Steve Lloyd, Tony Doyle [Origin: 1645–55; < F, fem. of naïf, OF naif natural, instinctive < L nātīvus native ]native.

CMS Stress Test Report Marco Verlato (INFN-Padova) INFN-GRID Testbed Meeting 17 Gennaio 2003.

GridPP Collaboration meeting Manchester 9/10 May 2002 P.Clarke Resource Management: Instruments and Procedures Testbed Rollout: Development of Plan Education.

Andrew McNabETF Firewall Meeting, NeSC, 5 Nov 2002Slide 1 Firewall issues for Globus 2 and EDG Andrew McNab High Energy Physics University of Manchester.

Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager

LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001.

First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.

GridPP Presentation to AstroGrid 13 December 2001 Steve Lloyd Queen Mary University of London.

GLite – An Outsider’s View Stephen Burke RAL. January 31 st 2005gLite overview Introduction A personal view of the current situation –Asked to be provocative!

DataGRID WPMM, Geneve, 17th June 2002 Testbed Software Test Group work status for 1.2 release Andrea Formica on behalf of Test Group.

Dave Newbold, University of Bristol8/3/2001 UK Testbed 0 Sites Sites that have committed to TB0: RAL (R) Birmingham (Q) Bristol (Q) Edinburgh (Q) Imperial.

Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.

University of Bristol 5th GridPP Collaboration Meeting 16/17 September, 2002Owen Maroney University of Bristol 1 Testbed Site –EDG 1.2 –LCFG GridPP Replica.

Tier1A Status Andrew Sansum 30 January Overview Systems Staff Projects.

Grid Security Vulnerability Group Linda Cornwall, GDB, CERN 7 th September 2005

Presenter Name Facility Name UK Testbed Status and EDG Testbed Two. Steve Traylen GridPP 7, Oxford.

Andrew McNabSecurity Middleware, GridPP8, 23 Sept 2003Slide 1 Security Middleware Andrew McNab High Energy Physics University of Manchester.

Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.

2-Sep-02Steve Traylen, RAL WP6 Test Bed Report1 RAL and UK WP6 Test Bed Report Steve Traylen, WP6

DataTAG Work Package 4 Meeting Bologna Simone Ludwig Brunel University 23rd and 24th of May 2002.

Andrew McNabGrid in 2002, Manchester HEP, 7 Jan 2003Slide 1 Grid Work in 2002 Andrew McNab High Energy Physics University of Manchester.

Grid Security work in 2004 Andrew McNab Grid Security Research Fellow University of Manchester.

WP7 Middleware Status and Plans Paul Mealor. Contents GridFTP monitoring Network monitoring information in RGMA UK network monitoring.

David Foster LCG Project 12-March-02 Fabric Automation The Challenge of LHC Scale Fabrics LHC Computing Grid Workshop David Foster 12 th March 2002.

The EDG Testbed The European DataGrid Project Team

Site Certification Process (Round Table) Fabio Hernandez IN2P3 Computing Center - Lyon October

15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK

The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

WP1 Status and plans Francesco Prelz, Massimo Sgaravatto 4 th EDG Project Conference Paris, March 6 th, 2002.

Stephen Burke – Sysman meeting - 22/4/2002 Partner Logo The Testbed – A User View Stephen Burke, PPARC/RAL.

Dave Newbold, University of Bristol14/8/2001 Testbed 1 What is it? First deployment of DataGrid middleware tools The place where we find out if it all.

II EGEE conference Den Haag November, ROC-CIC status in Italy

14 June 2001LHCb workshop at Bologna1 LHCb and Datagrid - Status and Planning F Harris(Oxford)

Dave Newbold, University of Bristol21/3/2001 (Short) WP6 Update Where are we? Testbed 0 going (ish); some UK sites being tried out for production (mostly.

June 2000 Globus UK Workshop R. Hughes-Jones Globus Current and Future Organizational / Management uHow do we keep informed of work in UK / HEP? èSimple.

J Jensen / WP5 /RAL UCL 4/5 March 2004 GridPP / DataGrid wrap-up Mass Storage Management J Jensen

The EDG Testbed Deployment Details

UK Testbed Status Testbed 0 GridPP project Experiments’ tests started

The EU DataGrid Fabric Management Services

Presentation transcript:

Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has been deployed in the UK?” –“What is in place to help sites and users join and use the Testbed?”

Andrew McNab - Manchester HEP - 17 September 2002 Existing “Testbed 0” Many sites have some version of Globus Toolkit installed: –GT1.1.3 or 2.0 built from source locally. –UK HEP GT1.1.3 RPMs –GridPP/EDG GT2.0 RPMs BaBar Grid gatekeepers EDG Testbed site Gavin’s Green Dot Map monitors nominated gatekeepers every ~25 minutes Need to move this to Testbed 1 with resource brokering before we’re really “a Grid”

Andrew McNab - Manchester HEP - 17 September 2002 EDG Software Releases Deployment largely driven/limited by EDG software release status and cycles. Testbed 1.2 release orginally intended to be stable for applications (eg Atlas Data Challenge.) released ~10 days ago for application/“production” testbed sites (now up to after minor additions.) Still some bugs limiting job sizes, which will need upgrades to fix (current version of Globus does not have these problems.) Uncertainty about “renormalisation” of 1.2 -> 1.3 Due to complexity of installation and configuration, need to use LCFG to install and manage the site. –Many configuration steps implemented in LCFG configuration are not fully documented elsewhere. –Therefore requires dedicated machines for each testbed site.

Andrew McNab - Manchester HEP - 17 September 2002 UK Deployment Plan Start with UK-WP6 people (+ other key experts) –Use mailing list, which anyone can join and is archived. Once have some UK WP6 sites up and a procedure that should work for any site, then ask more sites to test installation procedure, docs etc. Once this is stable, invite all interested sites to install Testbed software: by this point, installation instructions should be clear and not require previous grid installation experience. Support will then be provided by tb-support mailing list on best-effort basis, and by a formal ticket-based system. Sites will be validated using GridPP services (RB, VO, RC) and then proposed to EDG-WP6 for inclusion in EDG Testbed.

Andrew McNab - Manchester HEP - 17 September 2002 Testbed Status by site Bristol1.2b10 CE + SE + 2*WN + RC Cambridge1.2b9 CE + SE + 16*WN Imperial1.2.0 CE + SE + 2*WN + RB Liverpool1.2b10 CE + SE + 2*WN Manchester1.2.2 CE + SE + 6*WN + farms RAL * (CE + SE + 10*WN) UCL1.2.b9 CE + SE + WN This is based on last reported status at the phone conferences. All these sites are accessible via the GridPP Resource Broker at IC RAL and IC also in CERN RB. All installed by LCFG.

Andrew McNab - Manchester HEP - 17 September 2002 Testbed Support Web and List on GridPP website. Has links to GridPP-provided Testbed services and installation recipes. The mailing list is intended to be the primary support and announcements forum. Instructions for joining and access to the posting archives are available at the Testbed webpages. If you want to participate in the Testbed, please get someone from your institute to join this list.

Andrew McNab - Manchester HEP - 17 September 2002 Testbed Support phone conferences These are arranged via the tb-support list and advertised on the website and the list. They are intended to be short, frequent, short, informal and short. ~1hr (and shorter if ~7-14 days. Currently averaging about one every 2 weeks; different days of the week due to clashes with conferences. Two main purposes: –UK WP6 sees Testbed site by site - early flagging of problems. –Sites can get an overview of the state of the Testbed in the UK, including where they stand in relation to everyone else. –Aim to raise issues and direct effort at them, rather than trying to fix problems during meetings.

Andrew McNab - Manchester HEP - 17 September 2002 install.gridpp.ac.uk Installation procedure for LCFG server at each site: –modified RedHat HTTP network install –automates standard LCFG server installation procedure –puts all the commands into a small number of scripts (eg 1) Installation of the LCFG server almost turnkey now. Sites still need to configure local site description files manually. Installation and configuration of testbed elements (CE etc) is then almost entirely automatic. The steps necessary (including the otherwise undocumented “gotchas”) are described in the LCFG pages on the website.

Andrew McNab - Manchester HEP - 17 September 2002 GridPP Testbed Services rc.gridpp.ac.uk - Replica Catalog (Bristol) –used to advertise the location of replicas of files vo.gridpp.ac.uk - VO Authorisation Service (Mancheser) –provides lists of experiments’ authorised grid identities to sites. mds.gridpp.ac.uk - Information Service (RAL) –used by sites to advertise their properties and authorised users rb.gridpp.ac.uk - Resource Broker (Imperial) –uses information from MDS and RC to direct jobs to appropriate sites. gppui.gridpp.rl.ac.uk - User Interface node on CSF (RAL) –allows anyone with a certificate and a CSF account to use the EDG and GridPP Testbeds

Andrew McNab - Manchester HEP - 17 September 2002 Testbed Support “Bugzilla” Globus and EDG use Bugzilla ticket-based bug- tracking system. UK deployment plan calls for a ticket-based system for GridPP. Have set up an experimental system, which includes site admins in “front line” Still have to decide how this relates to Grid Support Centre system.

Andrew McNab - Manchester HEP - 17 September 2002 Bugzilla guidelines says: –“The GridPP Bugzilla system is intended for tracking and managing queries about the Testbed in the UK (not just bugs.) Site users wanting to report problems or ask questions via this system should select their "home" site as the "product" in their report (so that the report initially goes to their local site manager.)” –“Site managers reporting or dealing with queries outside their existing experience with the Testbed are encouraged to use the informal tb-support mailing list to attempt to resolve the question before passing it on to one of the Middleware "products" defined in Bugzilla.” –“Please bear in mind that many software problems cannot be solved within the UK. It may be better to report true bugs directly through the Globus Problem Reporting page or the EU DataGrid Bug Tracking page (both of which use Bugzilla too.)”

Andrew McNab - Manchester HEP - 17 September 2002 Monitoring Flagging problems is a vital part of keeping a Testbed available. In a changing environment, Testbed configuration will “go stale” if not actively maintained. –This also avoids pre-demo panics! Gavin’s map already monitors Globus functionality. Need monitoring of EDG job submission (Dave C.) and EDG information services (Steve T. using the NorduGrid tools.)

Andrew McNab - Manchester HEP - 17 September 2002 Summary Seven sites have EDG 1.2 Testbed software installed. All accessible via the GridPP Resource Broker. Support structures in place for sites: –mailing list, web pages, installation server, regular phone conferences, Bugzilla. Now ready for more sites to get on board...