Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.

Slides:



Advertisements
Similar presentations
LNL M.Biasotto, Roma, 22 novembre Some notes on WP6 INFN Testbed.
Advertisements

E. Ferro, CNAF, aprile LCFG: testbed upgrade Enrico Ferro INFN-LNL.
An open source approach for grids Bob Jones CERN EU DataGrid Project Deputy Project Leader EU EGEE Designated Technical Director
Andrew McNab - Manchester HEP - 15 February 2002 Testbed Release in the UK EDG Testbed 1 GridPP sources of information GridPP VO GIIS and Resource Broker.
WP2: Data Management Gavin McCance University of Glasgow November 5, 2001.
S.L.LloydGrid Steering Committee 8 March 2002 Slide 1 Status of GridPP Overview Financial Summary Recruitment Status EU DataGrid UK Grid Status GridPP.
Fabric and Storage Management GridPP Fabric and Storage Management GridPP 24/24 May 2001.
Tony Doyle - University of Glasgow GridPP EDG - UK Contributions Architecture Testbed-1 Network Monitoring Certificates & Security Storage Element R-GMA.
LCFG overview and future Michael George University of Liverpool
Andrew McNab - Manchester HEP - 10 May 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –What are other sites doing? –What are.
5-Dec-02D.P.Kelsey, GridPP Security1 GridPP Security UK Security Workshop 5-6 Dec 2002, NeSC David Kelsey CLRC/RAL, UK
User Board - Supporting Other Experiments Stephen Burke, RAL pp Glenn Patrick.
Stephen Burke - WP8 Status - 14/2/2002 Partner Logo WP8 Status Stephen Burke, PPARC/RAL.
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.
Partner Logo UK GridPP Testbed Rollout John Gordon GridPP 3rd Collaboration Meeting Cambridge 15th February 2002.
29 June 2006 GridSite Andrew McNabwww.gridsite.org VOMS and VOs Andrew McNab University of Manchester.
Andrew McNab - Manchester HEP - 24 May 2001 WorkGroup H: Software Support Both middleware and application support Installation tools and expertise Communication.
18 April 2002 e-Science Architectural Roadmap Open Meeting 1 Support for the UK e-Science Roadmap David Boyd UK Grid Support Centre CLRC e-Science Centre.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
22-Apr-02D.P.Kelsey, Security, UKHEP Sysman1 Grid Security 22 Apr 2002 UK HEP Sysman Meeting David Kelsey CLRC/RAL, UK
C. Loomis – Status of European DataGrid – May 23, 2002 – 1 Status of European DataGrid Charles Loomis CNRS/LAL NorduGrid Workshop May 23, 2002.
4 th DataGRID Project Conference, Paris, 5 March 2002 Testbed Software Test Plan I. Mandjavidze on behalf of L. Bobelin – CS SI; F.Etienne, E. Fede – CPPM;
Presenter Name Facility Name EDG Testbed Status Moving to Testbed Two.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
Andrew McNab - Manchester HEP - 31 January 2002 Testbed Release in the UK Integration Team UK deployment TB1 Job Lifecycle VO: Authorisation VO: GIIS and.
Andrew McNab - EDG Access Control - 14 Jan 2003 EU DataGrid security with GSI and Globus Andrew McNab University of Manchester
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Andrew McNab - Manchester HEP - 6 November Old version of website was maintained from Unix command line => needed (gsi)ssh access.
Task 3.5 Tests and Integration ( Wp3 kick-off meeting, Poznan, 29 th -30 th January 2002 Santiago González de la.
Oxford Jan 2005 RAL Computing 1 RAL Computing Implementing the computing model: SAM and the Grid Nick West.
Joining the Grid Andrew McNab. 28 March 2006Andrew McNab – Joining the Grid Outline ● LCG – the grid you're joining ● Related projects ● Getting a certificate.
EC Review – 01/03/2002 – G. Zaquine – Quality Assurance – WP12 – CS-SI – n° 1 DataGrid Quality Assurance Gabriel Zaquine Quality Engineer - WP12 – CS-SI.
Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps.
1 Deployment of an LCG Infrastructure in Australia How-To Setup the LCG Grid Middleware – A beginner's perspective Marco La Rosa
Andrew McNab - Manchester HEP - 26 June 2001 WG-H / Support status Packaging / RPM’s UK + EU DG CA’s central grid-users file grid “ping”
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Andrew McNab - Manchester HEP - 5 July 2001 WP6/Testbed Status Status by partner –CNRS, Czech R., INFN, NIKHEF, NorduGrid, LIP, Russia, UK Security Integration.
Support for system administrators Feedback from site admins after Testbed1 experience 05/03/2002 4th EDG WS Paris G. Merino, IFAE.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
DataGrid Applications Federico Carminati WP6 WorkShop December 11, 2000.
GridPP Collaboration meeting Manchester 9/10 May 2002 P.Clarke Resource Management: Instruments and Procedures Testbed Rollout: Development of Plan Education.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
GridPP Presentation to AstroGrid 13 December 2001 Steve Lloyd Queen Mary University of London.
DataGRID WPMM, Geneve, 17th June 2002 Testbed Software Test Group work status for 1.2 release Andrea Formica on behalf of Test Group.
CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.
DataGRID PTB, Geneve, 10 April 2002 Testbed Software Test Plan Status Laurent Bobelin on behalf of Test Group.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
Presenter Name Facility Name UK Testbed Status and EDG Testbed Two. Steve Traylen GridPP 7, Oxford.
Andrew McNabSecurity Middleware, GridPP8, 23 Sept 2003Slide 1 Security Middleware Andrew McNab High Energy Physics University of Manchester.
2-Sep-02Steve Traylen, RAL WP6 Test Bed Report1 RAL and UK WP6 Test Bed Report Steve Traylen, WP6
Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has.
Rutherford Appleton Lab, UK VOBox Considerations from GridPP. GridPP DTeam Meeting. Wed Sep 13 th 2005.
Andrew McNabGrid in 2002, Manchester HEP, 7 Jan 2003Slide 1 Grid Work in 2002 Andrew McNab High Energy Physics University of Manchester.
Grid Security work in 2004 Andrew McNab Grid Security Research Fellow University of Manchester.
The EDG Testbed The European DataGrid Project Team
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
Stephen Burke – Sysman meeting - 22/4/2002 Partner Logo The Testbed – A User View Stephen Burke, PPARC/RAL.
11-May-01D.P.Kelsey, Security Update1 GRID Security Update David Kelsey CLRC/RAL, UK
Dave Newbold, University of Bristol14/8/2001 Testbed 1 What is it? First deployment of DataGrid middleware tools The place where we find out if it all.
Dave Newbold, University of Bristol21/3/2001 (Short) WP6 Update Where are we? Testbed 0 going (ish); some UK sites being tried out for production (mostly.
Bob Jones EGEE Technical Director
Regional Operations Centres Core infrastructure Centres
The EDG Testbed Deployment Details
UK GridPP Tier-1/A Centre at CLRC
Testbed Software Test Plan Status
UK Testbed Status Testbed 0 GridPP project Experiments’ tests started
The EU DataGrid Fabric Management Services
Presentation transcript:

Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More EDG and TB information

Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Officially started 1st January 2001 Partners: CERN, CNRS, ESA, INFN, NIKHEF, PPARC Other contributions from HEP institutes (eg in NorduGrid countries) and other Grid projects (eg core UK e-Science) Management and software organised into Work Packages: –WP1 Resource Management (“job submission”) –WP2 Data Management –WP3 Information and Monitoring Services –WP4 Fabric Management (eg local installation and management tools) –WP5 Mass Storage –WP6 Testbeds (include Integration and support for the Testbed grid.) –WP7 Networking –WP8,9,10 Applications

Andrew McNab - Manchester HEP - 22 April 2002 Software Releases Have 3 major releases to coincide with three yearly Testbeds 1, 2 and 3 Have minor releases every 2 months, and then patch level releases between those: currently at (deployed last week) Currently, the only supported platform is RedHat 6.2 on Intel. Software is stored in a central CVS and published via a public HTTP server ( in RPM format. This includes EDG-authored software, a distribution of Globus (contributed by GridPP) and any external packages and updates not included in out-of-the-box RedHat 6.2. The official installation procedure is to use LCFG, contributed by Edinburgh and customised by WP4. Once an LCFG server is working at your site, installation of testbed machines is automated (rather like RedHat kickstart.) See Steve’s talk for details.

Andrew McNab - Manchester HEP - 22 April 2002

Authorisation at your site a.k.a “how do I maintain the list of certificate names (people) that can use my Testbed site?” WP6 provides a standard way of publishing lists of certificate names via an LDAP server, and selecting subsets based on group or “Virtual Organisation” (eg experiment) affiliation. gridmapdir patch to Globus provides dynamic user account allocation from a pool. Each LHC experiment maintains a “VO Server” and populates it with the DNs of their members. VO’s also exist for WP6, BaBar and GridPP.

Andrew McNab - Manchester HEP - 22 April 2002 More information Main EDG site is –each Work Package has a website, usually with documents, mailing list archives etc about its software. WP6 Testbed information at –includes links to software repository, User and Installation Guides, bug tracking Bugzilla etc. UK Testbed support: –has info about mailing list, Steve’s notes about LCFG and other practical information.

Andrew McNab - Manchester HEP - 22 April 2002 Summary EDG producing middleware components as part of a consistent distribution for testbed sites. Situation evolving rapidly, but central aim of job submission “to the Grid” via a Resource Broker is working. Software available to interested sites, and web and mailing list resources exist for support. See following talks for details.

Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps between the situation today, and all interested UK sites being part of the Testbed.” Definite predictions limited by uncertain nature of the releases.

Andrew McNab - Manchester HEP - 22 April 2002 “Constituencies” Sysadmins (represented in “Sysman” and by WP6) –Care about the integrity of their site (firewalls etc) and the maintenance load of Grid Testbed equipment; may be under pressure to get a “green dot” on the relevant map. Experiments (represented by GridPP EB) –Want sites up and running for application development and to run data challenges. Esp. concerned about sites hosting their farms. Grid developers (represented by GridPP TB) –Concerned about getting functionality running in UK, esp. at sites where experts are. Local HEP groups (represented on GridPP CB) –Want a transparent process that includes everyone.

Andrew McNab - Manchester HEP - 22 April 2002 UK Deployment Plan Start with UK WP6 people (+ other key experts) –Use mailing list, which anyone can join and is archived. Once have some WP6 sites up and a procedure that should work for any site, then ask more sites to test installation procedure, docs etc. Once this has stabilised, invite all interested sites to install Testbed software. –By this point, installation instuctions should be clear and not require previous grid experience, ad-hoc fixes etc. Support will then be provided by tb-support mailing list on best-effort basis and Grid Support Centre with a formal ticket-based system. –(Likely that mailing list will be best place to get a quick answer.) Need to repeat this every 2 months for EDG releases, although not all sites may have commitments (eg from experiments) to do this.

Andrew McNab - Manchester HEP - 22 April 2002 Testbed Joining Procedure Procedure for joining EDG testbed is being defined by WP6. For UK sites, WP6 UK will propose sites to rest of WP6. WP6-UK will provide help with testing UK sites: –Have GridPP VO, Resource Broker and MDS so can add sites to UK Testbed and validate functionality ourselves before trying in the EDG Testbed. We don’t want to propose sites without testing them ourselves; and cautious sites can put themselves up for validation within GridPP without risking “embarrassment” at a European level. –Will use same validation criteria as WP6.

Andrew McNab - Manchester HEP - 22 April 2002 Installation Procedure This needs to be based around LCFG because of complex configuration process, which is published as automatic LCFG configuration objects. Sites will almost certainly need to dedicate machines to be installed this way. LCFG itself has been non-trivial to install and configure. However, once your local LCFG server is working, installing CE etc is automated (similar to RedHat kickstart.) Steve has been installing LCFG at RAL and has written up the procedure. Also contributed updated scripts back to WP6. So the situation is much better now.

Andrew McNab - Manchester HEP - 22 April 2002 More information EDG Testbed talk from earlier today. WP6 website at GridPP Technical Board mailing list has: –mailing list information –Steve’s recipe for LCFG-installing Computing Element, Storage Element, User Interface machine and Worker Node.

Andrew McNab - Manchester HEP - 22 April 2002 Summary UK Deployment Plan largely defined –but depends on timing and quality of EDG releases Testbed joining procedure defined –aim to use UK resources to smooth path for UK sites to join EDG Testbed. Deployment to non-expert sites largely limited by current installation procedures –this has improved a lot and is pretty much ready to go.