Testbed: Status & Plans

Slides:



Advertisements
Similar presentations
LNL M.Biasotto, Roma, 22 novembre Some notes on WP6 INFN Testbed.
Advertisements

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MyProxy and EGEE Ludek Matyska and Daniel.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
Steve Traylen Particle Physics Department Experiences of DCache at RAL UK HEP Sysman, 11/11/04 Steve Traylen
4 th DataGRID Project Conference, Paris, 5 March 2002 Testbed Software Test Plan I. Mandjavidze on behalf of L. Bobelin – CS SI; F.Etienne, E. Fede – CPPM;
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
Andrew McNab - EDG Access Control - 14 Jan 2003 EU DataGrid security with GSI and Globus Andrew McNab University of Manchester
INFN-GRID Globus evaluation Massimo Sgaravatto INFN Padova for the INFN Globus group
27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,
C. Loomis – Testbed: Status… – Sep. 5, 2002 – 1 Testbed: Status & Plans Charles Loomis (CNRS) Sept. 5, th Project Conference (Budapest)
Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps.
EGEE is a project funded by the European Union under contract IST JRA1 Testing Activity: Status and Plans Leanne Guy EGEE Middleware Testing.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Glite I/O Storm Testing in EDG-LCG Framework Elena Slabospitskaya, Vadim Petukhov, (IHEP, Russia) Gilbert Grosdidier, (CNRC, France) NEC'2005, Sept 16.
C. Loomis – Testbed Status – 28/01/2002 – n° 1 Future WP6 Tasks Charles Loomis January 28, 2002
13-May-03D.P.Kelsey, WP8 CA and VO organistion1 CA’s and Experiment (VO) Organisation WP8 Meeting EDG Barcelona, 13 May 2003 David Kelsey CCLRC/RAL, UK.
Yannick Patois – Datagrid Repository Presentation- 2001/11/21 - n° 1 Partner Logo DataGrid Software Repository presentation A short presentation of the.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
Support for system administrators Feedback from site admins after Testbed1 experience 05/03/2002 4th EDG WS Paris G. Merino, IFAE.
DataGrid is a project funded by the European Union VisualJob Demonstation EDG 1.4.x 2003 The EU DataGrid How the use of distributed resources can help.
Bob Jones – June n° 1 EDG release Schedule Bob Jones.
C. Loomis – Integration Status- October 31, n° 1 Integration Status October 31, 2001
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.
3-Jul-02D.P.Kelsey, Security1 Security meetings Report to EDG PTB 3 Jul 2002 David Kelsey CLRC/RAL, UK
DataGRID WPMM, Geneve, 17th June 2002 Testbed Software Test Group work status for 1.2 release Andrea Formica on behalf of Test Group.
DataGRID PTB, Geneve, 10 April 2002 Testbed Software Test Plan Status Laurent Bobelin on behalf of Test Group.
GRID Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
2-Sep-02Steve Traylen, RAL WP6 Test Bed Report1 RAL and UK WP6 Test Bed Report Steve Traylen, WP6
Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has.
2-Sep-02D.P.Kelsey, WP6 CA, Budapest1 WP6 CA report Budapest 2 Sep 2002 David Kelsey CLRC/RAL, UK
Site Certification Process (Round Table) Fabio Hernandez IN2P3 Computing Center - Lyon October
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
INFSO-RI Enabling Grids for E-sciencE gLite Certification and Deployment Process Markus Schulz, SA1, CERN EGEE 1 st EU Review 9-11/02/2005.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
VOX Project Status T. Levshina. 5/7/2003LCG SEC meetings2 Goals, team and collaborators Purpose: To facilitate the remote participation of US based physicists.
7-May-03D.P.Kelsey, LCG-GDB-Security1 LCG/GDB Security Issues and Planning or Report from the Security Group CERN, 8 May 2003 David Kelsey CCLRC/RAL, UK.
CERN Certification & Testing LCG Certification & Testing Team (C&T Team) Marco Serra - CERN / INFN Zdenek Sekera - CERN.
WP3 WP3 at Budapest 2/9/2002 Steve Fisher / RAL. WP3 Steve Fisher/RAL - 2/9/2002WP3 at Budapest2 Summary News –EDG Retreat –EDG Tutorials –Quality –Release.
Software Tools Group & Release Process Alain Roy Mine Altunay.
J Jensen / WP5 /RAL UCL 4/5 March 2004 GridPP / DataGrid wrap-up Mass Storage Management J Jensen
Jean-Philippe Baud, IT-GD, CERN November 2007
Gri2Win: Porting gLite to run under Windows XP Platform
Grid2Win: Porting of gLite middleware to Windows platform
Workload Management Workpackage
Grid2Win Porting of gLite middleware to Windows XP platform
Status of Task Forces Ian Bird GDB 8 May 2003.
Regional Operations Centres Core infrastructure Centres
The EDG Testbed Deployment Details
Moving the LHCb Monte Carlo production system to the GRID
WP1 WMS release 2: status and open issues
Andreas Unterkircher CERN Grid Deployment
Software Integration, Deployment & Evaluation
Grid Deployment Area Status Report
Technical Board Meeting, CNAF, 14 Feb. 2004
Database Readiness Workshop Intro & Goals
WP4-install status update
Grid2Win: Porting of gLite middleware to Windows XP platform
Testbed Software Test Plan Status
Leanne Guy EGEE JRA1 Test Team Manager
Gri2Win: Porting gLite to run under Windows XP Platform
Stephen Burke, PPARC/RAL Jeff Templon, NIKHEF
Francesco Giacomini – INFN JRA1 All-Hands Nikhef, February 2008
LCG experience in Integrating Grid Toolkits
Leigh Grundhoefer Indiana University
Report on GLUE activities 5th EU-DataGRID Conference
gLite The EGEE Middleware Distribution
Presentation transcript:

Testbed: Status & Plans Charles Loomis (CNRS) Sept. 5, 2002 5th Project Conference (Budapest) charles.loomis@cern.ch (See http://documents.cern.ch/age?a021246 for trans.)

Software Status EDG 1.2.0 EDG 1.2.1 EDG 1.2.2 Deployed on application testbed. 20’ time-limit on jobs; high-rate submissions Other bugs: replica manager, GDMP replication EDG 1.2.1 Deployed on application testbed (CERN, Karlsruhe). No time-limit; low-rate submissions. Other bug: GDMP replication EDG 1.2.2 To be tagged when GDMP rpm tested.

Testbed Status Application Testbed (formerly “Production Testbed”) EDG release 1.2.0 deployed on six sites. CC-IN2P3, CERN, CNAF, Karlsruhe, NIKHEF, RAL. Actually split into two parts: 1.2.0 no GASS Cache hack: long jobs, low submission rate 1.2.0 proper: 20’ limit on jobs, high submission rate But, migrating to 1.2.1/2. ATLAS tests in progress  See F. Harris’ WP8 talk. Development Testbed EDG 1.2.1 installed. Testing 1.2.2 today.

Sites Six main sites currently participating. CERN, CNAF, Karlsruhe, Lyon, NIKHEF, RAL See transparancies for individual status. THANKS! Markus Schulz, Emanuele Leonardi, Alessandro Cavalli, Andrea Chierici, Alessandro Italiano, Markus Hardt, Fabio Hernandez, David Groep, Jeff Templon, Steve Traylen Beginning to see real computing power available. Storage beginning to ramp up as well. Around 15 others waiting to join. Other grid projects (CrossGrid, GridPP, INFN Grid,…) More still once some national CAs are approved.

Certification Authority Group (D. Kelsey) CAs are under control. Acceptance procedure working. Added German CA; Greece made report; Poland & Slovakia by email. Min. requirements updated (RA procedures; Online CA with special hardware.) Scalable for future? Procedures for establishing trust are quite involved. ATLAS raised issue about length of time to obtain approval. Cross-domain trust. Will participate in “CA Operations” group in GGF. Kerberos-based CAs: CERN and FNAL interested with this. VO Authorization Issues.

Authorization Group (L. Gaido) Currently use LDAP-based membership services. Will have grid-proxy-init with –vo option. Inserts VO-name into proxy subject. Requires patch to Globus code and change to mkgridmap. Available 30 Sept. 2002. VO Membership Service (VOMS) Inserts membership info into proxy as optional attributes. Client command (voms-proxy-init), Server, and migration tools exist. API & Admin. tools available 30 Sept. 2002. Real shift in the way we do VO-authorization.

Other Projects NorduGrid (Balazs Koyna) CrossGrid (Markus Hardt) Good communication though overlap of people. Grid Manager: replaces gatekeeper, smart input/output staging User Interface: contains built-in brokering. Info. System: based on MDS, includes job monitoring, user-specific info. CrossGrid (Markus Hardt) Close collaboration between EDG & CrossGrid testbed groups. Significant contributions to CA group. Globus Support shaky (distracted by OGSA, fixes supplied by others) Find EDG effort to support/fix Globus full-time. Reduce dependencies on Globus as much as possible.

Globus Version Globus 2.1.2 Globus 2.2 Has fix from CONDOR of GASS Cache problem. Lot of work to apply to beta-21. Includes many additional changes job manager. WP1 logging patches no longer work. Whole LRMS backend changes to perl framework. Globus 2.2 Exists, but… Some question about what is happening with the MDS 2.2 in this. Will make Globus Release-24 and test.

Short Term Plans (I) EDG 1.2 series NOT suitable for widespread deployment. EDG 1.2.0 Available now, known limitations. EDG 1.2.1 Deploying now: long jobs, low submission rate. Deploy multiple resource brokers to reduce problem. EDG 1.2.2 GDMP replication fix. Done today? Quick upgrade for sites at 1.2.1. EDG 1.2.x Other critical fixes, but very high threshold now.

Short Term Plans (II) EDG 1.3 series will be widely deployed. Upgrade Globus—will contain GASS cache patch from Condor. Hopefully will also have MDS 2.2. Subject to testing, will be deployed on application testbed. EDG 1.3.x Clean up LCFG objects/configuration. Modify setup to support new developer guidelines. EDG 1.4.x Begin incremental inclusion of new middleware packages.

Rolling Release Autobuild procedure will run daily: On all supported platforms (RH6.2, 7.2 now) To build, package, and unit test HEAD version of modules. Feedback information to developers. Middleware developers: Use development machines to test software. Tag package when ready for integration. Schedule time on development testbed to test package. ITeam Current baseline release  Add test package  New baseline release. Will use acceptance test suite to determine if package is included.

Autobuild Procedure (Y. Patois) On RH6.2 All but ~5/30 packages build and are packaged without errors. On RH7.2 Around 10/30 packages fail the “make install” step. All fail “make rpm” because of rpm command change. Warning: Won’t integrate packages unless autobuild procedure works.

Testing Group (G. Merino) Cooperation between testing groups (combine?): TSTG INFN EDG Testing Group CrossGrid test/validation group. LCG Testing Group: Goals: Testing of EDG services. Validation of new site installation & configuration. Methodology A priori definition of features to be tested. Collect tests from group and from others. Keep framework and tests in CVS.

Documentation Release Notes: User’s Guide: Installation Guide: Exist for 1.2.0 (will be updated for 1.2.1). User’s Guide: Exists, but should be considered draft. Comments welcome  please use Bugzilla for this. Installation Guide: Won’t be rewritten until Globus upgrade. LCFG configuration files up-to-date  must move this to Installation Guide. Tutorial materials also available.