Presenter Name Facility Name EDG Testbed Status Moving to Testbed Two.

Slides:



Advertisements
Similar presentations
DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.
Advertisements

UK Testbed Report GridPP 9 Steve Traylen
All Hands MeetingD. Colling, Imperial College London, for the GridPP Project 1 Hans Hoffman has described the scale of the problems that we are facing,
EU DataGrid TestBed 2 Component Review Paul Millar (University of Glasgow) (slides based on a presentation by Erwin Laure)
OptorSim: A Replica Optimisation Simulator for the EU DataGrid W. H. Bell, D. G. Cameron, R. Carvajal, A. P. Millar, C.Nicholson, K. Stockinger, F. Zini.
Andrew McNab - Manchester HEP - 10 May 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –What are other sites doing? –What are.
Status Report University of Bristol 3 rd GridPP Collaboration Meeting 14/15 February, 2002Marc Kelly University of Bristol 1 Marc Kelly University of Bristol.
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.
ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
WP2 and GridPP UK Simulation W. H. Bell University of Glasgow EDG – WP2.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
Steve Traylen Particle Physics Department Experiences of DCache at RAL UK HEP Sysman, 11/11/04 Steve Traylen
Data Management Expert Panel - WP2. WP2 Overview.
Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
Alessandro Italiano INFN – CNAF 26/09/2003 1/5 Status of the INFN - EDG testbeds Alessandro Italiano 7th DataGrid Conference.
Martin Bly RAL Tier1/A RAL Tier1/A Site Report HEPiX-HEPNT Vancouver, October 2003.
The EDG Testbed Introduction and Setup The European DataGrid Project Team
Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps.
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
The EDG Testbed Deployment Details The European DataGrid Project
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Steve Traylen Particle Physics Department EDG and LCG Status 9 th December 2003
Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.
Author - Title- Date - n° 1 Partner Logo WP5 Summary Paris John Gordon WP5 6th March 2002.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
Ariel Garcia LCG cluster installation, EGEE training, Ariel Garcia - IWR LCG Cluster Installation Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft.
CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
University of Bristol 5th GridPP Collaboration Meeting 16/17 September, 2002Owen Maroney University of Bristol 1 Testbed Site –EDG 1.2 –LCFG GridPP Replica.
Presenter Name Facility Name UK Testbed Status and EDG Testbed Two. Steve Traylen GridPP 7, Oxford.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
2-Sep-02Steve Traylen, RAL WP6 Test Bed Report1 RAL and UK WP6 Test Bed Report Steve Traylen, WP6
Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has.
DataTAG Work Package 4 Meeting Bologna Simone Ludwig Brunel University 23rd and 24th of May 2002.
Rutherford Appleton Lab, UK VOBox Considerations from GridPP. GridPP DTeam Meeting. Wed Sep 13 th 2005.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
BNL Service Challenge 3 Status Report Xin Zhao, Zhenping Liu, Wensheng Deng, Razvan Popescu, Dantong Yu and Bruce Gibbard USATLAS Computing Facility Brookhaven.
LCG LCG-1 Deployment and usage experience Lev Shamardin SINP MSU, Moscow
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
WP7 Middleware Status and Plans Paul Mealor. Contents GridFTP monitoring Network monitoring information in RGMA UK network monitoring.
Author - Title- Date - n° 1 Partner Logo WP5 Status John Gordon Budapest September 2002.
INFN - Ferrara BaBar Meeting SPGrid: status in Ferrara Enrica Antonioli - Paolo Veronesi Ferrara, 12/02/2003.
The EDG Testbed The European DataGrid Project Team
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
The EDG Testbed The European DataGrid Project Team
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
VOX Project Status T. Levshina. 5/7/2003LCG SEC meetings2 Goals, team and collaborators Purpose: To facilitate the remote participation of US based physicists.
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
Bob Jones – Project Architecture - 1 March n° 1 Project Architecture, Middleware and Delivery Schedule Bob Jones Technical Coordinator, WP12, CERN.
II EGEE conference Den Haag November, ROC-CIC status in Italy
Software Management Workshop Steve Traylen. Software Management(WG5) The aim of the working group is to look at deficiencies in deployed and upcoming.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Enabling Grids for E-sciencE Claudio Cherubino INFN DGAS (Distributed Grid Accounting System)
CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.
J Jensen / WP5 /RAL UCL 4/5 March 2004 GridPP / DataGrid wrap-up Mass Storage Management J Jensen
The EDG Testbed Deployment Details
U.S. ATLAS Grid Production Experience
Sergio Fantinel, INFN LNL/PD
Report on GLUE activities 5th EU-DataGRID Conference
The EU DataGrid Fabric Management Services
Presentation transcript:

Presenter Name Facility Name EDG Testbed Status Moving to Testbed Two

Steve Traylen, PPD 28th April 2003 Outline Current production status. Testbed at RAL. Testbed two. Changes from testbed one. LCFG -> LCFGng Software by node type. Status of integration of testbed two.

Steve Traylen, PPD 28th April 2003 Current Application TB Status Recommended testbed is still RH6.2, edg1.4.9 with LCFG. Currently eight UK sites contribute to the the total seventeen in datagrid. Not changed this year since the BD-II was introduced. The RB is again the limiting factor now the information system is reliable.

Steve Traylen, PPD 28th April 2003 Production Testbed at RAL. 1 CE, 1 SE (350 GB), 10 WNs, 1 UI. Top edgapp GIIS now at RAL. 1 CE as a gatekeeper into tier1a system. –In use by Atlas, Babar, LHCb and DZero,

Steve Traylen, PPD 28th April 2003 Running Production Jobs One month to 27 th April

Steve Traylen, PPD 28th April 2003 Development Testbed at RAL CE, SE, WN, MON, RLS, VOMS and LCFGng exist already. UI exists (gppui06.gridpp.rl.ac.uk) RB, HLR and PA to be installed this week. Updates happen twice a day on average. Improvements now faster than the addition of software.

Steve Traylen, PPD 28th April 2003 Testbed Two Lots more node types. Everything is incompatible including schema, globus, gridftp,… Still a lot of testing to be done. Loose cannons are not yet loose. GDMP vanishes which is good for integration of software into farms.

Steve Traylen, PPD 28th April 2003 LCFG -> LCFGng LCFGng is definitely an improvement. –NIS clients can be configured. –DMA can be turned on. –Using autofs is now the default. –Node profile updates happen immediately and reliably. –Reboot for ever does not happen. –PXE support built in from the start. –LCFGng generally is more complete. WP4s instructions are better and time proof. LCFGng has a web interface.

Steve Traylen, PPD 28th April 2003 LCFG ->LCFGng(2) Each node and object reports back its status. Middleware configuration completed by the developers and is a lot more ‘intelligent’. EDG profiles are more modular and clearer than before. Hardware support is still limited, e.G. Raid, SCSI, e1000 all require special case kernels. Post install notes will be supplied but are smaller, e.g gridmapdir is mounted, pool account lock files created, site GIIS configured to accept registrations from SE.

Steve Traylen, PPD 28th April 2003 Compute Element Node Now use’s Maui for scheduling. –Information providers claimed to support this. MPICH is installed. –Needed for wp1’s support of MPI jobs. GLOBUS v2.2.4 supplied from VDT –VDT. Virtual data toolkit from iVDgl. Gatekeeper, MDS and gridftp server. R-GMA client – Publishing CE information via GIN.

Steve Traylen, PPD 28th April 2003 Computing Element(2) GridFTP logs published into R-GMA. MSA. Monitoring Sensor Agent. Application software. DGAS client. One CE per site is required.

Steve Traylen, PPD 28th April 2003 Worker Node Application Software. Globus clients, GridFTP. RFIO clients. MSA, Monitoring Sensor Agent. VOMS, R-GMA, RLS, Reptor, Netcost and SE clients. At least one per site required.

Steve Traylen, PPD 28th April 2003 Storage Element Globus, GridFTP and MDS Information Providers publishing via MDS and GIN, R-GMA. GridFTP logs published into R-GMA. Replica Location -> Site Replica mapping. SE (apache) and SE web service (tomcat). One per site, possibly one per media, e.g. CASTOR, Atlas Data Store, Disk? MSA. Monitoring Sensor Agent.

Steve Traylen, PPD 28th April 2003 User Interface Clients for: –Datagrid job submission. –Globus job submission. –R-GMA –SE –VOMS –RLS, Reptor, Optor –Network cost client. Access required by all users of datagrid.

Steve Traylen, PPD 28th April 2003 Monitor Box Two distinct functions. R-GMA servlets(tomcat) –CE, SE and application producers register here. The fmonServer collects information from all the MSA. –Sensors such as lm_sensors, load, uptime, network I/O collected on the MON box. MySQL. One per site required, unless tomcat is moved elsewhere.

Steve Traylen, PPD 28th April 2003 Replica Location Service Node Tomcat MySQL R-GMA client, publishes service status. Replica catalogue. Metadata catalogue. Replaces the current replica catalogue. One node per VO until VOMS is integrated.

Steve Traylen, PPD 28th April 2003 Information Catalogue Node R-GMA registry servlets. Tomcat MySQL One node required per testbed.

Steve Traylen, PPD 28th April 2003 Network Monitor Iperf – Network bandwidth. Pinger – RTT time. UDPmon – UDP throughput. rTPL – A combination of the above. Netagent – Network traffic from interface to router. All published via apache and perl cgi. One per site.

Steve Traylen, PPD 28th April 2003 VOMS and MyProxy node VOMS –Apache (mod_perl) –MySQL –One per VO required. –VOMS will not be in TB2. MyProxy –MyProxy server. –At least one per testbed.

Steve Traylen, PPD 28th April 2003 WP1 Nodes DGAS (dg accounting service)  3 nodes. Deployment commences this week. RB ( Resource Broker) –At least one per testbed. HLR (Home Location Register Node) –Stores the accounts of users and resources. –One per testbed. (or site?). PA (Price Authority Node) –Assigns prices to resources. –One per VO.

Steve Traylen, PPD 28th April 2003 Status of Integration Lots of parallel changes, lots of new software. –Impossible to follow. Globus job submission is working, with some magic. Fabric Management and Network Monitoring complete. Information system, R-GMA was working well but introduction of GLUE has required a re- release. RLS service has been shown to work. Integration of the SE and SE with RLS is not completed.

Steve Traylen, PPD 28th April 2003 Status of Integration(2) Introduction of WP1 software this week and its success is critical to a release date. Job management interfaces to almost everything though this is the final component. May is expected to consist of continuous bug fixes once all software has been deployed.

Steve Traylen, PPD 28th April 2003 Testbed Two in the UK For a UK independent grid the UK will need to support the gridpp VO. –RB, HLR(?), PA, RLS, VOMS. Once the RB is in place (IC) then it makes sense to move interested sites to testbed two. What happens next? –LCG1, Crossgrid and EDG boundaries become blurred.