Bob Jones – Project Architecture - 1 March 2002 - n° 1 Information & Monitoring Services Antony Wilson WP3, RAL

Slides:



Advertisements
Similar presentations
LNL M.Biasotto, Roma, 22 novembre Some notes on WP6 INFN Testbed.
Advertisements

E. Ferro, CNAF, aprile LCFG: testbed upgrade Enrico Ferro INFN-LNL.
Open Science Grid Living on the Edge: OSG Edge Services Framework Kate Keahey Abhishek Rana.
Grid Tech Team Certificates, Monitoring, & Firewall September 15, 2003 Chiang Mai, Thailand Allan Doyle, NASA With the help of the entire Grid Tech Team.
DIVIDING INTEGERS 1. IF THE SIGNS ARE THE SAME THE ANSWER IS POSITIVE 2. IF THE SIGNS ARE DIFFERENT THE ANSWER IS NEGATIVE.
Addition Facts
Antony WilsonGridPP - November 2001 The Data Grid DIT & Schema.
Andrew McNab - Manchester HEP - 15 February 2002 Testbed Release in the UK EDG Testbed 1 GridPP sources of information GridPP VO GIIS and Resource Broker.
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – HEP Assessment of EDG – n° 1 HEP Applications Evaluation of the EDG Testbed.
S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.
WP2: Data Management Gavin McCance University of Glasgow November 5, 2001.
All Hands MeetingD. Colling, Imperial College London, for the GridPP Project 1 Hans Hoffman has described the scale of the problems that we are facing,
S.L.LloydGrid Steering Committee 8 March 2002 Slide 1 Status of GridPP Overview Financial Summary Recruitment Status EU DataGrid UK Grid Status GridPP.
GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.
Tony Doyle - University of Glasgow GridPP EDG - UK Contributions Architecture Testbed-1 Network Monitoring Certificates & Security Storage Element R-GMA.
GridPP Meeting, Cambridge, 15 Feb 2002 Paul Mealor, UCL UCL Testbed 1 status report Paul Mealor.
Andrew McNab - Manchester HEP - 10 May 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –What are other sites doing? –What are.
Status Report University of Bristol 3 rd GridPP Collaboration Meeting 14/15 February, 2002Marc Kelly University of Bristol 1 Marc Kelly University of Bristol.
Stephen Burke - WP8 Status - 14/2/2002 Partner Logo WP8 Status Stephen Burke, PPARC/RAL.
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.
ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
Partner Logo UK GridPP Testbed Rollout John Gordon GridPP 3rd Collaboration Meeting Cambridge 15th February 2002.
The National Grid Service Mike Mineter.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
22-Apr-02D.P.Kelsey, Security, UKHEP Sysman1 Grid Security 22 Apr 2002 UK HEP Sysman Meeting David Kelsey CLRC/RAL, UK
LHCb(UK) Meeting Glenn Patrick1 LHCb Grid Activities in UK LHCb(UK) Meeting Cambridge, 10th January 2001 Glenn Patrick (RAL)
Steve Traylen Particle Physics Department Experiences of DCache at RAL UK HEP Sysman, 11/11/04 Steve Traylen
C. Loomis – Status of European DataGrid – May 23, 2002 – 1 Status of European DataGrid Charles Loomis CNRS/LAL NorduGrid Workshop May 23, 2002.
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATOR E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
Presenter Name Facility Name EDG Testbed Status Moving to Testbed Two.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
Andrew McNab - Manchester HEP - 31 January 2002 Testbed Release in the UK Integration Team UK deployment TB1 Job Lifecycle VO: Authorisation VO: GIIS and.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
Grid Application Builders Teach In31/01/02Antony Wilson Information & Monitoring Services WP3.
Instalación y configuración de CE+WN Angelines Alberto CIEMAT Grid Tutorial, Sept
Addition 1’s to 20.
25 seconds left…...
Week 1.
EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
The EDG Testbed Introduction and Setup The European DataGrid Project Team
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – Title – n° 1 Grid Data Management in Action Experience in Running and.
Task 3.5 Tests and Integration ( Wp3 kick-off meeting, Poznan, 29 th -30 th January 2002 Santiago González de la.
Grid Computing, B. Wilkinson, 20046c.1 Globus III - Information Services.
INFN experience with Globus GIS A. Cavalli - F. Semeria INFN Grid Information Services workshop CERN, March 2001.
The EDG Testbed Deployment Details The European DataGrid Project
The EU DataGrid – Information and Monitoring Services The European DataGrid Project Team
Andrew McNab - Manchester HEP - 5 July 2001 WP6/Testbed Status Status by partner –CNRS, Czech R., INFN, NIKHEF, NorduGrid, LIP, Russia, UK Security Integration.
A. Cavalli - F. Semeria INFN Experience With Globus GIS 1 A. Cavalli - F. Semeria INFN First INFN Grid Workshop Catania, 9-11 April 2001 INFN Experience.
Support for system administrators Feedback from site admins after Testbed1 experience 05/03/2002 4th EDG WS Paris G. Merino, IFAE.
Steve Traylen Particle Physics Department EDG and LCG Status 9 th December 2003
Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
2-Sep-02Steve Traylen, RAL WP6 Test Bed Report1 RAL and UK WP6 Test Bed Report Steve Traylen, WP6
DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 1 GLUE Schema - Status Report DataTAG WP4 meeting Bologna,
The EU DataGrid – Information and Monitoring Services The European DataGrid Project Team
GIIS Implementation and Requirements F. Semeria INFN European Datagrid Conference Amsterdam, 7 March 2001.
The EDG Testbed The European DataGrid Project Team
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
Stephen Burke – Sysman meeting - 22/4/2002 Partner Logo The Testbed – A User View Stephen Burke, PPARC/RAL.
The EDG Testbed Deployment Details
The EU DataGrid – Information and Monitoring Services
Sergio Fantinel, INFN LNL/PD
A conceptual model of grid resources and services
EGEE Middleware: gLite Information Systems (IS)
Presentation transcript:

Bob Jones – Project Architecture - 1 March n° 1 Information & Monitoring Services Antony Wilson WP3, RAL

Antony Wilson –SysMan Meeting- 22 April n° 2 Introduction u information systems – LDAP (Lightweight Directory Access Protocol) n Ftree n Globus MDS u information providers n RPMs n configuration u starting ftree u configuration of the GRIS/GIIS registration u starting Globus MDS u example searches u summary

Antony Wilson –SysMan Meeting- 22 April n° 3 LDAP Information Systems u 2 configuration files n /etc/edg/info-mds.conf n /etc/globus.conf u info-mds.conf n configuration of the information providers u globus.conf n configuration of Globus MDS s includes registration details

Antony Wilson –SysMan Meeting- 22 April n° 4 Information Providers - RPMs u configuration n edg-info-main-*.i386.rpm u computing element information provider n CEInformationProviders-*.i386.rpm u netmon information provider n edg-info-netmon-*.i386.rpm u storage element information provider n edg-info-se-*.i386.rpm u replica catalogue information provider n edg-info-rc-*.i386.rpm

Antony Wilson –SysMan Meeting- 22 April n° 5 Information Providers - Configuration u configuration via /etc/edg/info-mds.conf n generic information n site information provider n computing element information provider n netmon information provider n storage element information provider n replica catalogue information provider u static data via /opt/edg/info/mds/etc/ldif/*.ldif n computing element n replica catalogue

Antony Wilson –SysMan Meeting- 22 April n° 6 info-mds.conf - Generic WP3_DEPLOY=/opt/edg/info/mds FTREE_INFO_PORT=2171 FTREE_DEBUG_LEVEL=0 # the default value is "Mds-Vo-name=local,o=grid SITE_DN=Mds-Vo-name=local,o=grid

Antony Wilson –SysMan Meeting- 22 April n° 7 info-mds.conf - Site u Note this is usually combined with computing element SITE_INFO=yes SITE_NAME=RAL SITE_INSTALLATION_DATE= Z SITE_DATAGRID_VERSION=1 SITE_NETMON_HOST=gppnetmon.gridpp.rl.ac.uk # comma separated list with no spaces SITE_SE_HOSTS=gppse05.gridpp.rl.ac.uk # comma separated list with no spaces SITE_CE_HOSTS=gppce05.gridpp.rl.ac.uk

Antony Wilson –SysMan Meeting- 22 April n° 8 info-mds.conf – Computing Element CE_PRESENT=yes CE_HOST=gppce05.gridpp.rl.ac.uk CE_BATCHSYSTEM=pbs CE_CLUSTER_BATCH_SYSTEM_BIN_PATH=/usr/pbs/bin # comma separated list with no spaces CE_QUEUE=workq # comma separated list with no spaces CE_CLOSE_SE_ID=gppse05.gridpp.rl.ac.uk # comma separated list with no spaces, these values must relate to the corresponding CLOSE_SE_ID CE_CLOSE_SE_MOUNT_POINT=data

Antony Wilson –SysMan Meeting- 22 April n° 9 info-mds.conf – Netmon u This will be changing in the next release u This is also usually combined with computing element NETMON_PRESENT=yes NETMON_PINGER_HOST=gppnetmon.gridpp.rl.ac.uk

Antony Wilson –SysMan Meeting- 22 April n° 10 info-mds.conf – Storage Element SE_PRESENT=yes SE_ID=gppse05.gridpp.rl.ac.uk SE_SIZE= SE_TYPE=disk # comma separated list with no spaces, this is a list of Vos supported by the SE SE_VO=alice,atlas,biomedical,cms,earthob,lhcb # comma separated list with no spaces, values used in df to obtain freespace SE_FILESYSTEMS=/dev/hda2,/dev/hda4 # comma separated list with no spaces SE_CLOSE_CE=gppce05.gridpp.rl.ac.uk:2119/jobmanager-pbs-workq # comma separated list with no spaces SE_PROTOCOLS=gridftp,rfio,file # comma separated list with no spaces, these values must relate to the corresponding SE_PROTOCOLS SE_PROTOCOL_PORTS=2811,3147,

Antony Wilson –SysMan Meeting- 22 April n° 11 info-mds.conf – Replica Catalogue RC_PRESENT=yes RC_HOST=gpprc05.gridpp.rl.ac.uk # comma separated list with no spaces RC_VO=alice,atlas,biomedical,cms.earthob,lhcb

Antony Wilson –SysMan Meeting- 22 April n° 12 Static Information – Computing Element u makes use of static information n /opt/edg/info/mds/etc/ldif/ce-static.ldif n this will be changing to /opt/edg/etc/info/mds/ce-static.ldif u ldif file can be customized for a queue n /opt/edg/info/mds/etc/ldif/ce-static-queuename.ldif Architecture:intel OpSys:RH 6.2 MinPhysMemory:512 MinLocalDiskSpace:24000 NumSMPs:2 MinSPUProcessors:2 MaxSPUProcessors:2 AverageSI00:450 MinSI00:450 MaxSI00:450 RunTimeEnvironment:CMS4.2 RunTimeEnvironment:ATLAS1.1 AFSAvailable:FALSE OutboundIP:TRUE InboundIP:TRUE The architecture of the hosts composing the CE The operating system of the hosts composing the CE The minimum value of the physical memory among the hosts composing the CE The minimum local disk footprint Number of SMP hosts The minimum number of SPU processors (for SMP hosts) The Maximum number of SPU processors (for SMP hosts The Average of the SpecInt2000 benchmark of the nodes associated with the CE The minimum value of the SpecInt2000 benchmark of the nodes associated with the CE The maximum value of the SpecInt2000 benchmark of the nodes associated with the CE A List of software/packages installed on this CE Defines if AFS is installed Defines if outbound connectivity is allowed Defines if inbound connectivity is allowed

Antony Wilson –SysMan Meeting- 22 April n° 13 Static Information – Replica Catalogue u makes use of static information n /opt/edg/info/mds/etc/ldif/rc-static.ldif n this will be changing to /opt/edg/etc/info/mds/rc-static.ldif u ldif file can be customized for a virtual organization n /opt/edg/info/mds/etc/ldif/rc-static-vo.ldif Rcport: 2001 RCmanagerDN: cn=manager,rc=AliceReplicaCatalogue,dc=eu- datagrid,dc=org Rcurl: ldap://grid-vo.nikhef.nl:10389/rc=AliceReplicaCatalog,dc=eu- datagrid,dc-org

Antony Wilson –SysMan Meeting- 22 April n° 14 Starting Ftree u /etc/rc.d/init.d/edginfo-mds n start n stop n restart n status u use information provided in /etc/edg/info-mds.conf u produces 2 ldif files n one for ftree n one for Globus MDS n both point to the same information providers u starts/stops ftree

Antony Wilson –SysMan Meeting- 22 April n° 15 Configuration of the GRIS/GIIS Registration u GRIS Grid Resource Information Server u GIIS Grid Index Information Server u there is a GRIS on any machine running an information provider u there is a GIIS at site level u the GRISs register with the site GIIS u the site GIIS registers with the country GIIS/VO GIIS u registration is controlled via /etc/globus.conf

Antony Wilson –SysMan Meeting- 22 April n° 16 globus.conf - Resource GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=ral GRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk

Antony Wilson –SysMan Meeting- 22 April n° 17 globus.conf - Site GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=ral GRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk GRID_INFO_GIIS_1=ral #Register with the country GIIS GRID_INFO_REG_GIIS_1=uk GRID_INFO_REG_HOST_1=gppinfo.gridpp.rl.ac.uk

Antony Wilson –SysMan Meeting- 22 April n° 18 globus.conf - Country GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=uk GRID_INFO_GRIS_REG_HOST=gppinfo.gridpp.rl.ac.uk GRID_INFO_GIIS_1=uk #Register with the top level GIIs for the testbed GRID_INFO_REG_GIIS_1=datagrid GRID_INFO_REG_HOST_1=lxshare0225.cern.ch

Antony Wilson –SysMan Meeting- 22 April n° 19 Starting Globus MDS u /etc/rc.d/init.d/globus-mds n start n stop n restart n status u use information provided in /etc/globus.conf u starts/stops Globus MDS

Antony Wilson –SysMan Meeting- 22 April n° 20 Example Searches u Ftree is on port 2171 u Globus MDS is on 2135 u search a resource: ldapsearch -x -H ldap://gppse05.gridpp.rl.ac.uk:2135-b 'Mds-Vo- name=local,o=grid objectclass=* u search a site: ldapsearch -x -H ldap://gppce05.gridpp.rl.ac.uk:2135-b 'Mds-Vo- name=ral,o=grid objectclass=* u search a country/VO: ldapsearch -x -H ldap://gppinfo.gridpp.rl.ac.uk:2135-b 'Mds-Vo- name=uk,o=grid objectclass=* u or use an LDAP browser such as mapcentre as provided by WP7 n

Antony Wilson –SysMan Meeting- 22 April n° 21 Summary u edit n /etc/edg/info-mds.conf n /etc/globus.conf n /opt/edg/info/mds/etc/ldif/*.ldif s this will be changing to /opt/edg/etc/info/mds/*.ldif u produce ldifs and start ftree n /etc/rc.d/init.d/edginfo-mds u start Globus MDS n /etc/rc.d/init.d/globus-mds u documentation available at: n