Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n. 306819.

Slides:



Advertisements
Similar presentations
Chapter 5: Server Hardware and Availability. Hardware Reliability and LAN The more reliable a component, the more expensive it is. Server hardware is.
Advertisements

MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 7 Configuring File Services in Windows Server 2008.
Overview of Active Directory Domain Services Lesson 1.
Grid Information Systems. Two grid information problems Two problems  Monitoring  Discovery We can use similar techniques for both.
Using Gstat 2 to Check your Published Information Stephen Burke RAL.
Africa & Arabia ROC tutorial The GSTAT2 Grid Monitoring tool Mario Reale GARR - Italy ASREN-JUNET Grid School - 24 November 2011 Africa & Arabia ROC Tutorial.
BINP/GCF Status Report BINP LCG Site Registration Oct 2009
Monitoring in EGEE EGEE/SEEGRID Summer School 2006, Budapest Judit Novak, CERN Piotr Nyczyk, CERN Valentin Vidic, CERN/RBI.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
WLCG Nagios and the NGS. We have a plan NGS is using a highly customised version of the (SDSC written) INCA monitoring framework. It was became too complicated.
GLite Information System(s) Antonio Juan Rubio Montero CIEMAT 10 th EELA Tutorial. Madrid, May 7 th -11 th,2007.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GStat 2.0 Joanna Huang (ASGC) Laurence Field.
Using the EMI testbed ARC middleware Marek Kočan University of P. J. Šafárik, Košice.
June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Performance Improvements to BDII - Grid Information.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration Antonio Juan.
BDII Server Installation and Configuration Manuel Rubio del Solar Extremadura Advanced Research Center (CETA-CIEMAT) 11th EELA Tutorial for Users Sevilla,
Information System Status and Evolution Maria Alandes Pradillo, CERN CERN IT Department, Grid Technology Group GDB 13 th June 2012.
Grid Deployment Enabling Grids for E-sciencE BDII 2171 LDAP 2172 LDAP 2173 LDAP 2170 Port Fwd Update DB & Modify DB 2170 Port.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information Dump White Areas Lecture Laurence.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Information System Claudio Cherubino.
E-infrastructure shared between Europe and Latin America gLite Information System(s) Manuel Rubio del Solar CETA-CIEMAT EELA Tutorial, Mérida,
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America BDII Server Installation Yubiryn Ramírez.
Site-BDII Installation&Configuration Sara Bertocco INFN Padova 11 th International GridKa School 2013 – Big Data, Clouds and Grids.
INFSO-RI Enabling Grids for E-sciencE /10/20054th EGEE Conference - Pisa1 gLite Configuration and Deployment Models JRA1 Integration.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical: The Information Systems.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Monitoring Tools E. Imamagic, SRCE CE.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Nagios Emir Imamagic /SRCE EGEE’09,
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System Tutorial Laurence Field.
EGEE is a project funded by the European Union under contract IST Experiment Software Installation toolkit on LCG-2
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Configuration Data or “What should be.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI GLUE 2: Deployment and Validation Stephen Burke egi.eu EGI OMB March 26 th.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
CERN IT Department CH-1211 Genève 23 Switzerland t DPM status and plans David Smith CERN, IT-DM-SGT Pre-GDB, Grid Storage Services 11 November.
Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.
The Grid Information System Maria Alandes Pradillo IT-SDC White Area Lecture, 4th June 2014.
Information System Evolution Enabling Grids for E-sciencE EGEE-III INFSO-RI LDAP LDAP_ADD LDAP_MODIFY Query Merge Update Provider Plugin LDIF.
Servizi core INFN Grid presso il CNAF: setup attuale
Piotr Bała, Marcin Radecki, Krzysztof Benedyczak
Scaling Network Load Balancing Clusters
The Information System in gLite middleware
gLite Information System
Site Administration Tools: Ansible
NGI and Site Nagios Monitoring
Installation and configuration of a top BDII
gLite Information System(s)
Practical: The Information Systems
BDII Performance Tests
lcg-infosites documentation (v2.1, LCG2.3.1) 10/03/05
The Information System in gLite
Sergio Fantinel, INFN LNL/PD
Towards an Integrated Information system: the EMI view
SRM2 Migration Strategy
Information System Virginia Martín-Rubio Pascual
gLite Information System
NGS Oracle Service.
gLite Information System
Site BDII Installation&Configuration
gLite Information System(s)
EGEE Middleware: gLite Information Systems (IS)
gLite Information System
Information System (BDII)
Designing IIS Security (IIS – Internet Information Service)
Site availability Dec. 19 th 2006
Information Services Claudio Cherubino INFN Catania Bologna
Presentation transcript:

Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n Information System Overview Christos Kanellopoulos, GRNET AA ROC All-Hands Meeting, 25 March 2013

Information System Overview  Mission Critical component  Provide Information about Grid Services  Built upon the Berkley Database Information Index (BDII)  The BDII can be visualized as an LDAP database 2 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Information System Overview  Hierarchical Structure of 3 levels  Resource Level BDII  Site Level BDII  Top Level BDII 3 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Information System Overview 4

 Resource Level BDII  usually co-located with the grid service  Provides information about the specific service (e.g. SE) 5 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Information System Overview  Site Level BDII  Each Grid Site runs an instance of a Site Level BDII  Aggregates the information from all the Resource Level BDIIs of the Site  In the past it was common that the Site BDII was co- located with the CE. Nowadays, it is advised that the Site BDII runs as a standalone service 6 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Information System Overview  TOP Level BDII  Aggregates all the information from the Site Level BDII  Contains all the Information about the Grid Services  The information system clients query a top level BDII to find the information that they require  There are multiple instances of the top level BDII in order to provide a fault tolerant, load balanced service 7 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Information System Overview  The BDII are populated with information by running Information Providers (IP)  Scripts which obtain information  Format it as LDIF  Print the result in stdout  Can be used in order to query other BDIIs  This is how the BDII hierarchy is being created  The information provided by the BDII conforms to the Glue Schema  Glue v1.x (Old version of the Glue Schema)  Glue v2.x (New version)  The BDII supports both Glue1 and Glue2 in parallel 8 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Information System Overview 9 Node TypeGlue 1Glue 2Notes LCG-CEYesNoObsolete CREAMYes Full support in EMI 2 CLUSTERYes Full support in EMI 2 WMSYes LBYes DPMYesEMI 2 dCacheYesEMI 2 StoRMYesEMI 2 LFCYesEMI 2 FTSYesEMI 2Channels not yet published HydraEMI 1EMI 2Not yet released in EMI 2 AMGAYesEMI 2 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Information System Overview 10 Node TypeGlue 1Glue 2Notes VOMSYes MyProxyYes ArgusNoEMI 2Publication for Deployment Monitoring Site BDIIYes Top BDIIYes R-GMAYesNoObsolete VOBOXYes APELNo Internal Service. Publishing not yet requested SquidNo Configuration exists but not enabled NagiosYes

Information System Overview  Freedom of Choice for Resources mechanism (FCR) is used within a top level BDII to enable the Virtual Organization (VO) to influence their usage of specific service  generates a list of services available to a VO  can be used by the VO manager to either white list or black list sites  downloaded by the top level BDII and it deletes the ACL for the VO on that specific service from the database  The information system is bootstrapped from the information in the Grid Operations Center Database (GOCDB)  Site enter the URL of their Site Level BDII3  A list of LDAP URLs for all the sites in the Grid is generated by the GOCDB  This list is downladed by the Information Provider to the Top Level BDII 11 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Tags  The IS can be used to publish specific tags  Two types of tags  VO Specific Tags (usually managed by the VO Admins)  Site wide Tags (usually managed by the Site Admins) 12 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Tags  Publishing VO Specific tags  The VO published for a specific VO can be found in the CE at the path: /opt/edg/var/info/ /.list  The Tag format follows the pattern: VO- -  Usually the VO Manager runs a script that modifies the vo tag file and appends any new Tags  globus-job-run srvslngrd004.uct.ac.za:2119/jobmanager-fork -s hello_shared_tag.sh  ldapsearch –LLL –H ldap://srvslngrd001.uct.ac.za:2170 –x –b \ 'mds-vo-name=local,o=grid'\ '(GlueHostApplicationSoftwareRunTimeEnvironment=VO-sagrid-hello)' \ GlueChunKey 13 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Tags  Publishing Site wide Tags  In site-info.def the CE_RUNTIMEENV holds a space separated list of software tags supported by the site  E.g. CE_RUNTIMEENV="LCG-2 LCG-2_1_0 LCG-2_1_1 LCG-2_2_0 GLITE-3_0_0 GLITE-3_1_0 GLITE-3_2_0 TAG1 TAG2" 14 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

High Availability Setup for TOP BDII  Hardware Requirements:  Dual core CPU  10GB of Hard Disk  4GB of RAM  Best Practices  DNS Round Robin load balancing  Fault Tolerance DNS Updater 15 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

High Availability Setup for TOP BDII  DNS Round Robin Load Balancer  Instances should have the same hardware configurations. If not, a load balancing arbiter is needed  It is recommended to have 3 instances running  Fault Tolerance DNS Updater  Test the group of the HA (E.g. nagios)  ldapsearch -x -h -p b "o=infosys"  remove or add DNS entries through DNS dynamic updates 16 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |

Further Information   mation mation    info_configuration_variables#site_BDII info_configuration_variables#site_BDII 17 Christos Kanellopoulos | | AA Roc All Hands Meeting 03/2013 |