NGI France-Grilles: Infrastructure evolution H. Cordier.

Slides:



Advertisements
Similar presentations
LCG-France Project Status Fabio Hernandez Frédérique Chollet Fairouz Malek Réunion Sites LCG-France Annecy, May
Advertisements

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks From ROCs to NGIs The pole1 and pole 2 people.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EG recent developments T. Ferrari/EGI.eu ADC Weekly Meeting 15/05/
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
Monitoring the Grid at local, national, and Global levels Pete Gronbech GridPP Project Manager ACAT - Brunel Sept 2011.
02/07/09 1 WLCG NAGIOS Kashif Mohammad Deputy Technical Co-ordinator (South Grid) University of Oxford.
WLCG Nagios and the NGS. We have a plan NGS is using a highly customised version of the (SDSC written) INCA monitoring framework. It was became too complicated.
James Casey, CERN, IT-GT-TOM 1 st ROC LA Workshop, 6 th October 2010 Grid Infrastructure Monitoring.
Training and Dissemination Enabling Grids for E-sciencE Jinny Chien, ASGC 1 Training and Dissemination Jinny Chien Academia Sinica Grid.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team James Casey EGEE’08.
EGEE-III INFSO-RI Enabling Grids for E-sciencE COD21 22 Sept 2009 Forum & COD-22 since COD21 until EGI Hélène Cordier COD-22, CNRS-IN2P3,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
HLRmon accounting portal DGAS (Distributed Grid Accounting System) sensors collect accounting information at site level. Site data are sent to site or.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Operational Architecture of PL-Grid project M.Radecki,
Report from the WLCG Operations and Tools TEG Maria Girone / CERN & Jeff Templon / NIKHEF WLCG Workshop, 19 th May 2012.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
PIC port d’informació científica EGEE – EGI Transition for WLCG in Spain M. Delfino, G. Merino, PIC Spanish Tier-1 WLCG CB 13-Nov-2009.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CIC portal Requirements from users WLCG service.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Ops Portal New Requirements.
CERN IT Department CH-1211 Genève 23 Switzerland t CERN IT Monitoring and Data Analytics Pedro Andrade (IT-GT) Openlab Workshop on Data Analytics.
AEGIS Academic and Educational Grid Initiative of Serbia Antun Balaz (NGI_AEGIS Technical Manager) Dusan Vudragovic (NGI_AEGIS Deputy.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Nagios Emir Imamagic /SRCE EGEE’09,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Grid Oversight in Service Level Agreement environment Małgorzata Krakowian,
Why a Commercial Provider should Join the Academic Cloud Federation David Blundell Managing Director 100 Percent IT Ltd Simple, Flexible, Reliable.
SAM Status Update Piotr Nyczyk LCG Management Board CERN, 5 June 2007.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Security Monitoring Daniel Kouřil EGI-TF 2011.
EMI INFSO-RI Testbed for project continuous Integration Danilo Dongiovanni (INFN-CNAF) -SA2.6 Task Leader Jozef Cernak(UPJŠ, Kosice, Slovakia)
NGI_TR Emrah Akkoyun TR-Grid Operational Center EGI-InSPIRE – SA1 Kickoff Meeting1.
EGI Process Assessment and Improvement Plan – EGI core services – Tiziana Ferrari FedSM project 1EGI Process Assessment and Improvement Plan (Core Services)
Setting up NGI operations Ron Trompert EGI-InSPIRE – ROD teams workshop1.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n
INFN/IGI contributions Federated Clouds Task Force F2F meeting November 24, 2011, Amsterdam.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Regionalisation summary Prague 1.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
HLRmon Enrico Fattibene INFN-CNAF 1EGI-TF Lyon, France19-23 September 2011.
APEL Architecture Alison Packer. Overview Grid jobs accounting tool APEL Client software - installed in sites (CEs, gLite- APEL node) APEL Server accepts.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Update on Service Availability Monitoring (SAM) Marian Babik, David Collados,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Regional tools use cases overview Peter Solagna – EGI.eu On behalf of the.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI VO Services Activities VO Services Activities NA3 F2F Meeting (3/03/2011)
TSA1.4 Infrastructure for Grid Management Tiziana Ferrari, EGI.eu EGI-InSPIRE – SA1 Kickoff Meeting1.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI APEL Regional Accounting Alison Packer (STFC) Iván Díaz Álvarez (CESGA) APEL.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Operations Portal OTAG September, 21th 2011 Cyril L’Orphelin – CCIN2P3/CNRS.
1 EGI Federated Cloud Architecture Matteo Turilli Senior Research Associate, OeRC, University of Oxford Chair – EGI Federated Clouds Task Force
CESGA QR2 SA1-SWE Partner Coordination Meeting 2 CICA, Sevilla
Transition to EGI PSC-06 Istanbul Ioannis Liabotis Greece GRNET
Daniele Bonacorsi Andrea Sciabà
John Gordon STFC OMB 26 July 2011
Introduction to OAT presentations
Evolution of SAM in an enhanced model for monitoring the WLCG grid
Security Monitoring in a Nagios world
Artem Petrosyan (JINR), Danila Oleynik (JINR), Julia Andreeva (CERN)
Advancements in Availability and Reliability computation Introduction and current status of the Comp Reports mini project C. Kanellopoulos GRNET.
E-GRANT development plans
Operations & Coordination Tools
Maite Barroso, SA1 activity leader CERN 27th January 2009
Infrastructure Area EMI All Hands Summary.
Cristina del Cano Novales STFC - RAL
John Gordon (STFC) APEL PT Leader
TS4.10 Comp Reports A new approach to Computing Availability/Reliability reports for EGI Progress Report C. Kanellopoulos GRNET 9/14/2018.
Solutions for federated services management EGI
Pierre Girard ATLAS Visit
Operational Tools & Middleware Versions Monitoring
Operations sustainability
GLOBUS ACCOUNTING USING GRID-SAFE - DEMO
APEL as a Global Accounting Repository
Site availability Dec. 19 th 2006
User Accounting Integration Spreading the Net.
Operations Management Board March 26
Presentation transcript:

NGI France-Grilles: Infrastructure evolution H. Cordier

Operations and infrastructure pole  Operations organization Infrastructure: -Accounting -Monitoring -Certification/Deployment -Certification Authority -Operations portal EGI (incl. EGI Operations Dashboard)

Infrastructure Pole  Accounting  Monitoring  Certification/Deployment

Architecture Globale 4  All regions to publish via ActiveMQ  Provide regional accounting system  Allow regions to continue using central system  Collect records from other grids/tools via same interface Source: © Cristina Del Cano Novales Currently – EGI Project

APEL-DB SITE 1 SITE 2 SITE 3 APEL-Publisher AMQ Broker SITE 1 Apel-Parser SITE 2 Apel-Parser SITE 3 Apel-Parser PORTAIL d'ACCOUNTING – NGI FRANCE SITE non EGI SITE 4 Parser Currently–NGI_France

Currently/Forecasts  Now : From 3 types to 1 type of sites publishing CC : Direct publication at RAL Sites using CC’s monbox: Auvergrid/LPC/SUBATECH/IPNL/IRES/LPSC Sites using their own monbox  Publication to EGI : From GRIF Filtering of relevant sites, Mutualization of glite-APEL /1 GRIF Transition - Data storage and backup  Participation in NGI task forces for a reliable accounting

Monitoring  Accounting  Monitoring  Certification/Deployment

 National Monitoring since June 2010  MyEGI set-up  On line documentation for sites-admins:  Tests to turn critical on dec 1rst : bdii.freshness Procedure in progress  Cream-CE into availability/Reliability algorithm Algorithm alteration Currently – NGI_FRANCE

 Systematic registration of incidents/problems: # – Introduction of arbitrary probes # – Nagios box redundancy # – Close SE and CE Av/Rel computations Liste_des _diff.C3.A9rentes_Requetes  Under study : Several Nagios boxes set-up updates, certification, redundancy, security, VO specific, « Supra » VO, National VO

 Accounting  Monitoring  Certification/Deployment

Currently  First Meeting on Nov 9th infrastructure: 1 WMS/LB, 1 site BDII, 1 TopBDII mission 1: nodes certification tests on-demand and monitoring mission 2 : deployment /Quattor template  2 infrastructures, 2 roles  Roadmap : certification- Provide Test nodes Test m/w components before deployment SupportSupport for deployment at sites completeOrganize a complete & reliable infrastructure : (co-administration, tech & proc checks, communication channels) VM implementation & Quattor Server

Perspectives: From last workshop on  National VO  Set- up Interface between Operations/Users  Set- up working groups roadmaps and specific procedures  Set- up metrics