Transition to EGI PSC-06 Istanbul Ioannis Liabotis Greece GRNET

Slides:



Advertisements
Similar presentations
SEE-GRID-SCI Regional Grid Infrastructure: Resource for e-Science Regional eInfrastructure development and results IT’10, Zabljak,
Advertisements

SEE-GRID-SCI SEE-GRID-SCI Operations Procedures and Tools Antun Balaz Institute of Physics Belgrade, Serbia The SEE-GRID-SCI.
Monitoring in EGEE EGEE/SEEGRID Summer School 2006, Budapest Judit Novak, CERN Piotr Nyczyk, CERN Valentin Vidic, CERN/RBI.
1 1 Service Composition for LHC Computing Grid Monitoring Beob Kyun Kim e-Science Division, KISTI
02/07/09 1 WLCG NAGIOS Kashif Mohammad Deputy Technical Co-ordinator (South Grid) University of Oxford.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GStat 2.0 Joanna Huang (ASGC) Laurence Field.
James Casey, CERN, IT-GT-TOM 1 st ROC LA Workshop, 6 th October 2010 Grid Infrastructure Monitoring.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team James Casey EGEE’08.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Multi-level monitoring - an overview James.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
CERN IT Department CH-1211 Geneva 23 Switzerland t GDB CERN, 4 th March 2008 James Casey A Strategy for WLCG Monitoring.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Wojciech Lapka SAM Team CERN EGEE’09 Conference,
SEE-GRID-SCI NA1-Technical Execution Plan Overview Open of PSC-03 Bucharest Ioannis Liabotis Greece GRNET iliaboti grnetSPAMFREE.gr.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Operations Automation Team KoM, May ROC VIEW (SWE)‏ Javier Lopez Cacheiro/
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
EMI INFSO-RI Accounting John Gordon (STFC) APEL PT Leader.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Ops Portal New Requirements.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Monitoring Tools E. Imamagic, SRCE CE.
GridView - A Monitoring & Visualization tool for LCG Rajesh Kalmady, Phool Chand, Kislay Bhatt, D. D. Sonvane, Kumar Vaibhav B.A.R.C. BARC-CERN/LCG Meeting.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Nagios Emir Imamagic /SRCE EGEE’09,
CERN - IT Department CH-1211 Genève 23 Switzerland t IT-GD-OPS attendance to EGEE’09 IT/GD Group Meeting, 09 October 2009.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks What all NGIs need to do: Helpdesk / User.
SEE-GRID-SCI Grid Operations Procedures Antun Balaz Institute of Physics Belgrade Serbia The SEE-GRID-SCI initiative.
NGI France-Grilles: Infrastructure evolution H. Cordier.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ROC model assessment AP ROC ShuTing Liao.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
APEL Architecture Alison Packer. Overview Grid jobs accounting tool APEL Client software - installed in sites (CEs, gLite- APEL node) APEL Server accepts.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations automation team presentazione.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Regional tools use cases overview Peter Solagna – EGI.eu On behalf of the.
INFSO-RI Enabling Grids for E-sciencE GOCDB2 Matt Thorpe / Philippa Strange RAL, UK.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GOCDB4 Gilles Mathieu, RAL-STFC, UK An introduction.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI A pan-European Research Infrastructure supporting the digital European Research.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IT ROC: Vision for EGEE III Tiziana Ferrari.
TSA1.4 Infrastructure for Grid Management Tiziana Ferrari, EGI.eu EGI-InSPIRE – SA1 Kickoff Meeting1.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI APEL Regional Accounting Alison Packer (STFC) Iván Díaz Álvarez (CESGA) APEL.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Operations Portal OTAG September, 21th 2011 Cyril L’Orphelin – CCIN2P3/CNRS.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operational Tools M2 Update James Casey.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI MPI VT report OMB Meeting 28 th February 2012.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks An insight into GOCDB for ROD Operators.
CESGA QR2 SA1-SWE Partner Coordination Meeting 2 CICA, Sevilla
GGUS New features and roadmap
Documentation, Best Practices and Procedures: Roadmap
Regional Operations Centres Core infrastructure Centres
NGI and Site Nagios Monitoring
WLCG Resources Reporting
SA1.4 Infrastructure for Grid Management Overview
Marc-Elian Bégin ETICS Project, CERN
POW MND section.
Operational Tools Update OMB 27/07/2010
Introduction to OAT presentations
Grid Operations Procedures
Evolution of SAM in an enhanced model for monitoring the WLCG grid
Security Monitoring in a Nagios world
Overview of IPB responsibilities in EGEE-III SA1
EGI Community Forum 2012 Munich, 29 March 2012
Operations & Coordination Tools
Cyril L’Orphelin (CC-IN2P3) COD-19, Bologna, March 30th 2009
Maite Barroso, SA1 activity leader CERN 27th January 2009
Action U-E-5 Technical Coordination – User Technical Support
Outline Introduction Objectives Motivation Expected Output
Cristina del Cano Novales STFC - RAL
John Gordon (STFC) APEL PT Leader
Monitoring in EGEE Automatisierung & Regionalisierung im Hinblick auf EGI Torsten Antoni (KIT), James Casey (CERN), Sabine Reißer (KIT)
Solutions for federated services management EGI
GLOBUS ACCOUNTING USING GRID-SAFE - DEMO
APEL as a Global Accounting Repository
Core Activities re-assessment
User Accounting Integration Spreading the Net.
Presentation transcript:

Transition to EGI PSC-06 Istanbul Ioannis Liabotis Greece GRNET iliaboti <at> grnetSPAMFREE.gr The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

NGI International Tasks Monitoring Infrastructure / availability, reliability Regional Dashboard (CIC Portal, BBmSAM, Nagios) GOCDB – HGSM Gstat 2.0 Accounting Help-Desk Core Services Documentation/wiki

Monitoring Infrastructure / availability, reliability

Nagios & Messaging System Integration

My EGEE Portal Visualise Test Results Replace SAM Portal

Links about Monitoring OAT web page https://twiki.cern.ch/twiki/bin/view/EGEE/OAT_EGEE_III OAT Multi-level monitoring architecture https://twiki.cern.ch/twiki/bin/view/EGEE/MultiLevelMonitoringOverview OAT Milestones https://twiki.cern.ch/twiki/bin/view/EGEE/MultiLevelMonitoringMilestones Operations Automation Strategy https://edms.cern.ch/document/927171

Regional Dashboard

Regional Dashboard

GOCDB 4 - Usage Models CENTRAL GOCDB WS GUI REGION / NGI 1 Adapter 3 2 GOCDB module EGI tools EGI users Central GOCDB (0) is a repository to access all EGEE/EGI data centrally (read only). Regions can have their own GOCDB deployed (1), use central GOCDB (2) or use any other tool with similar functions (3) REGION / NGI Local tools Local users 1 Local tool Adapter 3 2

Gstat 2.0

GStat 2.0 Links GStat 2.0 Beta Release Notes http://svnweb.cern.ch/trac/gridinfo/blog/GStat_2_0_beta Installation and Configuration Instructions http://goc.grid.sinica.edu.tw/gocwiki/GSInstallationGuide GStat 2.0 Beta instance for evaluation http://gstat-dev.cern.ch/gstat GStat Support List project-grid-info-support@cern.ch any questions or comments or problems, please email the GStat support list Feedback on desired features are welcome !

Accounting Architecture OTHER TOOL APEL FLEXIBLE ARCHIVER CENTRAL DATABASE CENTRAL ACCOUNTING PORTAL GRID/SUBGRID MySQL ACTIVEMQ BROKER

CENTRAL ACCOUNTING PORTAL Accounting Region A ACTIVEMQ BROKER REGION A PROS: No changes required No regional accounting infrastructure to install and maintain CONS: Accounting data for region only available through Central Accounting Portal (have to filter) APEL Region A APEL (Parser + Publisher) installed at all sites No Regional Accounting Server Sites publish directly to Central Accounting Server FLEXIBLE ARCHIVER APEL CENTRAL DATABASE CENTRAL ACCOUNTING PORTAL

CENTRAL ACCOUNTING PORTAL Accounting Region B APEL REGION B REGIONAL ARCHIVER REGIONAL DATABASE REGIONAL PORTAL PROS: No significant changes on client Regional Portal Data available at region Easier to accounting data at sites Filtering of data for Central Accounting Portal CONS: Install and maintain an Accounting Server ACTIVEMQ BROKER Region B APEL (Parser + Publisher) installed at all sites Regional Accounting Server Sites publish to Regional Archiver Regional Accounting Server publishes summaries to Central Accounting Server FLEXIBLE ARCHIVER CENTRAL DATABASE CENTRAL ACCOUNTING PORTAL

CENTRAL ACCOUNTING PORTAL Accounting Region C/D ACTIVEMQ BROKER REGION D REGION C REGIONAL DB REGIONAL DB OTHER TOOL FLEXIBLE ARCHIVER OTHER TOOL Region C Own accounting tool Own accounting system Region to publish summaries to the Central Accounting System Region D Own accounting tool Own accounting system Region to publish individual records to the Central Accounting System CENTRAL DATABASE CENTRAL ACCOUNTING PORTAL

Help Desk

Regional Help Desk to GGUS Integration Currently Mail SOAP Recommended for EGI Messaging (Active MQ)

Needs for EGI Nagios: Country Level Installation Needed Regional Dashboard: Can use central or Country level GOCDB: Can use Central or Country Level or HGSM Gstat 2.0: Central or Country Level Accounting: Central, Country Level Help-Desk: Central, Country Level Core Services: Central, VO Based, Country Level Documentation wiki per country

End of EGEE-III Add all countries to EGEE tools (Mid February) Nagios: Regional Level Installation (Greece) Regional Dashboard: Central with regional/country views GOCDB: Central or HGSM (Hakan to provide roadmap by end of the year) Gstat 2.0: Central or Country Level Accounting: Central, Regional (SEE-GRID portal, Bulgaria) Help-Desk: Regional (Romania, Bulgaria) – Knowledge collection Core Services: Central, VO Based, Country Level Documentation/wiki regional

Beginning of EGI Nagios: Regional Level Installation (Greece) Regional Dashboard: Central with regional/country views GOCDB: Central or HGSM Gstat 2.0: Central or Country Level Accounting: Central, Regional (BG, Greece) Help-Desk: Regional (Romania, Bulgaria) Core Services: Central, VO Based, Country Level (All) Documentation/wiki regional

Action Plan to the end of EGEE-III Follow up activities of tools regionalization Implement Plan of EGEE-III Implement EGI plan wherever possible (to be clarified)