1 1 Service Composition for LHC Computing Grid Monitoring Beob Kyun Kim e-Science Division, KISTI

Service Composition for LCG Monitoring 2 Outline  This talk is to introduce service composition approach as a new way to overcome problems on the use of current LCG monitoring. current LCG monitoring services’ problem requirements of integrated monitoring services an example of abstract integrated monitoring architecture

Service Composition for LCG Monitoring 3 Introduction Grid  LCG is LHC Computing Grid 120 institutes, 52 countries, 259 sites (July, 2008) 72,000 CPUs and 20 PB disks 274 VOs, 14,000 users More than 150,000 jobs are being processed Grid consists of many resources and services  too complex to understand and manage  if you can not monitor them, you can not manage it.  The purpose of grid monitoring To improve the reliability of resources To help resource providers with abstract views on their resources’ status

Service Composition for LCG Monitoring 4 Example: KISTI ALICE Tier2 Center Introduction Is there no way to see all these services’ status in one view ?

Service Composition for LCG Monitoring 5 Monitoring services for LCG  Availability testing framework – SAM/RSV  Job and Data reliability monitoring – Gridview  Grid topology – GOCDB/Registration DB  Dynamic view of the grid – BDII/CeMon  Accounting – APEL/Gratia  Experiment views – Dashboards  Fabric monitoring – Nagios, LEMON, …  Grid operations tools – CIC Portal Introduction

Service Composition for LCG Monitoring 6 Monitoring services for LCG If new monitoring service ? Introduction If we need to watch new aspects of resources ?

Service Composition for LCG Monitoring 7 Example: GOCDB

Service Composition for LCG Monitoring 8 Example: Fabric monitoring with Nagios

Service Composition for LCG Monitoring 9 Example: MonALISA Repository for ALICE Introduction

Service Composition for LCG Monitoring 10 User’s decision rule

Service Composition for LCG Monitoring 11 Requirements for LCG Monitoring Service Platform  Usually, to easily give integrated view of resources and services Integrated services should be loosely coupled  Basically, monitoring services are loosely coupled, except few of them. Service integration could be performed in distributed All services should have a standard interface Service integration process should be flexible to add and to retrieve entities  Entities include monitoring services and authorized users.

Service Composition for LCG Monitoring 12 Introduction to Service Composition

Service Composition for LCG Monitoring 13 Service Composition for Monitoring  Result of service composition Integrated monitoring view that consumer requested  Unit services to be used in service composition Existing monitoring service (SAM, Gridview, GOCDB, BDII, APEL, Dashboards, Nagios, … ) SAM (page 1) SAM (page 2) SAM_total Nagios gStat Service Mon. APEL Service Stat.

Service Composition for LCG Monitoring 14 Service Composition of Monitoring  Security of monitored information LCG users are authorized based on VO.  make it easy to add new users All services that are critical to security should be aware of VO based authorization.  make it easy to add new services SAM (page 1) SAM (page 2) SAM_total Nagios gStat Service Mon. APEL Service Stat. GOCDB User Cert. VOMS

Service Composition for LCG Monitoring 15 Service Composition of Monitoring  Composition rule A kind of service to give flexibility to user-defined integrated service  Decision function SAM (page 1) SAM (page 2) SAM_total Nagios gStat Service Mon. APEL Service Stat. GOCDB User Cert. VOMS Service_CRSAM_CRCR

Service Composition for LCG Monitoring 16 Service registration and retrieval  Service registration and retrieval are fundamental functions of service composition and execution GOCDB VOMS SAMNagiosAPELgStatGridviewNew Service Service Descriptions Service Registry Query Parser Composition Rule Query Engine Service Composition Engine X.509 Athentication & Authorization while using Composited Services

Service Composition for LCG Monitoring 17 Conclusion  To introduce a new way to overcome problems on the use of current LCG monitoring, service composition approach is introduced. To minimize the complexity of the use and management of LCG, new integrated view of monitoring information is needed.  By the use of service composition approach for LCG monitoring: Users can have flexibility to build their own monitoring view Users can add their own decision factor to their monitoring view with Composition Rule By the use of LCG’s auth. & authorization scheme, users can have the flexibility to add new service and new user.

Service Composition for LCG Monitoring 18