1. EGEE-III INFSO-RI-222667 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks GStat 2.0 Joanna Huang (ASGC) Laurence Field (CERN-IT) David Horat (CERN-IT) EGEE’09 Conference, Barcelona, 21 th September 2009

2. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 2 Overview What is GStat? Motivations for Version 2.0 Main Concepts Architecture Screen Shots of GStat 2.0 Beta

3. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 3 What is GStat?

4. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 4 What is GStat? An operations tool for the production infrastructure –Used successfully for over 5 years Started as a summary web page for the infrastructure –For people who didn’t want to do an LDAP search  How many sites have joined?  How many CPUs do we have?  How much storage is available? Gradually expanded to provide additional functionality –Site summaries –Information sanity check –BDII performance metrics –Alarms for information system problems –etc.

5. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 5 Motivations For Version 2.0 The pages are now too cluttered –The grid has grown to 300+ sites –1 CE at CERN to 20 CEs at CERN It is a single, centralized instance –EGI would like de-centralized, regional-based operations tools The information checks are not easily reusable –Difficult for use by sys admins and for software certification Tight coupling with SAM –Requires high-availability operation and notifications High-maintenance backend –Due to the gradual evolution of the code base

6. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 6 Design Goals Consolidate the existing code base –To give a low-maintenance solution Isolate the testing component –To ensure that the tests are reusable Remove the dependency on the GOC database –To enable de-centralized deployment  Bootstrapping should be achieved by querying a BDII Redesign the displays to address specific use cases –Generally improve the presentation Ensure that components are reusable –And that GStat is extensible

7. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 7 Main Concepts Common Libraries DB Configuration Information System Snapshot Topology (Site, Services etc.) Core Validation Monitoring Visualisation Information Content Testing Information System Monitoring

8. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 8 GStat 2.0 Framework

9. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 9 Implementation Choices Nagios –Manages the execution of tests and test results –Probes can be re-used by other OAT applications –Used for:  Information Content Validation Tests  BDII Service Monitor Django –Web application framework to simplify page generation  We no longer have to write code that prints html –Object-relational mapper simplifies database integration –Significant experience already exists within the OAT –Used for:  Snapshot and topology import scripts  Web page rendering and management

10. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 10 Reference BDII results graphs snapshot geo app Detailed Architecture topology check-service configure check-content Entities GLUE browser app summary app bdii view app glue app topology app site/top BDII … Data Interface Visualisation

11. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 11 Geo View: Open Layers

12. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 12 Geo View: Google Maps

13. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 13 LDAP Browser

14. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 14 Summary Views

15. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 15 Summary View: Grid

16. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 16 Summary View: EGEE ROC

17. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 17 Summary View: WLCG Tier

18. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 18 Summary View: Country

19. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 19 Site View: Overall Info and Status

20. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 20 Site View: More Detailed report

21. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 21 Summary: Top-level BDII View

22. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 22 Summary: Site BDII View

23. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 23 Summary Builds upon the success of first GStat –Consolidation of the current code base  Reducing the maintenance cost Addresses the design goals –Re-usable tests –Regional use –Improved displays Leveraging tools already used with the OAT –Sharing experience and re-using components Prototype available for evaluation –Suggestions of desired features are welcome Extensible, modular approach –Build your own visualisation app!

24. Enabling Grids for E-sciencE EGEE-III INFSO-RI-222667 24 GStat 2.0 Beta Release GStat 2.0 Beta Release Notes –http://svnweb.cern.ch/trac/gridinfo/blog/GStat_2_0_beta Installation and Configuration Instructions –http://goc.grid.sinica.edu.tw/gocwiki/GSInstallationGuide GStat 2.0 Beta instance for evaluation –http://gstat-dev.cern.ch/gstat GStat Support List –project-grid-info-support@cern.ch –any questions or comments or problems, please email the GStat support list Feedback on desired features are welcome !