Presentation is loading. Please wait.

Presentation is loading. Please wait.

EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Acccounting Portal Javier Lopez Cacheiro/

Similar presentations


Presentation on theme: "EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Acccounting Portal Javier Lopez Cacheiro/"— Presentation transcript:

1 EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks Acccounting Portal Javier Lopez Cacheiro/ CESGA ARM-8 Athens

2 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 2 Outline Requirements EGEE View –Global View –ROC View –Site View –VO Metrics View OSG View Unregistered View Future Work SWE RAP

3 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 3 Requirements The site must fulfill the following requirements in GOCDB: –Site must appear as a Certified site in the Production or PPS infrastructure  Currently suspended sites are also shown –Site must have at least one CE registered Site must publish data

4 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 4 APEL LcgRecords table: Fixed schema Data are stored centrally: Production: –Flexible Archiver @ RAL Pre-Production –Flexible Archiver @ CESGA

5 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 5 LcgRecords ExecutingSite ExecutingCE LocalJobID LCGJobID LocalUserID LCGUserID LCGUserVO StartTime StopTime ElapsedTime BaseCpuTime SpecInt2000 SpecFloat2000 MemoryReal MemoryVirtual

6 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 6 SumCPU ExecutingSite LCGUserVO Njobs SumCPU NormSumCPU SumWCT NormSumWCT Month Year RecordStart RecordEnd

7 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 7 MetricVO LCGUserVO Njobs SumCPU NormSumCPU SumWCT NormSumWCT Week Month Year RecordStart RecordEnd

8 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 8 EGEE VIEW

9 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 9 Accounting Portal @GOC

10 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 10 EGEE View

11 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 11 EGEE Hierarchical Tree

12 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 12 Selection Frame

13 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 13 EGEE View Data showed: Number of jobs Norm. Sum CPU Sum CPU Sum Elapsed Norm. Sum Elapsed CPU Efficiency (NEW) Cumulative Charts (NEW)

14 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 14 Global View Lisf of CERTIFIED sites NOT publishing accounting data to GOC in the last 3 months List of sites publishing accounting data but NOT defined in the GOCDB List of certified sites (including also currently suspended sites) that have published accounting data with SpecInt = 0 during the selected period Number of CERTIFIED sites publishing accounting records to GOC Summary usage statistics corresponding to the selected options

15 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 15 Current Status

16 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 16 Accounting Enforcement Sites that are not publishing accounting data (>7 days) Sites using a non-registered GOCDB sitename Normalization – SpecInt < 150 – SpecInt > 2500 – More than 3 different SpecInt values during the last month

17 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 17 Accounting Enforcement

18 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 18 CPU Normalization with PBS How to compare CPU values from different nodes? Each site publishes one GlueHostBenchmarkSI00 Homogeneous sites: –No problem –Unfortunately the least common case Heterogeneous sites: –Set PBS $cputmult factor in each node –CPU Normalization Standalone Test to obtain SPECint

19 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 19 Normalized CPU

20 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 20 Normalized CPU

21 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 21 ROC View Lisf of CERTIFIED sites NOT publishing accounting data to GOC in the last 3 months Summary usage statistics corresponding to the selected options A Gantt chart showing a summary of the accounting records for all sites in the ROC

22 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 22 Site View Summary usage statistics corresponding to the selected options

23 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 23 VO Metrics Active VO Integrated NJobs Integrated Norm. CPU Integrated CPU Integrated Norm. Elapsed Integrated Elapsed

24 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 24 Integrated CPU

25 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 25

26 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 26 OSG View Lisf of OSG sites NOT publishing accounting data to GOC in the last 3 months Summary usage statistics corresponding to the selected options A Gantt chart showing a summary of the accounting records for all sites in the ROC

27 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 27 UNREGISTERED View Summary usage statistics corresponding to the selected options A Gantt chart showing a summary of the accounting records for all sites in the ROC

28 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 28 Future Work Include DC information (now only Biomed) User level information (DN/VOMS) Possible Security Levels – layer 1 = “anonymous” information: open/certificate? – layer 2 = “own” user accounting: certificate based – layer 3 = VO accounting: VO admins – layer 4 = Site accounting: Site admins – layer 5 = ROC accounting: ROC admins New metrics SAM accounting enforcement test Requests? –Links to useful views of the data (A. Mills)

29 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 29 SWE

30 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 30

31 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 31

32 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 32

33 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 33 RAP

34 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 34

35 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 35

36 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 36 References EGEE View Wiki Page –http://goc.grid.sinica.edu.tw/gocwiki/EGEE_Viewhttp://goc.grid.sinica.edu.tw/gocwiki/EGEE_View EGEE View –http://www3.egee.cesga.es/gridsite/accounting/CESGA/egee.phphttp://www3.egee.cesga.es/gridsite/accounting/CESGA/egee.php Regional Accounting Portal (RAP) –http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/acctROC/http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/acctROC/ SWE Accounting Portal –http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/ Accounting Enforcement –https://edms.cern.ch/document/753895https://edms.cern.ch/document/753895 –http://www3.egee.cesga.es/acctenfor/http://www3.egee.cesga.es/acctenfor/

37 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 ARM-8 Athens 37 Acknowledgements EGEE View Main Developer: –Pablo Rey (CESGA) GOC –Dave Kant (RAL)

38 Enabling Grids for E-sciencE EGEE-II INFSO-RI-031688 Thanks We want your feedback!


Download ppt "EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Acccounting Portal Javier Lopez Cacheiro/"

Similar presentations


Ads by Google