1. ATLAS STEP09 UK T2 Activity
Brian Davies

2. pre-GDB dCache T2 Feedback
Highest Rate 1.4GB/s
pre-GDB dCache T2 Feedback
18 September, 2018

3. pre-GDB dCache T2 Feedback
UK Overall did well with
pre-GDB dCache T2 Feedback
18 September, 2018

4. pre-GDB dCache T2 Feedback
T1 Jobs
No User Analysis/HammerCLoud
Most Jobs failures due to Storage Issues
55% Failures occurred in 3% of time
STORAGE STABILITY A LARGE FACTOR IN JOB SUCCESS!!
pre-GDB dCache T2 Feedback
18 September, 2018

5. pre-GDB dCache T2 Feedback
T2 Production Success
pre-GDB dCache T2 Feedback
18 September, 2018

6. pre-GDB dCache T2 Feedback
Site Balancing
CPU Pledged
CPUs seen
Disk pledge
Disk Delivered
cpu/disk pledge
pledge/del cpu
pledge/del disk
CPU %
Disk %
LANC’
351
540
171
151.72
2.05
1.54
0.89
0.080
0.155
0.52
GLA’
859
1651
417
145.14
2.06
1.92
0.35
0.244
0.148
1.65
MAN’
804
780
391
86.79
0.97
0.22
0.115
0.088
1.30
PPD
346
400
168 85
1.16
0.51
0.059
0.087
0.68
QMUL
161
1115 78
29.46
6.93
0.38
0.165
0.030
5.49
RHUL
144
420 70
139
2.92
1.99
0.062
0.142
0.44
LIV’
114
650 55
86.84
2.07
5.70
1.58
0.096
1.09
SHEF’ 19
176 9
38.7
2.11
9.26
4.30
0.026
0.039
0.66
UCL 16 45 8
46.2
2.00
2.81
5.78
0.007
0.047
0.14
OX’
119
350 58
71.06
2.94
1.23
0.052
0.072
0.71
CAM’ 35
180 17
34.09
5.14
2.01
0.027
0.035
0.77
B’HAM 23 60 11
37.38
2.09
2.61
3.40
0.009
0.038
0.23
DUR’ 66 32 30
6.06
0.94
0.031
1.93
3057
6767
1485
981.38
pre-GDB dCache T2 Feedback
18 September, 2018

7. pre-GDB dCache T2 Feedback
Failure Modes
pre-GDB dCache T2 Feedback
18 September, 2018

8. pre-GDB dCache T2 Feedback
T2 HammerCloud Results
UKI-LT2-QMUL_MCDISK
150
1488
UKI-LT2-RHUL_MCDISK
100
400
UKI-LT2-UCL-CENTRAL_MCDISK 50
128
UKI-NORTHGRID-LANCS-HEP_MCDISK
656
UKI-NORTHGRID-LIV-HEP_MCDISK
760
UKI-NORTHGRID-MAN-HEP1_MCDISK
890
UKI-NORTHGRID-MAN-HEP2_MCDISK
UKI-NORTHGRID-SHEF-HEP_MCDISK
200
UKI-SCOTGRID-GLASGOW_MCDISK
250
1912
UKI-SOUTHGRID-BHAM-HEP_MCDISK 10
308
UKI-SOUTHGRID-CAM-HEP_MCDISK
152
UKI-SOUTHGRID-OX-HEP_MCDISK 75
1152
UKI-SOUTHGRID-RALPP_MCDISK
1020
ANALY_BHAM 10
308
ANALY_CAM 50
152
ANALY_GLASGOW
250
1912
ANALY_LANCS
100
656
ANALY_LIV
150
760
ANALY_MANC1
890
ANALY_MANC2
ANALY_OX 75
1152
ANALY_QMUL
1488
ANALY_RALPP
1020
ANALY_RHUL
400
ANALY_SHEF
200
ANALY_UCLCENT
128
pre-GDB dCache T2 Feedback
18 September, 2018

9. pre-GDB dCache T2 Feedback
T2 HammerCloud Results
UK_PANDA
SUBMITTED
RUNNING
COMPLETED
FAILED
Efficiency
# Files Expected
# Files Processed
ANALY_CAM
3045
1656
0.65
10805 ?
ANALY_BHAM
181
2640
275
0.91
5624
ANALY_MANC1
5033
2915
0.63
10159
ANALY_MANC2 1
3567
5780
0.38
8695
ANALY_GLASGOW 3
73726
1314
0.98
189702
ANALY_SHEF
830
5106
1436
0.78
11701
ANALY_RHUL
14657
3220
0.82
36759
ANALY_LANCS
3472
2339
0.6
7929
ANALY_UCLCENT
241
123
ANALY_LIV
7642
1660
27628
ANALY_OX
169
128
ANALY_RALPP 8
1612
907
0.64
5713
ANALY_QMUL
1475
2619
0.36
3397
TOTAL
1425 15
121975
24372
0.83
318112
84.9% World Ave
pre-GDB dCache T2 Feedback
18 September, 2018

10. pre-GDB dCache T2 Feedback
T2 HammerCloud Results UK
SUBMITTED
RUNNING
COMPLETED
FAILED
Efficiency
# Files Expected
# Files Processed
UKI-NORTHGRID-LANCS-HEP_MCDISK
405
903
0.31
1472
1311
UKI-SCOTGRID-DURHAM_MCDISK 22
532
0.04
163
154
UKI-LT2-UCL-CENTRAL_MCDISK
105
665
0.14
612
435
UKI-SOUTHGRID-BHAM-HEP_MCDISK
102 11
439
363
0.55
2294
2011
UKI-LT2-QMUL_MCDISK
298 31
853
13335
0.06
2268
772
UKI-NORTHGRID-SHEF-HEP_MCDISK 5
570
0.01 36
UKI-NORTHGRID-LIV-HEP_MCDISK
189
286
1267
995
0.56
9707
9705
UKI-SOUTHGRID-OX-HEP_MCDISK
140 8
3891
739
0.84
30128
29006
UKI-SCOTGRID-GLASGOW_MCDISK
376
594
2669
817
0.77
14398
13161
UKI-LT2-RHUL_MCDISK
158 28
6849
5532
29077
23287
UKI-SOUTHGRID-CAM-HEP_MCDISK
576
630
0.48
5288
3973
UKI-SOUTHGRID-RALPP_MCDISK
113
181
6634
797
0.89
40356
38965
TOTAL
1376
1139
23715
25878
135799
122816
74% World Ave
pre-GDB dCache T2 Feedback
18 September, 2018

11. Total UK FTS For ATLAS During STEP’09
pre-GDB dCache T2 Feedback
18 September, 2018

12. pre-GDB dCache T2 Feedback
ScotGrid
Site
Token
Total Size (TB)
Unused Size (TB)
UKI-SCOTGRID-DURHAM -
9.9 8
DATADISK
2.2
PRODDISK
2.1
MCDISK
5.5
3.8
UKI-SCOTGRID-GLASGOW
153.9
88.3
70.4
51.1
40.7
2.9
4.4
USERDISK
1.1
0.9
PPSDATADISK
15.4
15.3
SCRATCHDISK
LOCALGROUPDISK
UKI-SCOTGRID-ECDF
4.9
0.5
0.2 1
pre-GDB dCache T2 Feedback
18 September, 2018

13. pre-GDB dCache T2 Feedback
NorthGrid
Site
Token
Total Size (TB)
Unused Size (TB)
UKI-NORTHGRID-LIV-HEP -
83.5 42
DATADISK 33
19.4
MCDISK
31.9
9.6
PRODDISK
2.2 2
USERDISK
0.1
SCRATCHDISK
5.5
4.9
LOCALGROUPDISK
10.9 6
UKI-NORTHGRID-MAN-HEP
83.6
65.2
HEP1_DATADISK
18.7
18.1
HEP1_MCDISK 11
HEP1_PRODDISK
5.3
HEP1_SCRATCHDISK
3.3
3.1
-HEP2_DATADISK
HEP2_MCDISK
4.4
HEP2_PRODDISK
5.4
HEP2_SCRATCHDISK
HEP1_LOCALGROUPDISK
2.3
HEP2_LOCALGROUPDISK
Site
Token
Total Size (TB)
Unused Size (TB)
UKI-NORTHGRID-LANCS-HEP -
151.7
99.2
DATADISK
59.4
45.1
MCDISK
61.6
30.2
PRODDISK 11
10.6
USERDISK
1.1
0.9
SCRATCHDISK
6.6
5.5
PHYS-BEAUTY
4.4
4.1
LOCALGROUPDISK
7.7
2.8
UKI-NORTHGRID-SHEF-HEP
34.3
22.6
16.5
16.2
13.2
2.9
2.2
1.5
0.2
0.8
OCALGROUPDISK
pre-GDB dCache T2 Feedback
18 September, 2018

14. pre-GDB dCache T2 Feedback
SouthGrid
Site
Token
Total Size (TB)
Unused Size (TB)
UKI-SOUTHGRID-BHAM-HEP -
35.2
28.6
DATADISK
13.2
12.8
MCDISK
5.5
1.3
PRODDISK
2.2
SCRATCHDISK 11
10.9
LOCALGROUPDISK
3.3
UKI-SOUTHGRID-CAM-HEP
31.9
16.8
16.5
8.3
_MCDISK
6.6
1.4
1.6
USERDISK
3.1
2.4
Site
Token
Total Size (TB)
Unused Size (TB)
UKI-SOUTHGRID-OX-HEP -
68.9
33.1
DATADISK 22
8.4
MCDISK
28.6 10
PRODDISK
2.2
1.9
USERDISK
0.7
0.3
SCRATCHDISK
8.8 8
LOCALGROUPDISK
6.6
4.6
UKI-SOUTHGRID-RALPP
78.8
58.3 35
33.9 30
11.4 2
1.8
2.5
2.3 9
8.9
pre-GDB dCache T2 Feedback
18 September, 2018

15. pre-GDB dCache T2 Feedback
Raw numbers
LT2
Site
Token
Total Size (TB)
Unused Size (TB)
UKI-LT2-RHUL -
188.1
125.8
DATADISK
94.6
80.3
MCDISK
49.5
5.9
PRODDISK
5.5
4.1
USERDISK
0.1
SCRATCHDISK
6.6
5.4
LOCALGROUPDISK
31.9
30.1
UKI-LT2-Brunel
2.7
2.6
0.5
2.2
2.1
UKI-LT2-UCL-CENTRAL 44
37.9
17.6
16.8 11
5.7
GROUPDISK
8.8
UKI-LT2-QMUL
121.5
96.9
75.2
74.9
26.8
3.7
10.7
10.6
5.3
3.3
2.4
pre-GDB dCache T2 Feedback
18 September, 2018

16. pre-GDB dCache T2 Feedback
STEP’09 Data Placement
Token
Share (%)
Volume (TB)
Reserved (TB)
Headroom (TB)
DS complete
nFiles
Actual (TB)
UKI-LT2-QMUL_DATADISK 5
5.6
75.2
69.6
685/685
2649 6
UKI-LT2-RHUL_DATADISK 23
25.8
94.6
68.8
3126/3126
12496 28
UKI-LT2-UCL-CENTRAL_DATADISK 10
11.2
17.6
6.4
1363/1363
5150
11.8
UKI-NORTHGRID-LANCS-HEP_DATADISK 30
33.6
59.4
4075/4075
20213
42.8
UKI-NORTHGRID-LIV-HEP_DATADISK 15
16.8 33
16.2
2018/2018
6485
15.6
UKI-NORTHGRID-MAN-HEP1_DATADISK
18.7
1.9
2041/2041
7430
17.1
UKI-NORTHGRID-MAN-HEP2_DATADISK
25.3
8.5
10642
22.3
UKI-NORTHGRID-SHEF-HEP_DATADISK
16.5
5.3
6302
13.6
UKI-SCOTGRID-GLASGOW_DATADISK 40
44.8
70.4
25.6
5359/5359
16720
UKI-SOUTHGRID-BHAM-HEP_DATADISK
13.2
7.6
2027
UKI-SOUTHGRID-CAM-HEP_DATADISK
10.9
2008
UKI-SOUTHGRID-OX-HEP_DATADISK 2
2.2 22
19.8
277/277
1533
3.2
UKI-SOUTHGRID-RALPP_DATADISK 25 35 7
3355/3360
14965
32.4
Totals
200
224
497.2
273.2
175.6
pre-GDB dCache T2 Feedback
18 September, 2018

17. pre-GDB dCache T2 Feedback
CERN Traffic
pre-GDB dCache T2 Feedback
18 September, 2018

18. pre-GDB dCache T2 Feedback
SJ5
pre-GDB dCache T2 Feedback
18 September, 2018

19. pre-GDB dCache T2 Feedback
Lancaster Lightpath
pre-GDB dCache T2 Feedback
18 September, 2018

20. pre-GDB dCache T2 Feedback
UK Production
pre-GDB dCache T2 Feedback
18 September, 2018

21. pre-GDB dCache T2 Feedback
Submissions
pre-GDB dCache T2 Feedback
18 September, 2018

22. pre-GDB dCache T2 Feedback
Gen
pre-GDB dCache T2 Feedback
18 September, 2018

23. pre-GDB dCache T2 Feedback
Gen
pre-GDB dCache T2 Feedback
18 September, 2018

24. pre-GDB dCache T2 Feedback
18 September, 2018

25. pre-GDB dCache T2 Feedback
18 September, 2018

26. pre-GDB dCache T2 Feedback
18 September, 2018

27. pre-GDB dCache T2 Feedback
18 September, 2018

28. pre-GDB dCache T2 Feedback
18 September, 2018

29. pre-GDB dCache T2 Feedback
North
pre-GDB dCache T2 Feedback
18 September, 2018

30. pre-GDB dCache T2 Feedback
North
pre-GDB dCache T2 Feedback
18 September, 2018

31. pre-GDB dCache T2 Feedback
North
pre-GDB dCache T2 Feedback
18 September, 2018

32. pre-GDB dCache T2 Feedback
South
pre-GDB dCache T2 Feedback
18 September, 2018

33. pre-GDB dCache T2 Feedback
South
pre-GDB dCache T2 Feedback
18 September, 2018

34. pre-GDB dCache T2 Feedback
South
pre-GDB dCache T2 Feedback
18 September, 2018

35. pre-GDB dCache T2 Feedback
scot
pre-GDB dCache T2 Feedback
18 September, 2018

36. pre-GDB dCache T2 Feedback
Lt2
pre-GDB dCache T2 Feedback
18 September, 2018

37. pre-GDB dCache T2 Feedback
18 September, 2018

38. pre-GDB dCache T2 Feedback
Lt2
pre-GDB dCache T2 Feedback
18 September, 2018

39. pre-GDB dCache T2 Feedback
FTS Outputs
2nd Week
Ends 5pm Friday 12th June
pre-GDB dCache T2 Feedback
18 September, 2018

40. pre-GDB dCache T2 Feedback
2nd week step fts plots
pre-GDB dCache T2 Feedback
18 September, 2018

41. pre-GDB dCache T2 Feedback
general
pre-GDB dCache T2 Feedback
18 September, 2018

42. pre-GDB dCache T2 Feedback
general
pre-GDB dCache T2 Feedback
18 September, 2018

43. pre-GDB dCache T2 Feedback
Gen atlas as source
pre-GDB dCache T2 Feedback
18 September, 2018

44. pre-GDB dCache T2 Feedback
Gen atlas as dest
pre-GDB dCache T2 Feedback
18 September, 2018

45. pre-GDB dCache T2 Feedback
18 September, 2018

46. pre-GDB dCache T2 Feedback
18 September, 2018

47. pre-GDB dCache T2 Feedback
18 September, 2018

48. pre-GDB dCache T2 Feedback
North
pre-GDB dCache T2 Feedback
18 September, 2018

49. pre-GDB dCache T2 Feedback
North
pre-GDB dCache T2 Feedback
18 September, 2018

50. pre-GDB dCache T2 Feedback
North
pre-GDB dCache T2 Feedback
18 September, 2018

51. pre-GDB dCache T2 Feedback
South
pre-GDB dCache T2 Feedback
18 September, 2018

52. pre-GDB dCache T2 Feedback
South
pre-GDB dCache T2 Feedback
18 September, 2018

53. pre-GDB dCache T2 Feedback
South
pre-GDB dCache T2 Feedback
18 September, 2018

54. pre-GDB dCache T2 Feedback
Scot
pre-GDB dCache T2 Feedback
18 September, 2018

55. pre-GDB dCache T2 Feedback
Lt2
pre-GDB dCache T2 Feedback
18 September, 2018

56. pre-GDB dCache T2 Feedback
Lt2
pre-GDB dCache T2 Feedback
18 September, 2018

57. pre-GDB dCache T2 Feedback
Lt2
pre-GDB dCache T2 Feedback
18 September, 2018