1. Gruppo Server CCR michele.michelotto at pd.infn.it
Status Report

2. michele michelotto - INFN Padova
HEP-SPEC06
471.omnetpp
473.astar
483.xalancbmk
444.amd
447.dealII
450.soplex
453.povray
Integer tests
Floating Point tests
Geometric average on 7 tests. Sum on all cores
Sum on all Worker nodes
Hepix Fall 09
michele michelotto - INFN Padova 2 2

3. michele michelotto - INFN Padova
“old cpu”
Hepix Fall 09
michele michelotto - INFN Padova 3 3

4. michele michelotto - INFN Padova
Modern 4core processor
processor
HS06
HS06/Clock
HS06/Clock/core
Core/
Logical cpu
Intel Clovertown 53xx
53-60
23-26 8
Intel Harpertown 54xx
60-70
25-28
AMD Shanghai 23xx
60-74
25-27
AMD Instanbul 24xx
96-99
40-44 12
Intel Gainestown 5520
43-53
8-16
About 60 Measurement from Brunengo, Macorini, Crescente, Calzolari (all INFN), Srinivasan (LBNL), Iribarren (CERN), Alef (GridKa), PIC, RAL, Nikhef
nehalem
DC-QC
Xeon
Hepix Fall 09
michele michelotto - INFN Padova 4 4

5. michele michelotto - INFN Padova
Measuring Nehalem
Phase space complicated
32-64 bit
Hyperthreading ON - OFF
Memory (Size and number of channels)
Turbo Mode ON - OFF
Hepix Fall 09
michele michelotto - INFN Padova 5 5

6. michele michelotto - INFN Padova
The official HS06: 32bit
HS06 HT is on (16t) (8t)
Hepix Fall 09
michele michelotto - INFN Padova 6 6

7. michele michelotto - INFN Padova
64 bit
HS06 HT is on (16t) (8t)
Hepix Fall 09
michele michelotto - INFN Padova 7 7

8. michele michelotto - INFN Padova
32 vs 64
Hepix Fall 09
michele michelotto - INFN Padova 8 8

9. Memory 48GB (6x8) 24GB (3x8) 16GB (2x8)
64 bit
Memory 48GB (6x8) 24GB (3x8) 16GB (2x8)
32 bit
Hepix Fall 09
michele michelotto - INFN Padova 9 9

10. michele michelotto - INFN Padova
HT OFF 32bit
With HT OFF I’d imagine saturation after 8th thread
Will HT OFF 1-8 = HT ON?
Hepix Fall 09
michele michelotto - INFN Padova 10 10

11. michele michelotto - INFN Padova
HT ON vs HT OFF
HT ON:81.81 HT OFF: HT OFF is better up to 11t
Hepix Fall 09
michele michelotto - INFN Padova 11 11

12. michele michelotto - INFN Padova
HT OFF 64bit
At 64 bit: same behaviour
Hepix Fall 09
michele michelotto - INFN Padova 12 12

13. michele michelotto - INFN Padova
Turbo mode
Turn off the voltage on idle cores and overclock +133 MHz or even +266MHz the actives cores if temperature is ok
5520 Default clock is 2266 MHz
of 4 core +1bin  2400 MHz
or 2 core +2bin  2533 MHz
New half-generation e.g. Xeon 3500 up to 4 bin
Hepix Fall 09
michele michelotto - INFN Padova 13 13

14. michele michelotto - INFN Padova
Turbo mode
Benefit of Turbo mode decrease when number of active core increase
Hepix Fall 09
michele michelotto - INFN Padova 14 14

15. michele michelotto - INFN Padova
Opteron bit
HS06: (12t)
Hepix Fall 09
michele michelotto - INFN Padova 15 15

16. michele michelotto - INFN Padova
Opteron 2427 – 64bit
HS06: (12t)
Hepix Fall 09
michele michelotto - INFN Padova 16 16

17. michele michelotto - INFN Padova
Instanbul 2 x exacore
Opteron 2427 – 2200 MHz – 32GB
2P x 6cores
Hepix Fall 09
michele michelotto - INFN Padova 17 17

18. Overbooking? 5520 with HT OFF increased performance even after 8 cores
2247 doesn’t show any drop with 12 cores fully loaded
What happens if we start overloading with more processes than cores?

19. michele michelotto - INFN Padova
5520(2266) vs 2427(2200)
Hepix Fall 09
michele michelotto - INFN Padova 19 19

20. michele michelotto - INFN Padova
5520(2266) vs 2427(2200)
Hepix Fall 09
michele michelotto - INFN Padova 20 20

21. michele michelotto - INFN Padova
5520(2266) vs 2427(2200)
Hepix Fall 09
michele michelotto - INFN Padova 21 21

22. Todo Compare with Atlas and CMS code
GEN, SIM, DIGI and RECO
Effect of HT, Turbo Mode and Overbooking on Power Consumption

23. michele michelotto - INFN Padova
Questions?
Hepix Fall 09
michele michelotto - INFN Padova 23 23

24. michele michelotto - INFN Padova
Nehalem “gainestown”
45 nm
Cache L KB
Cache L2 256KB/core
Cache L3 8MB shared
80W: E GHz  E GHz
95W: X GHz  X GHz
Dual Thread (from 5520 upwards)
Turbo Mode
Quad core (excl and 5508)
Hepix Fall 09
michele michelotto - INFN Padova 24 24

25. michele michelotto - INFN Padova
Opteron Instanbul
45 nm
Cache L1 128 KB
Cache L2 512KB/core
Cache L3 6MB shared
Power Consumption:
EE: max 40W (1.8 GHz)
HE: max 55W ( GHz)
Standard max 75W ( GHz)
SE max 105W (2.8GHz)
Hepix Fall 09
michele michelotto - INFN Padova 25 25