2. Network infrastructure for CERN DataCenter Eric.Sallaz@cern.ch HEPiX Fall 2015

3. Agenda Needs Situation Options Implementation Questions HEPiX Fall 2015 3

4. Needs Support 40GbE, 100GbE and more Still available for 10GbE Also for low bandwidth (PDU, Management) High availability and reliability HEPiX Fall 2015 4

5. Needs Supporting 40G, 100G and more imply At least OM3 optical infrastructure At least MPO connectors HEPiX Fall 2015 5

6. Needs 10GbE compatible imply : LC connectors Convert MPO to LC Copper (Cat6A …) HEPiX Fall 2015 6

7. Needs Low bandwidth for management and PDU Copper is enough HEPiX Fall 2015 7

8. Needs High availability and reliability Respect of installation methods HEPiX Fall 2015 8

9. Needs HEPiX Fall 2015 9 High availability and reliability Respect of installation methods Cabling organization

10. Needs HEPiX Fall 2015 10 High availability and reliability Respect of installation methods Cabling organization Operation methods “Inspect before you connect !”

11. Situation Old infrastructure Copper from 1995 OM2 Racks Extension of the DC locally but also in Wigner site HEPiX Fall 2015 11

12. Options Copper Which use ? Management and PDU May come the need for 10G uplink HEPiX Fall 2015 12

13. Options Optical fiber quality OM3 allow 100GbE over 100m OM4 allow 100GbE over 150m HEPiX Fall 2015 13

14. Options Connector MPO, LC, … ? MPO-12 or MPO-24 ? What about MTP ? HEPiX Fall 2015 14

15. Options Optical cabling type A, B, C, …? key up, key down ? HEPiX Fall 2015 15

16. Options Type A HEPiX Fall 2015 16

17. Options Type B HEPiX Fall 2015 17

18. Options Type C HEPiX Fall 2015 18

19. Options Module type 1 MPO to 12 LC ? 2 MPO to 24 LC ? How many fiber per trunk and per chassis ? HEPiX Fall 2015 19

20. Options Cable type A same MPO to LC module but different patches HEPiX Fall 2015 20

21. Options Cable type B same patches but different MPO to LC module HEPiX Fall 2015 21

22. Options No type C if you want more than 10GbE ! HEPiX Fall 2015 22

23. Options Same patches and same MPO to LC module Patented solution HEPiX Fall 2015 23 Manufacturer dependent solution

24. Implementation Aggregation and ToR switches for Management ToR Data switches HEPiX Fall 2015 24

25. Implementation HEPiX Fall 2015 25 Infrastructure every 3 or 5 racks New copper in new rooms Old copper cabling reused for management and PDU

26. Implementation OM4 72 fibers with MTP-12 Type B HEPiX Fall 2015 26

27. HEPiX Fall 2015 27