Network infrastructure for CERN DataCenter HEPiX Fall 2015

Agenda Needs Situation Options Implementation Questions HEPiX Fall

Needs Support 40GbE, 100GbE and more Still available for 10GbE Also for low bandwidth (PDU, Management) High availability and reliability HEPiX Fall

Needs Supporting 40G, 100G and more imply At least OM3 optical infrastructure At least MPO connectors HEPiX Fall

Needs 10GbE compatible imply : LC connectors Convert MPO to LC Copper (Cat6A …) HEPiX Fall

Needs Low bandwidth for management and PDU Copper is enough HEPiX Fall

Needs High availability and reliability Respect of installation methods HEPiX Fall

Needs HEPiX Fall High availability and reliability Respect of installation methods Cabling organization

Needs HEPiX Fall High availability and reliability Respect of installation methods Cabling organization Operation methods “Inspect before you connect !”

Situation Old infrastructure Copper from 1995 OM2 Racks Extension of the DC locally but also in Wigner site HEPiX Fall

Options Copper Which use ? Management and PDU May come the need for 10G uplink HEPiX Fall

Options Optical fiber quality OM3 allow 100GbE over 100m OM4 allow 100GbE over 150m HEPiX Fall

Options Connector MPO, LC, … ? MPO-12 or MPO-24 ? What about MTP ? HEPiX Fall

Options Optical cabling type A, B, C, …? key up, key down ? HEPiX Fall

Options Type A HEPiX Fall

Options Type B HEPiX Fall

Options Type C HEPiX Fall

Options Module type 1 MPO to 12 LC ? 2 MPO to 24 LC ? How many fiber per trunk and per chassis ? HEPiX Fall

Options Cable type A same MPO to LC module but different patches HEPiX Fall

Options Cable type B same patches but different MPO to LC module HEPiX Fall

Options No type C if you want more than 10GbE ! HEPiX Fall

Options Same patches and same MPO to LC module Patented solution HEPiX Fall Manufacturer dependent solution

Implementation Aggregation and ToR switches for Management ToR Data switches HEPiX Fall

Implementation HEPiX Fall Infrastructure every 3 or 5 racks New copper in new rooms Old copper cabling reused for management and PDU

Implementation OM4 72 fibers with MTP-12 Type B HEPiX Fall

HEPiX Fall