Optimizing the Data Centre Physical Layer in the Era of the Cloud Scott Gregg Marketing Director, Asia Pacific Corning Optical Communications 24 May 2017
Let’s Talk About….. We all know that that the growth of the “Cloud” is drastically altering the data centre landscape How is it altering what is happening at the data centre physical layer? Fibre, fibre, fibre…….
Physical Layer Evolution Speed Distance Density Fibre type Cabling & connectivity designs
Hyperscale Data Centres By the Numbers 100’s of meters 1000’s of racks 10,000’s of servers 100,000’s of ports 40G, 100G & beyond
Speed
Ethernet Speed Map Source:
Ethernet Optical Transceiver Roadmap Solution Reach 40G 100G 400G Duplex OM3/4 Short BiDi WDM (Univ) SWDM ??? Parallel Short and Mid SR4/eSR4 4x10G Gen1: SR10 10x10G Gen2: SR4/eSR4 4x25G Gen1: SR16 16x25G Gen2: SR4 4x100G SM Long LR4 (10 km) LRL4 (2 km) CWDM4 (2 km) WDM(10 km) WDM (2 km) Mid PLR4 PSM4 PLR4 (500 m) (4 x 100, 50 Gbaud PAM4) Green text = included in current IEEE standard 40G & 100G now available in 2 & 8 fibre solutions Future out to 400G is dominated by 2 & 8 fibre transceivers
400G Multimode Fibre (MMF) Variants First Generation Standards Guidance to utilize 32F Parallel Optics (2017) Tx 16x25G and Rx 16x25G (NRZ) 32F MPO Connector, Double Array Minimal traction expected with AOC primary use (Pending) Second Generation Expected to Utilize 8F Parallel Optics with WDM (2019) Tx 4x100G and Rx 4x100G Two wavelengths at 25Gbaud PAM4 Four wavelengths at 25Gbaud NRZ 8/12F MPO Connector Deployed as pluggable module / embedded optics for core to edge uplinks and breakouts 2x16 format 1x12 or 8 format Source: USConec
400G Single-Mode Fibre (SMF) Variants At least 500 m: 8F Parallel Optics Tx 4x100G and Rx 4x100G (50Gbaud PAM4) 8F or 12F MPO Connector At least 2 km: 2F Serial Optics 8x50G WDM (25Gbaud PAM4) 2F LC Connector At least 10 km: 2F Serial Optics
Distance
Source: Corning Optical Communications Link Cost Versus Distance for 40 GbE: Multimode Versus Single-Mode Usage in the Data Centre Multimode fibre most cost effective for lengths < 150 m Source: Corning Optical Communications
Enterprise Deployments Only Source: Corning shipment data
Enterprise + Hyperscale Deployments Source: Corning shipment data
OM4 System Length
Single-Mode System Length
Single-Mode Hyperscale only
Density
Spine & Leaf Network Architectures Meshed architecture to reduce latency within the data centre Requires large amounts of connectivity between spine layer & switch layer Drives need for high density cabling & connectivity solutions Need for density also encourages use of: Network monitoring tap components integrated into structured cabling
Significant Connectivity Required for Spine & Leaf Architectures Cross Connect Design for 16-Way Spine Trunks to TOR Harnesses to Spine Switch (192) 72F Cables (1024) 12F Harnesses 16 Spine Switches 192 Leaf Switches Port Map Port Map Leaf BOM for 100% Population Housings: (24) 4U housings Modules: (1,152) 12F MTP-LC modules Cables: (192) 72F MTP trunk cables Spine BOM for 100% Population Housings: (22) 4U housings Modules: (1,024) 12F MTP-LC modules Module Harnesses: (1,024) 12F MTP-LC harnesses Patch Cords: (6,144) 2F LC patch cords Leaf Frame Leaf Frame Spine Frame Spine Frame
High Density Cabling and Connectivity Trunk cables terminated with MTP connectors up to 864-fibres Significant deployment time savings compared to field terminated solutions Single-mode or OM4 fibre Indoor/outdoor cables 4U housings: 576-fibre capacity for LC 2,304-fibre capacity for MTP Useable density Individual port access via sliding trays
Tapping Solution Not Integrated into Structured Cabling Main Distribution Area (MDA) EDA Elec Con Tap Area Structured Cabling Area Channel Link Patch Cord Patch Cord Patch Cord Patch Cord Monitor Device
Tapping Solution Integrated into the Structured Cabling Main Distribution Area (MDA) EDA Elec Con Tap Area Structured Cabling Area Channel Link Patch Cord Patch Cord Tap Harness Monitor Device
Summary: Optimizing the Physical Layer in the Cloud Era Speed 100G commonly used in the cloud today; 400G is on the horizon Distance Higher network speeds + longer distances are driving fibre type changes Single-mode becoming more prominent Multimode still most cost effective for 100G links up to 100 m Density The proliferation of connectivity needs for spine & leaf architectures means density is critical in all parts of the physical layer High fibre count MTP connectorized trunks High density connectivity solutions in the rack Integrating network monitoring taps into the physical layer