40 and 100 GbE – Network Interfaces of the Future Drew Perkins dperkins@infinera.com 408-572-5308

Agenda 40 and 100 GbE standards status 40 and 100 GbE LAN architectures 100 GbE transport architectures

IEEE HSSG / 802.3ba Task Force Study group approved 100G rate for network aggregation applications and 40G rate for server/host interfaces in Jul ‘07 Schedule (draft): HSSG→802.3ba Task Force Jan ‘08 Last New Proposal May ’08 Task Force Ballot Sept. ’08 802.3 Working Group Ballot March ’09 Sponsor Ballot Nov. ’09 Standard Published 2Q2010

Ethernet Alliance – High Speed Ethernet (HSE) Committee Technical & Marketing subcommittees established to facilitate consensus formation outside of the IEEE on technical approaches and to provide a cohesive set of industry education & application materials Published initial 40/100GbE white paper http://www.ethernetalliance.org/technology/white_papers/Overview_and_Applications2.pdf

ITU – SG15 Provides base recommendations for the mapping of 100 GbE client interfaces into the OTN hierarchy Draft proposals (which will be gated by IEEE draft standard decisions in 2008/09) to specify 4 OTN mappings for 100 GbE 10 x ODU2e 11 x ODU2 3 x ODU3 1 x ODU4 ODU4 rate is still TBD (either ~112G or 130G)

OIF (Optical Internetworking Forum) Several working groups contributing to requirements & specifications surrounding 100 GbE end-to-end interworking Carrier Working Group Drafting a set of 100 GbE user requirements to effectively interwork IEEE LAN interfaces into the transport system Physical and Link Layer Working Group Working on 25G electrical interface specifications & LAN-to-OTN related requirements

Proposed and Likely 100 GbE PMDs 10 km on Single-Mode Fiber (SMF) 4x 25G using 1310 nm EMLs (possibly DMLs) and WDM over single fiber pair 10GBASE-LX4 runs at 4x 3.125 Gb/s using 1310 nm DMLs over single fiber pair 10GBASE-L runs at 1x 10 Gb/s using 1310 nm DMLs OC-768 runs at 40 Gb/s using 1550 nm EMLs 40 km on SMF 4x 25G using 1310 nm EMLs, Semiconductor Optical Amplifiers (SOAs) and WDM over single fiber pair 10GBASE-E runs at 1x 10 Gb/s using 1550 nm EMLs First use of SOA technology in any standard (risk?) 100 m on OM3 Multi-Mode Fiber (MMF) 10x 10Gb/s using 850 nm VCSEL arrays and fiber ribbons 10GBASE-S runs at 1x 10 Gb/s using 850 nm VCSELs 10 m on a copper cable assembly 10x 10 Gb/s over Infiniband/CX4-style coax 10GBASE-CX4 runs at 4x 3.125 Gb/s Notes: No 100 Gb/s “serial” (i.e. single-l) PMDs No metro/LH DWDM interfaces

Likely100 GbE PMD Architectures 100 GbE MAC ASIC 10x 10 Gb/s CDR 10x 10G Copper 12x Infiniband Cable 100G Transponder 100 GbE MAC ASIC 10x 10 Gb/s VCSEL Array 10x 10G MMF 10x 10 Gb/s Detector & TIALA Arrays 12x MMF Ribbon 100G Transponder 100 GbE MAC ASIC 10:4 Gearbox 10x 10G 10 km SMF 4:10 Gearbox SMF 1 25Gx4l 4x 25 Gb/s MD & EML Arrays 4x 25 Gb/s Detector & TIALA Arrays 4:1 WDM Mux 4:1 WDM Demux 4x 25G 100G Transponder 100 GbE MAC ASIC 10:4 Gearbox 10x 10G 40 km SMF 4:10 Gearbox SMF 1 25Gx4l 4x 25 Gb/s MD & EML Arrays 4x 25 Gb/s Detector & TIALA Arrays 4:1 WDM Mux 4:1 WDM Demux 4x 25G SOA

Proposed and Likely 40 GbE PMDs 100 m on OM3 Multi-Mode Fiber (MMF) 4x 10 Gb/s (vs. 10x 10 Gb/s for 100 GbE) 10 m over a copper cable assembly 1 m over a backplane 4x 10 Gb/s Notes: No 40 GbE SMF PMDs No 40 Gb/s serial PMDs No metro/LH DWDM interfaces

How Will 100 GbE Be Transported Over DWDM? ODU4? 1x 100 (120?) Gb/s Several vendors proposing Dual Polarization QPSK 100 Gb/s single-l (not serial) 4x 26.75 Gb/s channels (with 7% FEC) ODU3-3v? 3x 40 Gb/s ODU2-11v? 11x 10 Gb/s ODU2e-10v? 10x 10 Gb/s ITU-T recently relented and specified OTU2e/ODU2e Overclocked OTU2/ODU2

It’s Really a Question of Economics OC-768 service provider experience 4x bandwidth increase, but » 4x cost increase Not 2.5x as historically experienced and now expected/wanted cost(1x 40 Gb/s) » cost(4x 10 Gb/s) ODU3-3v 20% wasted bandwidth cost(3x 40 Gb/s) » cost(12x 10 Gb/s) > cost(10x 10 Gb/s) Why would anyone do this? ODU2-11v cost(ODU2e) = cost(ODU2) cost(11x 10 Gb/s) > cost(10x 10 Gb/s) ODU4 Complicated, power-hungry electronics Will require significant integration to yield acceptable costs Will it cost < ODU2-10v (will 100 GbE cost < 10x 10 GbE)? Some predict 100 GbE may cost ~2.5x 40G POS cost(2.5x 40 Gb/s) » cost(10x 10 Gb/s) ODU2e-10v Already integrated via PICs and shipping since 2004 Prediction: 10x 10 Gb/s ls will remain « 1x 100 Gb/s ls for a long time

Optical Transport Network 100 GbE Over DWDM Transport – 10x 10Gb/s Example (1 of Several Possibilities) Router 1 100G LH Transponder 1 (Tx) 100G SR Transponder (Tx) 100G SR Transponder (Rx) 4x 25 Gb/s MD & EML Arrays 4x 25 Gb/s Detector & TIALA Arrays 100 GbE MAC ASIC 10x 10G 4x 25G 4x 25G 1 25Gx4l 4x 25G 4x 25G 10x 10G 10:4 Gearbox 4:1 WDM Mux 4:1 WDM Demux 4:10 Gearbox 10x 10 Gb/s FEC ASIC SMF 100G LH Transponder 2 (Rx) 10x 10 Gb/s Detector & TIALA Arrays 10x 10 Gb/s MD & EML Arrays 10x 10G 4x 25G 10x 10G 10x 10G 10:1 WDM Demux 10:1 WDM Mux 10x 10G FEC ASIC Optical Transport Network Router 2 100G SR Transponder (Tx) 100G SR Transponder (Rx) 4x 25 Gb/s MD & EML Arrays 4x 25 Gb/s Detector & TIALA Arrays 10x 10G 4x 25G 4x 25G 1 25Gx4l 4x 25G 4x 25G 10x 10G 100 GbE MAC ASIC 10:4 Gearbox 4:1 WDM Mux 4:1 WDM Demux 4:10 Gearbox SMF

SC2006 100GbE Network Demonstration

Drew Perkins dperkins@infinera.com 408-572-5308 Thanks! Drew Perkins dperkins@infinera.com 408-572-5308