1. 1 Rick Dallmann Session: DB 1.1 Designing Next-Generation SAN/Storage Optical Infrastructure Why Low Link (Budget) Loss is Critical

2. 2 Data Center World – Certified Vendor Neutral Each presenter is required to certify that their presentation will be vendor-neutral. As an attendee you have a right to enforce this policy of having no sales pitch within a session by alerting the speaker if you feel the session is not being presented in a vendor neutral fashion. If the issue continues to be a problem, please alert Data Center World staff after the session is complete.

3. 3 Designing Next-Generation SAN/Storage Optical Infrastructure - Why Low Link (Budget) Loss is Critical With the ratification of 16Gb Fibre Channel and the soon- to-be ratified 32 and 128Gb, this presentation will detail the shift in data center optical architecture and associated cabling infrastructure design. It will include best practices for infrastructure, equipment and cabling design to future-proof high-speed data center SAN at speeds of 16, 32 and 128 gigabits and beyond. The session will also address how to increase efficiency and manageability, decrease material and installation costs and implement best-in-class connectivity solutions with high reliability and performance.

4. 4 36 Years of Experience RCDDs (Registered Communications Distribution Designer), DCDCs on staff Subject matter expert presenter at AFCOM, BICSI, DatacenterDynamics conferences Expert infrastructure data center design, spec and implementation according to TIA-942 standards Large-scale, high-reliability data center specialization ISO 9001:2008 process- and design-certified – qualification documented and verified by third party Brocade authorized partner and solutions provider

5. 5 Fibre Channel Industry Association and T11 Committee

6. 6 This and this OR this TIA-942: Distributed Data Center Topology

7. 7 History has shown that loss is based on the design, installation and products choices

8. 8 Link Loss Budget The link loss “budget” defines the amount of acceptable loss between nodes on a fiber link, which is important because operating within the parameters is critical for establishing a reliable, stable network. Transmit SFP Receive SFP

9. 9 Operating within certain parameters is critical for establishing a reliable and stable network. The link loss measurement can assist with the task of selecting cable type (multi-mode or single-mode fiber), transmitter wavelength, (850 nm, 1300 nm, and so on) and other network components. It can help you determine the maximum physical distance of a link. It is a means of estimating whether or not current and future equipment can be supported over a cabling system. Looking into the future, link loss is impacted by higher bandwidths and the evolving structured cabling systems. Link Loss Budget

10. 10 What Factors Can Impact Link Loss Budget Number of paired connectors in the link Number and type of splices in the fiber Stressing of the cable Extending the length of the cable in the link Misaligned optical couplers Change in temperature Improper design and product choice Aging of passive components Poor performing connectors

11. 11 The Optics A Brief History of MMF OM1, 62.5, first deployed early 80’s Offered solution to core alignment issues Used low-cost LED sources Supported applications in Enterprise networks Ethernet and Fibre Channel grow in LANs and SANs in early 90’s OM1, main deployment for distances exceeding copper cabling twisted pair Data rates exceed 100MB/s The 850nm VCSEL becomes the new low-cost solution, modulates faster Convert to OM2 50um core LOMMF standard bandwidth of 2000 OM2 had inherently higher bandwidth The Gigabit era starts in the late 90’s OM3, 2000MHz/km at 850nm OM4, 4700MHz/km Image source: Cisco

12. 12 The Ability to Measure

13. 13 Parameters and Formulas ComponentMetricDescription Cable attenuationdB/kmRating varies with cable type, bandwidth, cable length, and source wavelength. Use the typical dB loss values. Connector pair (TX/RX)CountWhere two fibers are joined using connectors (for example, LC [Lucent Connector]). Use typical dB loss values. The connector at the end device is not included in the equation. Cable spliceCountWhere two fibers are joined together mechanically or by fusion (heat and electricity) to extend the fiber distance or to repair a fiber. Use the typical dB loss values.

14. 14 Link Loss Budget: Fibre Channel Link SpeedOM2 Link Loss Budget (dB) OM3 Link Loss Budget (dB) OM4 Link Loss Budget (dB) Single-mode Link Loss Budget (dB) 1 Gbps FC3.854.62N/A7.8 2 Gbps FC2.623.31N/A7.8 4 Gbps FC2.062.882.957.8 8 Gbps FC1.682.042.196.4 10 Gbps FC1.82.6N/A9.4 16 Gbps FC1.631.861.956.4

15. 15 Fiber Bandwidth and Attenuation Glass TypeATTENUATION/kmBandwidth OM23.5dB/km950MH/km OM33.25db/km2000MH/km OM43.0db/km4700MH/km

16. 16 Ability to Connect LC or MPO Optics

17. 17 dB Link Loss for Transmission Loss Budget… Scary? YearApplicationData RateStandardLoss Budget (dB) 1982Ethernet10 MbpsIEEE 802.312.5 1991Fast Ethernet100 MbpsIEEE 802.311.0 1998Short Wavelength Fast Ethernet10/100 MbpsTIA/EIA-7854.0 20001G Ethernet1,000 MbpsIEEE 802.3z3.56 20048&10G FC &10G Ethernet10,000 MbpsIEEE 802.3ae2.60 201016G FC & 40G Ethernet40,000 MbpsIEEE 802.3ba1.9 2010100G Ethernet100,000 MbpsIEEE 802.3ba1.5

18. 18 Link Loss Budgets for 32GFC &128GFC

19. 19 Interconnect dB Loss The Industry Standard EIA/TIA 568-C.3 LC 0.5dB/mated pair SC 0.5dB/mated pair MTP® 0.75dB/mated pair

20. 20 dB Link Loss for Transmission Insertion loss is a critical performance parameter in current data center cabling deployments. Total connector loss impacts the ability to operate over the maximum supportable distance. As total connector loss increases, the supportable distance at that data rate decreases. 16/40/100G Standard: OM3: 100m distance; maximum channel loss of 1.9 dB, which includes 1.5 dB total connector loss budget. OM4: 150m distance maximum channel loss of 1.5 dB, which includes 1.0 dB total connector loss budget. The maximum cabled fiber attenuation is 3.5 dB/km at 850 nm. Thus, the insertion loss specifications of connectivity components should be evaluated when designing data center cabling infrastructures. With low-loss connectivity components.

21. 21 Loss and Attenuation Performance Look For Leaders: Max/Mated Pair LC 0.15dB/mated pair MPO/MTP ® - 12F 0.20db/mated pair MPO/MTP ® - 24F0.35db/mated pair AND DOCUMENTED

22. 22 Why Low Optical Loss is Now Strongly Recommended When Considering Manufacturers Most manufacturers do not support more than 6 connections in an optical fiber channel LC connector losses are already very low at 0.15dB LC channel loss is 2.6dB, can easily support 6 connections per channel at 0.15dB per Very low MPO losses are very important Industry standard MPO loss is 0.7dB A low loss MPO is 0.25dB 6 links at 0.25 is 1.5dB total link loss which is also the maximum allowable channel loss for 40Gb/s and 100Gb/s with OM4 glass per IEEE Std 802.3ba.

23. 23 Fibre Channel 32, 64, 128GB QSFP28 NOT SFP+

24. 24 32GB Fibre Channel 128GFCp will require two 4-lane ports and modules 128GFCp capable port can be broken out to individual 16GFC and 32GFC lanes with a breakout cable QSFP28 Tx Rx MPO/MTP QSFP28 32/ 16GFC SFP+ -2 fibers MPO/MTP-LC 4 Channel

25. 25 FC16-64; FC32-64 Line Cards 64 Duplex Ports of 32 / 16GFC SFP+ 16 Ports of QSFP FC16-64 MTP Parallel Optics Staggered Trunk DCX MTP Parallel to Serial Conversion

26. 26 QSFP to Duplex

27. 27 Find The Loss Budget

28. 28 Let’s Calculate Director LC MTP HARNESS MTP TRUNK LC MTP Mated Pair Loss LC-LC = 0.0 MTP-MTP=0.2 0+0.2+0.2= 0.4dB PER MATED PAIR

29. 29 Let’s Calculate Devices MTP LC MTP LC 0.15 0.20 0.0 0.85db 0.15 0.20

30. 30 Total Connector Loss Page 10.4db Page 20.85db TotalConnector Loss1.25db

31. 31 Cable Attenuation Based on distance: Even with perfect glass, there is a loss per distance Glass TypeATTENUATION/kmBandwidth OM23.5dB/km950MH/km OM33.25db/km2000MH/km OM43.0db/km4700MH/km

32. 32 Cable Attenuation OM4: 3.0dB/km 3.0dB/1000km * 80ft/3.2080 = 0.075dB Cable Loss

33. 33 Total Loss Budget Total Connector 1.25dB Total Cable Loss0.075db Total Loss Budget1.325db OM4 @ 80ft Total Loss Budget1.420db OM4 @ 190ft At 125M cable loss is 0.375db

34. 34 3 Key Things You Have Learned During this Session 1.Best practices for infrastructure, equipment and optical cabling design to future-proof high-speed data center SAN at speeds of 16, 32 and 128 gigabits and beyond. 2.What is link loss budget and why it is critical to operate within the parameters for establishing a reliable, stable network. 3.How to increase efficiency and manageability, decrease material and installation costs and implement best-in-class connectivity solutions, reliability and performance.

35. 35 Thank you Rick Dallmann, Senior Data Center Infrastructure Architect rdallmann@cablexpress.com 800.913.9465