1. Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers Navid Hamed Azimi, Himanshu Gupta Vyas Sekar, Samir Das

2. Datacenter network design is hard! Cost Performance CablingExpandability Energy CoolingAdaptability 2

3. Over subscribed (tree, leaf spine,…) 3 Performance Existing Choices Cost … Core Top of Rack (ToR)

4. Over subscribed (tree, leaf spine,…) Existing Choices … 4 Over provisioned (Fattree, Jellyfish,…) Performance Cost Top of Rack (ToR) Core

5. Existing Choices … 5 Core Over subscribed (tree, leaf spine,…) Performance Cost Augmented (c-Through, 3D Beam) Top of Rack (ToR) Over provisioned (Fattree, Jellyfish,…)

6. Existing Choices 6 Over subscribed (tree, leaf spine,…) Performance Cost Augmented (c-Through, 3D Beam) Over provisioned (Fattree, Jellyfish,…) Can we get here?

7. Our Vision 7 … Core  Coreless Wired  Wireless Static  Flexible

8. Potential Benefits of This Vision Cost Performance Cabling Expandability Energy Cooling Adaptability 8 Wireless Coreless Flexible

9. Challenges in Realizing the Vision 9 Flexible wireless links Network management

10. Outline 10 Flexible wireless links Network management Feasibility & cost

11. Traditional RF is not Sufficient 11 … Wide beam High interference

12. Traditional RF is not Sufficient 12 … Wide beam Difficult to narrow High interference

13. Solution: Free Space Optical Links (FSOs) 13 No interference High throughput over long range … Easy to narrow beam

14. 14 Concerns with FSOs Cost : $30K Size : 3 ft³ Power: 60w Flexibility

15. Why Size, Cost, Power Can be Reduced? 15 Traditional use : outdoor, long haul ‒ High power ‒ Weatherproof Data centers: indoor, short haul ‒ Low power Feasible roadmap via commodity fiber optics ‒ E.g. Small form transceivers (Optical SFP)

16. Proof of Concept (1 Gbps) 16 Fiber connected to SFP (TX) Lens Mirror SFP (RX) SFP : 2x$40 Lens : 2x$30

17. FSO Link Throughput 17 PDF Throughput FSO link is the same as optical cable

18. FSO Link Misalignment Tolerance Effect of vibrations, etc. Movement tolerance – 0.7mm at destination – 3mm at source 3 mm 0.7 mm 18 FSO link is stable TX RXRX

19. Cost : $30K Size : 3 ft³ Power: 60w Flexibility 19 FSOs (1Gbps) Cost : $140 Size : 1x4 in Power: 0.3w Flexibility

20. Flexibility via Switchable Mirror 20 Sender Ceiling Mirror Receiver 1 Reciever2 Switchable Mirror: glass mirror Electronic control, low latency SM in “mirror” mode

21. Flexibility via Switchable Mirror 21 Sender Ceiling Mirror Receiver 1Reciever2 SM in “mirror” mode Receiver 1 Reciever2 Switchable Mirror: glass mirror Electronic control, low latency

22. Outline 22 Flexible wireless links Network management Feasibility & cost

23. Management: Pre-Configuration I nput: FSO#, SM#,… 23 Sender Receiver 1 Reciever2 Output: Candidate links (Alignment of each SM)

24. Management: Reconfiguration Input: Traffic 24 Sender Receiver 1 Reciever2 Output: Run-time topology

25. Current Solutions: Simple Heuristics Pre-Configuration : Regular Random Graph Reconfiguration Only reconfigure for large flows Only delete a link if network remains connected 25

26. Outline 26 Flexible laser link Management Feasibility & cost

27. Throughput 27 512 racks, 48 server/rack, hotspots traffic, flow level simulations FSO based 2-4x improvement

28. Cost Comparison 28 ArchitectureCostEffective Bisection Bandwidth Fattree 1 Gbps$ 13 M1 Gbps FSO based$ 38 M8.5 Gbps Fattree 10 Gbps$ 57 M10 Gbps FSO based: Near 10G performance with 65% of cost

29. Conclusions Data center network is challenging Our vision: Fully flexible, coreless, wireless network Key enablers : FSO + switchable mirrors Early promise: ~ 10Gbps performance @ 65% cost Future work: Improve FSO, better management 29