1. Putting BGP on the Right Path: A Case for Next-Hop Routing Michael Schapira (Yale University and UC Berkeley) Joint work with Yaping Zhu and Jennifer Rexford (Princeton University)

2. Once Upon a Time… Internet Inter-Network Routing: Small network Single administrative entity  NSFNET Shortest-path routing  distance-vector routing Then....

3. Interdomain Routing Over 35,000 Autonomous Systems (ASes) Interdomain routing = routing between ASes –Border Gateway Protocol (BGP) AT&T Qwest Comcast Sprint

4. Today’s Path-Based Routing With BGP Complex! –configuration errors, software bugs, … Bad convergence! –persistent route oscillations, slow convergence, … Vulnerable to attacks! –malicious, economically-driven, inadvertent, … and more, and more, and more … –bad performance, clumsy traffic engineering, …

5. How Can We Fix Interdomain Routing? One approach: add mechanisms to an already complex protocol –route flap damping, S-BGP, … Another approach: redesign interdomain routing from scratch –HLP, NIRA, pathlet routing, consensus routing, … Our approach: simplify BGP!

6. Agenda Our proposal: next-hop routing Fast convergence and Incentive-compatibility More scalable multipath routing Security, performance, traffic engineering Conclusions and future research merits

7. Background: Today’s Path- Based Routing With BGP AS i’s routing policy:  ranking of simple routes from i to each destination d  export policy BGP is a path-vector protocol Receive route updates from neighbors Choose single “best” route (ranking) Send route updates to neighbors (export policy)

8. 3 d 1 2 Background: Today’s Path- Based Routing With BGP 32d > 31d Don’t export 2d to 3 1, 2, I’m available 3, I’m using 1d a stable state is reached

9. AS-PATH = the Route of All Evil AS-PATH: list of all ASes on path –originally meant for loop-detection The AS-PATH is to blame! –error-prone, software bugs –no/slow convergence –large attack surface –bad scalability, clumsy traffic engineering, bad performance, …

10. Getting Off the AS-PATH No way back to shortest-path routing… Our proposal: next-hop routing –make routing decisions based solely on the “next hop” –relegate the AS-PATH to its original role

11. Wish List Loop freedom Fast Convergence Security Incentive compatibility Business policies Good performance Traffic engineering Scalability Simplicity

12. Expressiveness vs. Complexity complexity expressiveness not expressive enough sufficiently expressive extremely expressive simple too complex shortest-path routing next-hop routing! BGP’s path-based routing

13. Next-Hop Routing Rules! Rule 1: use next-hop rankings 4 d 3 5 1 2 4 > 3 541d > 53d > 542d

14. Next-Hop Routing Rules! Rule 1: use next-hop rankings Rule 2: prioritize current route –to minimize path exploration [Godfrey-Caesar-Hagen-Singer-Shenker] 2 d 3 1 2=3 Break ties in favor of lower AS number 2=3 Prioritize current route

15. Next-Hop Routing Rules! Rule 1: use next-hop rankings Rule 2: prioritize current route Rule 3: consistently export –to avoid disconnecting upstream nodes [Feigenbaum-S-Ramachandran] 3 d 4 1 2 1 > 2, Export 32d, but not 31d, to 4 1 > 2, Export 31d to 4

16. Next-Hop Routing Rules! Rule 1: use next-hop rankings Rule 2: prioritize current route Rule 3: consistently export –Defn: Node i consistently exports w.r.t. neighbor j if there is some route R s.t. each route Q is exportable to j iff R ≤ i Q. –Defn: Node i consistently exports if it consistently exports with respect to each neighboring node j.

17. Next-Hop Routing Rules! Rule 1: use next-hop rankings Rule 2: prioritize current route Rule 3: consistently export 3 deployment schemes –Configure today’s routers –Create new router configuration interface –Build new router software

18. Wish List Revisited

19. Loop freedom Fast convergence? Security Incentive compatibility? Business policies Good performance Traffic engineering Scalability? Simplicity

20. Agenda next-hop routing Fast convergence and Incentive-compatibility More scalable multipath routing Security, performance, traffic engineering Conclusions and future research merits

21. Existence of Stable State Existence of stable state not guaranteed even with next-hop rankings (Rule 1) [Feamster-Johari-Balakrishnan] Thm: If the next-hop routing rules hold, then a stable state exists in the network. What about (fast!) convergence?

22. BGP Oscillations BGP not guaranteed to converge even with next-hop routing! [Griffin-Shepherd-Wilfong] 1 d 2 2 > d 1 > d

23. The Commercial Internet ASes sign long-term contracts. Neighboring pairs of ASes have: –a customer-provider relationship –a peering relationship peer providers customers peer

24. Gao-Rexford Framework 3 simple conditions that are naturally induced by the AS-business-hierarchy. –Topology condition, Preference condition, Export condition If the Gao-Rexford conditions hold, then BGP is guaranteed to converge to a stable state. [Gao-Rexford] But, this might require exponentially- many forwarding changes! [Syed-Rexford]

25. Fast BGP Convergence Thm: In the Gao-Rexford framework, next-hop routing convergence to a stable state involves at most O(|L| 2 ) forwarding changes (|L| = # links). –all network topologies –all timings of AS activations and update message arrivals –all initial routing states –all initial “beliefs”

26. Simulations C-BGP simulator Cyclops AS-level topology, Jan 1 st 2010 –33,976 ASes, ~5000 non-stubs Protocols –BGP, Prefer Recent Route (PRR), next-hop routing

27. Simulations Metrics –# forwarding changes, # routing changes, # updates Events –prefix up, link failure, link recovery Methodology –500 experiments –10,000 vantage points (all non-stubs, 5000 stubs)

28. Simulation Results (# Forwarding Changes) maximum number of BGP forwarding changes > 20 maximum number of routing changes in next-hop routing = 3 maximum number of forwarding changes in PRR = 10

29. Simulation Results (# Routing Changes) maximum number of BGP routing changes > 160 maximum number of routing changes in next-hop routing < 20 maximum number of routing changes in PRR > 40

30. Simulation Results (# BGP Updates, Non-Stub ASes) maximum number of BGP updates > 6000 maximum number of updates in next-hop routing < 300 maximum number of updates in PRR > 1000

31. Simulation Results (# Routing Changes, The 0.1% Position)

32. Incentive Compatible Routing Configurations 2 d 3 1 d > 2 3 > d > 1 2 Each node is getting its best feasible next-hop

33. Next-Hop Routing is Incentive Compatible Thm [Feigenbaum-Ramachandran-S] : In the Gao-Rexford framework, next-hop routing is incentive compatible. (each node is guaranteed its best feasible next-hop)

34. Agenda next-hop routing Fast convergence and Incentive-compatibility More scalable multipath routing Security, performance, traffic engineering Conclusions and future research merits

35. Multipath Routing Exploiting path diversity to –realize the AS’s own objectives –customize route selection for neighboring ASes But... multipath routing is not scalable! –disseminate and store multiple routes

36. Multipath Routing is Not Scalable! d 1 2 34 P1P1 P2P2 Q1Q1 Q2Q2 I’m using P 1 and P 2 I’m using Q 1 and Q 2 I’m using P 1, P 2, Q 1 and Q 2

37. From AS-PATH to AS-SET Next-hop routing is more amenable to multipath –nodes don’t care about entire paths –… other than for loop detection Don’t announce routes, announce sets! –set = union of ASes on all routes –BGP route aggregation

38. Neighbor-Specific Next-Hop Routing Customizing route selection for neighbors –operational motivation [Kushman-Kandula-Katabi-Maggs] –economic motivation [Wang-S-Rexford] C1C1 z C2C2 C3C3 d ? R1R1 R2R2 R3R3 Secure! Short! Cheap!

39. Neighbor-Specific Next-Hop Routing Neighbor-Specific BGP [Wang-S-Rexford] –implementable using existing tools Results for convergence and incentive compatibility extend to multipath!

40. Wish List Revisited

41. Agenda next-hop routing Fast convergence and Incentive-compatibility More scalable multipath routing Security, performance, traffic engineering Conclusions and future research merits

42. Security, Performance, Traffic Engineering Still open research questions Handled (mostly) outside the routing protocol –and what is handled within the protocol is not effective! Next-hop routing makes the situation better

43. Security, Performance, Traffic Engineering AS-PATH does not help –large attack surface, shorter is not better, … Next-hop routing is better –smaller attack surface, multipath! [Andersen-Balakrishnan-Kaashoek-Rao] [Motiwala-Elmore-Feamster- Vempala] [Xu-Rexford] End-to-end mechanisms [Wendlandt-Avaramopoulos-Andersen-Rexford]

44. Agenda next-hop routing Fast convergence and Incentive-compatibility More scalable multipath routing Security, performance, traffic engineering Conclusions and future research merits

45. Conclusions and Future Research BGP is far too complicated! New approach: simplify BGP –without compromising global and local goals! Directions for future research: –getting rid of the AS-PATH? –software / configuration complexity –more theoretical and experimental work

46. Thank You