1. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 1 Clouds and Networks: Technology and Network Infrastructure Evolution Charles (Chuck) Kalmanek V.P. – Networking and Services Research AT&T Labs

2. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 2 Network Infrastructure Evolution Networks evolve in response to the changing nature of the traffic and advances in component and system technology. Changes in traffic are driven by advances in computing technology and applications.

3. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 3 Router Scalability –Growth in network load oData plane: traffic load oControl plane: number of Internet prefixes, OSPF topology, LDP labels, etc. –Currently require fork-lift router upgrades oSignificant CapEx costs oAdditional costs: manpower hours for certification, upgrade management tools, reduction in network reliability –Architectural reorganizations can improve network manageability oEspecially at the customer / aggregation / edge

4. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 4 Evolving the Traditional ISP Architecture How to handle failures and planned maintenance at network edge? –Treat AR’s as a resource pool, similar to blade servers –Migrate to a spare router, similar to taking a blade out of the load balancer rotation How to handle control plane scale issues at network edge? –Install new routers and migrate to them –Feature incompatibilities, differences in configs add complexity AR CE BR PoP Access Router Backbone Router XC AR

5. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 5 1.Extract customer configuration from initial router 2.Install customer configuration on to target router 3.Reconfigure transport (layer 1) connectivity 4.Wait for network to converge 5.Verify service 1.Extract customer configuration from initial router 2.Install customer configuration on to target router 3.Reconfigure transport (layer 1) connectivity 4.Wait for network to converge 5.Verify service BGP RouterFarm in Action* (Network Migration) Transport Network ISP Backbone * Agrawal, Bailey, et al., RouterFarm: Towards a Dynamic Manageable Network Edge, INM’06

6. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 6 Application 2 Replace a router with N physical ones Extending Access Router Life? –Use multiple physical routers to form a logical, Composable Router* –A Composable Router appears as a single routing entity to rest of network oDistribute control and data plane load among physical routers oWhen load increases, add more routers to Composable Router oReduce upgrade frequency and associated costs Application 1 Form a virtual access router from multiple access routers * Ee, Breslau, Ramakrishnan, REAP: Router Extensibility via Address-based Partitioning

7. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 7 Basic Idea –Start with a bunch of existing routers oThese form an array, we call each of them an array router –Need to distribute control and data plane load within the array oLet each array router be responsible for a subset of address space oDivide address space into blocks, assign to array routers Array Reduces per-router prefixes, labels Reduces forwarding load per router Block 1 Block 2 Block 3 Block 4 Block 5 IPv4 space

8. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 8 Basic Idea (data plane) –Splitter serves as distribution and aggregation point for array oLocal packet routing is static, on per-interface basis –Distribute incoming data packets based on dest IP –Aggregate outgoing data packets based on static mapping oE.g., 802.1q VLAN tags –Simple, large scale splitter /switch is needed Array Splitter

9. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 9 Basic Idea (control plane) –Control packet distribution, aggregation handled by meta- router oSplitter classifies and passes only control packets to meta- router oSplitter - meta-router link need not be of high-capacity oMeta-router distributes control packets, e.g. based on prefix advertised oAgain, incoming interface at splitter determines interface leading to array router (which also maintains state for that address block) Array Splitter Composable Router Meta-router

10. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 10 Road to Compute-based Infrastructure Source: Intel® (with permission) 2000 2012+ 10X SINGLE Thread With Multi-core MULTI-CORE 2006 FORECAST Performance 3X You Are Here Normalized Performance vs. Initial Intel® Pentium® 4 Processor Asymmetric/Symmetric Multiprocessing And Virtualization Supported

11. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 11 Network Distributed Computing Distributed Computing + Network => Services –Network application services –Cloud / utility computing –Software as a service Central office => data center –Data center switching –Virtualized computing –Storage –Security Example: video content delivery gateway

12. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 12 Content Delivery Gateway

13. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 13 Video Content Delivery Gateway: Functionality Transcoding Digital Rights Management Content Security Image Processing Ad Overlay Key Management Dynamic Ad Splicing High Performance Computing Technology Management Control Zone Ad Targeting Unicast / Broadcast Hardware/Software Acceleration IMS Network Management IMS Session Control Content Transformation Digital Rights Management Addressable Advertising Platform Technologies Packet Management Packet Management (Transport / Service Control) NEBs High Availability Bladed Platform Network Monitoring / Security

14. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 14 Cloud Computing Lease computation and storage resources on demand Highly dynamic resource provisioning –Add new servers within minutes –Easy to replicate virtual resources Only pay for what you use Several emerging services –Amazon EC2, IBM Blue Cloud, Google App Engine, Microsoft Azure, AT&T Synaptic Hosting, etc. Cloud Platform

15. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 15 What is Missing? Control over network management –Can’t request specific IP addresses –Can’t put VMs on own private network Control of Network Resources –Bandwidth, traffic isolation, etc Lack of network security and isolation –VMs have IP on public internet –Customer must manage security on VM itself at&t top secret Verizon pay roll

16. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 16 CloudNet: Bringing VPNs to the Cloud* Use VPNs to separate customer resources Customer’s VMs are only reachable from her other VPN end points More flexible control of how IP addresses are assigned Physical network is transparent to customer VPLS * Collaboration bet. U. Mass (P. Shenoy, T. Wood) & AT&T Labs (J. van der Merwe, K. K. Ramakrishnan)

17. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 17 System Components Cloud Manager –Create VMs –Resource Allocation –Controls up to CEs Network Manager –VPN management –Access controls –Controls PEs May be separate business entities Cloud 1Cloud 9 Network Manager Cloud Manager … CE

18. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 18 VPN Management All endpoints need to “match” Making changes to all endpoints is a pain! Use IRSCP –Centralized VPN manager –Looks like route reflector –Speaks BGP to PEs Rewrites VPN route targets IRSCP IRSCP Rules: VPN 1 = + + VPN 2 = + Takes about 5-8 seconds

19. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 19 Shadownet Provides infrastructure for CloudNet Uses Juniper router support for logical routers –Subdivide a physical router Instantiates arbitrary networks based on topology description Simplifies and automates router configuration –Tracks links, used interfaces, VLAN ids, etc Site 1Site 2

20. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 20 CloudNet Prototype Logical View Physical Instantiation PE CE VM CE VM PECE VM Customer W Cloud E PE Customer S PE Cloud N PECE VM PECE VM PECE VM PE VM CE

21. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 21 Summary Evolution in computing technologies continues to change the nature of network infrastructure Router scalability –Architectural reorganization at network edge holds promise Network distributed computing –Distinction between central offices and data centers is breaking down –Integration of cloud computing and VPNs provides isolation and security to enterprise customers

22. © 2008 AT&T Intellectual Property. All rights reserved. March 27, 2009 Page 22 Thank you! Questions???