Networks ∙ Services ∙ People Mian Usman IP Network Architect, GÉANT TNC16 13 th June 2016 GÉANT Transport Network Evolution

Networks ∙ Services ∙ People GÉANT Network Network Architecture Evaluation Transport SDN 2 Agenda

Networks ∙ Services ∙ People Two main networks Infinera based DWDM Juniper based IP/MPLS 3 main overlays on the IP/MPLS network Global R&E IP LHCONE IAS – GÉANT internet service GWS+Peerings A number of other services with much smaller data rate GN+ MDVPN BoD Etc.. 3 GÉANT Network

Networks ∙ Services ∙ People Elements providing large capacity Point-to-point across defined fibre routes 10G and 100G Lambda services are provided directly on this infrastructure 4 The DWDM network

Networks ∙ Services ∙ People Juniper MX routers IP traffic any to any.. with policy All services expect from Lambdas are provided here Use the DWDM network for some of its core links, leased capacity for others Provides Overlays 5 The IP/MPLS network

Networks ∙ Services ∙ People 6

Networks ∙ Services ∙ People 7 Traffic by Overlay IAS = Internet service None = GÉANT Global R&E IP LHCONE = LHCONE Less than 10% of traffic falls outside of these 3 main overlays.

Networks ∙ Services ∙ People 8 Traffic Growth Q > Q Growth ROUTING only Q > Q Growth Including Lambdas 47.70% 26.40% Year on year growth.. peaks are smoothed so actually higher! LHCONE Monthly average Gbps

Networks ∙ Services ∙ People Network Utilisation LinkAvailable capacity FRA-PRA80 BRA-PRA90 PAR-LON130 GEN-MIL170 AMS-FRA180 BRA-VIE190 GEN-PAR190 BRU-LON190 BRA-BUD190 FIN-VIE200 AMS-BRU200 On a reroute event peak was over 70Gbps!.. and the other leg out of Geneva has daily peaks of 50Gbps. 50% Of the Infinera superchannels have less than 200Gbps of available capacity..lambda services are not protected but restorable, so additional capacity is required on alternate routes for rerouting.

Networks ∙ Services ∙ People Current GÉANT Core network is utilizing fully functional routers For IP services, peering, packet forwarding, MPLS services, etc Deployed in sparse mesh (minimal router off-load) Backbone trunks follow fibre path Many packets transit through intermediate router hops Each transit packet consumes portion of the optical interface and forwarding capabilities Does this add any value? Transit through a backbone router incurs unnecessary costs Increases latency Increases utilisation of interfaces at IP layer 10 Core Network Architecture

Networks ∙ Services ∙ People IPoWDM (Thin Core) Router manages optical link Moves the cost of transponder/optics from optical layer equipment to the router Still a sparse mesh topology – unnecessary transit packets Hollow Core Mesh routers through OTN core GÉANT uses single routers in a PoP which performs functionality of both core and edge router In a 100G backbone full mesh would result in both increased complexity and costs 11 Evaluation of Network Architectures

Networks ∙ Services ∙ People IP over OTN Interconnect router with appropriate capacity trunk link Increase meshing between core routers Trunk links can be multiplexed by OTN layer into 500G super channel Transit traffic is kept at OTN layer instead of transiting through multiple routers Maximizes slot capacity at both IP and Optical layer Enables GÉANT to scale and converge the two networks Testing of Infinera PXM (OTN) Cards completed Will be rolled out in Eastern part of the network 12 Evaluation of Network Architectures

Networks ∙ Services ∙ People Current Architecture Follows the physical fibre Significant amount of transit traffic Requires two 100G interfaces per trunk Over provisioned Proposed Architecture IP Trunks based on traffic requirements between the two PoPs Significantly reduces the amount of transit traffic through routers Multiple trunk links can be setup on a single 100GE interface Reduces the amount of 100GE interfaces required on both IP and DWDM layer 13 Current and Proposed Architecture

Networks ∙ Services ∙ People Working closely with Infinera to develop a solution for managing OTN (PXM) cards using an OpenFlow controller Paves the way to multi-layer interaction It uses standard open APIs Enables us to bring more intelligence to the core network Reduce overprovisioning Reduce number of transit packets going through intermediate routers In future dynamically modify capacity on OTN layer to cater for peaky traffic on Layer 2 and 3 14 Transport SDN App

Networks ∙ Services ∙ People Transport SDN Current network architecture GÉANT WDM/OTN NREN GÉANT Router NREN GÉANT Router GÉANT Router GÉANT Router ODU4/2e links

Networks ∙ Services ∙ People Transport SDN Revised architecture with PXM cards NREN GÉANT Router 100GbE NREN GÉANT Router 100GbE GÉANT Router GÉANT Router GÉANT WDM/OTN IP trunks. ODUflex used to manage bandwidth between PXM cards. These are static (not OTS controlled) PXM cards support termination of EVPL circuits on vlans Legacy ODU4/2e links to routers via TIM ports 100GbE Trunks follow traffic rather than fibre

Networks ∙ Services ∙ People GÉANT WDM/OTN NREN GÉANT Router 100GbE NREN GÉANT Router 100GbE GÉANT Router GÉANT Router L2 SDN switch N x 10GbE SDN Phase 2 B/W management with transport SDN ODUflex and OTSv used to dynamically insatiate these links. 100GbE N x 10GbE SDN controller OTSc OTSv N x 10GbE Trunks now controlled by OTS

Networks ∙ Services ∙ People SDN Vision Integrated L2 and L3 services NREN 100GbE NREN 100GbE GÉANT Router 100GbE GÉANT Router SDN Switch WAN optimised switches operate as full layer 3 device and replaces the GÉANT router Layer 2 service as developed in earlier phases continues to be supported. GÉANT WDM/OTN Multi-layer SDN controller Switches connected to the WDM/OTN cloud via a 100GE port on a PXM card Both IP trunks and p2p L2 circuits all are provisioned in the same way – ODU 4/2e or ODUflex circuits terminating on PXM or TIM All circuits may be provisioned statically or dynamically via the OTSv

Networks ∙ Services ∙ People Exponential Bandwidth Increase Highly unpredictable traffic Brings application awareness in the network Integration with other e-Infrastrcture Improve network visibility and reduce operational costs Programmability, offers ability to use API to link applications to the network Support for virtual networks Remove dependence on vendor software ability to outsource/crowdsource service development - greater agility and speed of service development Niche service development feasible – R&E no longer dependent on the wants and needs of the big service providers that vendors pander to – ATT, Verizon, BT, Telefonica et al 19 Summary SDN enables R&E to differentiate from Commercial ISPs

Networks ∙ Services ∙ People Thank you and any questions Networks ∙ Services ∙ People © GEANT Limited on behalf of the GN4 Phase 1 project. The research leading to these results has received funding from the European Union’s Horizon 2020 research and innovation programme under Grant Agreement No (GN4-1). 20

Networks ∙ Services ∙ People LHCONE Traffic increase over last 12 months 21 Unpredictable Traffic