The GÉANT network: addressing current and future needs of the HEP community Vincenzo Capone, Mian Usman vincenzo.capone@geant.org CHEP2015 – 13-17 April 2015 (OIST, Okinawa - JP)

Outline About GÉANT GÉANT backbone Transport Routing and switching The network service structure International connectivity The support to HEP LHCOPN LHCONE BELLE II CERN-Wigner Conclusions

What is GÉANT? 28 European POPs 12,000km of dark fibre on 18 routes 50,000km network infrastructure on 44 routes Diversified footprint Serves 50 million users 10,000 institutions Across 40 European countries High-bandwidth, high-performance pan-European communications infrastructure Serving Europe’s research and education community GÉANT interconnects the European NRENs & provides Global access for the end users & researchers Co-funded by Europe’s NRENs and the European Commission (EC)

What does GÉANT do? (services) Develop, operate and support innovative services relating to such areas as Trust and identity, Security and certification, Mobility and access, Flexible connectivity options and test bed facilities Cloud Services and media and real-time communications Provide practical support for members, educators, researchers and other partners to collaborate, innovate, share knowledge and agree on policies and strategies One-stop-shop: international user support for big science communities

Outline About GÉANT GÉANT backbone Transport Routing and switching The network service structure International connectivity The support to HEP LHCOPN LHCONE BELLE II CERN-Wigner Conclusions

GÉANT backbone Latest transmission and switching technology Optical transmission platform provides 500Gbps super-channels Routers with 100Gbps capability 50%-rationale If a link is used more than 50% on average, the link capacity is doubled Easy to upgrade Up to 2Tb on the transport layer with the current hardware IP upgrade to N x 100G could be done in minutes!

GÉANT backbone (for techies…)

We selected… (for transmission) DTN-X solution from Infinera Why? Photonic integration 500G SuperChannel Ease of use Excellent service wrap

We selected… (switching/routing layer) MX series of IP/MPLS switch/routers from Juniper Why? Supports a wide array of switched services (based on EoMPLS) Includes MP2MP as well as P2P Optimised for Ethernet Supports 100GE 120Gbps/slot Also good at routing… …and ready for “virtualisation”… …and SDN

Network services map IP IP “Converged” (packet transport) platform IE BE SK UK DE ES DK AT HU GR EE LV LT RO BG TR IL MK RS HR SI NL FR CH IT CZ PL ALL now “Better featured” MT CY ME “Fully featured” “Routerless” “Fully featured” Off fibre net “Better featured” IP/MPLS only NREN POPs IP Circuits over GÉANT IP Leased circuits “Converged” (packet transport) platform Packet transport Switching platform PT LU DWDM Converged (P-OTS) platform Transmission platform Fibre Leased circuits

Outline About GÉANT GÉANT backbone Transport Routing and switching The network service structure International connectivity The support to HEP LHCOPN LHCONE BELLE II CERN-Wigner Conclusions

GÉANT global connectivity North America 100Gb Paris-NY (30Gb on ACE) 340Gb from ESNet 200Gb from ANA-200 (Not yet on the map) Asia 10Gb to SINET4 (via N.A.) 2.5Gb to TEIN (Mumbai) 10Gbit to ORIENT+/TEIN 622+155Mb to CAREN Future deployments: 10Gb to TEIN (Singapore) 2x10Gb to SINET5 (direct) Africa 2x10Gb to UbuntuNet Alliance 2x622Mb to EumedCONNECT3 Latin America 5Gb to RedCLARA GÉANT connects 65 countries outside of Europe, reaching all continents through international partners

Outline About GÉANT GÉANT backbone Transport Routing and switching The network service structure International connectivity The support to HEP LHCOPN LHCONE BELLE II CERN-Wigner Conclusions

LHCOPN TW-ASGC ES-PIC CA-TRIUMF US-T1-BNL US-FNAL-CMS KR-KISTI CH-CERN 2G ASnet T0-T1 and T1-T1 traffic GÉANT provided links T1-T1 traffic only TW-ASGC █ █ AS24167 117.103.96.0/20 140.109.98.0/24 140.109.102.0/24 202.140.160.0/19 202.169.168.0/22 ES-PIC █ █ █ AS43115 193.109.172.0/24 2001:67c:1148:200::/64 2001:67c:1148:201::/64 2001:67c:1148:202::/64 CA-TRIUMF █ AS36391 206.12.1.0/24 206.12.9.0/29 206.12.9.64/28 US-T1-BNL █ AS43 130.199.185.0/24 130.199.48.0/23 130.199.54.0/24 192.12.15.0/24 US-FNAL-CMS █ AS 3152 131.225.2.0/24 131.225.160.0/24 131.225.184.0/22 131.225.188.0/22 131.225.204.0/22 Not deployed yet (thick) >=10Gbps (thin) <10Gbps █ = Alice █ = Atlas █ = CMS █ = LHCb p2p prefix: 192.16.166.0/24 - 2001:1458:302::/48 edoardo.martelli@cern.ch 20141212 40G ESnet 5G Canarie-Surfnet 1G Canarie-Surfnet 20Gb ESnet 10G ASnet-Surfnet 20Gb ESnet 10G GÉANT – Rediris - Anella KR-KISTI █ AS17579 134.75.125.0/24 CH-CERN █ █ █ █ AS513 128.142.0.0/16 188.184.128.0/17 2001:1458:301::/48 AS61339 188.185.128.0/17 2001:1459:301::/48 40G ESnet RRC-KI-T1 █ █ █ AS59624 144.206.224.0/24 144.206.236.0/24 2G Kreonet2 - Surfnet 10G Asnet-Surfnet 10G RETN CERNlight 10G RETN 10G Nordunet-GÉANT 10G RETN CERNlight JINR-T1 █ AS2875 193.93.228.0/22 NDGF █ █ AS39590 109.105.124.0/22 2001:948:40::/42 10G JANET(UK)-GÉANT 10G DFN-GÉANT 10G GARR-GÉANT 10G Renater 10G JANET(UK)-GÉANT 10G DFN-GÉANT 10G GARR-SWITCH 10G Surfnet UK-T1-RAL █ █ █ █ AS 43475 130.246.176.0/22 130.246.152.240/28 NL-T1 █ █ █ AS1162 145.100.32.0/22 145.100.17.0/28 AS1104 194.171.96.128/25 DE-KIT █ █ █ █ AS34878 192.108.45.0/24 192.108.46.0/23 2a00:1398:104::/48 IT-INFN-CNAF █ █ █ █ AS137 131.154.128.0/17 FR-CCIN2P3 █ █ █ █ AS789 193.48.99.0/24 2001:660:5009:9::/64 10G Nordunet-Surfnet 10G Surfnet-DFN 10G DFN-Renater 2x1G local interconnection 10G RUNNet

LHCONE Over 15 national and international RENs Transatlantic connectivity from: GÉANT ESNet ACE ANA-200G Over 50 end sites connected to LHCONE: 46 Tier 2s 10 Tier 1s Aggregate LHCONE traffic Average traffic ~25Gbps Sustained Peaks ~45Gbps Expected to (at least) double for Run2

LHCONE overlay network Based on L3VPN VRFs (*BELLE II) GÉANT is working with the HEP and NRENs community to extend to: Latin America Exp. May 2015 Asia-Pacific Exp. 2H15

Support to the BELLE II Experiment Network monitoring based on perfSONAR Measurement Points in every T0/T1 sites Central Measurement Archive at PNNL Dedicated network test matrix Participation to the ANA-100G testbed Data Challenge performed on April 2014 under GÉANT coordination 4 NRENs involved (ESNet, GÉANT, DFN, GARR) Test servers at PNNL (US), INFN-Napoli (IT), CNAF (IT), KIT (DE) Simulation 1 day’s worth of raw-data movement (25 TB) between US and Europe Proved helpful to work out last-mile networking issues at the test sites BELLE II is now included in LHCONE!

BELLE II Trans-Atlantic Data Challenge (US and Trans-Atlantic topology) Juniper T4000 SURFNet (AS1103) VLAN 3011 Ethernet VLAN Bridging Mx1.ams.nl V R F 192.188.41.6/30 ANA100 100G aofa-cr5.es.net ESnet (AS293) pnwg-cr5.es.net 192.188.41.1/30 PNNL (AS65428) PNNL-CE2 (VRF) PNNL site test subnet 192.188.41.16/28 10Gbps Best-Effort LSP between VRFs 192.188.41.2/30 192.188.41.5/30 10G dc.hep.pnnl.org GÉANT (AS20965) MANLAN Exchange Brocade MLX

BELLE II Trans-Atlantic Data Challenge (European topology) SURFnet (AS1103) GÉANT (AS20965) GARR (AS137) GÉANT ANA-100 VRF GARR ANA-100 VRF 193.206.130.1/30 Juniper T4000 rx1.na1.garr.net V R F VLAN 3011 VLAN 3011 V R F V R F V R F 100G mx1.ams.nl mx1.gen.ch 100G rx1.mi1.garr.net 192.188.41.6/30 rx1.bo.garr.net 10G mx1.fra.de 193.206.128.1/30 VRF VRF 193.206.130.2/30 40G na.infn.it 193.206.128.2/30 cnaf.infn.it VLAN 3011 100G INFN Napoli CNAF DFN (AS680) ppssrm-kit.gridka.de (192.108.45.39) xr-fra1.x-win.dfn.de 10G 10G 10G DFN xxx.cnaf.infn.it (x.x.x.x) recasse01.na.infn.it (193.205.223.100) fts3-node1-kit.gridka.de (192.108.45.132) VLAN 3011 10G kr-fzk.x-win.dfn.de f01-151-10-e.gridka.de (192.108.45.245) kit.edu 10G 40G f01-151-45-e.gridka.de (192.108.45.246) KIT 10G KIT (AS34878)

BELLE II Trans-Atlantic Data Challenge (acknowledgment) Vincenzo Capone, Aleksandr Kurbatov, Mian Usman Chin Guok Marco Marletta Thomas Schmid, Hubert Weibel

CERN-Wigner 100G First 100G user service for R&E community In operation since 11/2012 Provided by GÉANT (GVA- BUD) + NIIFI/HungarNet (local loop in Budapest) GÉANT NOC operating as Single Point of Contact Provision of a 2nd diverse circuit currently in discussion

Outline About GÉANT GÉANT backbone Transport Routing and switching The network structure International connectivity The support to HEP LHCOPN LHCONE BELLE II CERN-Wigner Conclusions

The story so far (and a look at the future) All the current and future HEP communities will be part of LHCONE BELLE II is now in Pierre Auger Observatory interested in it ILC in the future? The GÉANT international users support has proved itself a valuable service A single point of contact/coordination for the users to interact with the NREN community The improvement of extra-EU connectivity will provide a tangible benefit to the HEP community overall GÉANT is keen to investigate and support the emerging trends and needs SDN, dynamic circuits, CDN, etc. The GÉANT network is ready NOW to satisfy TOMORROW’s users needs

Thank you and any questions vincenzo.capone@geant.org www.geant.org