1. The GÉANT network: addressing current and future needs of the HEP community
Vincenzo Capone, Mian Usman
CHEP2015 – April 2015 (OIST, Okinawa - JP)

2. Outline
About GÉANT
GÉANT backbone
Transport
Routing and switching
The network service structure
International connectivity
The support to HEP
LHCOPN
LHCONE
BELLE II
CERN-Wigner
Conclusions

3. What is GÉANT?
28 European POPs
12,000km of dark fibre on 18 routes
50,000km network infrastructure on 44 routes
Diversified footprint
Serves 50 million users
10,000 institutions
Across 40 European countries
High-bandwidth, high-performance pan-European communications infrastructure
Serving Europe’s research and education community
GÉANT interconnects the European NRENs & provides Global access for the end users & researchers
Co-funded by Europe’s NRENs and the European Commission (EC)

4. What does GÉANT do? (services)
Develop, operate and support innovative services relating to such areas as
Trust and identity,
Security and certification,
Mobility and access,
Flexible connectivity options and test bed facilities
Cloud Services and media and real-time communications
Provide practical support for members, educators, researchers and other partners to collaborate, innovate, share knowledge and agree on policies and strategies
One-stop-shop: international user support for big science communities

5. Outline
About GÉANT
GÉANT backbone
Transport
Routing and switching
The network service structure
International connectivity
The support to HEP
LHCOPN
LHCONE
BELLE II
CERN-Wigner
Conclusions

6. GÉANT backbone Latest transmission and switching technology
Optical transmission platform provides 500Gbps super-channels
Routers with 100Gbps capability
50%-rationale
If a link is used more than 50% on average, the link capacity is doubled
Easy to upgrade
Up to 2Tb on the transport layer with the current hardware
IP upgrade to N x 100G could be done in minutes!

7. GÉANT backbone (for techies…)

8. We selected… (for transmission)
DTN-X solution from Infinera
Why?
Photonic integration
500G SuperChannel
Ease of use
Excellent service wrap

9. We selected… (switching/routing layer)
MX series of IP/MPLS switch/routers from Juniper
Why?
Supports a wide array of switched services (based on EoMPLS)
Includes MP2MP as well as P2P
Optimised for Ethernet
Supports 100GE
120Gbps/slot
Also good at routing…
…and ready for “virtualisation”…
…and SDN

10. Network services map IP IP “Converged” (packet transport) platformIE BE SK UK DE ES DK AT HU GR EE LV LT RO BG TR IL MK RS HR SI NL FR CH IT CZ PL
ALL now “Better featured” MT CY ME
“Fully featured”
“Routerless”
“Fully featured”
Off fibre net
“Better featured”
IP/MPLS only
NREN POPs IP
Circuits
over GÉANT IP
Leased
circuits
“Converged”
(packet transport)
platform
Packet
transport
Switching
platform PT LU
DWDM
Converged
(P-OTS)
platform
Transmission
platform
Fibre
Leased circuits

11. Outline
About GÉANT
GÉANT backbone
Transport
Routing and switching
The network service structure
International connectivity
The support to HEP
LHCOPN
LHCONE
BELLE II
CERN-Wigner
Conclusions

12. GÉANT global connectivity
North America
100Gb Paris-NY (30Gb on ACE)
340Gb from ESNet
200Gb from ANA-200
(Not yet on the map)
Asia
10Gb to SINET4 (via N.A.)
2.5Gb to TEIN (Mumbai)
10Gbit to ORIENT+/TEIN
Mb to CAREN
Future deployments:
10Gb to TEIN (Singapore)
2x10Gb to SINET5 (direct)
Africa
2x10Gb to UbuntuNet Alliance
2x622Mb to EumedCONNECT3
Latin America
5Gb to RedCLARA
GÉANT connects 65 countries outside of Europe, reaching all continents through international partners

13. Outline
About GÉANT
GÉANT backbone
Transport
Routing and switching
The network service structure
International connectivity
The support to HEP
LHCOPN
LHCONE
BELLE II
CERN-Wigner
Conclusions

14. LHCOPN TW-ASGC ES-PIC CA-TRIUMF US-T1-BNL US-FNAL-CMS KR-KISTI CH-CERN
2G ASnet
T0-T1 and T1-T1 traffic
GÉANT provided links
T1-T1 traffic only
TW-ASGC
█ █
AS24167
/20
/24
/24
/19
/22
ES-PIC
█ █ █
AS43115
/24
2001:67c:1148:200::/64
2001:67c:1148:201::/64
2001:67c:1148:202::/64
CA-TRIUMF █
AS36391
/24
/29
/28
US-T1-BNL █
AS43
/24
/23
/24
/24
US-FNAL-CMS █
AS 3152
/24
/24
/22
/22
/22
Not deployed yet
(thick) >=10Gbps
(thin) <10Gbps
█ = Alice █ = Atlas
█ = CMS █ = LHCb
p2p prefix: / :1458:302::/48
40G ESnet
5G Canarie-Surfnet
1G Canarie-Surfnet
20Gb ESnet
10G ASnet-Surfnet
20Gb ESnet
10G GÉANT – Rediris - Anella
KR-KISTI █
AS17579
/24
CH-CERN
█ █ █ █
AS513
/16
/17
2001:1458:301::/48
AS61339
/17
2001:1459:301::/48
40G ESnet
RRC-KI-T1
█ █ █
AS59624
/24
/24
2G Kreonet2 - Surfnet
10G Asnet-Surfnet
10G RETN CERNlight
10G RETN
10G Nordunet-GÉANT
10G RETN CERNlight
JINR-T1 █
AS2875
/22
NDGF
█ █
AS39590
/22
2001:948:40::/42
10G JANET(UK)-GÉANT
10G DFN-GÉANT
10G GARR-GÉANT
10G Renater
10G JANET(UK)-GÉANT
10G DFN-GÉANT
10G GARR-SWITCH
10G Surfnet
UK-T1-RAL
█ █ █ █
AS 43475
/22
/28
NL-T1
█ █ █
AS1162
/22
/28
AS1104
/25
DE-KIT
█ █ █ █
AS34878
/24
/23
2a00:1398:104::/48
IT-INFN-CNAF
█ █ █ █
AS137
/17
FR-CCIN2P3
█ █ █ █
AS789
/24
2001:660:5009:9::/64
10G Nordunet-Surfnet
10G Surfnet-DFN
10G DFN-Renater
2x1G local interconnection
10G RUNNet

15. LHCONE Over 15 national and international RENs
Transatlantic connectivity from:
GÉANT
ESNet
ACE
ANA-200G
Over 50 end sites connected to LHCONE:
46 Tier 2s
10 Tier 1s
Aggregate LHCONE traffic
Average traffic ~25Gbps
Sustained Peaks ~45Gbps
Expected to (at least) double for Run2

16. LHCONE overlay network
Based on L3VPN VRFs
(*BELLE II)
GÉANT is working with the HEP and NRENs community to extend to:
Latin America
Exp. May 2015
Asia-Pacific
Exp. 2H15

17. Support to the BELLE II Experiment
Network monitoring based on perfSONAR
Measurement Points in every T0/T1 sites
Central Measurement Archive at PNNL
Dedicated network test matrix
Participation to the ANA-100G testbed
Data Challenge performed on April 2014 under GÉANT coordination
4 NRENs involved (ESNet, GÉANT, DFN, GARR)
Test servers at PNNL (US), INFN-Napoli (IT), CNAF (IT), KIT (DE)
Simulation 1 day’s worth of raw-data movement (25 TB) between US and Europe
Proved helpful to work out last-mile networking issues at the test sites
BELLE II is now included in LHCONE!

18. BELLE II Trans-Atlantic Data Challenge (US and Trans-Atlantic topology)
Juniper T4000
SURFNet
(AS1103)
VLAN 3011
Ethernet VLAN Bridging
Mx1.ams.nl V R F
/30
ANA100
100G
aofa-cr5.es.net
ESnet (AS293)
pnwg-cr5.es.net
/30
PNNL (AS65428)
PNNL-CE2
(VRF)
PNNL site test subnet /28
10Gbps Best-Effort LSP between VRFs
/30
/30
10G
dc.hep.pnnl.org
GÉANT (AS20965)
MANLAN
Exchange
Brocade MLX

19. BELLE II Trans-Atlantic Data Challenge (European topology)
SURFnet (AS1103)
GÉANT (AS20965)
GARR (AS137)
GÉANT
ANA-100
VRF
GARR
ANA-100
VRF
/30
Juniper T4000
rx1.na1.garr.net V R F
VLAN 3011
VLAN 3011 V R F V R F V R F
100G
mx1.ams.nl
mx1.gen.ch
100G
rx1.mi1.garr.net
/30
rx1.bo.garr.net
10G
mx1.fra.de
/30
VRF
VRF
/30
40G
na.infn.it
/30
cnaf.infn.it
VLAN 3011
100G
INFN Napoli
CNAF
DFN (AS680)
ppssrm-kit.gridka.de
( )
xr-fra1.x-win.dfn.de
10G
10G
10G
DFN
xxx.cnaf.infn.it
(x.x.x.x)
recasse01.na.infn.it
( )
fts3-node1-kit.gridka.de
( )
VLAN 3011
10G
kr-fzk.x-win.dfn.de
f e.gridka.de
( )
kit.edu
10G
40G
f e.gridka.de
( )
KIT
10G
KIT (AS34878)

20. BELLE II Trans-Atlantic Data Challenge (acknowledgment)
Vincenzo Capone, Aleksandr Kurbatov, Mian Usman
Chin Guok
Marco Marletta
Thomas Schmid, Hubert Weibel

21. CERN-Wigner 100G First 100G user service for R&E community
In operation since 11/2012
Provided by GÉANT (GVA- BUD) + NIIFI/HungarNet (local loop in Budapest)
GÉANT NOC operating as Single Point of Contact
Provision of a 2nd diverse circuit currently in discussion

22. Outline
About GÉANT
GÉANT backbone
Transport
Routing and switching
The network structure
International connectivity
The support to HEP
LHCOPN
LHCONE
BELLE II
CERN-Wigner
Conclusions

23. The story so far (and a look at the future)
All the current and future HEP communities will be part of LHCONE
BELLE II is now in
Pierre Auger Observatory interested in it
ILC in the future?
The GÉANT international users support has proved itself a valuable service
A single point of contact/coordination for the users to interact with the NREN community
The improvement of extra-EU connectivity will provide a tangible benefit to the HEP community overall
GÉANT is keen to investigate and support the emerging trends and needs
SDN, dynamic circuits, CDN, etc.
The GÉANT network is ready NOW to satisfy TOMORROW’s users needs

24. Thank you and any questions