2. Network Infrastructure @ CERN Tony Cass, 22 nd March 2016

3. Dependencies 3Network Infrastructure @ CERN Electricity Networking Everything else Databases

4. LHCOPN (Tier1s)LHCOPN LCG CORE GPN CPU, Disk, Tapes 10+Gbps (LACP) Link AFS, Mail, Web 100Gbps Link LHCONE (Tier2s)LHCONE TN PC, telephony, Printing … Wi-Fi EXTNET Internet2 US peering CIXP Internet LHCONE Geant2 1Gbps Link CNIC EXP ATLAS CMS Alice LHCb Underground Firewall

6. . GÉANT Europe ICEPP U Tokyo TEIN GARR LHCONE VRF domain/aggregator UChi Regional R&E communication nexus w/ switch providing VLAN connections exchange point / PoP router Sites that are standalone VRFs See http://lhcone.net for more detail.http://lhcone.net UNL March 2016 – WEJohnston, ESnet, wej@es.net PNU Belle II Tier 1/2 - yellow outline indicates LHC+Belle II site - Dashed outline indicates distributed site } KEK LHC Tier 2/3 ALTAS and CMS LHC ALICE or LHCb LHCONE: A global infrastructure for the High Energy Physics (LHC and Belle II) data management TIFR NKN India CERN Starlight (Chicago) CIC OmniPoP (Chicago) PacWave / PNWG (Seattle) WIX (Washington) NetherLight (Amsterdam) MAN LAN (New York) GÉANT Exchange (London) Paris Madrid. Milan Prague DFN Germany DESY RWTH Wup.U GSI CESNET Czech praguelcg2 ESnet Geneva London Amsterdam RedIRIS Spain PIC-T1 RoEduNet Romania NIHAM NIPNE x4 ISS ITIM UAIC PacWave Sunnyvale JANET UK ICL PacWave Los Angles NORDUnet Nordic NDGF-T1 NDGF-T1b NDGF-T1c UChi (MWT2) ARNES Solvenia SiGNET AGLT2 UM AGLT2 MSU IU (MWT2) UNL Cross-border router KREONET2 Korea KNU PNU KCMS KISTI –T1 Vienna Budapest Frankfurt Copenhagen DE-KIT-T1 LPNHE CEA- Distributed site RENATER France CPPM LPNHE APC LAL IPNHO LLR CEA- IRFU LPSC IPHC Subatech LPC SINET Japan KEK T1 CC-IN2P3-T1 Sites connected at 40G-100G KIT Broadcast VLAN Korea SINET NORDUnet CANARIE ASGC Internet2 KREONET CANARIE ASGC NORDUnet ESnet, Internet2, CANARIE, SARA, CERN via StarLight – NETHERLIGHT GÉANT, NetherLight StarLight GÉANT,via WIX+Geneva GÉANT+CANARIE via MAN LAN NORDUnet, ESnet, GÉANT, via MAN LAN ESnet StarLight GÉANT, MAN LAN ESnet KREONET GARR Italy CNAF-T1 INFN Bari Catania Frascati Legnaro Milano Roma1 Torino INFN Napoli INFN Pisa Starlight-CERN CUDI GÉANT CERN SINET TEIN Beijing GÉANT, London SInet CANARIE London SLAC Communication links: 1/10, 20/30/40, and 100Gb/s JANET TIEN, Bejing ESnet 100G, CERN, MREN 100G, Internet2 100G, GEANT, GARR. CANARIE 100G, UChicago 100G, UMich via Merit/MILR, ANL 100G, FNAL 100G, KREONET (10G/100G) ASGC, KIEA/RU (via GLORIAD), PacificWave 100G, CSTNET, CUDI, GRPnet 100G Internet2, SIINET, Caltech, UCSD, AARNet Internet2 ESnet Caltech SIINET Caltech SINET+ ESnet CANARIE Canada SimFraU TRIUMF-T1 McGill Harvard MIT RPN, Brazil Internet2, CANARIE via PacWave, LA ASGC Taiwan ASGC-T1 ASGC2 NCU NTU ESnet USA PNNL-T1 BNL-T1 FNAL-T1 SLAC ESnet, Geneva ESnet, Amst. ESnet, London CANARIE GÉANT Internet2, ESnet CUDI Mexico UNAM GLORIAD (global) CERNet2/ CSTNet China IHEP-ATLAS IHEP-CMS Pending LHCONE connection RedIRIS ESnet GARR ARNES RoEduNet RENATER PacificWave (distributed exchange) UTor IU UIUC SInet ESnet GÉANT/Geneva NL-T1 SURFsara Nikhef Netherlands NL-T1 AMPATH NAP of Americas (Miami) Bucharest UVic KIEA/RU LHC Tier 1 ALTAS and CMS CNAF-T1 RedCLARA to London CANARIE PSNC ESnet StarLight CSTNet StarLight PSNC Poland PSNC Network provider ANSP SINET to Internet2 TIFR India UBC GARR Geneva UWisc TEIN Hong Kong CERNet CSTNet TEIN Singapore TEIN Mumbai SInet StarLight GÉANT GÉANT+CERN ESnet+Internet2 MAN LAN CERN GÉANT CERN Geneva CERN-T1 KISTI Korea TIFR India CERN-T0 SURFsara ASGC, Taiwan Internet2 via WIX, AmLight ANSP via AmPath, PTTA Redecomep HEPGrid (UERJ) CBPF PTTA NAP do Brasil (São Paulo) RNP/IPĔ Brazil SAMPA (USP) SPRACE ANSP AtlanticWave (distributed exchange) SOX CERNLight CERN KREONET, KIEA/RU Internet2 UNL, Wisc, AGLT2, UChi, ESnet UNL, Wisc, AGLT2, UChi, IU KIAE/RU Russia HEPNET JINR PNPI IHEP Protvino NORDUnet GÉANT+CERN GÉANT/Frankfurt NORDUNet CANARIE UIUC (MWT2) All sites at MANLAN multipoint VLAN UCSD MANLAN GÉANT, Paris Hirosh. GÉANT Madrid TEIN, Mumbai Thailand NKN India CERN Beijing Hong Kong NOTE: LHCOPN paths are not shown on this diagram Mumbai NKN India TIFR VECC The Edoardo Solution Tuskuba Internet2 USA Harvard NE SoW UFlorida PurU Vanderbilt ASGC KREONET Amsterdam ESNet KREONet KIEA/RU RRC-KI T1 JINR T1 ITEP RCC-KI T2 KIEA/RU London TEIN TEIN (Singapore) - GEANT (London) GEANT Singapore SINet SINET (Tokyo) GEANT (London) GÉANT (London) Internet2, CERN, MIT, UChi, UFla, UOak, Vand,, GÉANT (all of NRENS and sites) and Brazilian sites), ESnet, NORDUNet, RUNNNET (HEPNET, GRIDPNPI, IHEP) CANARIE Global Research Platform Network (GRPnet) SARA, CERN Amsterdam PNWG PacificWave/ PNWG All sites at WIX multipoint VLAN, ANSP, RNP

7. Automation & Control 7Network Infrastructure @ CERN

8. IPv6 8Network Infrastructure @ CERN