IPv6 update Duncan Rand Imperial College London

Slides:



Advertisements
Similar presentations
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) HEPiX, Oxford 24 Mar 2015.
Advertisements

News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) WLCG GDB, CERN 8 July 2015.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP35, Liverpool 11 Sep 2015.
The production deployment of IPv6 on WLCG David Kelsey (STFC-RAL) CHEP2015, OIST, Okinawa 16 Apr 2015.
Oxford Update HEPix Pete Gronbech GridPP Project Manager October 2014.
WLCG Service Report ~~~ WLCG Management Board, 24 th November
The HEPiX IPv6 Working Group David Kelsey EGI TF, Prague 18 Sep 2012.
WLCG Service Report ~~~ WLCG Management Board, 1 st September
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
Status Report of WLCG Tier-1 candidate for KISTI-GSDC Sang-Un Ahn, for the GSDC Tier-1 Team GSDC Tier-1 Team 12 th CERN-Korea.
INFN TIER1 (IT-INFN-CNAF) “Concerns from sites” Session LHC OPN/ONE “Networking for WLCG” Workshop CERN, Stefano Zani
GridPP Dirac Service The 4 th Dirac User Workshop May 2014 CERN Janusz Martyniak, Imperial College London.
INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Pre-GDB Storage Classes summary of discussions Flavia Donno Pre-GDB.
HEPiX IPv6 Working Group David Kelsey GDB, CERN 11 Jan 2012.
LCG Report from GDB John Gordon, STFC-RAL MB meeting February24 th, 2009.
The HEPiX IPv6 working group David Kelsey (STFC-RAL) HEPiX meeting, Bologna 17 Apr 2013.
LCG WLCG Accounting: Update, Issues, and Plans John Gordon RAL Management Board, 19 December 2006.
Operations model Maite Barroso, CERN On behalf of EGEE operations WLCG Service Workshop 11/02/2006.
WLCG and IPv6 David Kelsey (STFC-RAL) LHCOPN/LHCONE, Rome 28 Apr 2014.
CMS: T1 Disk/Tape separation Nicolò Magini, CERN IT/SDC Oliver Gutsche, FNAL November 11 th 2013.
Development of a Tier-1 computing cluster at National Research Centre 'Kurchatov Institute' Igor Tkachenko on behalf of the NRC-KI Tier-1 team National.
The GridPP DIRAC project DIRAC for non-LHC communities.
WLCG Operations Coordination report Maria Alandes, Andrea Sciabà IT-SDC On behalf of the WLCG Operations Coordination team GDB 9 th April 2014.
Summary of SC4 Disk-Disk Transfers LCG MB, April Jamie Shiers, CERN.
WLCG: Are we ready for IPv6? David Kelsey (STFC-RAL) ISGC 2014, Taipei 26 Mar 2014.
CernVM-FS – Best Practice to Consolidate Global Software Distribution Catalin CONDURACHE, Ian COLLIER STFC RAL Tier-1 ISGC15, Taipei, March 2015.
HEPiX IPv6 Working Group David Kelsey david DOT kelsey AT stfc DOT ac DOT uk (STFC-RAL) HEPiX, Vancouver 26 Oct 2011.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) HEPIX, BNL 13 Oct 2015.
The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013.
UK Status and Plans Catalin Condurache – STFC RAL ALICE Tier-1/Tier-2 Workshop University of Torino, February 2015.
Vendredi 27 avril 2007 Management of ATLAS CC-IN2P3 Specificities, issues and advice.
The Worldwide LHC Computing Grid WLCG Milestones for 2007 Focus on Q1 / Q2 Collaboration Workshop, January 2007.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP33 Ambleside 22 Aug 2014.
WLCG Operations Coordination Andrea Sciabà IT/SDC GDB 11 th September 2013.
T0-T1 Networking Meeting 16th June Meeting
WLCG IPv6 deployment strategy
LHC[OPN/ONE]  IPv6  status
LHCOPN/LHCONE status report pre-GDB on Networking CERN, Switzerland 10th January 2017
Computing Operations Roadmap
WLCG Network Discussion
“A Data Movement Service for the LHC”
Dirk Duellmann CERN IT/PSS and 3D
LHCOPN/ONE meeting BNL 4-5 of April 2017 summary report GDB 12th of April 2017
LCG Service Challenge: Planning and Milestones
Report from WLCG Workshop 2017: WLCG Network Requirements GDB - CERN 12th of July 2017
Status Report on LHC_2 : ATLAS computing
LHCOPN update Brookhaven, 4th of April 2017
BNL Tier1 Report Worker nodes Tier 1: added 88 Dell R430 nodes
INFN Computing infrastructure - Workload management at the Tier-1
Plans to support IPv6-only CPU on WLCG
Ian Collier STFC Rutherford Appleton Laboratory
WLCG Operations Coordination
One independent ‘policy-bridge’ PKI
Update on Plan for KISTI-GSDC
LHCb Computing Model and Data Handling Angelo Carbone 5° workshop italiano sulla fisica p-p ad LHC 31st January 2008.
Support for IPv6-only CPU – an update from the HEPiX IPv6 WG
Deployment of IPv6-only CPU on WLCG – an update from the HEPiX IPv6 WG
Marian Babik Andrea Sciabà
Update from the HEPiX IPv6 WG
Deployment of IPv6-only CPU on WLCG – an update from the HEPiX IPv6 WG
Venue and Participants
Deployment of IPv6-only CPU on WLCG - update from the HEPiX IPv6 WG
Summary from last MB “The MB agreed that a detailed deployment plan and a realistic time scale are required for deploying glexec with setuid mode at WLCG.
Alerting/Notifications (MadAlert)
Tony Cass, Edoardo Martelli
Take the summary from the table on
WLCG and support for IPv6-only CPU
HEPiX IPv6 Working Group F2F Meeting
MB Maarten Litmaath CERN v1.0
The LHCb Computing Data Challenge DC06
Presentation transcript:

IPv6 update Duncan Rand Imperial College London Shown in Taipei by David Kelsey, STFC-RAL (with a few mods) Shown at WLCG GDB, ISGC2018, Taipei, 21 Mar 2018 LHCOPN/LHCONE meeting Abingdon, March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 Work done by HEPiX IPv6 Working Group and WLCG IPv6 Task Force and many others such as site admins, CERN and VO central support teams Many slides taken from recent HEPiX IPv6 Working Group face to face meeting https://indico.cern.ch/event/676532/ The main motivation is to make the data at the site accessible by clients running on IPv6-only machines WLCG might get an offer of opportunistic CPU resources which are IPv6-only IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 D. Kelsey, GBD IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 WLCG hosts status SURFsara Fraction of endpoints listed in the CERN central BDII (lcg-bdii.cern.ch) where the DNS returns a dual-stack IPv6-IPv4 (A+AAAA) resolution (green line) or an IPv6-only resolution (blue line). (http://orsone.mi.infn.it/~prelz/ipv6_bdii/). See also corresponding results from the LHC Expts VO feeds (http://orsone.mi.infn.it/~prelz/ipv6_vofeed/) IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 CERN Storage update (Hervé Rousseau) IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 Herve Rousseau (CERN)

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 Non-LHCOPN/non-LHCONE traffic February 2018 https://tinyurl.com/ok773t2 IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 Tier-1 Status All Tier 1, except KR-KISTI-GSDC, are now peering with LHCOPN over IPv6 Dual-stack storage slowly being deployed e.g. RAL Echo storage made dual-stack last week Transferring over IPv6: IN2P3, INFN, JINR, NDGF, RAL, SARA, ASGC, pic Transferring over IPv4: BNL, KIT, RRC-KI, FNAL, NIKHEF, TRIUMF FTS servers IPv4: FNAL, BNL IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 https://hepix-ipv6.web.cern.ch/sites-connectivity

Tier-2s: GGUS tickets submitted to all Tier-2 sites Request to deploy dual-stack perfSONAR and storage by end of Run 2 (end of 2018) Submitted tickets requesting timescale for deployment of IPv6 and details of steps Following up with assistance, checking etc IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 https://twiki.cern.ch/twiki/bin/view/LCG/WlcgIpv6#WLCG_Tier_2_IPv6_deployment_stat GGUS ticket details: https://tinyurl.com/y9tfd5oo IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 7 Dec 16 Jan 26 Feb IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 FTS transfer monitoring Approximately 12% of data transferred in the last 30 days went over IPv6 Transfers over IPv6 appear to be more efficient – investigating why IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 https://monit-grafana.cern.ch/

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 Now – ISGC2018 11% of total is IPv6 IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 From NDGF-T1 to pic IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 Marian Babik (CERN) https://tinyurl.com/y8ftd9sh IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 WLCG LHCOPN, USATLAS USCMS are now also testing over IPv4 & IPv6 where possible LHC VO meshes still testing over IPv4 – will be addressed soon http://psmad.grid.iu.edu/maddash-webui/index.cgi?dashboard=OPN%20Mesh%20Config IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 USCMS, USATLAS (and Belle-II) now also testing over IPv6 where enabled IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 ETF IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 UK GridPP Dirac Network Test Results Jobs are sent to a WN at each site to read 1GB, 2GB and 3GB files from each site's SE using various protocols. The files have been previously replicated to all SEs. The table shows average bandwidth computed from the times taken for each combination (including the local SE). Transfers are made with lcg-cp, gfal-copy, curl and xrdcp over IPv4 and IPv6 (where relevant) http://pprc.qmul.ac.uk/~lloyd/gridpp/ukgrid.html http://pprc.qmul.ac.uk/~lloyd/gridpp/nettest_lcg.html Recording percentage of UK storage available over IPv6 (currently 43%) IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 Q: is IPv6 faster or slower than IPv4? IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018

IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018 Summary WLCG needs to be ready for any opportunistic IPv6-only CPU resources Tier-1s should be providing production storage accessible over IPv6 by April 2018 (8/14 are currently able) Tier-2s by the end of 2018 (~20% done) ATLAS now running production jobs on IPv6-only worker nodes CERN EOS instances are now all dual-stack Approximately 12% of FTS transfers go over IPv6 (which appear more efficient/reliable) 111/271 perfSONAR hosts now reporting IPv6-enabled OPN, USCMS, USATLAS, UK and Belle II perfSONAR meshes now dual-stack Some interest in examining performance of IPv6 compared to IPv4 IPv6 update LHCOPN/LHCONE meeting Abingdon March 2018