The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013.

Slides:



Advertisements
Similar presentations
The HEPiX IPv6 Working Group David Kelsey GridPP29, Oxford 27 Sep 2012.
Advertisements

The Middleware Readiness Working Group LHCb Computing Workshop LHCb Computing Workshop Maria Dimou IT/SDC 2014/05/22.
IPv6 testing plans 25 Jan Short term – next 6 weeks Add sites to testbed – Glasgow (DPM storage end point) – Fix DESY – Others? Is GridFTP mesh.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) HEPiX, Oxford 24 Mar 2015.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL, UK) 4 May 2011 HEPiX, GSI, Darmstadt david.kelsey at stfc.ac.uk.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) 1 July 2011 UK HEP Sysman meeting.
The HEPiX IPv6 Working Group David Kelsey HEPiX, IHEP Beijing 17 Oct 2012.
SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.
FP6−2004−Infrastructures−6-SSA IPv6 and Grid Middleware: the EUChinaGRID experience Gabriella Paolini – GARR Valentino.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) WLCG GDB, CERN 8 July 2015.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP35, Liverpool 11 Sep 2015.
The production deployment of IPv6 on WLCG David Kelsey (STFC-RAL) CHEP2015, OIST, Okinawa 16 Apr 2015.
The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) HEPiX, Ann Arbor MI 30 Oct 2013.
The HEPiX IPv6 Working Group David Kelsey EGI TF, Prague 18 Sep 2012.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Report Mario Reale NGI IT / GARR HEPiX f2f meeting.
Your university or experiment logo here GridPP Storage Future Jens Jensen GridPP workshop RHUL, April 2010.
MW Readiness Verification Status Andrea Manzi IT/SDC 21/01/ /01/15 2.
The HEPiX IPv6 Working Group David Kelsey WLCG GDB, CERN 14 Nov 2012.
“From IPv4 to eternity”: the HEPiX IPv6 working group CHEP2012, New York 21 May 2012.
MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons 10/12/2014.
HEPiX IPv6 Group David Kelsey (STFC-RAL, UK) 8 Dec 2010 GDB, CERN david.kelsey at stfc.ac.uk.
HEPiX IPv6 Working Group David Kelsey GDB, CERN 11 Jan 2012.
Data Transfer Service Challenge Infrastructure Ian Bird GDB 12 th January 2005.
Andrea Manzi CERN On behalf of the DPM team HEPiX Fall 2014 Workshop DPM performance tuning hints for HTTP/WebDAV and Xrootd 1 16/10/2014.
The HEPiX IPv6 working group David Kelsey (STFC-RAL) HEPiX meeting, Bologna 17 Apr 2013.
16-Nov-01D.P.Kelsey, HTASC report1 HTASC - Report to HEP-CCC David Kelsey, RAL rl.ac.uk 16 November 2001, CERN ( )
A. Mohapatra, T. Sarangi, HEPiX-Lincoln, NE1 University of Wisconsin-Madison CMS Tier-2 Site Report D. Bradley, S. Dasu, A. Mohapatra, T. Sarangi, C. Vuosalo.
CernVM-FS Infrastructure for EGI VOs Catalin Condurache - STFC RAL Tier1 EGI Webinar, 5 September 2013.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
WLCG Operations Coordination Andrea Sciabà IT/SDC 10 th July 2013.
WLCG and IPv6 David Kelsey (STFC-RAL) LHCOPN/LHCONE, Rome 28 Apr 2014.
QI Fazhi / IHEP CC HEPiX IPv6 F2F Meeting IPv6 Network Status in IHEP/China QI Fazhi Computing Center, IHEP July 4, 2013.
Testing Infrastructure Wahid Bhimji Sam Skipsey Intro: what to test Existing testing frameworks A proposal.
CMS: T1 Disk/Tape separation Nicolò Magini, CERN IT/SDC Oliver Gutsche, FNAL November 11 th 2013.
The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.
MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons Maarten Litmaath On behalf of the WG participants GDB 09/09/2015.
The HEPiX IPv6 Working Group David Kelsey HEPiX, Prague 26 April 2012.
Andrea Manzi CERN EGI Conference on Challenges and Solutions for Big Data Processing on cloud 24/09/2014 Storage Management Overview 1 24/09/2014.
WLCG: Are we ready for IPv6? David Kelsey (STFC-RAL) ISGC 2014, Taipei 26 Mar 2014.
“From IPv4 to eternity” - the High Energy Physics transition to IPv6 David Kelsey TNC2012, Reykjavik 23 May 2012.
HEPiX IPv6 Working Group David Kelsey david DOT kelsey AT stfc DOT ac DOT uk (STFC-RAL) HEPiX, Vancouver 26 Oct 2011.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) HEPIX, BNL 13 Oct 2015.
Outcome should be a documented strategy Not everything needs to go back to square one! – Some things work! – Some work has already been (is being) done.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
WLCG Operations Coordination report Maria Dimou Andrea Sciabà IT/SDC On behalf of the WLCG Operations Coordination team GDB 12 th November 2014.
DOE /ESnet-related IPv6 Activities Phil DeMar HEPix IPv6 Workshop (CERN) Sept. 6,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
Accounting Update John Gordon. Outline Multicore CPU Accounting Developments Cloud Accounting Storage Accounting Miscellaneous.
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP33 Ambleside 22 Aug 2014.
HEPiX spring 2013 report HEPiX Spring 2013 CNAF Bologna / Italy Helge Meinhard, CERN-IT Contributions by Arne Wiebalck / CERN-IT Grid Deployment Board.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI IPv6 Report for HEPiX CERN October 5, 2012 CERN 1
Operations Coordination Team Maria Girone, CERN IT-ES GDB, 11 July 2012.
“From IPv4 to eternity” - the High Energy Physics transition to IPv6 David Kelsey TNC2012, Reykjavik 23 May 2012.
“From IPv4 to eternity” The High Energy Physics transition to IPv6 David Kelsey EGI Community Forum, Munich 30 March 2012.
WLCG IPv6 deployment strategy
LCG Service Challenge: Planning and Milestones
gLite->EMI2/UMD2 transition
Andrea Manzi, Oliver Keeble
Plans to support IPv6-only CPU on WLCG
Deployment of IPv6-only CPU on WLCG – an update from the HEPiX IPv6 WG
Update from the HEPiX IPv6 WG
Deployment of IPv6-only CPU on WLCG – an update from the HEPiX IPv6 WG
Deployment of IPv6-only CPU on WLCG - update from the HEPiX IPv6 WG
WLCG and support for IPv6-only CPU
IPv6 transition Vincenzo Spinoso EGI Operations.
Andrea Manzi, Oliver Keeble
IPv6 update Duncan Rand Imperial College London
Presentation transcript:

The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013

Outline The HEPiX working group HEPiX IPv6 testbed Software and tools survey Some technical matters Future plans Summary 19/12/2013HEPiX IPv6 WG2

IPv6 is taking off 19/12/2013HEPiX IPv6 WG3 2.3% of clients contact Google on IPv6

The HEPiX IPv6 working group HEPiX shares information (and coordinates) between global HEP computing centres Mandate of IPv6 wg (created in 2011) – Consider whether/how IPv6 should be deployed in HEP, especially WLCG – Perform readiness/gap analysis All applications, middleware, management and monitoring tools Run a distributed testbed 19/12/2013HEPiX IPv6 WG4

The HEPiX IPv6 Testbed A dedicated distributed testbed Connected to IPv6 and IPv4 networks – IPv6-only/IPv4-only names also registered in DNS – e.g. hepix-v6.desy.de & hepix-v4.desy.de Caltech, CERN, Chicago, DESY, FNAL, FZU, Glasgow, IHEP, Imperial, INFN, KIT, NDGF, PIC 19/12/20135HEPiX IPv6 WG

GridFTP IPv6 data transfer mesh 19/12/2013HEPiX IPv6 WG6 > 2 PB data transferred in 6 months Success rate > 87% Very High! Operating at risk Time to transfer max 500 s

CMS PhEDEx/FTS3/DPM etc Dual-stack FTS3 server deployed at Imperial IPv6-only DPM SE’s at Imperial and Glasgow CMS transfer data using PhEDEx (IPv6) > 120 TB data transferred in 2 months Conclusion – “PhEDEx can operate to CMS production standards with IPv6-enabled services” Now testing SToRM and dCache endpoints 19/12/2013HEPiX IPv6 WG7

Dual-Stack services at Imperial Tier 2 Imperial College, London Configured a subset of their service to be IPv4/IPv6 dual stack – DNS, SSH, NFS, EMI 2 and EMI 3 CREAM CEs, EMI 2 Worker Nodes, ARC CE and dCache (headnode, SRM component only), all BDII services – Stateless address autoconfiguration (SLAAC) No problems observed – Did not need to turn IPv6 off 19/12/2013HEPiX IPv6 WG8

19/12/2013HEPiX IPv6 WG9 Software and Tools survey …

(as of 10 Dec 2013) see URL for full details 19/12/2013HEPiX IPv6 WG10

Some technical matters Storage: DPM, StoRM, dCache all work on IPv6 (in some configurations) NDGF just joined testbed – having initial problems with dCache (DCAU not supported) – using special ndgf version of v2.7.2 Globus now released – With patch for ftp client IPv6 enviroment variables At CERN will use VMs for dual-stack testing rather than LXPLUS nodes – File transfers fail from time to time (whole host of reasons!) Still waiting for xrootd 4.0 (with IPv6 support) HTCondor and ARC-CE being tested 19/12/2013HEPiX IPv6 WG11

19/12/2013HEPiX IPv6 WG12 Future plans and next steps …

Testing 2014 Systematic tests of the experiment Use Cases Try more (a small number!) Tier 2 sites with dual stack services Glasgow, KIT, CERN are deploying larger scale test-clusters – Use these for more complete testing Turn on dual-stack services as soon as possible 19/12/2013HEPiX IPv6 WG13

Timetable WLCG IPv6 transition Will need to negotiate and agree with many stakeholders – EGI and NGIs very much included here of course The WG will continue to test experiment Use Cases Aim for dual-stack on most/many services – when? Aim for an IPv6 workshop at CERN in Spring/Summer 2014 – To kickstart/encourage wider deployment 19/12/201314HEPiX IPv6 WG

Further info HEPiX IPv6 web HEPiX IPv6 wiki Working group meetings WLCG Operations IPv6 Task Force EGI SA2 IPv6 testing 19/12/201315HEPiX IPv6 WG

Summary Good progress has been made by the HEPiX IPv6 working group with proving that dual stack IPv4/IPv6 services work in WLCG – But work is slow and there is lots more to do! We are very much effort-limited – Tier 1 and Tier 2 sites – Experiments We do need to encourage sites to deploy IPv6 – The 2014 workshop should help here VOLUNTEERS to join the group are always welcome – please contact me! 19/12/201316HEPiX IPv6 WG

19/12/2013HEPiX IPv6 WG17 Questions?