Janet Update Martin Dunmore Multi-Service Networks 2012 Cosener’s House, Abingdon, 12 th July 2012

Topics Intro to Janet Janet6 Support for Network Research

Introduction to Janet

AreaSites Higher Education211 Further Education520 Local Authority123 Self-funded53 Research Council Use of Janet LA / Schools HE/FE Adult Relative sizes of sectors: from funding body statistics on staff & student numbers 18 million possible users of JANET. ConnectionsUsers

Network Figures Routing equipment: ~100 routers in the core of JANET ~300 regional area routers ~520 end organisation routers Circuits/fibres: ~1,500 circuits make up JANET non-trivial task to monitor ~80% of total outage time

The SuperJanet5 Network Six core points of presence. A core across the UK of 20Gbit/s, 80Gbit/s and 100Gbit/s. 19 regional distribution areas. Multiple connections for resilience. ~900 organisations connected. Point to point “light path” connections for research. ~400Gbit/s external connectivity.

Global Transit #2 Global Transit #1 Glasgow Leeds London Bristol Warrington Reading Telecity HX Telehouse 10G 40G 100G The Network Telecity Manchester Global Transit #3

Major Peerings

Regularly Hitting > 100Gb/s of Traffic From JanetTo Janet Mean18.5 Gb/s58.6 Gb/s Max29.7 Gb/s115 Gb/s Min5.72 Gb/s9.57 Gb/s Typical week in May…

Total Janet Traffic Prediction

Janet6

Similar topology to SJ5. Two north-south paths New east-west path from Birmingham to Nottingham – Erdington to Lowdham No backbone PoP at Reading – Still have a regional PoP New PoP in Acton, West London Janet6: Backbone Resilience

Contractual – Favourable: Mandated 40Gbit/s in 2006 contract – Favourable: Worked with Verizon for deployment of 100GE – Less Favourable: Maximum bandwidth available for use on each link Increasing those needed technical and legal negotiations Engineering – Legacy of layered optical systems Provide 40G SDH and 100GE over system not designed for it Large “guard bands” of wasted bandwidth Limits of SuperJANET5

Manage the optical layer directly For more detail see Networkshop presentation – ROADM Flexible optical platform – DWDM – Theoretically 80 channels – 100Gbit/s per lambda from day 1 – Plans for 400Gbit/s and 1Tbit/s with better spectral density “Data DelugeBonanza” – Big Science LHC, SKA, Bioinformatics, ITER, Radio Astronomy, Climate Data – Day-to-day usage Removing SJ5’s limits

Original 2006 T-640 chassis still in service – 40Gbit/s per slot, 32 10Gbit/s ports per chassis Most upgraded to T-1600 – Same chassis, new switching fabric and PSUs – 100Gbit/s per slot T-4000 – Same chassis, new switching fabric and PSUs – 240Gbit/s per slot, Gbit/s ports per chassis – Two power supplied for resilience Each one takes 6, 60A, 48VDC feeds – 17kVA! Migration – Janet6 will be in new PoPs – Can’t move all the connections overnight – New routers and hand back the old Janet6 IP Platform

Investigated provisioning over optical platform – Not enough competitive offers for smaller chassis Investigated merging Lightpath and IP platforms – IP platforms are already short on chassis space, some locations would require additional chassis Keep on current MX960 platforms – Upgrade interconnects to 100GE – Move 10GE lightpaths from lambdas to EoMPLS circuits Scope for point to point circuits without committed bandwidth – Shared with Janet IP access Janet6 Lightpath Network

Janet6 Procurement Strategy Options appraisal Procure dark fibre infrastructure Procure optical transmission equipment Management in-house by the Janet NOC Why?Agility Janet NOC will have a view from the fibre up the stack to the routers Fewer contract/administrative boundaries or chains to cross Directly translate the community’s requirements into engineering Why?Different contractual vehicles for fibre and equipment Fibre: long-term, little need to change Optical equipment: rapidly evolving, highly competitive competitive dialogue procedure

Janet6 Procurement Timeline

Progress to date Procurement kicked off October 2011 Dialogue with 6 bidders during first half of 2012 Bids received from 2 suppliers Procurement Update – Fibre

Current Status SSET selected as preferred supplier Design optimisation Finalising contract & schedules Signature by end July 2012 Procurement Update – Fibre

Progress to date Procurement kicked off November 2011 Dialogue with 6 bidders during first half of 2012 Procurement Update – Equipment

Current Status Bids received from all 6 suppliers Evaluation underway Selection by end July 2012 Signature by mid September 2012 Procurement Update – Equipment

Fibre delivery by end March 2013 Equipment delivery by end April 2013 Commissioning Migration by end July 2013 Rollout & Transition

Support for Network Research

Stuff we can help with Router configs Network diagrams Access to Netsight (SNMP data) – Be careful what you wish for! Netflow data – SBR exporters (1:10 to 1:50) – Some BAR exporters – Regional routers as and when we can TVN, Eastern – Subject to agreement data is non-anonymised – We don’t have much disk space to store it – 100GB!

UK Testbed for Loc / ID Research Loc / ID – Decoupling Location and Identity from the IP address – LISP, HIP, ILNP, SHIM6, others Stimulate synergy between UK researchers in this area Janet wants to get a handle on the operational pros/cons Call for proposals should go out later this year – Has been ready for a while but we need to resource internally Modest funding: max 30k 12 months but testbed would stay up after that

SDN / OpenFlow Testbed? Start off small scale – 3x OF switches in Core PoPs – 10G inter-switch – 1G switch to user ‘Usual Suspects’ – 1 or 2 controllers Scale up organically Who manages the – HW ? – Service ?

THANK YOU