1. RedIRIS-NOVA real experiencies of tendering and deploying an optical network in Spain 1 TERENA TF-MSP “Non-technical aspects of dark fibre” Workshop Amsterdam - 9 and 10 November, 2010 Esther.Robles@rediris.es RedIRIS Network Manager RedIRIS/Red.es

2. RedIRIS10 Highlights...  20 PoPs: > 13.000 km distance  156 Gbps backbone  43 links: 10GE, STM-16/4/1  Leased Capacity to T-Systems and Telefonica  GEANT IP access:  10Gbps @ ES PoP  2.5Gbps @ FR PoP (bck)  GEANT Lambda Service:  3 x 10Gbps E2E links  2 Transit Providers (Madrid)  Telia and Global Crossing @ 10Gbps  IXPs presence:  ESPANIX @ 10Gbps (Madrid) – 59 peerings  CATNIX @ GE (Barcelona) – 19 peerings 2 Institutions Access Links 10 GE n x GE FE TF-MSP “Non-technical aspects of dark fibre” Workshop.

3. RedIRIS Users Classification 3 R&D Centers 35% Universities 20% Health institutions 13% R&D Management Institutions 17% other 15% TF-MSP “Non-technical aspects of dark fibre” Workshop.

4. RedIRIS Traffic Trends (PBytes) 2.5Gbps Backbone 10 Gbps Backbone 4 40,5 PB 9,5 PB around 1,45 /year TF-MSP “Non-technical aspects of dark fibre” Workshop.

5. Network Resources Consumers Examp. BSC-RES project: Supercomputing national initiative at 10Gbps DEISA project: EU supercomputing network at 10Gbps. LHC infrastructure support (nx10Gbps) PASITO: Spanish experimental testbed network RENEM (National Emergency Network): high availability and specialized support. e-VLBI network support... 5TF-MSP “Non-technical aspects of dark fibre” Workshop.

6. ... and telescopes in Canary Islands 10.4m telescope with a segmented primary mirror. Currently, the biggest telescope in the world. http://www.gtc.iac.es/ 6TF-MSP “Non-technical aspects of dark fibre” Workshop.

7. RedIRIS10 contracts will end in October 2011 The historical leased capacity model does not scale for the new e-Science challenges: no Flexibility limitations to develop advanced functionalities high Costs Globally, Educational and Research Networks are evolving to a model based on own dark fiber... or, more accurate, have evolved ! after RedIRIS10... 7 RedIRIS-NOVA Spanish government commitment to build a photonic network based on dark fiber TF-MSP “Non-technical aspects of dark fibre” Workshop.

8. RedIRIS-NOVA project 8  138 MM€ : EU structural + Science and Innovation Ministry + Regional Governments funds  National coverage requirements:  Penninsula and Islands ( Cannary and Balears)  Ceuta and Melilla ( Norh Africa Spanish Cities)  Competitive Dialog Tender Process helps to know the dark fiber market in Spain and to define the tender requirements:  RFI in Oct/Nov 2008  Dialog Process: December 2008 to July 2009  Evaluation: September & October 2009  Tender structured in 3 lots:  Guaranteed Fiber within the penninsula and housing facilities  Guaranteed Fiber with Canary Islands and housing facilities  Optical Equipment  25 companies applied to participate and 23 companies joined in Dialog:  10 fiber providers  13 equipment vendors TF-MSP “Non-technical aspects of dark fibre” Workshop.

9. PoPs Redundancy 9TF-MSP “Non-technical aspects of dark fibre” Workshop.  C1 PoP ( ): Its connection within the DF network requires a high reliability level. At least, two completely diversified routes with other two C1 PoPs  C2 PoP ( ): The realibility expectations are not so high ( not a core institution or economically not affordable) and the redundancy requirement is relaxed: ony one route required and one building access

10. Fiber Tender Results... 10 Required ( improvements as criteria selection) Achieved IRU Duration > 10 years21 years and 30 for Canary Islands fiber ( starting when last span is delivered – 2011) Fiber TypeG.652B/D, G.655 and G.656 (Subm.)G.652D and G.655 Fiber Agemax. 1994New Deployment ( terrestrial and submarine) Attenuation≤ 0,38 dB/Km (@1310nm) ≤ 0,25 dB/Km (@1550nm) ≤ 0,34 dB/Km (@1310nm) ≤ 0,20 dB/Km (@1550nm) PMD≤ 0.50 ps/√km≤ 0.20 ps/√km Coverage Peninsula: 48 add/drop PoPs mandatory and 128 add/drop PoPs desired but optional Canary Islands fiber: with and within Peninsula: 148 add/drop PoPs ( 42 + 106 ) [42 PoPs => 10.475 km ] Canary Islands fiber: 3 add/drop PoPs => 2.000 km of fiber Redundancy C1 PoPs 15 fiber rings ILA sitesSpace without fitting-outGuaranteed fitting-out included for all ILAs Telefónica as peninsula fiber supplier TF-MSP “Non-technical aspects of dark fibre” Workshop. Islalink fiber as Canary Islands supplier

11. 11 Iberia Optical Ring Dual FCCN optical fiber interconnection Splices already done Iberia Optical Ring Dual FCCN optical fiber interconnection Splices already done Additional PoPs will be added RedIRIS-NOVA fiber footprint I TF-MSP “Non-technical aspects of dark fibre” Workshop.

12. RedIRIS-NOVA fiber footprint II 12 1.504 km 232 km 143 km TF-MSP “Non-technical aspects of dark fibre” Workshop.

13. Guaranteed means... Fiber Quality will be guaranteed until IRU ends: Keep installation fiber parameters No-complianced fiber spans will be swapped 24/7 hot line Supplier is responsible for end to end fiber quality ( even optical panel connector) Optical Fiber Supervision System based on OTDR measurements, via:  A spare single fiber in same cable RedIRIS-NOVA fibers (selected) OR  RedIRIS-NOVA fibers @ 1650nm Housing facilities with guaranteed service: power supply, air conditioning, 24h independent access... Classical operational model adapted to a fiber infrastructure Integrated with new RedIRIS procedures Failures Response Times Specification via SLAs: Leased capacity approach adapted to a fiber infrastructure scenario SLAs model discussed with bidders PMD <= 0.50 ps/√km (0.20) 13 QUALITY OPERATION MAINTENANCE TF-MSP “Non-technical aspects of dark fibre” Workshop.

14. Failures and SLAs definition... Failures classification Complex Failures ( CF): Fiber outages or degradations that require special (≈ long) works to be fixed Normal Failures ( NF): no special works 14 Service Level Agreements (to Fiber Links) Fiber Link Availability (monthly): 99.2% just for NF times PoP Availability (monthly): 99.98%, both CF + NF Mean Times between Failures : 180 days (365 subm. )for CF and 30 days for NF Maximum Unavailability Time for CF per 12 months periods: 30 hours for each 1.000km of fiber. Time to Repair: 12 hours (20 days subm.) for CF and 8 hours (10 days subm.) for NF Frequency of Failures (measured over 12 months periods): 3 for CF and 6 for NF. Fiber spans would be swapped if threshold is reached. ILA PoP Fiber Link (includes even the connector at RedIRIS optical panel) Fiber span TF-MSP “Non-technical aspects of dark fibre” Workshop.

15. SLAs penalties... Deployment phase Delays in deployment 15 Operational phase ILA housing conditions failures No collaboration with 3rd party entities Fiber link unavailability PoP unavailability ( simultaneous outage or degradation for all PoP fibers) To exceed Meant Time Between Failures parameter for each fiber link To exceed the Maximum Number of CF per 12 months periods To exceed the Maximun Time to Repair Improper fiber operations TF-MSP “Non-technical aspects of dark fibre” Workshop. How are penalties charged with an up-front payment model ? Provider set up a “1% contract budget” bank guarantee to support those penallties. The 1% bank guarantee should be kept until IRU contract ends. Provider must put back money when any penalty reduce it.

16. RedIRIS-NOVA PoPs I Requirements Supply the required conditions to operate the RedIRIS-NOVA equipment (optical, data and management). Requirements depends on PoP-degree Power Supply ( with backup power generators) Electrical ground network Space: (... and upto 600kg/rack) Temperature and humidity... 16TF-MSP “Non-technical aspects of dark fibre” Workshop.

17. RedIRIS-NOVA PoPs II More Requirements... Interconnection points for RedIRIS members Physically accesible to RedIRIS staff on a 7x24 basis Secure access Neutral to the termination of 3rd party fibre Technical support and remote hands 17TF-MSP “Non-technical aspects of dark fibre” Workshop. Partnership with PoP sites Add/Drop PoPs (ROADM) site hosts are RedIRIS members Not a commercial relationship, Win-Win model supported on service. “Housing Agreement” Users can interconnect to RedIRIS-NOVA directly or through a Regional Network.

18. The Regional Networks (RNs) 18 E3 TF-MSP “Non-technical aspects of dark fibre” Workshop.

19. To Optical Regional Networks... Extend RedIRIS-NOVA fiber footprint to reach RN points. Great opportunity to improve the RN infrastructure Contribute to the concurrent evolution of national, regional and intercampus networks  User Service Enhacement RedIRIS Support: As a means for regional networks to acquire and light dark fiber. Costs: 12.500 km of fiber with national coverage Favorable results by aggregating demand Agreements with Regional Governments Current tender allows to reach 108 additional PoPs (phase I) New tenders would be launched as needed (phase II) 19 TF-MSP “Non-technical aspects of dark fibre” Workshop.

20. Optical Equipment Tender... List of mandatory and optional equipment functionalities. Hypothetical fiber footprint as working scenario for all bidders Management and Planification systems required. 20 Virtual/logical Components Catalogue: Optical Functionality ≈ Virtual/Logical Component Vendors Equipment groupped and mapped their hardware list elements to each Virtual Component. Optical network design for the working scenario based only on Virtual Components Economical proposals include the cost for each Virtual Component: Only Virtual Components can be bought to light the real fiber footprint TF-MSP “Non-technical aspects of dark fibre” Workshop.

21.  Equipment and service guarantee provider : Telefonica  Service Guarantee to end 2012.  Alcatel-Lucent Equipment:1626 Light Manager Red 5.0A (6.0 update included)  WSS (Wavelength Selective Switch) technology. No O/E/O conversion.  50 Ghz grid spacing: 93 x 10 G / 80 x 40G  10G, 40G supported. 100G prepared to be supported when available  8-degree ( 7x1)  Directionless and colorless support.  EDFA and RAMAN amplification  Variable Optical Attenuators (VOA) in transponders and amplifiers.  Automatic Power Equalization  Automatic Pre-emphasis Adjustment  User ports ( required by RedIRIS): 10GE, GE and OTN.  OSNCP protection 1+1 included.  OSC running at 1510nm (4 Mbps)  GMPLS support  Network Management System: 1350 OMS Rel. 5.0A  Optical Network Design Platform - ONDP Rel. 5.0A 21 Optical Equipment Tender Results TF-MSP “Non-technical aspects of dark fibre” Workshop.

22. Optical Equipment Guarantee... 22 24/7 hot line to fix problems and technical support Hardware Replace Time: 4 hours Incident Time Resolution: 4 hours ( critical and high), NBD ( medium), 2 BD ( low) Direct access to the vendor support center 5-people operation team ( 24 hours @ RedIRIS offices) Software Releases Upgrade upto 2 new software releases per year  optical equipment, NMS and planification systeml Done by supplier ( remotely or in-situ, as needed) Preventive Tasks Set of tasks to check the health of patch panels, fiber cords and optical equipments for all sites. At least, one per year. TF-MSP “Non-technical aspects of dark fibre” Workshop.

23. Optical Equipment Guarantee... 23 Corrective & Scheduled Maintenance Works Reports Technical Documentation Complete access to the technical documentation ( even the private one): hardware, functionalities, bugs, interoperability... Regular (quarterly) Technical Workshops to present 12 months roadmap:: hardware and functionalties. TF-MSP “Non-technical aspects of dark fibre” Workshop.

24. RedIRIS-NOVA services 24 Ethernet Layer Wavelengths between RedIRIS PoPs: Unprotected Protected and/or With Restoration  RedIRIS community Private Circuits  RedIRIS community IP services Global IPv4 and IPv6 reachability Multicast DNS IPv4 and IPv6 address space management NTP  Optical Regional Networks Wavelengths between Shared PoPs and/or RN PoPs: Performance Monitoring Tools By Type: Unprotected Protected and/or with Restoration By Use: IP Regional Network Support Projects Support TF-MSP “Non-technical aspects of dark fibre” Workshop.

25. 25 Edificio Bronce, Plaza Manuel Gómez Moreno s/n 28020 Madrid. España Tel.: 91 212 76 20 / 25, Fax: 91 212 76 35