Advances in Optical Networking Jeff Verrant Senior Engineer Research and Education Initiatives Ciena Government Solutions, Inc.

Agenda Lightwave Technologies Core Transport OTN, G.709, the “ Digital Wrapper “ Deployable Control Plane Technologies Optical Switching GFP w/ VCAT-LCAS

Network Solutions for Research & Education Remote Off-Fiber Campus Solutions University National Lab HPC Lab Research University Regional Optical Network Research University National Backbone Connectivity Optical Add/Drop GbE/10GbE Storage SONET National Lab Fully Automated Turnup and Management of Optical Connections 2.5G 10G 40G Metro/Regional DWDM Intelligent Optical Switching Long Haul DWDM

CoreStream: Flexible Transport Platform for the Future One Platform for all applications eFEC, Raman, multi-stage EDFAs, pre-emphasis, and spectrum flattening allow CoreStream to handle span designs from 1600 - 3200km CoreStream is approved for NDSF, NZDSF, and DSF Transceivers for 2.5G, 10G, 40G available today 50GHz (for ~3000km) & 25GHz (up to ~2000km) channel spacings Cost is reduced by installing special technologies only where needed 25GHz systems can be used to provide high capacities as 40G technologies become more cost effective 28 Channels 40 Gbps 100 GHz spacing 8 Channels 10 Gbps 25 GHz spacing Data rates/channel spacing mixed at the sub-band level Mixed rate deployment likely Optimize Capacity x Distance for each sub-band separately >3000 km, 80x10Gb/s NRZ @ 50 GHz 2000 km, 160x10Gb/s NRZ @ 25 GHz The CoreStream Platform is a very flexible transport platform that can accommodate a range of data rates, channel spacings, modulation formats, and distance x capacity demands. The modular architecture allows advanced technologies to be incorporated as they are developed and only where they are needed to keep costs low. OADM Nodes Up to 1600 km, 40x40Gb/s CS-RZ @ 100 GHz or 160x10Gb/s NRZ @ 25 GHz Channel Counts are C-Band only. Numbers assume NDSF and 8 dB FEC

Demonstrated System Capability with Raman Fiber Type Best mixed 40/10G Capacity Distance Total Capacity NDSF 40ch x 40G 1600km 1.60Tb/s DSF 19ch x 40G + 24ch x 10G 1000km 1.00Tb/s TW 32ch x 40G + 16ch x 10G 1.44Tb/s TW-RS E-LEAF The ability to mix and match data rates allows the CoreStream system to achieve more than 1.4 Tbps on any type of fiber except DSF. Capacity is for C-band propagation only Pure 10G capacity is 1.92 Tbps Distances are ~ 1200 km without Raman

(standard CBR mapping) 40G Configurations OC-768 POS (standard CBR mapping) OC-768/STM-256 POS Standard OTU3 WDM Infrastructure 4 x 10G Muxponder 4 x 10G Muxponder OTU3 Regenerator Support standard OTU3 / OC-768 Support standard 40G multiplexing OC-192/STM-64 (9.95328G) 10GbELAN (10.3125G, GFP-F mapping) OTU2 (10.7G) Support standard OTU3 regenerator Overrate clients?? 10GFC (10.51875G) OTU2-LAN (11.05G) OTU2-LAN (11.09G) OTU2-FC (11.27G) Proprietary Muxing ? Use 10G waves only ?

Development Issues What is the 40G line rate? 40G POS client only requires standard OTU3 (43.018G line rate) 10G multiplexing creates possibly many different 40G line rates depending on solution (as high as 45.270G) Non-standard, overrate, muxing will result in proprietary solutions, interop problems, and ASIC availability issues Due to limited optical reach an OTU3 to OTU3 regenerator will probably be required Ideally about 1600km reach w/o Raman. New transceivers utilizing 50 / 100GHz DPSK modulation Overrate solutions increase line rate and reduce reach

Beyond 40G ?? 100G standards effort just beginning. IEEE Call of Interest this month. Expect target 2010 100G standard, at a minimum. Proprietary Solution. Bonded Nx10G, Nx40G. 80G / 100G client. Economics. Currently “ PAIN “ customers club. COG’s and market price are premium.

Agenda Lightwave Technologies Core Transport OTN, G.709, the “ Digital Wrapper “ Deployable Control Plane Technologies Optical Switching GFP w/ VCAT-LCAS

How is OTN Deployed? OTN is the common optical backbone network of the future. OTN can provide transparent SONET/SDH services to end users who require section overhead bytes like DCC. OTN maps all services into a common set of wavelengths – simplifying everything from monitoring and deployment to sparing and capacity management. GbE OCn/STMn FC SDI ISC OTU-N

OTN and the OSI Stack Service OPVC OPTU OPU ODU OTU Physical GFP The diagram on this page shows the OSI stack modified to show the OTN layers The Service layer represents the end user service, it can be GbE, SONET, SDH, FC, or any other protocol. For asynchronous services such as ESCON, GbE or FC the service is passed through a GFP mapper The OPVC or Optical channel Payload Virtual Container handles mapping the service into a uniform format. The OPVC is the only layer that needs to change to support a new service type. The OPTU or Optical channel Payload Tributary Unit maps the output of the OPVC into a timeslot and performs timing adaptations to unify the clocking. The OPU or Optical channel Payload Unit contains all of the timeslots in the OTN frame. The ODU or Optical channel Data Unit provides the path-level transport functions of the OPU. The OTU or Optical Transport Unit provides the section-level overhead for the ODU and provides the GCC0 bytes. The Physical layer maps the OTU into a wavelength or WDM muxing system. Service GFP OPVC OPTU OPU ODU OTU Physical

OTN revealed OTN Framing is very similar to SONET and SDH framing. It can be represented by a table 4080 bytes long and 4 bytes high. http://www.innocor.com/pdf_files/g709_tutorial.pdf FA OH OTUk OH ODUk OH OPUk OH OPUk Payload (4x3808 bytes) OTUk FEC (4x256 bytes) 3808 bytes 4 bytes 256 bytes 2 bytes 14 bytes 3 bytes 1 byte 7 bytes

10GE for High Bandwidth Applications Expected to become Intra-office interface of choice Server connections Router interface Transparency of Ethernet MAC can be important Solution for Transparent WAN connectivity not standardized Data rate not compatible with standard framing for OC-192 or ODU-2 Supported using Agile Wavelengths today using OTU-2+ variation of G.709 (11+ Gbps) 10GE LAN PHY Transparency Issue 10GE LAN PHY 10.3125 Gbps 9.995 Gbps OTN OPU-2 ODU-2 O/H OTU-2 10.709 Gbps 10.000 Gbps with 64B/66B Encoding 10.037 Gbps Transparent transport of 10 GbE LAN PHY will require some changes to the standards. Currently there is not enough “room” in the OUT-2 definition to contain a full bandwidth 10 GbE LAN PHY signal without some compression or processing. As most physical devices can support the relatively small increment in data rate, the main obstacle to implementation of this potentially very low cost format is really just agreement on a new standard – the OUT-2+.

Agenda Lightwave Technologies Core Transport OTN, G.709, the “ Digital Wrapper “ Deployable Control Plane Technologies Optical Switching GFP w/ VCAT-LCAS

Ciena’s Intelligent Control Plane: History Complete and deployed distributed routing and signaling mechanism for core mesh networks Topology discovery with available bandwidth updates Constraint based route calculation In-band signaling for end-to-end sub-network connection (SNC) setup and mesh restoration Standards based G.ASON compliant (G.7713.1, G.7715.1…) Mature, Scalable, and Reliable 20+ customers with control plane networks (largest has 100+ of nodes) 5 years of history; research, product, deployments Only distributed mesh control plane currently widely deployed in live operation Configuration Provisioning Restoration

Peer-to-Peer Signaling/Routing Single Domain I-NNI G F H B I-NNI Domain A E I Peer-to-Peer Signaling/Routing Within a single domain, all nodes share topology information All nodes belong to a common trusted environment and share a common I-NNI (Interior Network-Network Interface) A source node can initiate a connection with a single request message

Multi-Domain Control Plane I-NNI Domain I-NNI Domain G G F F H H B O-UNI A O-UNI E E I I E-NNI Networks support Multiple Domains Carrier networks are multi-domain & multi-technology A single control plane does not scale or fit all needs Individual domains interoperate through the E-NNI or Exterior Network-Network Interface This preserves domain characteristics and scalability

Ciena Standards Support CoreDirector I-NNI optical control plane protocol (OSRP) is based on ITU ASON Recommendation G.7713.1, with extensions for value-add functionality Over 5 years of experience in live networks Proven to significantly reduce operational costs and service activation time Proven >99.999% service reliability in up to 120 node network Available : OIF O-UNI 1.0, based on ITU ASON Recommendation G.7713.2 OIF E-NNI (also based on ITU G.7713.2), O-UNI 2.0 and IETF GMPLS (I-NNI)

OIF Implementation Agreements Based on Requirements set by the Carrier WG OIF UNI 1.0 (now in Release 2) Implementation subset of GMPLS RSVP, CR-LDP and LMP Optimized for SONET/SDH client interface Tested at Supercomm 2001, OFC 2003, Supercomm 2004 OIF E-NNI 1.0 Implementation subset of GMPLS RSVP and OSPF Optimized for SONET/SDH inter-domain interface Tested at OFC 2003, Supercomm 2004 OIF UNI 2.0 Now in progress – adds features such as Ethernet

Ciena OIF Participation Co-Founder and strong supporter Co-founded with Cisco Currently President Participated in Supercomm and OFC demonstrations Participated in UNI 1.0 and 2.0 development Editor of UNI 1.0R2, E-NNI Signaling and Routing specifications Keeping NNI aligned with ITU-T directions Implementation of UNI 1.0R2, E-NNI 1.0

Ciena’s ITU-T Participation Strong supporter of ASON work Helped edit G.7713.1 and G.7713.2 Signaling Recommendations Editor of G.7714.1 (Discovery Mechanisms) Participated in editing of G.7715 (Routing Arch.) Supplied main text to G.7715.1 (Routing Requirements) Supporting ITU-T work on Management of ASON Provided input to new G.7718 – ASON Management Framework Editor of G.7718.1 (to be completed) – ASON Management Object Model Implementation of G.7713.1/2, G.7714, G.7715.1

Ciena’s GMPLS Participation Co-author of: GMPLS framework GMPLS signaling functional spec GMPLS signaling for SONET/SDH GMPLS signaling extensions (RSVP, CR-LDP) GMPLS routing extensions (OSPF, IS-IS) GMPLS LMP specification GMPLS ASON requirements drafts Continued participation… Currently in Joint Design Team of experts to evaluate ASON-based routing extensions Implementation of GMPLS RSVP/OSPF-TE

ASON/OIF Testing 2001, 2003, 2004, 2005 OIF Interops Tested ASON/OIF UNI, E-NNI Signaling and E-NNI Routing Testing venues include 7 carrier laboratories Vendors include 15 major switch and router vendors Tested Interoperable OSPF-based E-NNI routing Interoperable RSVP-based E-NNI signaling Support of Ethernet over SONET/SDH using GFP Support of VCAT/LCAS connections

ISOCORE Integrated IP/MPLS and Optical Control Plane Demonstration Applications e.g., VPN, VPLS, Triple Play IP/MPLS Domain Optical Domain CIENA CoreDirector® provided intelligent optical switching in the ISOCORE self-managed optical core at Supercomm 2004 GMPLS control plane protocols used for dynamic routing and automated circuit set up Router clients forward IP/MPLS application traffic over the optical paths Successful interoperation of GMPLS RSVP-TE and OSPF-TE in a multi-layer IP environment, including Cisco and Juniper routers

Agenda Lightwave Technologies Core Transport OTN, G.709, the “ Digital Wrapper “ Deployable Control Plane Technologies Optical Switching GFP w/ VCAT-LCAS

Optical Exchange Model – CoreDirector CI / DWR CoreDirector CI and CN 4200 based solution Multi-layer switch facility Dynamic Wave Router – 3rd Gen Wavelength Tunable ROADM / Optical Switch OTN interfaces for OTU1/2 OC3,12,48,192, GbE, 10GbE O-UNI / NNI, GMPLS signaling Research Partnerships control plane initiatives SONET, Layer 2 witching O-UNI, GMPLS Network Node SONET, GbE, 10GbE WAN Interfaces DWR-8 F A N DWR-8 λ Tunable DWDM Ports DWDM, OTN WAN interfaces F A N POWER POWER

1x9 Multi-port Wavelength Selective Switch (MWSS) Technology Functional Operation Full reconfigurability of Add, Drop and Express ports Drop any channel from incident optical spectrum Single channel drop per port or Drop any N wavelengths at a port Power level control on each port 50GHz compatible Expandable to higher degree node l1 MEMS mirror (1 per l) Input: l2 l3 … l96 … Diffraction grating … … … … … Express Output Ports: 1 2 3 8 Another possible application… Basic ROADM configuration Multiple Express configuration for multi-degree node/ring interconnect In Express 1x9 MWSS In 1x9 MWSS 1 Express port 4 x Express 8 x Drop 4 x Drop

Agenda Lightwave Technologies Core Transport OTN, G.709, the “ Digital Wrapper “ Deployable Control Plane Technologies Optical Switching GFP w/ VCAT-LCAS

Generic Framing Procedure (GFP) Executive Summary GFP is an approved ITU Recommendation (G.7041.2001) for adapting a wide variety of data signals to transport networks Data Types PDU-oriented (e.g., Ethernet, IP/PPP) Block-code-oriented (e.g., ESCON, FICON, Fibre Channel) Transport Networks SONET (including Virtual Concatenation) Optical Transport Network (OTN) Other octet-synchronous paths Other client signals Ethernet IP/PPP MAPOS RPR Channel Fibre FICON ESCON GFP Frame mapped Transparent mapped SONET/SDH path Other OTN ODUk path

GFP within the Protocol Hierarchy Future Services IP/Layer 3 Services POS GE, ESCON FC/FICON RPR Storage Services OTN HDLC GE, Ethernet GFP SONET DWDM Lambda Services TDM Services T1.105 DSn ATM PPP X.86 HEC Vcat OC-N Another mapping for IP services, a better mapping for Ethernet, an enabler for Storage services. Future Services IP Services GE, ESCON FC/FICON RPR Storage Services OTN GE, Ethernet GFP DWDM Lambda Services TDM Services T1.105 DSn PPP Vcat OC-N Encapsulate & demarcate all services for common management GFP – Generic Framing Procedure (ITU-T Rec. G.7041) Uniform mapping of packet, storage & future services to global transport network Maximise network efficiency & resource utilisation VCAT – Virtual Concatenation of SONET/SDH Flexible provisioning of dynamic multi-services with LCAS* (ITU-T Rec. G.7042) *LCAS – Link Capacity Adjustment Scheme Extending SONET/SDH to support new Broadband Optical Services

Virtual Concatenation “Right-sizes” the provisioned SONET path for the client signal Enables mapping into an arbitrary number of standard STS-1s Transport capacity decoupled from service bandwidth – less stranded bandwidth STS signals can be diversely routed through SONET network Recombined to contiguous payloads at end point of transmission Need to handle differential delays at egress due to diverse routing Do this using internal buffers – 5us/km of fibre Inter-works with all existing SONET/SDH equipment Only source & sink terminals need to support VCAT STS-1-2v STS-1-4v OC-192 SONET STS-3c-4v ESCON (160M)  STS-1-4v Fibre Channel (1G)  STS-3c-6v Gigabit Ethernet  STS-3c-nv STS-1-2v Provides superior link utilization for both voice and data services

VCAT – Soft Protection VCAT Link New soft protection schemes possible Improves efficiency beyond classic SONET protection strategies Works best with packet services utilising CoS priority support Soft protection via path diversity 100% transport capacity utilised under normal conditions (~99.99% availability) On a failure, percentage of transport capacity is lost (due to impacted STSs) Client signal automatically re-mapped into the remaining STSs LCAS enables the VCAT link to be hitlessly repaired VCAT Link

Link Capacity Adjustment Scheme (LCAS) Executive Summary An approved mechanism (ITU G.7042.2001) for dynamically adjusting the size of a Virtually Concatenated channel Allows services more flexibility for handling dynamic bandwidth demands Relies on the NMS/EMS or O-UNI to provision the bandwidth change Allows channel size adjustment to be hitless Provides mechanism for adjustment of bandwidth during STS-1 failure LCAS uses bit-oriented protocol encapsulated in control packets carried in SONET H4 Payload Overhead (16 125μs frames per control packet)

Ethernet Private Line Services

Managed IP Services over Transparent LANs

Backplane GbE/10GbE Ports Pluggable GbE /10GbE Ports Ethernet Line Modules Backplane GbE/10GbE Ports Ethernet Services Line Modules Integrated Layer 2 switching 20G full duplex Ether switch capacity 1 x 10GbE or 10 x GbE ports Supports GFP-F, VCAT and LCAS Variety of mappings possible: PPP, GFP, LAP-S, ATM/FR Integrated NPU enables MAC learning bridge, Spanning Tree, VLANs, MPLS, PWE3, traffic prioritization, per flow traffic management, statistical multiplexing, link aggregation, port protection, etc. Any-to-Any packet switching Traffic from any port switched to any VCG SON/SDH Line Module Port to Port (Hairpin) 3 VCG to VCG (Server Mode) 2 VCG(s) Port to VCG 1 NPU SON/SDH Mapper Pluggable GbE /10GbE Ports Traffic Mgr CD (TDM) Fabric ESLM SON/SDH Line Module

Ending slide