Central Office Re-architected as a Datacenter (CORD) Larry Peterson Open Networking Lab (In collaboration with AT&T)

Open Networking Lab Mission – To bring openness and innovation to the Internet and Cloud History – A non-profit corporation, spun out of Stanford to catalyze SDN Parallel organization to the Open Networking Foundation (ONF) Team – 25 Engineers + Visiting Engineers + Student Interns Partners – AT&T, NTT, SKT NEC, Ericsson, Huawei, Cisco, Fujitsu, Intel, Ciena Projects – Open Network Operating System (ONOS) & OpenCloud (XOS) Note: Distinctions are artificial (based on history, not fundamental)… Is a firewall an VNF or an SDN application? Is CDN a cloud service or a VNF? Is VPN a cloud service or an SDN application?

ONOS – An Open Network OS Apps Apps NB Core API Distributed Core (state management, notifications, high-availability & scale-out) SB Core API Adapters Adapters Adapters Adapters Protocols Protocols Protocols Protocols

Telco Central Office Large number of big facilities AT&T alone operates 4-5k Central Offices Evolved over the past 40-50 years Not architected as a single coherent facility Source of huge CAPEX/OPEX costs Especially when compared to OTT cloud providers Note: Distinctions are artificial (based on history, not fundamental)… Is a firewall an VNF or an SDN application? Is CDN a cloud service or a VNF? Is VPN a cloud service or an SDN application?

Inside a Central Office Terminates subscriber connections 10-100k per Central Office Terminates metro networks and enterprise links SONET and Carrier Ethernet Connects to backbone networks Optical and transport termination Connects cellular networks Backhaul termination, S-GW, P-GW, MME,… Provides range of services Voice, Video, Data

Central Office Re-architected as a Datacenter Cloud Management and Service Orchestration Leaf-Spine Fabric ROADM (Core) PON OLT MACs GPON (Access) Commodity Servers, Switches, and Storage

Converging Threads Cloud SDN NFV about best practices in scaling functionality SDN NFV about treating the network’s control plane as a programmable function about treating the network’s data plane as a programmable function

Value Proposition Leverage SDN, NFV and modern datacenter technologies and best practices Reduce CAPEX with virtualized commodity hardware Reduce OPEX with automated service orchestration Accelerate time-to-market for new services Add value to existing OTT cloud services

SDN x NFV x Cloud Source of technology to reduce CAPEX/OPEX e.g., virtual machines, virtual networks, elastic scaling Source of services to offer subscribers Global Cloud Services e.g., CDN, NoSQL DB, Analytics, Internet-of-Things Control Plane Services e.g., VPN, Q-in-Q Termination, MPLS Tunneling Data Plane Services e.g., Parental Control, NAT, WAN Acceleration Note: Distinctions are artificial (based on history, not fundamental)… Is a firewall an VNF or an SDN application? Is CDN a cloud service or a VNF? Is VPN a cloud service or an SDN application? Also, mutually supporting – e.g., load balancing (some improve ops, some provide value to customers)

Devices We Want to Virtualize Residence/Enterprise Central Office Backbone Core Data Center CPE ONU OLT ETH AGG BNG Acronyms CPE – Customer Premises Equipment OLT – Optical Line Termination BNG – Broadband Network Gateway ONT

Devices We Want to Virtualize Residence/Enterprise Central Office Backbone Core Data Center CPE ONU OLT ETH AGG BNG NAT DHCP VoIP Firewall Parental Control … ONT

Devices We Want to Virtualize Residence/Enterprise Central Office Backbone Core Data Center CPE ONU OLT ETH AGG BNG Authorization Physical Connect Point … ONT

Devices We Want to Virtualize Residence/Enterprise Central Office Backbone Core Data Center CPE ONU OLT ETH AGG BNG QoS VPN GRE Tunneling MPLS Tunneling Q-in-Q Termination … ONT

Virtualization Process – Generic TLA  vTLA = Merchant Silicon + SDN Control Function (App running on ONOS) + NFV Data Function (Network-Function-as-a-Service) TLA = Three Letter Acronym Note: Distinctions are artificial (based on history, not fundamental)… Is a firewall an VNF or an SDN application? Is CDN a cloud service or a VNF? Is VPN a cloud service or an SDN application? Also, mutually supporting – e.g., load balancing (some improve ops, some provide value to customers)

Virtualization Process – Specific CPE  vCPE = White-box Switch in the home + N/A + vCPE-as-a-Service (Container-per-Subscriber) OLT  vOLT = GPON Interface Card in the Central Office + vOLT-as-a-Service (App running on ONOS) BNG  vBNG = White-box Switching Fabric in the Central Office + vBNG-as-a-Service (App running on ONOS) Note: Distinctions are artificial (based on history, not fundamental)… Is a firewall an VNF or an SDN application? Is CDN a cloud service or a VNF? Is VPN a cloud service or an SDN application? Also, mutually supporting – e.g., load balancing (some improve ops, some provide value to customers)

Residence/Enterprise Before Residence/Enterprise Central Office Backbone Core Data Center CPE ONU OLT ETH AGG BNG Acronyms CPE – Customer Premises Equipment OLT – Optical Line Termination BNG – Broadband Network Gateway ONT

Residence/Enterprise vOLT + vCPE + vBNG + CDN Residence/Enterprise Central Office Backbone Core Data Center ONU vOLT-as-a-Service vCPE-as-a-Service CDN-as-a-Service vBNG-as-a-Service ONT

Control Plane Services (vOLT-as-a-Service + vBNG-as-a-Service) Target Architecture XOS (Service Orchestration) + OVX (Virtual Networks) + ONOS (Control Apps) Data Plane Services (vCPE-as-a-Service) Cloud Services (CDN-as-a-Service) PON OLT MACs ROADM GPON Control Plane Services (vOLT-as-a-Service + vBNG-as-a-Service) Commodity Servers, Switches, and Storage

Everything-as-a-Service (XaaS) Logically centralized interface to network-wide functionality Service Controller (Multi-Tenant) Many points of implementation distributed across the network. Service Instances (VMs, Devices)

Internet-as-a-Service Logically centralized interface to network-wide functionality. vBNG Controller (Tenant = Routable Subnet) OpenFlow Many points of implementation distributed across the network. Service Instances (VMs, Devices) OpenFlow Switches Over simplified… Three-tier implementation: (1) logically centralized state management; (2) distributed controller instances; (3) switches themselves.

Access-as-a-Service vOLT Controller Logically centralized interface to network-wide functionality. vOLT Controller (Tenant = Subscriber VLAN) OpenFlow Many points of implementation distributed across the network. Service Instances (VMs, Devices) OpenFlow Switches Over simplified… Three-tier implementation: (1) logically centralized state management; (2) distributed controller instances; (3) switches themselves.

ONOS – An Open Network OS vOLT & vBNG Apps Apps NB Core API Distributed Core (state management, notifications, high-availability & scale-out) SB Core API Adapters Adapters Adapters Adapters Protocols Protocols Protocols Protocols

Subscriber-as-a-Service Logically centralized interface to network-wide functionality. vCPE Controller (Tenant = Subscriber Bundle) Dockerfile Many points of implementation distributed across the network. Service Instances (VMs, Devices) Per-Subscriber Linux Container (with select bundle) … Tie to earlier slide. Introduce the concept. The following slides walk through three examples.

CDN-as-a-Service CDN Controller Logically centralized interface to network-wide functionality. CDN Controller (Tenant = Content Provider) Proprietary Many points of implementation distributed across the network. Service Instances (VMs, Devices) Caches Over simplified… Three-tier implementation: (1) logically centralized state management; (2) distributed controller instances; (3) switches themselves.

And the Plumbing Too Note: Distinctions are artificial (based on history, not fundamental)… Is a firewall an VNF or an SDN application? Is CDN a cloud service or a VNF? Is VPN a cloud service or an SDN application?

Infrastructure-as-a-Service Logically centralized interface to network-wide functionality. OpenStack (Tenant = Slice) Open Source Many points of implementation distributed across the network. Service Instances (VMs, Devices) VMs Over simplified… Three-tier implementation: (1) logically centralized state management; (2) distributed controller instances; (3) switches themselves.

VN-as-a-Service OVX Controller Logically centralized interface to network-wide functionality. OVX Controller (Tenant = Virtual Network) OpenFlow Many points of implementation distributed across the network. Service Instances (VMs, Devices) OpenFlow Switches Over simplified… Three-tier implementation: (1) logically centralized state management; (2) distributed controller instances; (3) switches themselves.

OpenVirteX (OVX) Network OS Network OS Network OS VM OpenVirteX – A Network Hypervisor that supports Topology, Address Space, and Control Isolation Physical Network Key capability -- Dynamically create customizable Virtual Networks.

XOS – XaaS Operating System Service 1 Controller Service 2 Controller Service 3 Controller Service 4 Controller Service N Controller . . .

XOS – XaaS Operating System Tenant View Developer View Operator View . . . (REST API, xoslib) Data Model Controller Framework Service 1 Controller Service 2 Controller Service 3 Controller Service 4 Controller Service N Controller . . . Adheres to MVC Paradigm

XOS – XaaS Operating System Subscriber View Developer View CORD View . . . (REST API, xoslib) Data Model Controller Framework vOLT Controller vCPE Controller vBNG Controller CDN Controller OpenStack Controller . . . Adheres to MVC Paradigm

XOS Data Model Defines Service as a first class object Service = ({Slice,…}, Controller) Flexible control over operational parameters Slice = ({VM,…}, {VN,…}) VM = (Placement, Image, Resources) VN = (Topology, NetworkOS, Resources) Controller = (URL, Credentials, Plugin) Service Composition and Tenancy Tenant = (ServiceTenant , ServiceProvider , Connect) Connect = Public | Private | Interconnect | Management

Tenancy Graph vOLT vCPE CDN vBNG XOS OpenStack OpenVirteX

Demonstration Hardware – OpenCloud – PP Management Network OpenFlow capable External Network Cisco 3560 IBM G8264 14 x Cisco 220 M3 (16 cores / 128GB RAM) POD

OpenCloud – Pilot Deployment

Value Proposition Leverage SDN, NFV and modern datacenter technologies and best practices Reduce CAPEX with virtualized commodity hardware Reduce OPEX with automated service orchestration Accelerate time-to-market for new services Add value to existing OTT cloud services

Value-Added Carrier Cloud Note: Distinctions are artificial (based on history, not fundamental)… Is a firewall an VNF or an SDN application? Is CDN a cloud service or a VNF? Is VPN a cloud service or an SDN application?

Service Composition Service 3 = Service 1  Service2 Logically compose services to achieve desired functional/security behavior Service1 Service2 VM VM VM VM VM VM VM VM VM VM VM Map onto physical infrastructure to meet performance requirements VM VM VM VM VM VM VM VM VM VM VM VM VM VM

Multi-Tier Carrier Cloud Operator Data Centers Backbone PoPs Central Offices Subscribers (Enterprises) Amazon AWS Google Cloud Platform … Commodity Clouds Nintendo Wii Latency matters Shared state matters Sufficient resources matters

Operational Example Syndicate = CDN  Object Store  NoSQL DB Value-Add Storage Service Scalable Read Bandwidth (Akamai HyperCache & RequestRouter) Data Durability (S3, Glacier, DropBox, Box, Swift) Data Consistency (Google App Engine)

Value-Added Storage Service Commodity Clouds Operator Data Centers Backbone PoPs Central Offices Subscribers (Enterprises) Nintendo Wii HPC Amazon AWS RR S3 HPC … Google Cloud Platform MS Latency matters Shared state matters Sufficient resources matters

More Information OpenCloud: An Operational Cloud portal.opencloud.us guide.opencloud.us XOS: An Open Source Project github.com/open-cloud/xos ONOS: An Open Source Project + Community onosproject.org Syndicate: A Research Project (also open source) syndicatedrive.com

Join the journey @ onosproject.org