Sponsored by the National Science Foundation Software Defined Exchanges: New Opportunities for Future Internet Research Mike Zink GREE-SC2014 July 21 st 2014, Iowa State University

Sponsored by the National Science Foundation 2 GEC20 Overview Motivation What is an SDX? SDN Domains Prototypes Opportunities –Cyber-physical System –Adaptive Streaming Instrumentation and Measurement Routing Education Conclusions

Sponsored by the National Science Foundation 3 GEC20 Emerging SDN Capabilities are Virtually Certain to Require Multi-Domain Infrastructure OpenFlow and software defined networking play an important role in GENI –GENI is deploying a multi-domain SDN federation at ~50 campuses nationwide –Key technology for enabling GENI’s deep programmability capability Because GENI is built as a federation, there’s a clear need for SDN infrastructure to span multiple operating domains –GENI infrastructure is owned and operated by the host institutions –Experiments and services need to exert control across these borders in a consistent and controlled way –These needs are repeated at a larger scale when GENI federates with other peer infrastructure, nationally and internationally

Sponsored by the National Science Foundation 4 GEC20 Multi-Domain SDN GENI Projects Prototype GENI Multi-Services Network Exchange (GMNE) Shakedown Experimentations and Prototype Services on Scalable, Agile, Robust, and Secure Multi-Domain Software Defined Networks A Software Defined Exchange for Engaging Commercial Partners in a Self-sustaining GENI

Sponsored by the National Science Foundation 5 GEC20 What is an SDX? It’s for adv. BGP It’s OF on steroids It’s software everything It’s an adv. IXP It’s multi- domain SDN It’s only for research

Sponsored by the National Science Foundation 6 GEC20 What do I believe it is! First and foremost: Connecting several independent SDN domains But only networking? Chip Elliot: “If we would built the Internet from scratch today it would have routers with lots of storage and computation added” SDX: Interconnect of SDN domains, storage & computation

Sponsored by the National Science Foundation 7 GEC20 Taking the next step Create SDX’s to bridge “SDN islands” SDN SDX Today: “SDN islands” GENI slices & VLAN stitching help point the way Next Step: Add SDX’s Build a “Rev 0” control plane, run native next-gen apps and scientific instruments spanning multi-domain SDNs SDI

Sponsored by the National Science Foundation 8 GEC20 SDX’s build the human community Working together... –US Industry –Network operators –Next-gen app developers –Scientific Instrument developers and users –Researchers Basic concept –“SDN Exchange” –Open meeting point –Support end-to-end applications across multiple SDN domains Key benefit: Very OPEN –Good way to rapidly build / grow tech community –Good way to create & share open-source tool chains –Good way to try out different approaches, perhaps vendor specific, in early days –Later, we can move to private peering points

Sponsored by the National Science Foundation 9 GEC20 SDN Domains What is an SDN domain? Example: Internet Advanced Layer 2 Service (AL2S) Google’s B4 In this talk I will focus on the research network/academic side of SDN Domains.

Sponsored by the National Science Foundation 10 GEC20 SDX Prototypes Exchange points that connect several SDN domains StarLight, SOX, MAX, iMinds in Europe, … Most of them also include computation and storage StarLight and SOX SDXes open for researchers GENI racks at both locations!

Sponsored by the National Science Foundation StarLight QXF3500 Switch StarLight QXF3500 Switch StarLight Openflow Switch StarLight Openflow Switch StarLight Ciena Switch StarLight Ciena Switch StarLight E1200 Switch StarLight E1200 Switch AL2S ORNL , Other GENI Racks ESnet 1651 SL GENI AM SDX NU Rack SLRack StarLight OF switch StarLight OF switch StarLight Network Diagram for SDX StarLight SDX

Sponsored by the National Science Foundation 12 GEC20 Where can we go? Lot’s of things we cannot do (or at least only in complicated ways) in today’s Internet NDN Cyber-physical systems Clean slate In-network computation and storage …

Sponsored by the National Science Foundation 13 GEC20 GENI: Infrastructure for Experimentation GENI is a large multi-domain SDN testbed

Sponsored by the National Science Foundation 14 GEC20 GENI: Infrastructure for Experimentation GENI is the largest multi-domain SDN testbed

Sponsored by the National Science Foundation 15 GEC20 Setting up an SDX Experiment Deploy it on a GENI slice Study the benefits of SDX on NowCast, a time-critical short- term weather forecast application

Sponsored by the National Science Foundation 16 GEC20 Conceptual diagram GEC floor SDX SDN (SDN) SDN Simulated Radar Traffic Middlebox

Sponsored by the National Science Foundation 17 GEC20 GENI Slice StarLight OF switch StarLight OF switch NU-IG Rack NU-IG Rack end hosts (radar traffic) SoX OF switch sdx SoX-IG Rack SoX-IG Rack middlebox (processing host) GT-IG Rack GT-IG Rack end hosts (view results) AL2S Switch Resource reservation with standard GENI tools demo floor

Sponsored by the National Science Foundation 18 GEC20 SDN Control StarLight OF switch StarLight OF switch NU-IG Rack NU-IG Rack SoX OF switch sdx SoX-IG Rack SoX-IG Rack GT-IG Rack GT-IG Rack AL2S Switch Experiment choice how to manage SDN resources Load Balancer Controller Learning Controller

Sponsored by the National Science Foundation 19 GEC20 Nowcast – Processing Grid & Merge DARTS Post-process Webserver Dynamically provisioned SDN Nowcast VM New nowcast every one minute!

Sponsored by the National Science Foundation 20 GEC20 Nowcast – Experiment GEC floor SDX SDN (SDN) SDN Simulated Radar Traffic Middlebox OF Controller Monitoring with GIMI tools

Sponsored by the National Science Foundation 21 GEC20 Nowcast – Data Flow GEC floor SDX SDN (SDN) SDN Simulated Radar Traffic Middlebox Monitoring with GIMI tools

Sponsored by the National Science Foundation 22 GEC20 Example: Adaptive Streaming Steps: ● Video is chunked (broken into segments of equal length) ● Each chunk is represented in different quality segments - encoded in 5 different bitrates ● Bitrate (quality) of content streamed to client is chosen based on bandwidth between server and client. ● Client decides the quality which is to be played ● Every chunk requested is a new HTTP connection Features: ●Quality of the video “adapts” to the client’s bandwidth requirements ●Fewer video freezes ●Highly likely that client receives better quality as video progresses Requirements: ●High/consistent bandwidth connection ●Compute-intensive Operation - Live transcoding ●Content availability SOLUTION : SDX

Sponsored by the National Science Foundation 23 GEC20 Instrumentation and Measurement Perform repeatable experiment –Automate experiment –Archive data –Share experiments Outfit SDXes with measurement infrastructure and tools that can be used by research community –Important for initial research stages –Analysis, verification, validation More on the basics in tomorrow’s tutorial

Sponsored by the National Science Foundation 24 GEC20 Some wild ideas Can you use measurement data for OF controller behavior Send measurement data on different flow than production traffic –Isolation –Measurement data collection will not interfere with production traffic

Sponsored by the National Science Foundation 25 GEC20 Separating Measurement & Production Inherent in GENI but imposes limitations

Sponsored by the National Science Foundation 26 GEC20 Routing In between GENI Racks we can implement, test, and evaluate our own routing protocols Inter-domain routing not possible SDXes will allow research in new inter-domain routing protocols. E.g. work on BGP: –SDX: A Software Defined Internet Exchange. Arpit Gupta, Laurent Vanbever, Muhammad Shahbaz, Sean P. Donovan, Brandon Schlinker, Nick Feamster, Jennifer Rexford, Scott Shenker, Russ Clark, Ethan Katz-Bassett

Sponsored by the National Science Foundation 27 GEC20 Routing 2.0 OpenFlow: Flow rules based not only on IP but also type- of-service, port, VLAN priority and so on BGP policy Even BGP traffic could be treated differently Routing without IP Routing to avoid DDoS attacks Routing based on available storage and compute resources

Sponsored by the National Science Foundation 28 GEC20 Education Use SDX in the classroom and computer networks/distributed systems labs E.g., students can study inter-domain routing in real testbed (not sure if this is possible anywhere else?)

Sponsored by the National Science Foundation 29 GEC20 Conclusions SDX: They are here (to stay?) New vehicle for “at-scale”, next-generation Internet research Examples for SDX use Meaningful experimentation How could you use them for your routing ideas?

Sponsored by the National Science Foundation 30 GEC20 Further Reading NRTDI SDX Workshop: _Workshop_for_OnVector_Monga_v2.pdf NSF SDX Workshop: hop hop Paper on Google B4: sigcomm13.pdf

Sponsored by the National Science Foundation 31 GEC20 Acknowledgements Niky Riga Mark Berman Chip Elliott Divyashri Bhat Joe Mambretti Russ Clark

Sponsored by the National Science Foundation 32 GEC20 StarLight SDX