Sponsored by the National Science Foundation GENI as a Virtual Laboratory for Networking and Distributed Systems Classes Workshop 7 at SIGCSE ‘14 Sarah Edwards GENI Project Office

Sponsored by the National Science Foundation2GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Agenda Presentation and Demo: An Introduction to GENI (45min) Hands-on: Getting Started with GENI (45min) Break (10min) Hands-on: IPv4 Routing Assignment (50min) Resources for Instructors (15min) Miscellaneous GENI Topics & Wrap-Up (15min)

Sponsored by the National Science Foundation GENI Exploring Networks of the Future

Sponsored by the National Science Foundation4GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Outline GENI – Exploring future internets at scale The GENI Concept Building GENI Experimental and Classroom use of GENI What’s next for GENI? GENI: An experimenter’s view

Sponsored by the National Science Foundation5GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Credit: MONET Group at UIUC Society Issues We increasingly rely on the Internet but are unsure we can trust its security, privacy or resilience Science Issues We cannot currently understand or predict the behavior of complex, large-scale networks Innovation Issues Substantial barriers to at-scale experimentation with new architectures, services, and technologies Global networks are creating extremely important new challenges

Sponsored by the National Science Foundation6GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net GENI: Infrastructure for Experimentation GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

Sponsored by the National Science Foundation7GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net GENI: Infrastructure for Experimentation GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

Sponsored by the National Science Foundation8GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Multiple GENI Experiments run Concurrently Infrastructure can be shared between slices Experiments live in isolated “slices”

Sponsored by the National Science Foundation9GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net GENI is “Deeply Programmable” I install software I want throughout my network slice (into routers, switches, …) or control switches using OpenFlow Experimenters can set up custom topologies, protocols and switching of flows

Sponsored by the National Science Foundation10GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net GENI Compute Resources GENI Racks Existing Testbeds (e.g. Emulab) GENI Wireless compute nodes

Sponsored by the National Science Foundation11GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net GENI Networking Resources Networking within a Rack National Research Backbones (e.g. Internet2) Regional Networks (e.g. CENIC) WiMAX Base Stations

Sponsored by the National Science Foundation12GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Outline GENI – Exploring future internets at scale The GENI Concept Building GENI Experimental and Classroom use of GENI GENI: An experimenter’s view

Sponsored by the National Science Foundation13GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net “I have a great idea.” “That will never work.” A bright idea

Sponsored by the National Science Foundation14GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Let’s try it out! My new architecture worked great in the lab, so now I’m going to try a larger experiment for a few months. He uses a modest slice of GENI, sharing its infrastructure with many other concurrent experiments.

Sponsored by the National Science Foundation15GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net It turns into a really good idea His slice of GENI keeps growing, but GENI is still running many other concurrent experiments. This service looks very useful

Sponsored by the National Science Foundation16GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net “Looks like an app to me.” “It’s my very own GENI slice.” Attracts real users

Sponsored by the National Science Foundation17GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net “Boy did I learn a lot!” “What a cool service.” (I wonder how it works.) “I always said it was a great idea.” (But way too conservative.)

Sponsored by the National Science Foundation18GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net If you have a great idea, check out the NSF CISE research programs for current opportunities. ??

Sponsored by the National Science Foundation19GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Moral of this story GENI is meant to enable... –At-scale experiments –Internet-incompatible experiments –Both repeatable and “in the wild” experiments –‘Opt in’ for real users –Instrumentation and measurement tools GENI creates a huge opportunity for ambitious research!

Sponsored by the National Science Foundation20GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Outline GENI – Exploring future internets at scale The GENI Concept Building GENI Experimental and Classroom use of GENI GENI: An experimenter’s view

Sponsored by the National Science Foundation21GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Growing GENI’s footprint

Sponsored by the National Science Foundation22GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Federation GENI grows by GENI-enabling heterogeneous infrastructure Avoid technology “lock in” and grow quickly by incorporating existing infrastructure Backbone #1 Regional GENI Rack Access #1 Commercial Clouds Corporate GENI suites Non-US Testbeds Research Testbed Campus My experiment runs across the evolving GENI federation. My GENI Slice This approach looks remarkably familiar...

Sponsored by the National Science Foundation23GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Federation Extends the Reach of GENI and International Peer Testbeds Initial plan to federate testbeds on five continents

Sponsored by the National Science Foundation24GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net “At scale” GENI prototype Campus photo by Vonbloompasha Build GENI at sufficient scale Infeasible to build a testbed as big as the Internet GENI-enabled campuses, students as early adopters HP ProCurve 5400 Switch NEC WiMAX Base Station GENI-enabled equipment GENI-enable testbeds, commercial equipment, campuses, regional and backbone networks

Sponsored by the National Science Foundation25GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net GENI architecture Flexible network / cloud research infrastructure Also suitable for physics, genomics, other domain science Support “hybrid circuit” model plus much more (OpenFlow) Distributed cloud (racks) for content caching, acceleration, etc. Metro Research Backbones Internet ISP Regional Networks Campus g g g Legend GENI-enabled hardware Layer 3 Control Plane Layer 2 Data Plane

Sponsored by the National Science Foundation26GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Creating and deploying GENI racks GENI Rack Installed at GPO – Feb 22, 2012 Ilia Baldine RENCI More resources / rack, fewer racks Rick McGeer Fewer resources / rack, more racks

Sponsored by the National Science Foundation27GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net GENI WiMAX 2013 Researcher-owned, researcher-operated 4G cellular systems 26 Wimax Base Stations in 13 Sites Sliced, virtualized and interconnected On the Air Not On the Air

Sponsored by the National Science Foundation28GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net GENI WiMAX Agreements Agreement with Clearwire –Clearwire and Rutgers University have signed a master agreement –encompassing all WiMAX sites, to ensure operation in the EBS Band. –An emergency stop procedure, in case of interference with Clearwire service, has been agreed upon. GENI Mobile Virtual Network Operator (MVNO) - Partner with Sprint and Arterra (a Sprint partner) to create and operate an (MVNO) that serves the academic research community - The effort is led by Jim Martin, Clemson Univ, and is underway with a 1 year NSF EAGER Agreements in place to broadcast on our own frequency and to support roaming

Sponsored by the National Science Foundation29GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net GENI Operations GMOC: GENI Meta-operation Center Keeps track of outages Notification system for resource reservation Monitors most GENI Aggregates GMOC Google Calendar keeps track of reservations/outages

Sponsored by the National Science Foundation30GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Outline GENI – Exploring future internets at scale The GENI Concept Building GENI Experimental and Classroom use of GENI GENI: An experimenter’s view

Sponsored by the National Science Foundation31GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net How is GENI being Used? Research Future Internet Architectures Software defined networking Large scale evaluation of protocols Education Networking and Distributed systems classes Cloud computing classes WiMAX classes As of October 2013, GENI had over 1200 users!

Sponsored by the National Science Foundation32GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Three FIA Teams have Slices on GENI GENI is the only testbed that can support these teams. XIA (demo at GEC15) NDN (demo at GEC 13) MobilityFirst (demo at GEC 12 & GEC18)

Sponsored by the National Science Foundation33GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Virtual Desktop Cloud Prasad Calyam, University of Missouri, Columbia Program realtime load- balancing functionality deep into the network to improve QoE

Sponsored by the National Science Foundation34GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Spring 2014: Jeannie Albrecht (Williams College) Suman Banerjee (U. of Wisconsin) Deniz Gurkan (U. of Houston) Thanasis Korakis (NYU Poly) Yaoqing Liu (Clarkson U) Shivendra Panwar (NYU Poly) Robert Ricci (Utah) Violet Syrotiuk (Arizona State U) Bing Wang (U. of Conn) KC Wang (Clemson) Vasillis Maglaris (NTUA Greece) Gaia Maselli (Sapienza University of Rome – Italy) GENI in the Classroom – A great success! Jeannie Albrecht (Williams College) with students from her Spring 2012 Distributed Systems class Fall 2013: Prasad Calyam (U. of Missouri) Zongming Fei (U. of KY) John Geske (Kettering U.) Deniz Gurkan (U. of Houston) Christos Papadopoulos (Col. State) Violet Syrotiuk (Arizona State U.) Zhi-Li Zhang (U. of MN) Spring 2013: Jay Aikat (U. of NC) Rudra Dutta (NCSU) Khaled Harfoush (NCSU) Jelena Marasevic (Columbia U) Parmesh Ramanathan (U. Wisc) Violet Syrotiuk (Arizona State U.) KC Wang (Clemson) Michael Zink (U. of MA) Fall 2012: Rudra Dutta (NCSU) Zongming Fei (U. of KY) Fraida Fund (NY Poly) Kaiqi Xiong (RIT)

Sponsored by the National Science Foundation35GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Upcoming GENI Events GENI Engineering Conferences, held three times a year Planning & discussion for experimenters, software, infrastructure Tutorials and workshops Travel grants to US academics for participant diversity GENI Summer Camp June ‘14 GEC19 Georgia Tech, Atlanta March 17-19, 2014 Train-the-TA Offered online at the start of each semester Tutorials at Conferences IC2E ‘14, etc

Sponsored by the National Science Foundation36GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Outline GENI – Exploring future internets at scale The GENI Concept Building GENI Experimental and Classroom use of GENI GENI: An experimenter’s view

Sponsored by the National Science Foundation37GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Slice –An experiment uses resources in a slice –Slices isolate experiments –Experimenters are responsible for their slices Slice Container for a collection of resources capable of running experiments

Sponsored by the National Science Foundation38GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Slice credentials Clearinghouse and Aggregates Clearinghouse: Manages users, projects and slices –Standard credentials shared via custom API or new Common CH API –GENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENI CH Aggregate: Provides resources to GENI experimenters –Typically owned and managed by an organization –Speaks the GENI AM API –Examples: PlanetLab, Emulab, GENI Racks on various campuses Create & Register Slice Researcher Aggregate Manager API - listResources - createSliver … Aggregate Manager Aggregate Resources users slice s clearinghouse projects Tool

Sponsored by the National Science Foundation39GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Resource Specifications (Rspecs) RSpecs: Lingua franca for describing and requesting resources –“Machine language” for negotiating resources between experiment and aggregate –Experimenter tools eliminate the need for most experimenters to write or read RSpec <rspec xmlns=" xmlns:xsi=" xsi:schemaLocation=" type="request" > <node client_id="my-node" exclusive="true"> RSpec for requesting a single node

Sponsored by the National Science Foundation40GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Reserving Resources using RSpecs and the AM API Experimenter tools and aggregates talk to each other using resource specifications (RSpecs) and the GENI Aggregate Manager API (GENI AM API) Advertisement RSpec: What does an aggregate have? Request RSpec: What does the experimenter want? Manifest RSpec: What does the experimenter have? Aggregate Manager Experimenter Tool ListResources(…) Advertisement RSpec CreateSliver(Request RSpec, …) Manifest RSpec ListResources(SliceName, …) Manifest RSpec What do you have? I have … I would like … You have … What do I have? You have …

Sponsored by the National Science Foundation41GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Reserve resources across many aggregates in the same slice One slice can contain: bare metal machines, virtual machines, VLANs, OpenFlow resources, etc Backbone #1 Backbone #2 Campus #3 Campus #2 Access #1 Commercial Clouds Corporate GENI suites Other-Nation Projects Research Testbed Campus My GENI Slice My slice contains resources from many aggregates.

Sponsored by the National Science Foundation42GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Putting it all Together: Demo Demo –Login to the GENI Portal –Create a slice –Create a sliver at one aggregate Two computers (VMs), connected by a LAN –Install and run software on the machines –View output of software –Delete sliver Experimenter tool: Flack server (VMs) client (VMs)

Sponsored by the National Science Foundation43GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Start Demo Login to GENI Experimenter Portal Create slice Launch Flack Draw topology Create sliver Verify sliver creation was successful

Sponsored by the National Science Foundation44GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net The Demo Experiment in Flack

Sponsored by the National Science Foundation45GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net The Request RSpec <rspec type="request” xsi:schemaLocation=“ xmlns:xsi=" xmlns=" <rspec type="request” xsi:schemaLocation=“ xmlns:xsi=" xmlns="

Sponsored by the National Science Foundation46GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net The Manifest RSpec <node client_id="server" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="true" component_id="urn:publicid:IDN+emulab.net+node+pc554" sliver_id="urn:publicid:IDN+emulab.net+sliver+95506"> <node client_id="client" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="false" component_id="urn:publicid:IDN+emulab.net+node+pc533" sliver_id="urn:publicid:IDN+emulab.net+sliver+95505"> <node client_id="server" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="true" component_id="urn:publicid:IDN+emulab.net+node+pc554" sliver_id="urn:publicid:IDN+emulab.net+sliver+95506"> <node client_id="client" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="false" component_id="urn:publicid:IDN+emulab.net+node+pc533" sliver_id="urn:publicid:IDN+emulab.net+sliver+95505">

Sponsored by the National Science Foundation47GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net GENI is a nationwide virtual environment enabling networking and distributed systems research Experimenters can set up custom topologies, protocols and switching of flows

Sponsored by the National Science Foundation48GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net QUESTIONS?

Sponsored by the National Science Foundation49GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Agenda Presentation and Demo: An Introduction to GENI (45min) Hands-on: Getting Started with GENI (45min) Break (10min) Hands-on: IPv4 Routing Assignment (50min) Resources for Instructors (15min) Miscellaneous GENI Topics & Wrap-Up (15min)