Sponsored by the National Science Foundation Experimentation using GENI Mark Berman GENI Project Office February 18, groups.geni.net

Sponsored by the National Science Foundation 2 Feb 18, 2011 Thank You To Deniz Gurkan for organizing this workshop To all of you for coming The GENI team hopes to engage you in Using GENI for your experiments GENI-enabling your infrastructure GEC10 – San Juan, March 15-17:

Sponsored by the National Science Foundation 3 Feb 18, 2011 Outline GENI Basics for Experimenters Some Example Resources Some Example Experiments Please Get Involved

Sponsored by the National Science Foundation 4 Feb 18, 2011 GENI’s Unique Advance Today –Lots of specific testbeds –Mostly homogeneous –Require separate accounts, tools –Interconnected via Internet GENI –End-to-end, controlled interconnection –Shared toolset –Common authentication, access control –Direct L2 access to end-users –Lots of stuff (quantity and diversity)

Sponsored by the National Science Foundation 5 Feb 18, 2011 Initial implementation with 3 aggregate types 20 aggregates advertise 5,000+ resources via the GENI AM API Shared credentials offer experimenters single point of access October 19, 2010 Network Resources: OpenFlow switches, PlanetLab/VINI links, ProtoGENI links Compute Resources: PlanetLab nodes, ProtoGENI nodes Spiral 2 Initial GENI AM API Implementation

Sponsored by the National Science Foundation 6 Feb 18, 2011 PlanetLab, ProtoGENI, and OpenFlow October 20, 2010 Today’s Resources Accessible via GENI AM API We want all GENI resources to appear on this map!

Sponsored by the National Science Foundation 7 Feb 18, 2011 GENI Is a Virtual Laboratory To succeed as a virtual laboratory, GENI must support a wide variety of experiments. Early GENI goals include support for –Repeatable and/or “in the wild” behavior –Large-scale infrastructure –Novel network architecture –Deep programmability –Programmable switches and routers –Opt-in users These capabilities are rapidly taking shape –GENI will continue to increase in capability, scale, and interoperability

Sponsored by the National Science Foundation 8 Feb 18, 2011 GENI Experimenter Interests (June 2010)

Sponsored by the National Science Foundation 9 Feb 18, 2011 What resources can I use? Components Aggregate A Computer Cluster Components Aggregate B Backbone Net Components Aggregate C Metro Wireless These GENI Clearinghouse Researcher Resource discovery Aggregates publish resources, schedules, etc., via clearinghouses

Sponsored by the National Science Foundation 10 Feb 18, 2011 GENI Clearinghouse Components Aggregate A Computer Cluster Components Aggregate B Backbone Net Components Aggregate C Metro Wireless Create my slice Slice creation Clearinghouse checks credentials & enforces policy Aggregates allocate resources & create topologies

Sponsored by the National Science Foundation 11 Feb 18, 2011 Components Aggregate A Computer Cluster Components Aggregate B Backbone Net Components Aggregate C Metro Wireless Experiment – Install my software, debug, collect data, retry, etc. GENI Clearinghouse Experimentation Researcher loads software, debugs, collects measurements

Sponsored by the National Science Foundation 12 Feb 18, 2011 Components Aggregate A Computer Cluster Components Aggregate B Backbone Net Components Aggregate C Metro Wireless Make my slice bigger ! GENI Clearinghouse Slice growth & revision Allows successful, long-running experiments to grow larger

Sponsored by the National Science Foundation 13 Feb 18, 2011 Components Aggregate A Computer Cluster Components Aggregate B Backbone Net Components Aggregate C Metro Wireless Make my slice even bigger ! GENI Clearinghouse Components Aggregate D Non-NSF Resources Federated Clearinghouse Federation of Clearinghouses Growth path to international, semi-private, and commercial GENIs

Sponsored by the National Science Foundation 14 Feb 18, 2011 Components Aggregate A Computer Cluster Components Aggregate B Backbone Net Components Aggregate C Metro Wireless GENI Clearinghouse Federated Clearinghouse Components Aggregate D Non-NSF Resources Operations & Management Always present in background for usual reasons Will need an ‘emergency shutdown’ mechanism Oops Stop the experiment immediately !

Sponsored by the National Science Foundation 15 Feb 18, 2011 Outline GENI Basics for Experimenters Some Example Resources Some Example Experiments Please Get Involved

Sponsored by the National Science Foundation 16 Feb 18, 2011 Spiral 2 infrastructure Building the GENI Meso-scale Prototype WiMAX ShadowNet Salt Lake City Kansas City Washington DC Atlanta Stanford UCLA UC Boulder Wisconsn Rutgers Polytech Inst NYU UMass Columbia OpenFlow backbone Seattle Sunnyvale Los Angeles Denver Houston Chicago Atlanta Washington DC New York City OpenFlow Arista 7124S Switch HP ProCurve 5400 Switch Juniper MX240 Ethernet Services Router NEC WiMAX Base Station NEC IP8800 Ethernet Switch Pronto 3290 Ethernet Switch Stanford U Washington Wisconsin Indiana Rutgers Princeton Clemson Georgia Tech Kansas State

Sponsored by the National Science Foundation 17 Feb 18, 2011 World-class GENI Partners National LambdaRail and Internet2 Buildout for GENI prototyping within two national footprints to provide end-to-end GENI slices (IP or non-IP) National LambdaRail Up to 30 Gbps bandwidth Internet2 ProtoGENI & SPP Photo by Chris Tracy

Sponsored by the National Science Foundation 18 Feb 18, 2011 Campus GENI build-outs Researchers teaming with campus IT staff Nick Feamster PI Russ Clark, GT-RNOC Ellen Zegura Ron Hutchins, OIT OpenFlow in 2 GT- RNOC lab bldgs now OpenFlow/BGPMux coursework now Dormitory trial Access control, authentication focus How are we “GENI-enabling” campuses? Vitaliy Neret WiMAX GENI racks

Sponsored by the National Science Foundation 19 Feb 18, 2011 Example ProtoGENI Resources U. Utah/Emulab: 600+ PCs 6 netFPGA U. Utah/Emulab: 600+ PCs 6 netFPGA U. Wisconsin: 2 PCs Wail: 100+ PCs 50+ Routers U. Wisconsin: 2 PCs Wail: 100+ PCs 50+ Routers Internet2 Kansas City PoP: 2 PCs 4 NetFPGA SPP node Internet2 Kansas City PoP: 2 PCs 4 NetFPGA SPP node Internet2 DC PoP 2 PCs 4 NetFPGA SPP node Internet2 DC PoP 2 PCs 4 NetFPGA SPP node U. Kentucky: 90 PCs U. Kentucky: 90 PCs Internet2 SLC PoP: 4 NetFPGA 2 PCs SPP node Internet2 SLC PoP: 4 NetFPGA 2 PCs SPP node

Sponsored by the National Science Foundation 20 Feb 18, 2011 Programmable WiMax Base Stations Site now: –WINLAB Rutgers –BBN Cambridge –NYU Poly Sites in progress: –Columbia –UMass Amherst –Univ Wisconsin –Univ Colorado Boulder –UCLA GENI terminals (WiMAX phone/PDA running GENI/Linux) Virtual GENI Router (at PoP) GENI Backbone Network GENI Access Network (Ethernet SW & Routers) GENI Compliant WIMAX Base Station Controller WiMAX Base Station (GBSN)

Sponsored by the National Science Foundation 21 Feb 18, 2011 PlanetLab & SPP PlanetLab Central: nodes worldwide SPP: programmable router in 5 Internet2 PoPs Other sites running local versions of PlanetLab: –GpENI high-speed network in Kansas –GENI-enabled campuses Chassis Switch 10x1 GbE CP External Switch net FPGA GPE NPE Line Card GP Processing Engines Network Processing Engine Line Card Chassis Switch External Switch

Sponsored by the National Science Foundation 22 Feb 18, 2011 Outline GENI Basics for Experimenters Some Example Resources Some Example Experiments Please Get Involved

Sponsored by the National Science Foundation 23 Feb 18, 2011 Sponsored by the National Science Foundation November 3, 2010 Pathlet Architecture GEC 9 experiment demonstration Lets users monitor and select their own network paths to optimize their services Protects critical traffic even without waiting for adaptation time 23 path 1 failed link path 2 Resilient Routing in the Pathlet Architecture Ashish Vulimiri and Brighten Godfrey University of Illinois at Urbana-Champaign Deploy innovative routing architecture deep into network switches across the US

Sponsored by the National Science Foundation 24 Feb 18, 2011 ActiveCDN GEC 9 experiment demonstration ActiveCDN Kansas Utah Clemson Benefits of ActiveCDN: Dynamic deployment based on load Localized services such as weather, ads and news Benefits of ActiveCDN: Dynamic deployment based on load Localized services such as weather, ads and news GPO Jae Woo Lee, Jan Janak, Roberto Francescangeli, SumanSrinivasan, Eric Liu, Michael Kester, SalmanBaset, Wonsang Song, and Henning Schulzrinne Internet Real-Time Lab, Columbia University Program content distribution services deep into the network, adapt distribution in real time as demand shifts

Sponsored by the National Science Foundation 25 Feb 18, 2011 Multi-radar NetCDF Data Nowcast Processing 1.Spin up system in Amazon commercial EC2 and S3 services on demand “raw” live data Generate “raw” live data ViSE/CASA radar nodes Generate “raw” live data ViSE/CASA radar nodes ViSE views steerable radars as shared, virtualized resources ViSE views steerable radars as shared, virtualized resources Nowcast images for display Nowcast images for display Weather NowCasting GEC 9 experiment demonstration David Irwin et al Create and run realtime “weather service on demand” as storms turn life-threatening

Sponsored by the National Science Foundation 26 Feb 18, 2011 GEC 9 experiment demonstration Aster*x Load Balancing (via OpenFlow) Nikhil Handigol et al, Stanford Univ. Program realtime load-balancing functionality deep into the network itself

Sponsored by the National Science Foundation 27 Feb 18, 2011 Outline GENI Basics for Experimenters Some Example Resources Some Example Experiments Please Get Involved

Sponsored by the National Science Foundation 28 Feb 18, 2011 Experiments Guide GENI Development GENI needs your feedback –As experimenters, you are the GENI user community –What works? Doesn’t work? Hasn’t been built yet? GENI Solicitation 3 addresses some key needs –Place more GENI-enabled switches in backbone and regional networks –Additional WiMax deployments –“GENI racks” for increased in-network storage and computation –Instrumentation –Experiment Support

Sponsored by the National Science Foundation 29 Feb 18, 2011 GENI’s next steps Substantially ramp up research experimentation –More experimenters, more experiments –Support experimenters via training, course materials, summer camps, and help desk –Transition to reliable operations Enhance the growing meso-scale GENI –Increase number of GENI-enabled campuses –Enhance build-outs in campuses and backbones –GENI-enable 5-6 regional networks –Deploy GENI-racks throughout US Begin to grow from meso-scale to “at scale” GENI We hope you will be a part of GENI’s success.

Sponsored by the National Science Foundation 30 Feb 18, 2011 Have an Experiment in Mind? GPO can help –Bring us in early –Advice on best match to your goals –Establishment of end-to-end VLANs –Some software support If interested, contact Mark Berman

Sponsored by the National Science Foundation 31 Feb 18, 2011 Want to affiliate your infrastructure? If so, you will become a new GENI “aggregate” –You own / operate your aggregate, and “affiliate” into GENI –You make (some of) your resources available for experiments –Examples: testbeds, campuses, regionals and backbone networks, commercial providers,... Three actions needed on your part –Download GENI API software, modify to reflect your infrastructure resources and local policies –Connect to GENI, ideally at Layer 2 but otherwise via GRE tunnel –Agree to GENI policies, sign MOUs, join GENI operations Reminder: GENI is still a really early prototype! If interested, contact Heidi Dempsey

Sponsored by the National Science Foundation 32 Feb 18, 2011 Conclusion GENI is entering an exciting phase! Nobody has done this before The GPO is here to help GPO Points of Contact Project Director: Chip Elliott, Architecture: Aaron Falk, Engineering: Heidi Dempsey, Experiments: Mark Berman,