Sponsored by the National Science Foundation GENI Welcome ! GENI Engineering Conference 11 Denver, Colorado Chip Elliott July 27,
Sponsored by the National Science Foundation 2 July 27, 2011 GENI Engineering Conferences Meet every 4 months to review progress together GEC 11: THANK YOU to everyone involved! GEC 12: November 2-4, Kansas City With many thanks to Prof. Deep Mehdi Subsequent Meetings, open to all who fit in the room –Held at regular 4-month periods; see GENI Wiki for dates / places –Geographic rotation through US (central, east, west) –Held on / near university campuses – volunteers? –Travel grants for participant diversity (US academics only)
Sponsored by the National Science Foundation 3 July 27, 2011 Professor Computer Science and Engineering, UCSD Division Director CNS Division, CISE National Science Foundation And inventor of something you use every day * Marzullo’s algorithm Check it out! Welcome from Dr. Keith Marzullo
Sponsored by the National Science Foundation GENI GENI Status and Outlook GENI Engineering Conference 11 Denver, Colorado Chip Elliott March 16,
Sponsored by the National Science Foundation 5 July 27, 2011 GENI is out of its start-up phase, and now growing rapidly Substantially ramp up research experimentation –Expand from today’s 20 experiment teams –Support experimenters via training, course materials, summer camps, and help desk –Transition to reliable operations Enhance the growing meso-scale GENI –Increase number of GENI-enabled campuses –Enhance build-outs in campuses and backbones –GENI-enable 5-6 regional networks –Deploy GENI-racks throughout US Begin to grow from meso-scale to “at scale” GENI
Sponsored by the National Science Foundation 6 July 27, 2011 Three-track format; we’re interested in suggestions New GEC format focuses on “ramp up” Experimenters Campus / Ops Software
Sponsored by the National Science Foundation 7 July 27, 2011 What’s new for GENI experimenters Tools are becoming more capable and easier to use. Point-and-click tools (e.g., Flack *, sface † ) Command-line tools (e.g., omni*, gush †, raven † ) Built-in tool support for multi-aggregate slices –Flack * support for connectivity via GRE tunnels, ION, and GpENI ‡, instrumentation via INSTOOLS † –Gush † and Raven † support mixed PlanetLab and ProtoGENI host configurations –Coming: stitching Experiment Templates “Standard” experiment designs that provide a starting place for many potential experiments Hands-on tutorials give experience with these templates (Tutorials: *Tuesday, † Wednesday, ‡ Thursday)
Sponsored by the National Science Foundation 8 July 27, 2011 GENI Experiment Templates GEC tutorials are now giving “Ready-to-Go” starting points Wide Area IP / non-IP experiments ProtoGENI + Internet2 at 8 sites Software routers (eg Click) Easy-to-use graphical interface NetServ Modular router components dynamically deployed to ProtoGENI hosts Today’s Meso-scale infrastructure 8 campuses with OpenFlow, ProtoGENI, and MyPLC, plus OpenFlow through Internet2, NLR IP and non-IP experiments using OpenFlow-controlled switches
Sponsored by the National Science Foundation 9 July 27, 2011 Go ahead and start experimenting! Get an account Stop by the GENI help table Instructions on the wiki Start experimenting Help is available –Mark Berman Learn how to use GENI Attend tutorials Visit the wiki: –
Sponsored by the National Science Foundation 10 July 27, 2011 Ramping up to reliable operations GENI Resource Workflow March 2011 (Aggregates supporting GENI AM API) Workflows Shakedowns & trial operations Operator tools GENI Recommended Use Policy GENI Aggregate Provider's Agreement m/Aggregate%20Provider%20Agreement%20v3.pdf GENI Emergency Stop y_Stop_System_Description_v5.1.doc GMOC Concept of Operations Concept-of-Operations-v2.1.doc Legal, Law Enforcement and Regulatory Plan m/LLR%20Responsibilities%20of%20GENI.pdf Policies
Sponsored by the National Science Foundation 11 July 27, 2011 Today’s meso-scale GENI Layer 2 slices span campuses, Internet2, and NLR Each VLAN contains ~ 25 OpenFlow switches and 40+ computers (PlanetLab & ProtoGENI) OpenFlow / FlowVisor manages slices within a VLAN Ongoing federated ops (8 campuses, 2 backbones, GMOC), each organization with its own operators, policies, etc. Now shaking down large-scale slices
Sponsored by the National Science Foundation 12 July 27, 2011 PlanetLab, ProtoGENI, OpenFlow resources spanning multiple campuses, Internet2, & NLR Want to plug your campus in? Send
Sponsored by the National Science Foundation 13 July 27, 2011 Ops shakedown via “Plastic Slices” Why? As mesoscale GENI moves towards production, exercise it with “plastic” experiments that represent constant regular use. (No real experimenters were harmed.) What? Ran 8 baselines over 2 months, with representative traffic flows. Used resources from campus OpenFlow and PlanetLab aggregates in 10 slices. GMOC and sites used early operations procedures. –Details & data at Conclusions –Most shakedowns ran as expected, but –Longer experiments are harder –Shakedowns improve mesoscale GENI –....and should continue after GEC11
Sponsored by the National Science Foundation 14 July 27, 2011 Please come participate (campus track) GENI Ops – Agreements and Policies GENI Recommended Use Policy GENI Aggregate Provider's Agreement Emergency Stop Procedure GMOC Concept of Operations Legal, Law Enforcement and Regulatory Plan Adopted Draft under review Operational Security Plan Operational Security Plan.pdf Operational Security Plan.pdf In process (working on drafts) Clearinghouse Policy Incident Response Plan More proposed - CampusTrack
Sponsored by the National Science Foundation 15 July 27, 2011 Open interfaces & interoperability Accomplishments since GEC 10 Common RSpecs In use at ProtoGENI and PlanetLab; coming soon for OpenFlow and ORCA Stitching End-to-end stitching demo today
Sponsored by the National Science Foundation 16 July 27, 2011 Open interfaces & interoperability Being worked out in this GEC Identity Portal issuing GENI credentials Federation Mutually beneficial agreements ABAC Authorization trial continuing RSpecs Compute Stitching Wireless Monitoring Status and health of GENI infrastructure Stitching APIs and schemas Wired Networks Wired Networks Flowspace ✔ Storage
Sponsored by the National Science Foundation 17 July 27, 2011 Looking forward Growing to the “at scale” GENI Suggest US campuses as target for “at scale” –Both academia and national labs –GENI-enable the campuses –Their students, faculty, staff can then “live in the future” using both today’s Internet and many experiments –Build out backbones, regionals, and shared clouds to support the campuses Grow via ongoing spiral development –Identify, understand, and drive down risks –Learn what is useful and what is not –Early GENI campuses can help later ones Transition to community governance
Sponsored by the National Science Foundation 18 July 27, 2011 Envisioned architecture Flexible network / cloud research infrastructure Also suitable for physics, genomics, other domain science Support “hybrid circuit” model plus much more (OpenFlow) Distributed cloud (racks) for content caching, acceleration, etc. Metro Research Backbones Internet ISP Regional Networks Campus g g g Legend GENI-enabled hardware Layer 3 Control Plane Layer 2 Data Plane
Sponsored by the National Science Foundation 19 July 27, 2011 Internet 2 NDDI slide?
Sponsored by the National Science Foundation 20 July 27, 2011 Growing GENI to campuses Spiral development ? 200? GENI racks, OpenFlow, WiMAX, training, ops Campus buildout Solicitation 3 efforts Campus expansions NEW
Sponsored by the National Science Foundation 21 July 27, 2011 Solicitation 3’s role in campus buildouts GENI Solicitation 3 –More WiMAX base stations with Android handsets –GENI-enable 5-6 regional networks –Inject more OpenFlow switches into Internet2 and NLR –Add GENI Racks to locations within campuses, regionals, and backbone networks GENI Racks serve as programmable routers, distributed clouds, content distribution nodes, caching or transcoding nodes, etc
Sponsored by the National Science Foundation 22 July 27, 2011 A new solicitation coming GENI-enabling 20+ campuses Growing to 20+, then campuses –Plan roughed out at 2 nd CIO workshop, July 7, 2011 (thank you EDUCAUSE) –“Buddy system” for each meso-scale campus to guide 2-3 new campuses –Increase GENI-enabled campuses from 14 to in a staged manner, over several years GENI candidate campuses are now being lined up –Two-person teams will visit candidate campuses this fall, helping campus CIOs draw up plans and proposal material –“Campus expansion” solicitation expected ~ Dec 2011 Create a proposal to GENI-enable your campus Larry Landweber is organizing this effort:
Sponsored by the National Science Foundation 23 July 27, 2011 GENI-enabled cities First concrete step in US Ignite activity Very strong interest from 6 US cities to date –Chattanooga, Cleveland, Lafayette LA, Philadelphia, Salt Lake City region, Washington DC –Their citizens will be able to “live in the future” Cities can be GENI-enabled very rapidly –We have visited all 6 cities for surveys, discussions –GENI rack, OpenFlow, and Layer 2 connectivity appear quite feasible –Can be federated into GENI very quickly Can support experimental, gigabit applications in GENI slices through cities –Creates tremendous new research opportunities
Sponsored by the National Science Foundation 24 July 27, 2011 Research Infrastructure for Computer Scientists Public-Private Partnership for Next-Gen Applications Future commercial offerings U.S. Ignite is a new organization that will promote advanced applications and infrastructure leveraging GENI research and technologies. CS Experiments Experimental Usage and Demonstrations Pre-commercial Applications Regional and backbone networks Campus and Lab Applied Research Campus networksMunicipal and commercial networks App creation teams GENI members, policies, … US Ignite members, policies, … GENI technology federation Service creators Commercial Applications GENI U.S. Ignite CS Research U.S. Ignite is now taking shape Bridging CS Experiments to Next-Gen Applications in Cities
Sponsored by the National Science Foundation 25 July 27, 2011 GENI moves to the next stage Ramp down of Solicitation 1 efforts (autumn)... –Some prototyping efforts will sunset as Sol 1 funds run out –Many will continue under Sol 2 / 3 funding –Others have funds remaining, will receive extensions... and major growth in GENI infrastructure –Rise in experimentation and continuous operations –Growth across 20+ campuses, regionals, and backbones –U. S. Ignite cities & next-gen applications coming online soon We’re looking for 20+ campuses to take GENI to the next stage –It’s really happening –If you want your campus to participate, talk to us!
Sponsored by the National Science Foundation 26 July 27, 2011 Internet pioneer –First Internet Exchange point (FIX) –First TCP/IP implementation for IBM PC –Routers for the first NSFNET backbone Community leader –DARPA program manager –Novell CTO –President & CEO of National LambdaRail... and Inventor * Ricart-Agrawala Algorithm Introducing Dr. Glenn Ricart, U.S. Ignite!