Sponsored by the National Science Foundation ORCA-BEN, ORCA-AUG Spiral 2 Year-end Project Review RENCI UNC-CH, Duke University PI: Ilia Baldine, Jeff Chase Staff: Yufeng Xin, Anirban Mandal, Chris Heermann, Aydan Yumerefendi Students: Prateek Jaipuria, Varun Marupadi (former) Visiting Scholar: Namgon Kim (GIST, Korea) 08/26/10 Project Graphic and/or Photo

Sponsored by the National Science Foundation 2 Project Summary Advanced control framework project, not a public testbed Open substrate with plugin interfaces –Eucalyptus/cloud –BEN Network elements across multiple layers –Dynamic circuit services (e.g., NLR Sherpa) –OpenFlow –Testbeds (ViSE, Kansei/NetEye, DOME) Integrated resource brokering (policies and federation) Extensible, future-proof, standards-based declarative resource descriptions –Drives allocation and coordinates stitching (limit “baked in” substrate assumptions) Configure network topologies using native dynamic circuit services Cloud integration and multi-domain cloud control Open identity management and authorization 08/26/2010

Sponsored by the National Science Foundation 3 Milestone & QSR Status (ORCA-BEN) IDMilestoneStatusOn Time? On Wiki? GPO signoff? S2.aRelease 2.0 ORCA code to projectsBella 2.0 release done on 03/14. COD deprecated. NLR Sherpa handler, XML-RPC ProtoGENI controller, actor registry, enhanced stitching support, Eucalyptus handler and policy LateYes S2.b Release 2.1 ORCA code to projectsBella 2.1 release being readied to be done this week (08/23). Numerous bug-fixes, restructured network drivers, actor NDL support, registry NDL support, OpenFlow support LateYesNo S2.c Release 2.2 ORCA code to projects Bella 2.2 final release. Expected Euca 1.6.x support (vms with mutliple interfaces), associated handler, bug-fixes Due 09/30 Yes S2.d Release 2.x ORCA code to projects Bella 2.2 is the last Spiral 2 releaseDue 09/30 Yes S2.e Operate, extend clearinghouse CH with broker and actor registry operational at and EarlyYes S2.f GMOC access to clearinghouse Details of actor registry API communicated to GMOC Due 09/30 Yes S2.g Cluster plan for VLANs between testbeds Connectivity between Cluster D members. Umass, Ohio State, Wayne State connected to StarLight, LEARN is awaiting switch installation On timeYes S2.h BEN testbed access by GENI users Several pre-GENI-experimenter workshop experiments run on BEN. GENI IMF experiments demonstrated. We are doing our own experiment outreach. BEN has little usable edge substrate. LateYes 08/26/2010

Sponsored by the National Science Foundation 4 Milestone & QSR Status (ORCA-BEN) IDMilestoneStatusOn Time? On Wiki? GPO signoff? S2.iBEN testbed access from remote sites Experiments on cross-layer protocols between Columbia and NCSU. BEN has little usable public edge substrate. LateYes S2.j VLANs from BEN to backbone BEN has direct NLR FrameNet connection. Sherpa support integrated into ORCA. On timeYes S2.k Integration w/ GUSH Interoperate with GUSH tools. An XML-RPC plug-in controller is being developed/enhanced for use by GUSH. LateYes S2.l Experiments on BEN and other testbeds Several demos run between BEN and ViSE (GEC7 and GEC8) LateYes S2.m POC to GENI response team Chris HeermannLateYes S2.n POC to GENI security team Chris HeermannLateYes S2.o Contribution to GENI outreach Chase helped organize Tridentcom; Held discussions with multiple experimenter candidates (e.g. Xiaowei Yang (Duke), Don Smith, Kevin Jeffay, Jasleen Kaur (UNC CH)); continuing discussions with SNE UvA group. Due 09/30 Yes QSR: 4Q2009Submitted/ApprovedOn TimeYes QSR: 1Q2010 Submitted/Approved On TimeYes QSR: 2Q2010 Submitted/Approved On TimeYes 08/26/2010

Sponsored by the National Science Foundation 5 Milestone & QSR Status (ORCA-AUG) IDMilestoneStatusOn Time? On Wiki? GPO signoff? S2.aRelease 2.0 ORCA code to projectsBella 2.0 release done on 03/14. COD removed. NLR Sherpa handler, XML-RPC ProtoGENI controller, actor regustry, enhanced stitching support, Eucalyptus handler and policy LateYes S2.b Release 2.1 ORCA code to projectsBella 2.1 release being readied to be done this week. Numerous bug-fixes, restructured network drivers, actor NDL support, registry NDL support, OpenFlow support LateYes S2.c Release 2.2 ORCA code to projects Bella 2.2 final release. Expected Euca 1.6.x support (vms with mutliple interfaces), associated handler, bug-fixes Due 09/30 Yes S2.d Release 2.x ORCA code to projects Bella 2.2 will be the last release for Spiral 2Due 09/30 Yes S2.e Single registry of brokers Actor registry available from Bella 2.0Early 03/14 Yes S2.f Query broker for available resources Available as part of core ORCA functionality. Extended to support NDL in Bella 2.1 upcoming release Late (07/20) Yes S2.g Broker authorization based on attributes from Shibboleth Demonstrated at GEC8LateYes S2.hEucalyptus VM provisioningDemonstrated at GEC7 and GEC8. ORCA provisions VMs using EC2 interface and attaches them to a given VLAN. On TimeYes S2.iFirst ontology workshopHeld in conjunction with GEC7On TimeYes S2.jFirst draft of ontology schemaDocumented on TimeYes S2.kSecond ontology workshopHeld in conjunction with GEC8On TimeYes 08/26/2010

Sponsored by the National Science Foundation 6 Accomplishments 1: Advancing GENI Spiral 2 Goals (1/2) Continuous Experimentation –Early experiments for pre-GENI-experimenter workshop –Early IMF experiments –Joint ViSE/BEN demos of sensor/cloud integration Integration –Integrated DOME, ViSE, Kansei/NetEye testbeds Instrumentation and Measurement –Closely working with IMF, ERM and LEARN to run experiments on BEN (incremental demos at GEC7 and 8; full demo at GEC9) 08/26/2010

Sponsored by the National Science Foundation 7 Accomplishments 1: Advancing GENI Spiral 2 Goals (2/2) Interoperability –Developing ProtoGENI/AM-API (XML-RPC) ORCA controller Subject to resource representation conversion constraints NS2->NDL converter exists, ProtoGENI RSpec-> NDL being developed Identity/authorization is an issue for AM-API –Resource representation workshops Identity Management –Planning for/with Shibboleth –Demonstrated Shibboleth “edge” integration –SFA 2.0 opens de facto GENI standard to external IdPs –Relationship to ABAC 08/26/2010

Sponsored by the National Science Foundation 8 Accomplishments 2: Other Project Accomplishments We are pursuing an alternative CF vision that supports GENI long-term goals and is practical, inclusive and sustainable. –GENI as advanced multi-domain deeply-networked IaaS cloud orchestration Integrate with other substrates without owning them or requiring dedicated resources. Leverage standard provisioning interfaces Declarative resource representations (NDL+ ontology) Open substrate integration: –Example Eucalyptus integration demonstrates how GENI can use “ExoGENI” substrates –OpenFlow integration Connectivity: –Deployed ORCA-controlled switch at StarLight/iGENI to inter-connect Cluster D –Also enables connections to ESNet and I2 ION Multi-domain provisioning using dynamic circuit services: –Joint demos with ViSE and iGENI/StarLight Building on declarative W3C-standard based resource descriptions –Policies, queries, format converters 08/26/2010

Sponsored by the National Science Foundation 9 Issues SFA 2.0 vs. GENI AM API 1.0 conflict –Settling on AM API 1.0 as the basis for interoperability conflicts with our milestones (e.g. Shibboleth integration and others), our development path, and GENI standardization path Need for open substrate –CFs living above substrate, not “baked on” is the best guarantee of interoperability –Provides easy path for future new substrate integration Virtualization Models –GENI should leverage industrial-strength virtualization –Performance of VT for deeply-networked applications an issue (e.g. SR-IOV) –Support for bare-metal provisioning still useful/essential Identity/authorization issues are a barrier to interoperability –These should be factored out of CF and run as an external service, rather than reimplemented in each CF and managed independently for each testbed. 08/26/2010

Sponsored by the National Science Foundation 10 Plans What are your plans for the remainder of Spiral 2? –Consolidation and bug fixes –Preparing for GEC9 demos supporting experiments –Production testbed (and finding funding) The GPO is starting to formulate goals for Spiral 3. What are your thoughts regarding potential Spiral 3 work? –More open substrate integration (ORCA-BEN) ESNet, ION, MAX xCAT –Enhanced Shibboleth integration (ORCA-AUG) –NDL extensions, RSpec -> NDL conversion tools (ORCA-BEN) –User experiment tools (Gush, others) (ORCA-BEN) –Complex topology embedding (ORCA-AUG) –Monitoring and testing against deployment (ORCA-BEN) –“Virtual autonomous systems” on shared infrastructure 08/26/2010