Sponsored by the National Science Foundation Meeting Introduction: Integrating GENI Networks with Control Frameworks Aaron Falk GENI Project Office June 25, 2009

Sponsored by the National Science Foundation 2 PRESENTATION DATE HERE Who’s Here? Rob Ricci, ProtoGENI Jon Duerig, ProtoGENI Guido Appenzeller, Enterprise GENI Rod Sherwood, Enterprise GENI Larry Peterson, PlanetLab Ilia Baldine, ORCA/BEN Yufeng Xin, ORCA/BEN Yogesh Mundada, DTunnels Nick Feamster, DTunnels Ted Faber, TIED Ivan Seskar, ORBIT/WiMAX Chris Tracy, GMOC Camilo Viecco, GMOC Harry Mussman, GPO Chris Small, GPO Chip Elliott, GPO Aaron Falk, GPO By phone: Max Ott, ORBIT James Sterbenz, GpENI Heidi Picher-Dempsey, GPO

Sponsored by the National Science Foundation 3 June 25, 2009 Key Goals for GENI Spiral 1 Drive down critical technical risks in GENI’s concept GENI Clearinghouse Components Aggregate A Computer Cluster Components Aggregate B Backbone Net Components Aggregate C Metro Wireless Create my slice Goal #1 Fund multiple, competing teams to develop GENI Clearinghouse technology, encourage strong competition within the first few spirals Goal #1 Fund multiple, competing teams to develop GENI Clearinghouse technology, encourage strong competition within the first few spirals Goal #2 Demonstrate end-to-end slices across representative samples of the major substrates / technologies envisioned in GENI Goal #2 Demonstrate end-to-end slices across representative samples of the major substrates / technologies envisioned in GENI

Sponsored by the National Science Foundation 4 June 25, 2009 Goals for this Meeting For each cluster answer: –How does a network device or aggregate represent/reserve resources? –How do network slivers join to form an end-to-end slice? Produce concrete examples, plans

Sponsored by the National Science Foundation Network Configuration Use Case (slightly updated excerpt from GEC2 presentation)

Sponsored by the National Science Foundation 6 June 25, 2009 Compute Cluster Network Interface Storage Aggregate Manager 10 GbE GbE Measurement 6 Sliver Creation: Computation Resources (1 of 3) 1. Researcher submits credentials and request to aggregate manager (AM) for resources, that includes a reservation time I want to reserve all the pieces to build my experiment, I will start with a CPU cluster, reserving the following 300 Processors 10 TB Local storage (multiple disks) 1 GbE and 10 GbE link capacity from network interface to CPU’s and 10TB drive CPU utilization measurement w/ data transfer rates 2. CM checks policies against credentials and accepts reservation by returning signed RSpec to User (called a ticket). A similar set of actions are performed for the other CPU cluster and storage array Metro Wireless Access CPU Cluster Optical Backbone Optical Edge CPU Cluster Regional Research Storage Server NSF GENI clearinghouse Slice & User Registry 3b. AM sends copy of ticket to Slice Registry (who tracks resources in each slice). At this stage, the researcher has a right to use specific resources (i.e., establish slivers) from several of the aggregates. However, these resources are not active and have not been composed into a coherent experiment. Resource Discovery Service 3a. AM sends schedule update with reservation information (resources and dates)    GID

Sponsored by the National Science Foundation 7 June 25, 2009 Sliver Creation: Aggregate Interconnection (2 of 3) GID Now that my edge processor resources are reserved, I need to establish data link connections across the multiple network domains. But, how do I set-up connections between two aggregates? Compute Cluster Storage 10 GbE GbE Measurement Processing Center Optical Edge/ Metro Wireless Regional Research Storage Server GIMS Aggregate Manager When the AM issues a ticket, the signed Rspec will contain interconnection parameters of each network reservation, e.g., port number, VLAN ID, source Ethernet address, so the OB AM can associate network resources in PC to those in OB. Aggregate Manager The reservation specifies network bandwidth between the 3 components and Optical Backbone. The Processing Center AM handles establishing requested internal network configuration. Connectivity to OB already exists. Optical Transport At this stage, the researcher has obtained payload mapping information from each of the aggregate managers. No connections have been established Optical Backbone Measurement This is repeated for the Regional Research, Storage Server, Optical Edge (and Metro Wireless) networks.

Sponsored by the National Science Foundation 8 June 25, 2009 Processing Center Optical Edge Regional Research Storage Server GIMS Aggregate Manager Optical Transport Optical Backbone 10GbE Measurement 3c. AM sends copy of ticket to Slice Registry 3b. AM sends status update with reservation information 2. AM checks policies against credentials and accepts reservation by returning signed RSpec to User 3a. AM maps payloads to interfaces and provides information in ticket returned to user 1. Researcher submits credentials, aggregate interconnection maps and request to aggregate manager (AM) for resources, that includes a reservation time Sliver Creation: Networking Resources (3 of 3) GID Metro Wireless Access CPU Cluster Optical Backbone Optical Edge CPU Cluster Regional Research Storage Server NSF GENI clearinghouse Slice & User Registry Resource Discovery Service    Now that aggregate interconnection mapping is established, I want to reserve the following resources: Optical multipoint topology from storage server to PC,OE, RR network interfaces FPGA framers on linecards mapped to 10GbE payload at each aggregate interface 1 GbE link capacity between Processing center and other aggregate interfaces BER and OSNR measurements on all links Measurement data transfer rates     At this stage, a complete slice reservation exists. However, until that reservation is exercised (i.e., tickets redeemed), active slivers cannot be programmed.

Sponsored by the National Science Foundation 9 June 25, 2009 Questions Is a standard method of describing network “coordinates” required? Does it go into the RSpec? Are there now constraints on the order in which networks can be added to a slice? How does work with multiple networks in series? How are ordering constraints handled in the control framework? How are tunnels (i.e., non-adjacent resources) handled?

Sponsored by the National Science Foundation 10 June 25, 2009 Today’s Agenda (ready to bash…)

Sponsored by the National Science Foundation 11 June 25, 2009 Ground rules for today Spiral 1 focus (i.e., by this fall) Different answers are OK for different clusters Shared responsibility between control framework & aggregate projects is required to solve this This is an engineering, not research, discussion