Data Plane Measurements Deniz Gurkan June 26 th, 2009

D. Gurkan2 2 GENI Spiral 1: 5 Control Framework Clusters (29 Projects) DETER Trial Integration Cluster A Cluster B PlanetLab Enterprise GENI GUSH Tools Provisioning Service Mid-Atlantic Crossroads GpENI SPP Overlay Hosting Nodes Cluster C ProtoGENI Virtual Tunnels CMU Testbeds Instrumentation Tools Measurement System Studies GENI Meta Operations Security Architecture Data Plane Measurements Optical Access Networks Cluster D ORCA/BEN Vehicular Mobile Network Sensor/Actuator Network Kansei Sensor Network Cluster E Orbit Framework WiMAX PICK ONE Programmable Edge Node GENI at 4yr Colleges Million Node GENI Regional Opt-In Digital Object Registry Embedded Real-time Measurements

Outline D. Gurkan3 1.Review all Substrate Technologies* 2.Embedded Measurements* 3.Milestones 4.Suggested External Measurements a.Desired Attributes: networking b.Desired Attributes: reconfiguration and programmability c.An example case * Based on the “Spiral-1 Substrate Catalog” GPO, J. Jacob.

Review all substrate technologies D. Gurkan4 SubstrateNetwork Infrastructure C – A TIEDRouters and computers Cluster B Mid Atlantic Network Regional optical network, 10 Gbps DWDM optical nodes, 10 Gbps Ethernet switches, computer servers GpENI Regional optical network, 10 Gbps optical switches, 10 Gbps Ethernet switches, Programmable Routers, Site-specific experimental nodes Enterprise GENI Campus wide programmable Ethernet switches Planet Lab SPP Overlay High performance overlay hosting nodes, netFPGA cards

Review cont. D. Gurkan5 Cluster C CMU Testbeds Small scale Emulab testbed, Residential small form-factor machines, Wireless emulator Proto-GENI Programmable Ethernet Switch, PC’s with NetFPGA cards Programmable Edge Node Intel 2855 network processor based programmable edge node Measurement System PC-based IP Packet monitors, Data Storage Systems SubstrateNetwork Infrastructure

Review cont. D. Gurkan6 SubstrateNetwork Infrastructure Cluster D BEN Regional optical network, optical fiber switch, 10 Gbps optical transport equipment, 10 Gbps Routers/Switches, Site-specific experimental nodes DOME Metro mobile network, variety of wireless interfaces, devices, wireless access points. ViSE Multi Sensor (camera, radar, weather station) Network Kansei Sensor Networks Wireless sensor networks C - E WiMAXIEEE e WiMAX base-station OrbitHeterogeneous and Mobile Wireless Testbeds

Measurements D. Gurkan7 1.Embedded Measurements: Readily available at the multi-purpose nodes (network nodes, other boxes) where transparency is dependent on the manufacturer’s design. Access is sometimes restricted to only through the vendor’s API where there is no direct access to the sensors (refer to GIMS). 2.External Measurements: Depending on needs assessment in a GENI control framework, external measurement instruments are investigated.

Example Embedded Measurements D. Gurkan8 Ciena CN 4200: Bit error rate, optical power Protocol specific performance monitoring (Remote Monitoring (RMON) for Ethernet connections) Performance monitoring on network services 2 x 10/100BaseT Ethernet ports for remote connectivity, and a RS-232 serial port for local craft access Adva FSP 3000: Optical performance monitoring SONET/SDH, physical layer, service availability PM threshold setting PM threshold crossing alerts FEC counters SNMP traps for alarm monitoring Fault Management Ethernet, RS-232 serial cable, SNMP, remote management via in-band channels Infinera DTN: Full digital access to the optical layer and performance monitoring, fault management. Ethernet- based craft interface, remote connection via the in- band management channel carried by the Optical Supervisory Channel (OSC) GpENI Mid-Atlantic Network Proto-GENI & BEN

Example Embedded Measurements D. Gurkan9 Polatis 24 Port Fiber Switch in BEN Monitor the optical power on a per port basis Ethernet, serial interface (RS232), or GPIB. NOTE: Measurement Applications Enabled by the Fiber Switch Receiver and transmitter testing BER Jitter and protocol testing Source:

Embedded Measurements D. Gurkan10 Cluster B Mid Atlantic Network – Adva Optical Network ( FSP 3000): Optical performance monitoring, FEC counters, SNMP traps for alarm monitoring – Nagios: Monitors network Health, round trip time between nodes – Ethernet Switches: Packet counters and error counters – Cricket: Graphing of network performance and optical performance monitoring data. GpENI – Ciena CN 4200: Bit error rate, optical power and performance monitoring. Enterprise GENI – OpenFlow: Gather statistics at a per flow entry on routers/switches. SPP Overlay – PlanetLab mechanisms for auditing outgoing traffic. – Generates real time charts of traffic associated with the slice. – NetFPGA: Programmable hardware

Cluster DCluster C Embedded Measurements D. Gurkan11 CMU Testbeds o Interface monitoring,tcpdump/pcap and Nagios-style monitoring of machine availability. Proto-GENI – Ethernet switches: Packet counters and error counters – Net FPGA: Programmable hardware Programmable Edge Node – Network Processor: Flow Statistics Measurement System – Capture packets associated with the experiment. – System utilization measurements via SNMP – Activity logs BEN – Polatis 32 fiber optical switch: Optical power measurement – Infinera DTN: Full digital access to the optical layer, digital performance monitoring DOME – Umass Server: SSIDs and BSSIDs, signal strength, noise level, and type of security Vise – NetCDF files: Raw reflectivity and Voltage data Kansei Sensor Networks – Kansei Doctor: measures the number of available nodes, their health, radio link quality and networking metrics relevant for sensor networks.

Embedded Measurements D. Gurkan12 Cluster E WiMax – NEC WiMax Base Station o PHY : Access mode, Frequency, DL:UL ratio, Channel BW, FFT size, Frame duration, TX output Power and # of sectors. o MAC: Head compression, ARQ, MBS support, Resource management o Network: IP protocols, Bridging/Routing and Packet handling. – Orbit Measurement Library o Record per flow or per packet measurements o Layer 2 and 3 measurements

Milestones Milestones Delivered Review all substrate technologies in spiral-1 Document embedded measurement capabilities As more substrate input is delivered to the substrate workgroup, we will revisit these deliverables. Future Milestones Identify external measurement equipment due May 30 th 2009 Describe the network connections for external measurements due August 31 st, 2009 D. Gurkan13

Some Notes on Embedded Measurements Control frameworks have been busy with preparing for the first prototype implementations. Embedded measurements (that are included in our report) are not all available in prototype implementations: – Integration of measurement resources as components into the aggregate manager may not be present. – Need-assessment for the embedded measurements has not been a priority. Most embedded measurements have been in the control plane serving layer 2/3 monitoring needs. D. Gurkan14

External Measurements Wireless 1.Anritsu MS269xA Signal Analyzer with Mobile WiMAX Measurement Software: IEEE802.16e RF signal characteristics 2.JDSU G7104A Multimaster Base Station Tester: Test and measure CDMA, WCDMA/HSPDA systems 3.JDSU GC7105A Base Station Analyzer: Test and maintenance of wireless communication systems 4.JDSU GC7106A RF Analyzer: Test and measure RF communication systems Optical 1.Anritsu MP1800A: Signal Quality Analyzer at 40 Gbps with Remote control Ethernet/GPIB 2.JDSU T-BERD/ MTS-8000: Full 40 G testing, 1550 nm optics (per ITU-T and GR-253 standards), G.826 and G.828 performance measurements with configuration capability on application modules. 3.Centellax TG1B1-A: 10G BERT with GPIB control Interface. D. Gurkan15

Desirable Attributes Networking of Instruments Remote access mechanisms Flexible API to interface with the aggregate managers across GENI Storage Re-configuration & Programmability Configure measurement parameters Re-program a measurement resource Slice a measurement instrument for multiple user access D. Gurkan16

Networking of External Measurement Instruments Remote access mechanisms: Ethernet, USB, other – include a computer (server) at each instrument site Interface to the instrument: (programmable) vendor API/drivers – couple with GENI control frameworks – Planetlab interface, rspecs – ORCA interface, NDL – ProtoGENI interface, Emulab Storage (experiment execution – data collection and analysis*): on-instrument, on-network, local, at researcher’s access point, ??? * “Lifecycle of a GENI Experiment”, GPO, V. Thomas. D. Gurkan17

Re-configuration of External Measurements Configure measurements as you can register/plan (resource discovery, tool discovery, etc.)* an experiment – what parameters are measured at which measurement resource at what granularity. E.g.: – optical power per wavelength channel, – at input of Infinera DTN at UH for the link between UH and Rice, – at a sampling frequency of 60 Hz. Reconfiguration availability: e.g. change sampling rate (need to know the range of configuration) * “Lifecycle of a GENI Experiment”, GPO, V. Thomas. D. Gurkan18

Programmability of External Measurements Re-program a measurement resource according to what your analysis requirements dictate: – Local analysis and then report instead of continuous raw data reporting – Upload custom measurement software to instruments Slicing of a measurement instrument similar to a resource being sliced – multiple researchers can access the same or different measurement parameters at the same time D. Gurkan19

Example Capabilities: An optical measurement instrument Bit error rate Polarization Mode Dispersion testing – PMD delay, PMD coefficient and second order values. Chromatic Dispersion testing – OTDR based method and phase shift method DWDM: Optical SNR, power and wavelength in the S, C, L bands. Optical spectrum analyzer(OSA) module Network connection to the instrument – Dedicated link – In-line Link-based measurements: the basis for end-to-end? – Infinera – Ciena – ADVA – Fujitsu Update frequency of measurements Desired sampling rate Event reporting Other exotic analysis D. Gurkan20

Thank you Questions? Suggestions? D. Gurkan21