GEMINI Indiana University, University of Kentucky

Overview Combine U. Kentucky’s INSTOOLS, perfSONAR and Periscope Support scalable, high-rate measurement across layers – Including infrastructure

Measurement Points Produce measurement data Send data to a Measurement Store Send metadata to UNIS Standard perfSONAR and INSTOOLS MPs BLiPP (Basic Lightweight Periscope Probes) – High rate host monitoring – Adjustable frequency NetLogger and Calipers for application monitoring – Addressing scalability with in-line analysis and summarization – Example: system call monitoring to determine file transfer bottleneck

Measurement Store Stores Measurement data (I know you didn’t see that coming) Supports high-rate data transfers Publish/Subscribe interface Multiple tiers with different characteristics – Surge tank near the source – Bottom of rack – Parallel storage for slice-wide data

MAP Measurement/Management and/Analysis Presentation Service Configuration GUI Visualize data (from MS) Visualize topology (obtained from UNIS)

Portal “One stop shop” to integrate various MAP services

MC Measurement controller/coordinator Initiates measurement collection Coordinates measurements Fetches data from some MPs

UNIS Directory service Topology data – As well as changes Service data Measurement metadata

Cross cutting RESTful interface to perfSONAR (Periscope) GEMINI Event Messaging Service (GEMS) – High rate data with JSON/BSON

Portal Login Windowing Standard Views Prefs Operator User CF Control FLACK GUSH Other… IM Control INSTOOLS UNIS Other… Measurement Graphs/Tables INSTOOLS Periscope MAP Other… CMS Interface Drupal Runtime Interface -VNC Archive Interface Control Framework Services Archive MP 1 MP 2 MP 3 MP n CM SA Storage Services … VM to run archive Services … VM to run archive CH MCCMS Local/Pri vate Storage Local/Pri vate Storage Control And (Data) Collection Control And (Data) Collection AuthN/Z UNIS INSTOOLS GMOC iRODS - Shells Lab Book Management and Presentation (MAP) I&M Services GENI Resources

GEMINI Architecture GEMINI Global Registry (UNIS) GENI I&M Archive GENI I&M Archive Portal and MAP ✓ ✓ ✓ ✓ ✓ ✓ Event Messaging Service perfSONAR (REST and SOAP) MP Measurement Points MP Measurement Points BLiPP MP NEW (Openflow, Layer2, Virtual Machine) NEW (Openflow, Layer2, Virtual Machine) Meas. Stores MA GENI AuthN/Z Instrumentize GENI RACKS GEMINI SLICE GEMINI SLICE MC Measurement Controller / Collector MC Measurement Controller / Collector Network MS

Status Initial merger of INSTOOLS, Periscope and perfSONAR (LAMP) MC functionality running together – Some duplicate functionality Development workflow Migration to github Jira Collection of “user stories”

Demo Topology

Bottleneck Detection