Experiments with Grid-enabled Network Control Plane in the PHOSPHORUS test-bed Bartosz Belter Poznan Supercomputing and Networking Center TERENA Networking Conference 2009 Malaga, Spain

TERENA Networking Conference 2009, Malaga, Spain AGENDA 1  From GMPLS to G 2 MPLS: The GMPLS protocol stack Introduction to G 2 MPLS  The PHOSPHORUS test-bed  Validation of the G 2 MPLS protocol stack The TNC 2009 demonstrations  Summary

TERENA Networking Conference 2009, Malaga, Spain FROM GMPLS… TO G2MPLS 2

TERENA Networking Conference 2009, Malaga, Spain The GMPLS protocol stack  Based on Quagga  The prototype released in the form of a XEN virtual machine Includes also all the needed system packages (libs and apps) a “plug – configure – play” approach for the user Available at the PHOSPHORUS web-site:  Four different kinds of controllers can be run depending just on the node configuration GMPLS border controller GMPLS edge controller GMPLS core controller GMPLS UNI-C controller

TERENA Networking Conference 2009, Malaga, Spain The PHOSPHORUS GMPLS w.r.t standards ASON architecture IETF (CCAMP) Protocol Controllers + some architectural aspects OIF Network Interfaces (UNI and E-NNI) PHOSPHORUS GMPLS

TERENA Networking Conference 2009, Malaga, Spain FROM GMPLS… TO G 2 MPLS 5

TERENA Networking Conference 2009, Malaga, Spain What is G 2 MPLS?  uniform interface for the Grid-user to trigger Grid & network resource actions  single-step provisioning of Grid and network resources (w.r.t. the dual approach Grid brokers + NRPS-es)  adoption of well-established procedures for traffic engineering, resiliency and crankback  exposes interfaces specific for Grid services  made of a set of extensions to the standard GMPLS JSDL schema v1.3 (GMPLS signalling) GLUE schema v1.3 (GMPLS routing) G2G2 G2G2 G2G2 G2G2 G.I-NNI G.E-NNI G.O-UNI G 2 MPLS NRPS Grid site A Grid site B Grid site C G.O-UNI

TERENA Networking Conference 2009, Malaga, Spain THE PHOSPHORUS TEST-BED 7 Transport Plane Control Plane Middleware and Applications

TERENA Networking Conference 2009, Malaga, Spain  ADVA FSP 3000RE-II (Lambda Switch) 15 pass through ports 6 local ports 3 physical units  Calient Diamond Wave (Fibre Switch) 60 ports 1 physical unit / 4 logical units (switch virtualization) G 2 MPLS test-bed – Transport Plane [1]

TERENA Networking Conference 2009, Malaga, Spain  Foundry XMR NetIron 8000 (Ethernet Switch) 2 x 4-port 10GE modules (XFP) 1 x 24-port 1GE module (SFP) 3 physical units  Allied Telesis AT-8000/S (Fast Ethernet Switch) Low-cost managed stackable Fast Ethernet switch PoE connectivity at the edge for VoIP phones and wireless access points 10/100 TX x 24 ports  Allied Telesis AT-9424T (Gigabit Ethernet Switch) 10/100/1000T x 24 ports 2 SFP bays G 2 MPLS test-bed – Transport Plane [2]

TERENA Networking Conference 2009, Malaga, Spain G 2 MPLS test-bed – Transport Plane [4] The PHOSPHORUS test-bed in PSNC

TERENA Networking Conference 2009, Malaga, Spain G 2 MPLS test-bed – Transport Plane [4] The PHOSPHORUS test-bed in UESSEX

TERENA Networking Conference 2009, Malaga, Spain THE PHOSPHORUS TEST-BED 12 Transport Plane Control Plane Middleware and Applications

TERENA Networking Conference 2009, Malaga, Spain  The Control Plane implemented by a set of G 2 MPLS node controlers Each of them operates exclusively on a Transport Network element (real or derived from partitioning) Each controller is interfaced to the Transport Network equipment (Southbound Interface) through TL1 (ADVA, CALIENT), CLI (Allied Telesis) and SNMP (Foundry XMR) Node controllers run on i bit platform with Gentoo Linux distribution  Signaling Control Network (SCN) To transport signaling messages between the CP components Each G 2 MPLS exposes at least an interface on the Signaling Communication Network (SCN) over which the G 2 MPLS protocol messages flow SCN is IP-based with addresses from the private scope. IP tunnelling is used for out of band connectivity between controllers. G 2 MPLS test-bed – Control Plane [1]

TERENA Networking Conference 2009, Malaga, Spain  The configuration of the G 2 MPLS CP requires mapping of actual physical topology into the configuration files associated with each of the G2MPLS processes G 2 MPLS test-bed – Control Plane [2]

TERENA Networking Conference 2009, Malaga, Spain THE PHOSPHORUS TEST-BED 15 Transport Plane Control Plane Middleware and Applications

TERENA Networking Conference 2009, Malaga, Spain G 2 MPLS test-bed – GRID Middleware: UNICORE6  UNiform Interface to COmputing REsources  seamless, secure, and intuitive  Initial development started in two German projects funded by the German ministry of education and research (BMBF)  Continuous development since 2002 in several European projects  Core developers today from Europe: CINECA, ICM, Intel, FLE, FZJ

TERENA Networking Conference 2009, Malaga, Spain G 2 MPLS test-bed – Applications [1]  KoDaVis: Making Atmospheric Processes visible  WISDOM: Wide In Silicio Docking on Malaria  TOPS:Technology for Optical Pixel Streaming  SAGE: Scalable Adaptive Graphics Environment  DDSS: Backup/archive copies with TSM (Tivoli Storage Manager)

TERENA Networking Conference 2009, Malaga, Spain G 2 MPLS test-bed – Applications [2] KoDaVis: Making Atmospheric Processes visible  simulations of physical and chemical processes in the atmosphere help to understand the effect of human activities on the climate: data sets ~ 1000 GigaByte  visualization of data provides insight into processes

TERENA Networking Conference 2009, Malaga, Spain  KoDaVIS in Phosphorus: Adapt application to Phosphorus environment to make scheduled synchronous reservations of its resources via the UNICORE middleware Deploy at FZJ, FHG, PSNC to evaluate new Phosphorus services  Communication requirements: At visualisation sites: 700 Mbit/s, 10 msec latency At data-server site(s): n x 700 Mbit/s Traffic characteristics: 30 Mbit/s video (continuous) + bursty transfer of 3.3 MB data-slices CAVE, WorkBench HoloBench, (3D-Wall) Data & collaboration server (FZJ) Client Site A Client Site C Client Site B ~ 700 Mbit/s G 2 MPLS test-bed – Applications [3]

TERENA Networking Conference 2009, Malaga, Spain EXPERIMENTS WITH THE G2MPLS PROTOCOL STACK 20 The TNC09 demo: Integration of KoDaVIS with G 2 MPLS The TNC09 demo: DDSS Backup

TERENA Networking Conference 2009, Malaga, Spain Experiments with KoDaVIS, UNICORE and G 2 MPLS  Main building blocks: Application: KoDaVIS Grid Middleware: UNICORE Grid-aware Network Control Plane: G 2 MPLS

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 KoDaVIS demo – Transport Plane

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 KoDaVIS demo – Control Plane

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 demo – application scenarios [1]  Scenario 1: „Reduced” overlay mode  Scenario 2: Overlay mode  Scenario 3: Integrated mode

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 demo – application scenarios [2] Scenario 1: „Reduced” overlay mode  No routing information about the network layer in Grid Middleware  The scheduler just asks for a network path from the application client to server G.OUNI gateway KoDaVIS Session Manager Request for network QoS from client to server Network Reservation Request Activity endpoint Create Network SLA KoDaVIS client KoDaVIS Data server Create new session UNICORE clientMSS Load the visualisation connect Monitor SLA

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 demo – application scenarios [3] Scenario 2: Overlay mode  Grid Layer has both, Grid and network routing knowledge  Grid scheduler responsible for initiation and coordination of the reservation process through the participating Grid sites and the network  G 2 MPLS acts as an e2e information bearer for network and Grid resources information

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 demo – application scenarios [4] Scenario 2: Overlay mode (cont.) G.OUNI gateway KoDaVIS Session Manager Network Reservation Request Activity endpoint Create Network SLA KoDaVIS client KoDaVIS Data server Create new session UNICORE client MSS Load the visualisation connect Request for routing information Routing information Request for network QoS from client to any server Selection of data server Monitor SLA

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 demo – application scenarios [5] Scenario 3: Integrated mode  Most of the functionalities for resource advance reservation and co- allocation are moved to the Network Control Plane  G 2 MPLS acts as an e2e information bearer for network and Grid resources information

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 demo – application scenarios [6] Scenario 3: Integrated mode (cont.) G.OUNI gateway KoDaVIS Session Manager Network Reservation Request to any server Activity endpoint Create Network SLA KoDaVIS client KoDaVIS Data server Create new session UNICORE client MSS Load the visualisation connect G 2 MPLS CP Monitor SLA Request for network QoS from client to any server Select a server and reserve the network QoS Publish the server address

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 KoDaVIS demo

TERENA Networking Conference 2009, Malaga, Spain EXPERIMENTS WITH THE G2MPLS PROTOCOL STACK 31 The TNC09 demo: Integration of KoDaVIS with G 2 MPLS The TNC09 demo: DDSS Backup

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 DDSS demo (1)  Main building blocks: Application: DDSS - GridFTP Grid Middleware: none Grid-aware Network Control Plane: G 2 MPLS

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 DDSS demo (2)  The G 2 MPLS Control Plane handling requests of the Distributed Data Storage System (DDSS) application: The multi-domain and multi-technology test-bed Two network domains: –LSC domain (3 x ROADM ADVA FSP 3000RE-II) – PSNC –FSC doman (4 virtualized nodes based on Calient DiamondWave FiberConnect) – UESSEX –Domains interconnected with the 1 Gbit/s GÉANT2 data plane link  The DDSS application offers the large files backup service using Grid- FTP (part of the Globus toolkit)  The DDSS client application is located in PSNC and remotely connected to the TNC09 booth  DDSS uses the anycast feature of G 2 MPLS (Integrated mode)

TERENA Networking Conference 2009, Malaga, Spain The TNC2009 DDSS demo (3)

TERENA Networking Conference 2009, Malaga, Spain ACKNOWLEDGMENTS AND CONCLUSIONS 35

TERENA Networking Conference 2009, Malaga, Spain Acknowledgments  G 2 MPLS development team Nicola Ciulli, Gino Carrozzo, Giacomo Bernini, Francesco Salvestrini, Giodi Giogi, Giada Landi for their hard work on the G 2 MPLS control plane design and development Damian Parniewicz, Kuba Gutkowski, Łukasz Łopatowski, Krzysztof Dombek, Artur Juszczyk for their significant input to design and development and all testbed-related activities Eduard Escalona, Reza Nejabati for their support and the gateways development  Grid Middleware and Application team Bjorn Hagemeier and Karl Catewicz for their support with the UNICORE6 and KoDaVIS integration Adam Zawada for his involvement and hard work on the DDSS demonstration

TERENA Networking Conference 2009, Malaga, Spain Summary  Currently, the Open Source G 2 MPLS protocol stack supports the representatives from three main technology areas: LSC, FSC and Ethernet The stack is extendable: quick and simple development of the extensions in support of different vendors and equipment Extensions for low-cost Ethernet switches has just been developed and tested  PHOSPHORUS G 2 MPLS is backward compatible with ASON/GMPLS Provides „legacy” ASON/GMPLS transport services and procedures This compliance fosters the possible integration of Grids in operational and/or commercial networks  G 2 MPLS allows to run any kind of applications, even not bridged by Grid Middleware. It is possible to connect the application directly to the network through G.OUNI, bypassing existing gateways developed for UNICORE Corba interfaces allow easy plug&play of external applications in the G 2 MPLS framework

Bartosz Belter TERENA Networking Conference 2009 Malaga, Spain, June 8 th – 11 th 2009 Thank you. Questions?