NOVI: Networking innovations Over Virtualized Infrastructures STREP Project No. 257867, Call 5 – FIRE www.fp7-novi.eu NOVI OVERVIEW Prof. Vasilis Maglaris.

Slides:



Advertisements
Similar presentations
HOlistic Platform Design for Smart Buildings
Advertisements

Connect communicate collaborate OpenFlow in GN3s Network Factory GN3 OpenFlow Facility Joan A. García-Espín on behalf of JRA2-T5 Partners i2CAT, Barcelona.
DILIGENT Digital libraries powered by the Grid Peter Fankhauser
1 From Grids to Service-Oriented Knowledge Utilities research challenges Thierry Priol.
“Challenges and Methodologies
IEEE/FIPA WG Mobile Agents Ulrich Pinsdorf Fraunhofer-Institute IGD, Germany Dept. Security Technology
Kathy Benninger, Pittsburgh Supercomputing Center Workshop on the Development of a Next-Generation Cyberinfrastructure 1-Oct-2014 NSF Collaborative Research:
As computer network experiments increase in complexity and size, it becomes increasingly difficult to fully understand the circumstances under which a.
1 - Testbed Interoperability Pre-FIA Workshop, Athens, 17 April 2014 Social-Aware Virtual Network Embedding for Wireless Content Delivery SAViNE Chrysa.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
FEDERATED TEST-BEDS FOR LARGE SCALE INFRASTRUCTURE EXPERIMENTS.
Network Management Overview IACT 918 July 2004 Gene Awyzio SITACS University of Wollongong.
The Future of GÉANT: The Future Internet is Present in Europe Vasilis Maglaris Professor of Electrical & Computer Engineering, NTUA Chairman, NREN Policy.
Feb On*Vector Workshop Semantic Web for Hybrid Networks Dr. Paola Grosso SNE group University of Amsterdam The Netherlands.
F EDERATED V IRTUALIZED I NFRASTRUCTURES AND F UTURE I NTERNET R ESEARCH: The NOVI Experience Vasilis Maglaris Professor of Electrical & Computer Engineering,
FI-WARE – Future Internet Core Platform FI-WARE Cloud Hosting July 2011 High-level description.
June Amsterdam A Workflow Bus for e-Science Applications Dr Zhiming Zhao Faculty of Science, University of Amsterdam VL-e SP 2.5.
GGF16-ghpnD. Simeonidou Lambda User Controlled Infrastructure For European Research LUCIFER.
The Future Internet is Present in Europe Role of GÉANT and National Research & Education Networks - NREN’s : Use Cases of FEDERICA & NOVI Vasilis Maglaris.
Kostas Giotis, Yiannos Kryftis, Vasilis Maglaris
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
European Life Sciences Infrastructure for Biological Information ELIXIR
GN2 Performance Monitoring & Management : AA Needs – Nicolas Simar - 2 nd AA Workshop Nov 2003 Malaga, Spain GN2 Performance Monitoring & Management.
NTUA-NATIONAL TECHNICAL UNIVERSITY OF ATHENS School of Electrical and Computer Engineering The FEDERICA Concept: Federated E-Infrastructure Dedicated to.
Interoperability in the Cloud By Alex Espinoza
Science Research: Journey to 10,000 Sources Presented by: Abe Lederman, President and Founder Deep Web Technologies, Inc. Special Libraries Association.
Agenda Context and Vision FI-WARE Architecture
Software-defined Networking Capabilities, Needs in GENI for VMLab ( Prasad Calyam; Sudharsan Rajagopalan;
Sponsored by the National Science Foundation Programmable Networks and GENI Marshall Brinn, GPO GEC October 25, 2012.
RESULTS OF THE IRTF-NMRG Workshop Challenges for Future Research on Network and Service Management Jointly organized with EMANICS October 2006 – SURFnet.
Control-Plane Slicing Methods in Multi-Tenant Software Defined Networks IFIP/IEEE International Symposium on Integrated Network Management May 11, 2015.
RESOURCE MANAGEMENT AND TOPOLOGY EMBEDDING IN A DISTRIBUTED NETWORKED INFRASTRUCTURE ENVIRONMENT S. Papavassiliou, C. Papagianni NETMODE, NTUA I.Baldin,
COMMI T/ ONTOLOGY SESSION THURSDAY SEP. 17 Dr. Paola Grosso Assistant Professor SNE group - UvA Dr. Ilya Baldin Director, Networking Research.
FIRE – GENI collaboration workshop Sep 2015 Washington.
GEC3www.geni.net1 GENI Spiral 1 Control Frameworks Global Environment for Network Innovations Aaron Falk Clearing.
Advanced Next gEneration Mobile Open NEtwork Tridentcom th International Conference on Testbeds and Research Infrastructures for the Development.
GEC 15 Houston, Texas October 23, 2012 Tom Lehman Xi Yang University of Maryland Mid-Atlantic Crossroads (MAX)
TESTBED FOR FUTURE INTERNET SERVICES TEFIS at the EU-Canada Future Internet Workshop, March Annika Sällström – Botnia Living Lab at Centre for.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
OnTimeMeasure-GENI: Centralized and Distributed Measurement Orchestration Software Prasad Calyam, Ph.D. (PI) Paul Schopis, (Co-PI) Weiping Mandrawa (Network.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
Distributed Computing Environment (DCE) Presenter: Zaobo He Instructor: Professor Zhang Advanced Operating System Advanced Operating System.
Bob Jones Technical Director CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST
Connect. Communicate. Collaborate BANDWIDTH-ON-DEMAND SYSTEM CASE-STUDY BASED ON GN2 PROJECT EXPERIENCES Radosław Krzywania (speaker) PSNC Mauro Campanella.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GRID ARCHITECTURE Chintan O.Patel. CS 551 Fall 2002 Workshop 1 Software Architectures 2 What is Grid ? "...a flexible, secure, coordinated resource- sharing.
Enabling the Future Service-Oriented Internet (EFSOI 2008) Supporting end-to-end resource virtualization for Web 2.0 applications using Service Oriented.
A DVANCE AND I MMEDIATE R ESERVATIONS OF V IRTUALIZED N ETWORK R ESOURCES Laia Ferrao Fundació i2CAT
SDN Management Layer DESIGN REQUIREMENTS AND FUTURE DIRECTION NO OF SLIDES : 26 1.
Sponsored by the National Science Foundation GENI Aggregate Manager API Tom Mitchell March 16, 2010.
STREP Research Project HOBNET (FP7- ICT , ) HOlistic Platform Design for Smart Buildings of the Future InterNET (
Measuring reputation in Testbeds Chrysa Papagianni, Symeon Papavassiliou National Technical University of Athens.
Overview –Monitoring the slice(s) dynamically provisioned over the FELIX testbed Cooperates with the Resource Orchestrator (RO) for overall view – Hierarchical.
Virtualization as Architecture - GENI CSC/ECE 573, Sections 001, 002 Fall, 2012 Some slides from Harry Mussman, GPO.
Aneka Cloud ApplicationPlatform. Introduction Aneka consists of a scalable cloud middleware that can be deployed on top of heterogeneous computing resources.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
TERENA Conference, Maastricht, 6 th June 2013 Fabio Farina Fabio Farina (GARR), Simon Vocella (GARR), Álvaro Monje (UPC), Celia Velayos (i2Cat), Chrysa.
1 Network related topics Bartosz Belter, Wojbor Bogacki, Marcin Garstka, Maciej Głowiak, Radosław Krzywania, Roman Łapacz FABRIC meeting Poznań, 25 September.
OGF 43, Washington 26 March FELIX background information Authorization NSI Proposed solution Summary.
Designing a Federated Testbed as a Distributed System Robert Ricci, Jonathon Duerig, Gary Wong, Leigh Stoller, Srikanth Chikkulapelly, Woojin Seok 1.
System Software Laboratory Databases and the Grid by Paul Watson University of Newcastle Grid Computing: Making the Global Infrastructure a Reality June.
Bob Jones EGEE Technical Director
ΕΘΝΙΚΟ ΜΕΤΣΟΒΙΟ ΠΟΛΥΤΕΧΝΕΙΟ - Ε. Μ. Π
FEDERICA Federated E-infrastructure Dedicated to European Researchers Innovating in Computing network Architectures Mauro Campanella - GARR Joint Techs.
GENUS Virtualisation Service for GÉANT and European NRENs
Joan A. García-Espín (i2CAT)
NOVI: Networking innovations Over Virtualized Infrastructures
DRIVER Digital Repository Infrastructure Vision for European Research
GENI Exploring Networks of the Future
Presentation transcript:

NOVI: Networking innovations Over Virtualized Infrastructures STREP Project No , Call 5 – FIRE NOVI OVERVIEW Prof. Vasilis Maglaris (NETMODE/NTUA) Dr. Chrysa Papagianni (NETMODE/NTUA) GENI Engineering Conference – GEC 18 Brooklyn, New York, October 2013

NOVI’s Objectives NOVI targets innovative research in a bottom-up approach, addressing a critical area in FI services: How FI users securely share a multi-domain networking substrate. NOVI builds a set of algorithms, methods and services for control and management of federated virtualized infrastructures. Provide experimenters the ability to request, reserve, use and update a basket of virtualized resources in a federated environment, tailored to their needs.

NOVI’s Objectives

The Consortium 4 1. National Technical University of Athens - NTUA (Greece) 2. Martel GmBH (Switzerland) 3. Université Pierre & Marie Curie - UPMC (France) 4. Consortium GARR (Italy) 5. Universiteit van Amsterdam - UvA (Netherlands) 6. Fundació i2CAT (Spain) 7. DFN Verein (Germany) 8. Institut National de Recherche en Informatique et en Automatique - INRIA (France) 9. Eötvös Loránd Tudományegyetem - ELTE (Hungary) 10. Poznan Supercomputing and Networking Center - PSNC (Poland) 11. Cisco Systems International B. V. (Netherlands) 12. Fraunhofer - Gesellschaft zur Förderung der angewandten Forschung e.V. (Germany) 13. Universitat Politècnica de Catalunya – UPC (Spain)

NOVI’s Technical Approach Design and implement a modular data, control and management plane architecture as an integrated prototype implementing: – An ontology-based Information Model capturing the abstractions of virtualized resources and services across different platforms. – A framework providing interoperability of monitoring tools across federated heterogeneous platforms. – A semantic distributed resource discovery and mapping framework tackling the inter-domain virtual network embedding problem. – A policy-based management framework able to enforce intra and inter-domain management policies. – Data-plane stitching mechanisms towards transparent data-plane connectivity across dissimilar platforms involved in multi-domain user-slices.

NOVI – Information Model

The NOVI Information Model Background

NOVI Control & Management Architecture

NOVI External Components Build on top of Slice Federation Architecture – SFA – FEDERICA adapter 1.Acts like an Aggregate Manager 2.Acts as the C&M plane for FEDERICA 3.Extended RSpec ProtoGENI v2 Prompted the development of the Generic SFA Wrapper by NOVI partners (

Innovative NOVI Services (1/4) NOVI API – Exposes services provided by NOVI service layer e.g. combined slice creation, slice deletion, resource cross-listing – Feedback component: captures interactively how a user request is being handled within NOVI service layer Request Handler – Invokes appropriate operations to the corresponding SFA APIs o Handles resource provisioning requests to the underlying platforms o Enables information retrieval from test beds o Translates NOVI IM to PlanetLab/FFEDERICA RSpec and vice versa. – Triggers calls to the NSwitch service

Innovative NOVI Services (2/4) NSwitch Service – Provides L2 connectivity between resources of the same slice residing in different domains: PlanetLab (slivers) and FEDERICA (Logical Routers) – Ethernet over GRE traffic originating from PlanetLab slivers is translated to FEDERICA VLAN tagged traffic via the NOVI NSwitch Resource Information Service (RIS) – Responsible for collecting information about available resources across the federation and providing it to other NOVI services. – Maintains information about slices, users and policies – Resource discovery/ registration /reservation

Innovative NOVI Services (3/4) Monitoring Service – Handles the available monitoring tools in a uniform way – Harmonizes the measurement data that the tools provide – Triggers substrate / slice passive or active monitoring – Slice Monitoring API View instantiated slices via Platform specific GUIs Keep track of monitoring information Submit slice monitoring tasks into the NOVI federated testbeds

Innovative NOVI Services (4/4) Policy Service – Policy based management system / Ponder2 policy framework. – Policies o Intra-domain (Access Control, Event-Condition-Action, Role Based Access Control - RBAC) o Inter-domain (Mission). Intelligent Resource Mapping Service – Orchestrates the creation of a new combined slice – Combined Slice Embedding; decides upon the strategy for dealing with the various sub-problems of the mapping process (Multi-domain Virtual Network Embedding) – Facilitates slice re-embedding e.g., upon node failure

Publications: Selected Journals (1/2) J. van der Ham, J. Steger, S. Laki, Y. Kryftis, V. Maglaris, C. de Laat, “The NOVI Information Models”, Elsevier Future Generation Computer Systems (to appear). K. Giotis, C. Argyropoulos, G. Androulidakis, D. Kalogeras, V. Maglaris, “Combining OpenFlow and sFlow for an effective and scalable Anomaly Detection and Mitigation mechanism on SDN Environments”, Elsevier Computer Networks (to appear). C. Papagianni, A. Leivadeas, S. Papavassiliou, V. Maglaris, C. Cervello-Pastor, A. Monje, "On the Optimal Allocation of Virtual Resources in Cloud Computing Networks," IEEE Transactions on Computers, vol. 62, no. 6, pp , June, A. Leivadeas, C. Papagianni, S. Papavassiliou, "Efficient Resource Mapping Framework over Networked Clouds via Iterated Local Search based Request Partitioning”, IEEE Transactions on Parallel and Distributed Systems, Vol. 24, Issue 6, pp , June 2013.

Publications: Selected Journals (2/2) W. Adianto, R. Koning, P. Grosso, A. Belloum, M. Bubak, C. de Laat, “OIntEd: online ontology instance editor enabling a new approach to ontology development”, Journal of Software: Practice and Experience, doi: /spe.2141, July 2012 L. Lymberopoulos, M. Grammatikou, M. Potts, P. Grosso, A. Fekete, B. Belter, M. Campanella and V. Maglaris, "NOVI Tools and Algorithms for Federating Virtualized Infrastructures", Lecture Notes in Computer Science / Information Systems and Applications (LNCS), Springer, Vol. 7281, May

Publications: Selected Conferences (1/2) C. Argyropoulos, G. Androulidakis, D. Kalogeras, B. Pietrzak, B. Belter, L. Lymberopoulos, V. Maglaris, "Network Virtualization over Heterogeneous Federated Infrastructures: Data Plane Connectivity", IFIP/IEEE Integrated Network Management Symposium (IEEE IM 2013), Ghent, Belgium, May 2013 S. Vocella, A. Monje, C. Velayos, F. Farina, C. Papagianni, V. Maglaris and M. Campanella, “Complex federated slices provisioning through SFA: The FEDERICA and NOVI joint experience”, TERENA Networking Conference 2013, Maastricht, Netherlands, 3-6 June C. Pittaras, M. Ghijsen and Wibisono, W. Adianto, P. Grosso., J. van der Ham, and C. de Laat, “ Semantic Distributed Resource Discovery for Multiple Resource Providers”, in Proc., In: Proceedings of the 8th International Conference on Semantics, Knowledge and Grids, Beijing, China, Oct 22-24, 2012 (SKG)

Publications: Selected Conferences (2/2) L. Lymberopoulos, P. Grosso, C. Papagianni, D. Kalogeras, G. Androulidakis, J. van der Ham, C. de Laat and V. Maglaris: Managing Federations of Virtualized Infrastructures: A Semantic-Aware Policy Based Approach. Third IEEE/IFIP International Workshop on Management of the Future Internet (ManFI 2011), Dublin, Ireland, May 27, B. Hullár, S. Laki, J. Stéger, I. Csabai, and G. Vattay: SONoMA: A Service Oriented Network Measurement Architecture, TRIDENTCOM 2011, April 2011, Shanghai, China (2011) J. van der Ham, C. Papagianni, J. Steger, P. Matray, Y. Kryftis, P. Grosso and L. Lymberopoulos, "Challenges of an Information Model for Federating Virtualized Infrastructures", In 5th International DMTF Academic Alliance Workshop on Systems and Virtualization Management: Standards and the Cloud, Paris 24 Oct

Need for Federated FI Testbeds: The NOVI Experience Validation of NOVI innovative services over small scale representative stitched testbeds – FEDERICA: controlled virtualized environment (networking and computing resources) - modeling a private virtualized Data Center (IaaS) with commercial middleware (VMware ESXi, Juniper Junos) – Private PlanetLab installations - modeling public cloud PaaS. NOVI relied on wide area networking resources (L2/L3 connectivity) and expertise from NRENs and GÉANT NOVI faced complex SW engineering issues for delivering a stable distributed approach – Building upon GENI and FIRE basic services 18

Lessons Learned Greatest challenge: to orchestrate a multi-national, multi-faceted consortium towards delivery of innovative FI services as stable proofs of concept The NOVI consortium combined: – Academic excellence (Universities &Research Centers) – SW development skills (Laboratories active in FI R&D) – Operational experience (NRENs) – Industrial insight of a major vendor (Cisco) NOVI profited from strong links with the global FI community (FIRE, GENI, NRENs, GÉANT, Internet2…) 19

Thank you…