MPlane – Building an Intelligent Measurement Plane for the Internet Alessandro D’Alconzo FTW Forschungszentrum Telekommunikation Wien, AT

Slides:



Advertisements
Similar presentations
Geneva, Switzerland, 17 October 2011 ITU Workshop on Service Delivery Platforms (SDP) for Telecommunication Ecosystems: from todays realities to requirements.
Advertisements

Future Internet boosting Creativity in Europe: XIFI Project Jose Gonzalez Universidad Politecnica Madrid
§ Project acronym: mPlane Project full title: “mPlane – an Intelligent Measurement Plane for Future Network and Application Management” Grant agreement.
MPlane: project and architecture The need of an intelligent measurement plane for the internet FIRE-GENI workshop May 5-6, Cambridge USA Disclaimer: I’m.
1/20 Cloud Computing SLAs in FP7 Bruxelles, May 27, 2013 mPlane – an Intelligent Measurement Plane for Future Network and Application Management MPLANE.
Joint CASC/CCI Workshop Report Strategic and Tactical Recommendations EDUCAUSE Campus Cyberinfrastructure Working Group Coalition for Academic Scientific.
The TETRACOM Approach to Technology Transfer Rainer Leupers ICE - Institute for Communication Technologies and Embedded Systems RWTH Aachen University.
1 st Review Meeting, Brussels 5/12/12 – Technical progress (P. Paganelli, Bluegreen) iCargo 1st Review Meeting Brussels 5/12/12 Technical.
Unified Logs and Reporting for Hybrid Centralized Management
COST Telecommunications and Information Science and Technologies.
Advanced Data Mining and Integration Research for Europe ADMIRE – Framework 7 ICT ADMIRE Overview European Commission 7 th.
Applying MDA in the ATM: A practical approach Teodora Bozheva, Terry Bailey (ESI) Julia Reznik, Tom Ritter (Fraunhofer FOKUS)
The Plane distributed measurement infrastructure Overview, insights & hindsights Journée du Conseil Scientifique de l’Afnic, #JCSA2015, July 9 th 2015.
All Optical Access Platforms for Fiber to the Home Networks Francesco Matera, Alessandro Valenti, Edion Tego, In cooperation with.
MPlane – Building an Intelligent Measurement Plane for the Internet Maurizio Dusi – NEC Laboratories Europe NSF Workshop on perfSONAR.
MPlane – Building an Intelligent Measurement Plane for the Internet A quick overview.
Application and Usage of Cloud Computing and Data Security
1 MultimEDia transport for mobIlE Video AppLications 9 th Concertation Meeting Brussels, 13 th February 2012 MEDIEVAL Consortium.
Exploring Europe's Television Heritage in Changing Contexts Connected to: Funded by the European Commission within the eContentplus programme
mPlane – Building an Intelligent Measurement Plane for the Internet
Open APIs for Open Minds Nuria de Lama, Atos Research & Innovation Future Internet Public Private Partnership in EU FI-WARE: Overview.
Project Presentation.
Large Scale Broadband Measurement Activities within the IETF, Broadband Forum and EU Leone project Trevor Burbridge, 16 th May 2013 The research leading.
Happy Network Administrators  Happy Packets  Happy Users WIRED Position Statement Aman Shaikh AT&T Labs – Research October 16,
Per Møldrup-Dalum State and University Library SCAPE Information Day State and University Library, Denmark, SCAPE Scalable Preservation Environments.
NSLA Members ACT Library and Information Service National Library of Australia National Library of New Zealand Northern Territory Library State Library.
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
Advanced Next gEneration Mobile Open NEtwork Tridentcom th International Conference on Testbeds and Research Infrastructures for the Development.
MOME MOME: An advanced measurement meta-repository IPS-MoMe Workshop, Warsaw, Poland March 14, 2005 Felix Strohmeier Authors:
How to start research V. Jayalakshmi. Why do we research? – To solve a problem – To satisfy an itch – To gain more market share/ Develop and improve –
TESTBED FOR FUTURE INTERNET SERVICES TEFIS at the EU-Canada Future Internet Workshop, March Annika Sällström – Botnia Living Lab at Centre for.
Experiences of a NMP 1 st call STREP coordinator How to develop a project from the idea 23/05/2005, Poznan, Poland Prof. Dr. ir. Bert LAUWERS Department.
An Intelligent Measurement Plane for the Internet Pedro Casas – Senior FTW Vienna Traffic Monitoring & Analysis.
1.  Infrastructure status  Up to 60G backbone for testing network equipment capability  10~60G backbone is deployed nationwide (6 Pops)  About 60.
Participation in 7FP Anna Pikalova National Research University “Higher School of Economics” National Contact Points “Mobility” & “INCO”
1 CHORUS + Coordinated approacH to the EurOpean effoRt on aUdio-visual Search engines ” Grant Agreement No CHORUS + 01/01/2010 – 31/12/ Jean-Charles.
Project overview objectives, work plan, milestones and deliverables Mark Stevenson, University of Sheffield Kate Fernie, MDR Partners PATHS Final Project.
Towards a Well-Managed Next Generation Internet! Hot Research Topics in Next Generation Internet Panel NY Systems/Networking Summit, NYU Aman Shaikh AT&T.
Semantic Web: The Future Starts Today “Industrial Ontologies” Group InBCT Project, Agora Center, University of Jyväskylä, 29 April 2003.
Francesco Matera Fondazione Ugo Bordoni 22 aprile 2015 mPlane – an Intelligent Measurement Plane for Future Network and Application Management.
Datalayer Notebook Allows Data Scientists to Play with Big Data, Build Innovative Models, and Share Results Easily on Microsoft Azure MICROSOFT AZURE ISV.
Built on the Powerful Microsoft Azure Platform, Mproof’s Clientele ITSM Provides Companies with a Complete Software Suite to Manage Services MICROSOFT.
TACTIC | Workflow: Project Management OSS on Microsoft Azure Helps Enterprises to Create Streamline, Manage, and Track Digital Content MICROSOFT AZURE.
ENVISION Enriched Network-aware Video Services over Internet Overlay Networks David Griffin, UCL 5th FP7 Networked Media Concertation Meeting 3-4 February.
18/01/16 ComNets, RWTH Aachen University, Faculty 6 openWNS Open Source Wireless Network Simulator A Simulation Platform for Wireless Systems Chair of.
Built on the Microsoft Azure Platform, Prudena Provides Users with the Ideas and Confidence to Make Sound Investment Decisions MICROSOFT AZURE APP BUILDER.
1 workshop Barcelona, April 22, 2015.
France Telecom Group & PF7 OCEAN consortium confidential European Project FP7 OCEAN OCEA N European Project FP7 OCEAN Open ContEnt Aware Networks 5th FP7.
Performance Limitations of ADSL Users: A Case Study Matti Siekkinen, University of Oslo Denis Collange, France Télécom R&D Guillaume Urvoy-Keller, Ernst.
EGEE Project Review Fabrizio Gagliardi EDG-7 30 September 2003 EGEE is proposed as a project funded by the European Union under contract IST
MPlane Use Case Demonstrations Erhan Kahveci, FASTWEB mPlane Use case Demonstrations Heidelberg November 30 th, 2015.
Taking Advantage of the Microsoft Azure Platform, Pingvalue Connects People, Products, Stores, and Brands to Deliver Better Experiences for Everyone MICROSOFT.
Avantida is Helping Ocean Carriers to Optimize Their Empty Shipping Container Flows, Based on the Highly Scalable Microsoft Azure Platform MICROSOFT AZURE.
THE FUTURE INTERNET PPP User-driven Innovation Future Internet Conference October 24, 2011 Nuria de Lama Representative of Atos Research & Innovation.
Presentation of Work Package 6 (WP6) “Design and implementation of Dissemination Activities” MATcHES Kick-off meeting Feb 2014 Ruse, Bulgaria TEMPUS BG-TEMPUS-JPHES.
LIMS (Location Information Management System) is the Smart Claim Solution for Motor Insurers, Built on the Powerful Microsoft Azure Platform MICROSOFT.
© 2016 Catalyze, Inc. Go-To-Market Services HIPAA Compliance in the Cloud: Catalyze Provides Microsoft Azure Customers with a HITRUST Certified Platform-as-a-Service.
Task Performance Group Provides Cutting-Edge E-Commerce B2B EDI Integration Using MegaXML SaaS Solution on Microsoft Azure Cloud Platform MICROSOFT AZURE.
1 June 9 th, WARD ICT Mobile Summit W D 4 WP1 - BIRD Business Innovation, Regulation and Dissemination Luis M. Correia, IST-TUL, PT Klaus.
Standardization activities on IPTV in CCSA
Summit 2017 Breakout Group 2: Data Management (DM)
Wonderware Online Cost-Effective SaaS Solution Powered by the Microsoft Azure Cloud Platform Delivers Industrial Insights to Users and OEMs MICROSOFT AZURE.
Chair of Communication Networks
Interlake Hybrid Cloud Management Suite
International Collaboration Project on Information Security
Utilizing the Capabilities of Microsoft Azure, Skipper Offers a Results-Based Platform That Helps Digital Advertisers with the Marketing of Their Mobile.
Partner Logo Azure Provides a Secure, Scalable Platform for ScheduleMe, an App That Enables Easy Meeting Scheduling with People Outside of Your Company.
AIMS for BizTalk, Built on the Microsoft Azure Platform, Empowers Enterprises to Automate Insight and Analytics and Boost Value Creation MICROSOFT AZURE.
Single Cell’s Progenitor Powered by Microsoft Azure Improves Organisational Efficiency with Strategic Procurement, Contract Management, and Analytics MICROSOFT.
The Intelligent Enterprise and SAP Business One
Presentation transcript:

mPlane – Building an Intelligent Measurement Plane for the Internet Alessandro D’Alconzo FTW Forschungszentrum Telekommunikation Wien, AT IFIP TC6 2014/2 Strategic Review Meeting, Dagstuhl, Germany November 12-14, 2014

2 mPlane project quick facts mPlane is an FP7 Integrated Project Project acronym: mPlane Project full title: “mPlane – an Intelligent Measurement Plane for Future Network and Application Management” Grant agreement no: Staring Date: November 1 st 2012 Total Cost: 11,274, € Duration: 3 years Partners: 16 Coordinator: Prof. Marco Mellia – Politecnico di Torino - IT

3 Who we are Marco Mellia POLITO Saverio Nicolini NEC Dina Papagiannaki Telefonica Ernst Biersack Eurecom Brian Trammell ETH Tivadar Szemethy NetVisor Dario Rossi ENST Fabrizio Invernizzi Telecom Italia Guy Leduc Univ. Liege Pietro Michiardi Eurecom Pedro Casas FTW Andrea Fregosi Fastweb 3 operators 6 research centers 5 universities 2 small enterprises Coordinator Tech. Coordinator

4 The mPlane community Many Academic and research institutions come from the Traffic Monitoring Analysis (TMA) COST Action:  PoliTo, ETH, ENST, Eurecom, UniLiege, FTW, NEC Some others were part of previous EU projects:  PRISM: FTW, ETH  NapaWine: PoliTo, ENST, NetVisor, NEC  DEMONS: FTW, ETHZ, NEC, TID  …

Which problem(s) mPlane aims at solving

6 The nowadays Internet “The Internet is the first thing that humanity has built that humanity doesn't understand, the largest experiment in anarchy that we have ever had.” Eric Schmidt – ex Google Exec. Chairman

7 A complicated technology…  Internet: different technologies are combined to offer a plethora of services  We sorely miss the technology to understand what is happening in the network and thus to optimize its performance and utilization  Specially when something goes wrong!

8 …that no one controls and understands A complicated technology… Why is not working? Which is the best ISP in my area? Where is traffic coming from? How to optimize my network for facebook? There are no tools to help me !

9 Why we are here: mPlane motivation The Internet is a global interconnection of networks  No single organization operates, administers or governs it  It is robust thanks to its diversity, but it is vulnerable and fragile In case of “failure”, who can tell what’s going wrong?  Each ISP may have a figure of what happens inside its network  But what if the failure depends on other ISPs? Or on the content provider? Or on the CDN? Or on user equipment? Today, the web is a tangle  Nobody really understands what happens today in the Internet  How to predict what will happen tomorrow? We need an intelligent system that collects, analyzes, provides visibility to support better management: an oracle that provides answers

How can mPlane solve the problem(s)?

11 The mPlane vision Goal: design and demonstration of a measurement plane for the Internet  A distributed infrastructure for network measurement  … which perform passive and active measurements, continuously or on-demand, at a wide variety of scales  … with built-in support for iterative measurement and automated iteration. mPlane is about  large scale network measurements,  and intelligent big-data analysis for troubleshooting support  embedding measurement into the Internet as an additional capability

12 mPlane in a slide Build a distributed, open, standard measurement infrastructure for the Internet  Probes (WP2) – get the data Build on existing tools/methodologies Offer a flexible, programmable, open platform to run and collect passive, active, hybrid measurement  Repositories (WP3) – store and preprocess the data Collect measurement in a standard way Pre-process large amounts of data in efficient ways Grant access to interested parties (ISP, content providers, end-users, regulation agencies, etc.) subject to authorization rules  Intelligent reasoner (WP4 ) – dig into the data Mine automatically the data and extract useful information Help in drilling down to the root cause of a problem Tivadar Szemethy Pietro Michiardi Pedro Casas

13 mPlane WPs’organization WP8 - Project Management WP7 - Dissemination, Exploitation and Standardization WP4 - mPlane Supervisor: Iterative and Adaptive Analysis (supervision layer) WP3 - Large-scale Data Analysis (Repository and Analysis Layer) WP2 – Programmable Probes (Measurement Layer) WP1 Use Cases, Requirements and Architecture WP6 Demonstration WP5 Integration, Deployment, Data Collection, Evaluation Ruediger Martin

14 Supervisor WP4 mPlane in a picture Measurement Layer mInterface mInterface e mProbe 1mProbe 2mProbe NlegacyProbe 1legacyProbe 2legacyProbe N WP2 Raw data Coordination WP3 Repository and Analysis Layer legacyDB 1 legacyDB 2 legacyDB N mPlane Repository DBStream Blockmon Data collection & processing Data collection & processing Intelligent Reasoner Module 1 Module 2 Module N Analysis Modules

15 Some of the mPlane Use Cases Cloud services troubleshooting Mobile network performance issues troubleshooting Web browsing QoE troubleshooting Anomaly detection and diagnosis in large scale netoworks Multimedia content delivery troubleshooting Content and service popularity estimation & caching for network optimization SLA verification and certification

16 Who benefits from mPlane? mPlane benefits everyone:  ISPs get a fine-grained picture of the network status, empowering effective management, operation, and troubleshooting.  Content and Application providers gain powerful tools for handling performance issues of their delivery systems and applications.  Regulators and end-users can verify adherence to SLAs, even when these involve many parties.  Customers of all kinds can objectively compare network performance, improving competition in the market.  The Research Community gets a system to accelerate the pace of research driven by Internet measurements

17 Collaborating Institutions mPlane promotes collaboration with external partners  To strengthen the standardization effort in mPlane  To allow larger deployment of the mPlane system  To enable external partners to get in touch with mPlane technology Official list of collaborating institutions  Univ. Federal de Juiz de Fora (Prof. Borges Vieira), BR  Univ. Federal de Minas Gerais (Prof.s Marques de Almeida and Couto da Silva), BR  Univ of Auckland (Nevil Brownlee), NZ  Univ. of Wurzburg (Prof. Tran-Gia, Tobias Hossfeld), DE  Orange Polska S.A (Dr Zbigniew Kopertowski), PL  University of Twente (Aiko Pras, Anna Sperotto), NL Active Collaborations  University of Waterloo (Prof. Lukasz Golab), CND  Cooperative Association for Internet Data Analysis (Dr Alberto Dainotti), US  Northwestern University (Prof. Fabian Bustamante), US  Boston University (Prof. Mark Crovella), US

18 Dissemination activities (1) Schools  Summer school on "Big-Data Algorithms and Applications to Traffic Measurements” in collaboration with BigFoot project (bigfootproject.eu) Organizers: Marco Mellia – PoliTo, Dario Rossi - ENST Speakers: Pietro Michiardi, Antonio Barbuzzi – Eurecom  4th TMA PhD School, in collaboration with ACM SIGCOMM, March th 2014, London Organizers: Dario Rossi – ENST Speakers from ENST, PoliTo, Uni Liege, Inria, Uni Pierre and Marie Curie Workshop  On mPlane architecture and coding of mPlane-compatible monitoring probes during the METRICS bootcamp Aug. 25 – Sept. 5, 2014, Université Catholique de Louvain, Belgium Seminar  Contribution to the organisation of the Dagstuhl Seminar on "Global Measurement Framework". Organizers: Philip Eardley (BT Research R&D, GB), Marco Mellia (PoliTo, IT), Jörg Ott (Aalto University, FI), Jürgen Schönwälder (Jacobs University Bremen, DE), Henning Schulzrinne (Columbia University, US) 20 invited talks and project presentations

19 Dissemination activities (2) Conferences  Gold sponsor of ACM IMC 2013, organized by TID in Barcelona  TMA 2013, in conjunction with IEEE Infocom in Turin, and chaired by mPlane partners  Several mPlane partners involved in the organization of ACM IMC, CoNEXT, IEEE Infocom, TMA, IEEE TRAC Standardization  IETF: ETH active in several working groups and meetings Brian Trammel from ETH is the chair of the IETF IP Performance Metrics (IPPM) Contributes to Large-Scale Measurement of Broadband Performance (LMAP), Congestion Exposure (ConEx), and TCP Maintenance and Minor Extensions (tcpm) WGs  3 RFCs have being published during the project  5 RFCs drafts are in progress  Full list at:  IRTF: A-LBELL actively contributes to the Network Management Research Group (NMRG)  Brian Trammel appointed as Internet Architecture Board (IAB) member on February 2014

20 Other ongoing efforts for measurement frameworks FP7 European projects  Integrated Project (IP) 3 years  2 left, 16 partners, 11.2 Meuros  “From global measurements to local management” Specific Targeted Research Projects (STReP) 3 years  2 left, 10 partners, 3.8 Meuros Build a measure framework out of probes IETF, Large-Scale Measurement of Broadband Performance (LMAP)  Standardization effort on how to do broadband measurements Defining the components, protocols, rules, etc.  It does not specifically target adding “a brain” to the system Initial discussion with institutions such as RIPE and CAIDA … is like a “mPlane use case” Strong similarities for the architecture core Brian Trammell ETH

21 Where we are We are at the end of 2 nd year We have lot of “tools”  Active, passive, mobile, browsers, edge, core, … We have lot of research papers in the most prominent conferences, including ACM IMC, IEEE Infocom, PAM, IFIP TMA, IEEE TRAC  47 items during 1 st year  25 items during 9 months of 2 nd year  2 Awards (ANRP 2013, ITC25) …

22 Conclusions mPlane aims at simplifying network monitoring practices  Reasoning and Analysis focused on iterative measurements Troubleshooting support  Open source release of software Tstat, Blockmon, QoF, Tracebox, etc.  Maximum reuse of existing measurement tools First software libraries available at the mPlane website Open for collaborations  Collaboration Institutions (CI) Mlab, Orange Lab Poland, Endace, etc.  Other (less formal) ways are welcomed as well

Thank you for Your attention! Alessandro D’Alconzo – FTW