1. © 2015 The SmartenIT Consortium 1 Commercial in Confidence DTM for minimization of inter-domain traffic cost Grzegorz Rzym, AGH, June 16, 2015 Socially-aware Management of New Overlay Application Traffic combined with Energy Efficiency in the Internet European Seventh Framework STREP FP7-2012-ICT-317846 http://www.smartenit.eu

2. © 2015 The SmartenIT Consortium 2 Commercial in Confidence What is DTM?  DTM = Dynamic Traffic Management*  The content is not available locally  The download will generate inevitable inter-domain traffic  The cost of the downstream traffic depend on the tariff on inter-domain link used  Optimize total cost of inter-domain traffic  DTM consists of:  Optimization algorithm  Compensation procedure  Metering component *Zbigniew Dulinski, Rafal Stankiewicz and Krzysztof Wajda, Mechanism for dynamic optimization of inter-domain traffic cost in multi-homed ISP’s network, NETWORKS 2014, Sept. 17-19, Funchal, Madeira, Portugal

3. © 2015 The SmartenIT Consortium 3 Commercial in Confidence Definitions  Traffic  Manageable (DC-DC traffic)  Delay tolerant (can be postponed)  Delay sensitive (should be sent asap)  Background (non-manageable)  Vectors  Reference – shows optimal distribution of traffic among inter-domain links (based on the previous billing period)  Compensation – temporary information how traffic should be distributed among inter-domain links in order to achieve optimal solution (send e.g., every 30 sec.)

4. © 2015 The SmartenIT Consortium 4 Commercial in Confidence Compensation algorithm Metering component Optimization algorithm DTM – traffic management concept

5. © 2015 The SmartenIT Consortium 5 Commercial in Confidence DTM – traffic management concept Compensation algorithm Metering component Optimization algorithm Finds optimal goal vector R t Calculates compensation vector C t e.g. every 5 min and influences path selection e.g. SNMP Monitors current traffic on inter- domain links and calculated measured vector X t e.g. every 30s R CtCt

6. © 2015 The SmartenIT Consortium 6 Commercial in Confidence DTM Assumptions

7. © 2015 The SmartenIT Consortium 7 Commercial in Confidence Assumption 1 – Sources of Network Traffic  Data are exchanged between cloud resources located in more than one Data Center  Federation of clouds  An application/a service may use resources of independent clouds Cisco Global Cloud Index: Forecast and Methodology, 2013–2018

8. © 2015 The SmartenIT Consortium 8 Commercial in Confidence Assumption 2 – Cloud Resources in Multiple Network Domains (1) In case of one cloud resources are located in multiple network domains to cover the geographical region are important from the business point of view of a Cloud Service Provider.

9. © 2015 The SmartenIT Consortium 9 Commercial in Confidence Assumption 2 – Cloud Resources in Multiple Network Domains (2) In case of more than one cloud belonging to independent Cloud Service Providers resources are also located in multiple network domains.

10. © 2015 The SmartenIT Consortium 10 Commercial in Confidence Assumption 3 – Multiple Flows between Network Domains  One of the characteristics of the inter-domain network traffic between resources deployed in independent network domains is the high number of flows  It is considered to have around 900 flows*; average number of flows simultaneously active at a given Data Center (DC). This characteristic is based on [1] and [2], presenting the nature of network traffic generated by Data Centers, where cloud resources are located as well as information on the share of inter- DC traffic in overall DC traffic, provided by Cisco Global Cloud Index. [1] T. Benson, A. Akella, D. A. Maltz. Network traffic characteristics of data centers in the wild. 10th ACM SIGCOMM conference on Internet measurement (IMC '10). ACM, New York, NY, USA, 2010 [2] T. Benson, A. Anand, A. Akella, M. Zhang. Understanding data center traffic characteristics, SIGCOMM Computer Communications Review, Vol. 40, No. 1, January 2010

11. © 2015 The SmartenIT Consortium 11 Commercial in Confidence Assumption 4 – Multi-homed Network Domains  Dynamic distribution of traffic among inter-domain links (adaptation to the current traffic)  Inbound traffic cost is optimized in the current implementation of DTM AS1 Link L2 Link L1 Inbound traffic AS2 AS3

12. © 2015 The SmartenIT Consortium 12 Commercial in Confidence DTM operations – general overview

13. © 2015 The SmartenIT Consortium 13 Commercial in Confidence DTM Logical Topology (Basic) Cloud A DC-A Cloud B DC-B AS1 AS2 AS3 AS4 Link L2 Link L1 BGP router Intra-domain router Inter-domain link Intra-domain link tun 2 tun 1 Default BGP path from DC-B to DC-A

14. © 2015 The SmartenIT Consortium 14 Commercial in Confidence SmartenIT System Elements Cloud A DC-A Cloud B DC-B AS1 AS2 AS3 AS4 Link L2 Link L1 BGP router Intra-domain router Inter-domain link Intra-domain link tun 2 tun 1 SDN controller S-Box

15. © 2015 The SmartenIT Consortium 15 Commercial in Confidence Generation of Traffic Flows Cloud A DC-A Cloud B DC-B AS1 AS2 AS3 AS4 Link L2 Link L1 BGP router Intra-domain router Inter-domain link Intra-domain link tun 2 tun 1 SDN controller S-Box Traffic generator (sender) Traffic generator (sender) Traffic receiver Traffic receiver

16. © 2015 The SmartenIT Consortium 16 Commercial in Confidence DTM Operations Cloud A DC-A Cloud B DC-B AS1 AS2 AS3 AS4 Link L2 Link L1 BGP router Intra-domain router Inter-domain link Intra-domain link tun 2 tun 1 SDN controller S-Box SNMP Compensation vector L2 total traffic (background+manageable) tun 2 traffic (manageable) L1 total traffic (background+manageable) tun 1 traffic (manageable) OpenFlow: use tun 2

17. © 2015 The SmartenIT Consortium 17 Commercial in Confidence Traffic receiver Putting all Elements Together Cloud A DC-A Cloud B DC-B AS1 AS2 AS3 AS4 Link L2 Link L1 BGP router Intra-domain router Inter-domain link Intra-domain link tun 2 tun 1 SDN controller S-Box Traffic generator (sender) Traffic generator (sender) Traffic receiver SDN controller S-Box SNMP Compensation vector OpenFlow: use tun 2

18. © 2015 The SmartenIT Consortium 18 Commercial in Confidence Volume-based tariff

19. © 2015 The SmartenIT Consortium 19 Commercial in Confidence DTM benefit End of billing period T Actual total cost (with DTM) Estimated total cost (real-time estimation) Costs w/o DTM Benefit

20. © 2015 The SmartenIT Consortium 20 Commercial in Confidence 95 th percentile-based tariff

21. © 2015 The SmartenIT Consortium 21 Commercial in Confidence Simulation results (95 th percentile) Top 5% of samples above the 95 th percentile threshold on link 2 Top 5% of samples above the 95 th percentile threshold on link 1

22. © 2015 The SmartenIT Consortium 22 Commercial in Confidence Simulation results (95 th percentile) Top 5% of samples above the 95 th percentile threshold on link 2 Top 5% of samples above the 95 th percentile threshold on link 1

23. © 2015 The SmartenIT Consortium 23 Commercial in Confidence Simulation results – reference vector achieved decrease ~182 increase ~171

24. © 2015 The SmartenIT Consortium 24 Commercial in Confidence DTM extension (DTM++)

25. © 2015 The SmartenIT Consortium 25 Commercial in Confidence DTM and ICC* – general ideas Shift in time to the off-peak-period 5 min samples Shift in time (ICC) 5 min samples Shift in space (DTM) Link 1 Link 2 5 min samples 5 min samples nn–1n+1n+2n+3n+4 nn–1n+1n+2n+3n+4 nn–1n+1n+2n+3n+4nn–1n+1n+2n+3n+4 n+m+1 n+mn+m+2 n+m+3 n+m+4 n+m+5 TARGET traffic (cost) to be achieved in the current period * The SmartenIT Project, Deliverable D2.2: Report on Definitions of Traffic Management Mechanisms and Initial Evaluation Results;,October 2013

26. © 2015 The SmartenIT Consortium 26 Commercial in Confidence DTM++ (DTM+ICC)  Main intelligence  95 th percentile tariff considered  Minimization of inter-domain traffic charge by influencing the sizes of 5-min samples  Influencing traffic distribution among links (DTM functionality)  Influence manageable traffic (e.g. inter-DC traffic)  Influencing the sample sizes by delaying the delay-tolerant traffic (ICC functionality)  DTM++ operations  Apply DTM to optimally split traffic at customer PoIs and then apply ICC at transit aggregates to enforce Ctarget

27. © 2015 The SmartenIT Consortium 27 Commercial in Confidence Summary  Minimization of cost for inter-domain traffic for volume-based and 95 th percentile-based tariff  Distribution of inter-domain traffic among two inter- domain links is influenced  Background traffic not affected  DTM influences the distribution of manageable traffic among links  Capable of compensating traffic bursts and traffic fluctuations

28. © 2015 The SmartenIT Consortium 28 Commercial in Confidence Thank you!