Bandwidth Measurements for VMs in Cloud

Slides:



Advertisements
Similar presentations
Network Resource Broker for IPTV in Cloud Computing Lei Liang, Dan He University of Surrey, UK OGF 27, G2C Workshop 15 Oct 2009 Banff,
Advertisements

Cloud Service Models and Performance Ang Li 09/13/2010.
SLA-Oriented Resource Provisioning for Cloud Computing
Ningning HuCarnegie Mellon University1 Optimizing Network Performance In Replicated Hosting Peter Steenkiste (CMU) with Ningning Hu (CMU), Oliver Spatscheck.
LOAD BALANCING IN A CENTRALIZED DISTRIBUTED SYSTEM BY ANILA JAGANNATHAM ELENA HARRIS.
1 NETE4631 Cloud deployment models and migration Lecture Notes #4.
Cloud Computing Brandon Hixon Jonathan Moore. Cloud Computing Brandon Hixon What is Cloud Computing? How does it work? Jonathan Moore What are the key.
INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 6 2/13/2015.
Transparent Checkpoint of Closed Distributed Systems in Emulab Anton Burtsev, Prashanth Radhakrishnan, Mike Hibler, and Jay Lepreau University of Utah,
Look Who’s Talking: Discovering Dependencies between Virtual Machines Using CPU Utilization HotCloud 10 Presented by Xin.
Dynamically Scaling Applications in the Cloud Presented by Paul.
Scalable and Crash-Tolerant Load Balancing based on Switch Migration
On the Geographic Distribution of On- line Game Servers and Players Wu-chang FengWu-chi Feng Presented By: Abhishek Gupta.
1 Virtual Machine Resource Monitoring and Networking of Virtual Machines Ananth I. Sundararaj Department of Computer Science Northwestern University July.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
On the Geographic Distribution of On- line Game Servers and Players Wu-chang FengWu-chi Feng Discussion moderated By: John Carter.
FI-WARE – Future Internet Core Platform FI-WARE Cloud Hosting July 2011 High-level description.
Scale-out File Server Cluster Hyper-V Cluster Virtual Machines SMB3 Storage Network Fabric.
Jennifer Rexford Princeton University MW 11:00am-12:20pm Data-Center Traffic Management COS 597E: Software Defined Networking.
Bandwidth Measurements for VMs in Cloud Amit Gupta and Rohit Ranchal Ref. Cloud Monitoring Framework by H. Khandelwal, R. Kompella and R. Ramasubramanian.
Private Cloud or Dedicated Hosts Mason Mabardy & Matt Maples.
A User Experience-based Cloud Service Redeployment Mechanism KANG Yu.
Supporting GPU Sharing in Cloud Environments with a Transparent
INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 7 2/23/2015.
Department of Computer Science Engineering SRM University
Monitoring Latency Sensitive Enterprise Applications on the Cloud Shankar Narayanan Ashiwan Sivakumar.
Creating an EC2 Provisioning Module for VCL Cameron Mann & Everett Toews.
Presented by: Sanketh Beerabbi University of Central Florida COP Cloud Computing.
A Framework for Elastic Execution of Existing MPI Programs Aarthi Raveendran Tekin Bicer Gagan Agrawal 1.
A Framework for Elastic Execution of Existing MPI Programs Aarthi Raveendran Graduate Student Department Of CSE 1.
High Performance File System Service for Cloud Computing Kenji Kobayashi, Osamu Tatebe University of Tsukuba, JAPAN.
1 Finding Constant From Change: Revisiting Network Performance Aware Optimizations on IaaS Clouds Yifan Gong, Bingsheng He, Dan Li Nanyang Technological.
11 Experimental and Analytical Evaluation of Available Bandwidth Estimation Tools Cesar D. Guerrero and Miguel A. Labrador Department of Computer Science.
Introduction to dCache Zhenping (Jane) Liu ATLAS Computing Facility, Physics Department Brookhaven National Lab 09/12 – 09/13, 2005 USATLAS Tier-1 & Tier-2.
Advanced Network Architecture Research Group 2001/11/74 th Asia-Pacific Symposium on Information and Telecommunication Technologies Design and Implementation.
Biomedical Big Data Training Collaborative biobigdata.ucsd.edu BBDTC UPDATES Biomedical Big Data Training Collaborative biobigdata.ucsd.edu.
BNL Service Challenge 3 Status Report Xin Zhao, Zhenping Liu, Wensheng Deng, Razvan Popescu, Dantong Yu and Bruce Gibbard USATLAS Computing Facility Brookhaven.
Emerging applications in cloud High performance computing E-Commerce Media hosting Web hosting Content delivery... –from Amazon AWS survey 1 Emulated network.
Trojan Express Network II Goal: Develop Next Generation research network in parallel to production network to address increasing research data transfer.
Autonomic aspects in cloud data management Alexandra Carpen-Amarie KerData.
INTRODUCTION TO AMAZON WEB SERVICES (EC2). AMAZON WEB SERVICES  Services  Storage (Glacier, S3)  Compute (Elastic Compute Cloud, EC2)  Databases (Redshift,
The Limits of Volunteer Computing Dr. David P. Anderson University of California, Berkeley March 20, 2011.
Md Baitul Al Sadi, Isaac J. Cushman, Lei Chen, Rami J. Haddad
Chen Qian, Xin Li University of Kentucky
FileCatalyst Performance
Brad Sutton Assoc Prof, Bioengineering Department
Authors: Sajjad Rizvi, Xi Li, Bernard Wong, Fiodar Kazhamiaka
Improving Datacenter Performance and Robustness with Multipath TCP
Mohammad Malli Chadi Barakat, Walid Dabbous Alcatel meeting
Written by : Thomas Ristenpart, Eran Tromer, Hovav Shacham,
Usage of Openstack Cloud Computing Architecture in COE Seowon Jung Systems Administrator, COE
Slingshot: Deploying Stateful Services in Wireless Hotspots
Cloud-Assisted VR.
ECE544: Software Assignment 3
Server Allocation for Multiplayer Cloud Gaming
Where can I download Aws Devops Engineer Professional Exam Study Material - Get Updated Aws Devops Engineer Professional Braindumps Dumps4downlaod.us
Replication Middleware for Cloud Based Storage Service
VDN: Virtual Machine Image Distribution Network for Cloud Data Centers
Computer Network Performance Measures
Webinar # April 2017 Isolates in the Cloud
Mobile Agents M. L. Liu.
Brandon Hixon Jonathan Moore
Computer Network Performance Measures
AWS Cloud Computing Masaki.
Different types of Linux installation
Building Serverless Enterprise Applications
Cloud Security AWS as an example.
Cloud Security AWS as an example.
- Measurement of traffic volume -
Requirements of Computing in Network
Presentation transcript:

Bandwidth Measurements for VMs in Cloud Amit Gupta and Rohit Ranchal Ref. Cloud Monitoring Framework by H. Khandelwal, R. Kompella and R. Ramasubramanian. Purdue University research report, 2010.

MOTIVATION Many applications are being deployed in cloud to leverage the scalability provided by the cloud providers. Tools provided by the cloud providers do not give performance metrics from the network perspective. Network topology is not exposed to the cloud users and the applications consider all network links to be homogeneous. Metrics such as available bandwidth, latency etc. will be more useful to the cloud users.  

Experimental Evaluation Set up 19 EC2 small instances (US East) 342 (19*18) links among VMs Ubuntu 10.04 server version  Centralized Scheduler for starting Iperf clients Predefined serialized schedule file at each VM instance. Schedule file contains a time stamp along with the nodes that should communicate for a single reading. * Iperf - Network testing tool to measure the network throughput between end hosts. 

Experimental Evaluation Iperf takes 6 seconds to measure round trip time ( bandwidth) for a single link. Each round of measurement takes around 30 minutes for finding available bandwidth for all 342 links. Experiments runs for 5 rounds Throughput matrix: Matrix containing estimated values for available bandwidth 

Bandwidth Estimation Shows the CDF of link bandwidth estimation for all the rounds. Used throughput matrix having estimated 342 values. All links in clouds are not homogeneous. Only 10% of the links have available bandwidth less than 400Mbps.  All links do not get same bandwidth  

Bandwidth Variation Estimation Shows the CDF of link bandwidth variation across all the rounds. Bandwidth range of a link defined as the difference between the max and min value across all rounds. For most of the links, bandwidth is consistent across time. Only 20% links have variation of more than 80 Mbps.   

Virtual Machine Performance Shows the available download/upload bandwidth of all machines for a single round Almost all the machines have average available bandwidth more than 400 Mbps.   

Virtual Machine Performance Shows the average available download/ upload bandwidth and its range for each machine across all rounds. Almost all the machines have average download/ upload bandwidth more than 400 Mbps. Some VMs (1, 4, 7) have large available bandwidth variation.  

CONCLUSIONS Focussed on available bandwidth metric between each pair of VM instances. Amazon EC2 data center is optimally utilized with ample available bandwidth for almost all VMs. Some badly performing VMs can be pointed out based on the large variation in the available upload/download bandwidth and can be replaced with new VMs.

Future Work More performance metric such as latency etc. can be considered. These performance metrics can be used to improve the performance of applications running in the cloud. These performance metric tests can be run on large EC2 instances.

References http://aws.amazon.com/ec2/ AWS Amazon EC2:      http://aws.amazon.com/ec2/ Amazon CloudWatch:      http://aws.amazon.com/cloudwatch/  Iperf       http://iperf.sourceforge.net/ Data reported in Cloud Monitoring Framework by H. Khandelwal, R. Kompella and R. Ramasubramanian. Purdue University research paper, 2010. Data provided by Khandelwal to Rohit and Amit