Naixue GSU Slide 1 ICVCI’09 Oct. 22, 2009 A Multi-Cloud Computing Scheme for Sharing Computing Resources to Satisfy Local Cloud User Requirements.

Slides:



Advertisements
Similar presentations
Proposal by CA Technologies, IBM, SAP, Vnomic
Advertisements

Distributed Systems Major Design Issues Presented by: Christopher Hector CS8320 – Advanced Operating Systems Spring 2007 – Section 2.6 Presentation Dr.
Hadi Goudarzi and Massoud Pedram
SLA-Oriented Resource Provisioning for Cloud Computing
High Performance Computing Course Notes Grid Computing.
Cloud Computing to Satisfy Peak Capacity Needs Case Study.
4.1.5 System Management Background What is in System Management Resource control and scheduling Booting, reconfiguration, defining limits for resource.
Serverless Network File Systems. Network File Systems Allow sharing among independent file systems in a transparent manner Mounting a remote directory.
A Server-less Architecture for Building Scalable, Reliable, and Cost-Effective Video-on-demand Systems Jack Lee Yiu-bun, Raymond Leung Wai Tak Department.
Tunis, Tunisia, 28 April 2014 Business Values of Virtualization Mounir Ferjani, Senior Product Manager, Huawei Technologies 2.
Copyright 2007, Information Builders. Slide 1 Workload Distribution for the Enterprise Mark Nesson, Vashti Ragoonath June, 2008.
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Authorizing Grid Resource Access and Consumption Erik Elmroth, Michał.
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
Adaptive Sampling for Sensor Networks Ankur Jain ٭ and Edward Y. Chang University of California, Santa Barbara DMSN 2004.
RDMA ENABLED WEB SERVER Rajat Sharma. Objective  To implement a Web Server serving HTTP client requests through RDMA replacing the traditional TCP/IP.
12006/9/26 Load Balancing in Dynamic Structured P2P Systems Brighten Godfrey, Karthik Lakshminarayanan, Sonesh Surana, Richard Karp, Ion Stoica INFOCOM.
Building a Strong Foundation for a Future Internet Jennifer Rexford ’91 Computer Science Department (and Electrical Engineering and the Center for IT Policy)
EA and IT Infrastructure - 1© Minder Chen, Stages in IT Infrastructure Evolution Mainframe/Mini Computers Personal Computer Client/Sever Computing.
Client/Server Grid applications to manage complex workflows Filippo Spiga* on behalf of CRAB development team * INFN Milano Bicocca (IT)
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
The Autonomic Cloud An ASCENS case study Future Emerging Technologies.
A Cloud is a type of parallel and distributed system consisting of a collection of inter- connected and virtualized computers that are dynamically provisioned.
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
A Unified Modeling Framework for Distributed Resource Allocation of General Fork and Join Processing Networks in ACM SIGMETRICS
Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni.
Cluster Reliability Project ISIS Vanderbilt University.
Microsoft and Community Tour 2011 – Infrastrutture in evoluzione Community Tour 2011 Infrastrutture in evoluzione.
A Framework for Elastic Execution of Existing MPI Programs Aarthi Raveendran Tekin Bicer Gagan Agrawal 1.
Budget-based Control for Interactive Services with Partial Execution 1 Yuxiong He, Zihao Ye, Qiang Fu, Sameh Elnikety Microsoft Research.
A Framework for Elastic Execution of Existing MPI Programs Aarthi Raveendran Graduate Student Department Of CSE 1.
Towards Low Overhead Provenance Tracking in Near Real-Time Stream Filtering Nithya N. Vijayakumar, Beth Plale DDE Lab, Indiana University {nvijayak,
Module 8: Implementing the Placement of Domain Controllers.
A User-Lever Concurrency Manager Hongsheng Lu & Kai Xiao.
Looking Ahead: A New PSU Research Cloud Architecture Chuck Gilbert - Systems Architect and Systems Team Lead Research CI Coordinating Committee Meeting.
Performance evaluation of component-based software systems Seminar of Component Engineering course Rofideh hadighi 7 Jan 2010.
Job scheduling algorithm based on Berger model in cloud environment Advances in Engineering Software (2011) Baomin Xu,Chunyan Zhao,Enzhao Hua,Bin Hu 2013/1/251.
Zibin Zheng DR 2 : Dynamic Request Routing for Tolerating Latency Variability in Cloud Applications CLOUD 2013 Jieming Zhu, Zibin.
Mehmud Abliz, Taieb Znati, ACSAC (Dec., 2009). Outline Introduction Desired properties Basic scheme Improvements to the basic scheme Analysis Related.
Introducing Virtualization via an OpenStack “Cloud” System to SUNY Orange Applied Technology Students SUNY Innovative Instruction Technology Grant Christopher.
11 CLUSTERING AND AVAILABILITY Chapter 11. Chapter 11: CLUSTERING AND AVAILABILITY2 OVERVIEW  Describe the clustering capabilities of Microsoft Windows.
Group member: Kai Hu Weili Yin Xingyu Wu Yinhao Nie Xiaoxue Liu Date:2015/10/
© 2006, National Research Council Canada © 2006, IBM Corporation Solving performance issues in OTS-based systems Erik Putrycz Software Engineering Group.
Infrastructure as code. “Enable the reconstruction of the business from nothing but a source code repository, an application data backup, and bare metal.
Dynamic Scheduling Monte-Carlo Framework for Multi-Accelerator Heterogeneous Clusters Authors: Anson H.T. Tse, David B. Thomas, K.H. Tsoi, Wayne Luk Source:
Configuring, Managing and Maintaining Windows Server® 2008 Servers Course 6419A.
Web Technologies Lecture 13 Introduction to cloud computing.
Chapter 8 System Management Semester 2. Objectives  Evaluating an operating system  Cooperation among components  The role of memory, processor,
CLOUD COMPUTING WHAT IS CLOUD COMPUTING?  Cloud Computing, also known as ‘on-demand computing’, is a kind of Internet-based computing,
1 Sheer volume and dynamic nature of video stresses network resources PIE: A lightweight latency control to address the buffer problem issue Rong Pan,
May 7-8, 2007ICVCI 2007 RTP Autonomic Approach to IT Infrastructure Management in a Virtual Computing Lab Environment H. Abdel SalamK. Maly R. MukkamalaM.
Cloud Powered Rural Telecenters – A Model for Sustainable Telecenters Osman Ghazali, Baharudin Osman, Azizah Ahmad, Azizi Abas, Abdul Razak Rahmat, Mohamed.
Architecture for Resource Allocation Services Supporting Interactive Remote Desktop Sessions in Utility Grids Vanish Talwar, HP Labs Bikash Agarwalla,
Architecture of a platform for innovation and research Erik Deumens – University of Florida SC15 – Austin – Nov 17, 2015.
A service Oriented Architecture & Web Service Technology.
Spark on Entropy : A Reliable & Efficient Scheduler for Low-latency Parallel Jobs in Heterogeneous Cloud Huankai Chen PhD Student at University of Kent.
Extreme Scale Infrastructure
Bringing Dynamism to OPNFV
Clouds , Grids and Clusters
Virtual laboratories in cloud infrastructure of educational institutions Evgeniy Pluzhnik, Evgeniy Nikulchev, Moscow Technological Institute
Walter Binder Giovanna Di Marzo Serugendo Jarle Hulaas
Cloud Computing By P.Mahesh
A Framework for Automatic Resource and Accuracy Management in A Cloud Environment Smita Vijayakumar.
Unistore: Project Updates
Operating Systems Bina Ramamurthy CSE421 11/27/2018 B.Ramamurthy.
Outline Midterm results summary Distributed file systems – continued
Smita Vijayakumar Qian Zhu Gagan Agrawal
Cloud Computing Architecture
Cloud Computing Architecture
August 8, 2006 Danny Budik, Itamar Elhanany Machine Intelligence Lab
Towards Predictable Datacenter Networks
Presentation transcript:

Naixue GSU Slide 1 ICVCI’09 Oct. 22, 2009 A Multi-Cloud Computing Scheme for Sharing Computing Resources to Satisfy Local Cloud User Requirements N. Xiong, A. Vandenberg, M.L. Russell and K.P. Robinson Information Systems and Technology, GSU

Naixue GSU Slide 2 ICVCI’09 Oct. 22, 2009 Outline 1.Problem and Background 2.Contributions 3.VCL system model 4.VCL control scheme 5.Simulation Results 6.Conclusions and Future work

Naixue GSU Slide 3 ICVCI’09 Oct. 22, 2009 Problem How to satisfy large numbers of users applications by using limited resources in dynamically scalable, virtualized services across networks? Virtual computing is becoming increasingly important as a solution to solve it.

Naixue GSU Slide 4 ICVCI’09 Oct. 22, 2009 Background Virtual Computing Lab (VCL): An Apache.org incubator, open source code project, A remote access service A management framework Characteristics of three main parameters: processing, storage, and memory

Naixue GSU Slide 5 ICVCI’09 Oct. 22, 2009 Background VCL makes available extensive application environments: multiple applications are deployed in multiple environments; Instructors requiring course allocations reserve computing resources for future times or as allocations [1];

Naixue GSU Slide 6 ICVCI’09 Oct. 22, 2009 Background GSU is deploying VC as a solution alternative to traditional student computing labs VC as a solution to support researchers: where researchers request computing environments that may be non-standard configurations not readily available Some VCL related areas of interest are: Network control and security; dynamic virtual local area networks (VLANS) and VLAN control; support for high- performance computing (HPC); resource allocation between HPC and other services.

Naixue GSU Slide 7 ICVCI’09 Oct. 22, 2009 Outline 1.Problem and Background 2.Contributions 3.VCL system model 4.VCL control scheme 5.Simulation Results 6.Conclusions and Future work

Naixue GSU Slide 8 ICVCI’09 Oct. 22, 2009 Contributions Considers target resource utilization and the history of application computing rates Focus on dynamically scalable, virtualized services across networks to enable a multi-cloud computing scheme for sharing computing resources to satisfy local cloud user requirements. Fast response and high utilization are sometimes conflicting requirements when you have multiple users. A feedback control scheme: set and monitor both user desired response levels and target levels of resource utilizations.

Naixue GSU Slide 9 ICVCI’09 Oct. 22, 2009 Contributions propose a system model for a multi-cloud environment propose an proportional and integral scheme to satisfy requirements of multiple users. VCL scheme: considers actual versus target value of resource utilization and the history of application computing rates provide a theoretical analysis of system stability and give guidelines for selection of feedback control parameters Simulations

Naixue GSU Slide 10 ICVCI’09 Oct. 22, 2009 Outline 1.Problem and Background 2.Contributions 3.VCL system model 4.VCL control scheme 5.Simulation Results 6.Conclusions and Future work

Naixue GSU Slide 11 ICVCI’09 Oct. 22, 2009 Model North Carolina State University VCL model [1].

Naixue GSU Slide 12 ICVCI’09 Oct. 22, 2009 Model VCL Software/ Management nodes Servers Delay t 2 Delay t 1 User/applications Model: Applications sent to a management node that controls many servers’ resources (x: used; M: assigned; u: released resource)

Naixue GSU Slide 13 ICVCI’09 Oct. 22, 2009 Outline 1.Problem and Background 2.Contributions 3.VCL system model 4.VCL control scheme 5.Simulation Results 6.Conclusions and Future work

Naixue GSU Slide 14 ICVCI’09 Oct. 22, 2009 VCL scheme VCL Scheme (x: used; M: assigned; c: capacity resource) error signal between the used CPU resource and the target value for the used CPU resource sum of the history assigned CPU resource in management node during the last round-trip time used CPU resource at a server can be stabilized near its target value.

Naixue GSU Slide 15 ICVCI’09 Oct. 22, 2009 VCL scheme A recursive digital filter for VCL feedback controller: dynamic, stabilize itself based on the internal feedbacks parameters integral component proportional component + the initial incoming resource

Naixue GSU Slide 16 ICVCI’09 Oct. 22, 2009 VCL scheme apply z-transformation to Eqs. (3-4) and relevant control theory If is close to the target value, the system get better performance.

Naixue GSU Slide 17 ICVCI’09 Oct. 22, 2009 Outline 1.Problem and Background 2.Contributions 3.VCL system model 4.VCL control scheme 5.Simulation Results 6.Conclusions and Future work

Naixue GSU Slide 18 ICVCI’09 Oct. 22, 2009 Simulation Model Model: Applications sent to a management node that controls many servers’ resources x: used)

Naixue GSU Slide 19 ICVCI’09 Oct. 22, 2009 Parameters setting The target value for the servers is 80%...

Naixue GSU Slide 20 ICVCI’09 Oct. 22, 2009 Two schemes VCL controller Without a VCL controller: Application computing amount that the Management node assigns to every server is same Server works independently and the management evenly distributes all work.

Naixue GSU Slide 21 ICVCI’09 Oct. 22, 2009 Performance Evaluation Fig. 5. The CPU utilization for Server 1. Fig. 6. The CPU utilization for Server 2.

Naixue GSU Slide 22 ICVCI’09 Oct. 22, 2009 Performance Evaluation Fig. 7. The CPU utilization for Server 3. Fig. 8. computing amount in assigning the applications to servers

Naixue GSU Slide 23 ICVCI’09 Oct. 22, 2009 Without VCL controller Server 1: directly to the full utilization rate, means the load is too much for Server 1, and it cannot deal with it effectively. Server 2, stable at about 5%, low, means it can deal with more applications, but no way to assign work effectively. Server 3, quickly becomes 0, means it finishes its applications load using only part of its available CPU resources, wasting lots of CPU resource.

Naixue GSU Slide 24 ICVCI’09 Oct. 22, 2009 VCL controller Although the CPU utilization rate fluctuates at first, then stable quickly, reaching the target value of 80% It more effectively using the available CPU resources of the cloud environment It is an effective multi-cloud computing controller for ensuring both fast response and high resource utilization rates.

Naixue GSU Slide 25 ICVCI’09 Oct. 22, 2009 Outline 1.Problem and Background 2.Contributions 3.VCL system model 4.VCL control scheme 5.Simulation Results 6.Conclusions and Future work

Naixue GSU Slide 26 ICVCI’09 Oct. 22, 2009 Conclusions propose a system model for a multi-cloud environment, propose an effective proportional and integral feedback control scheme based on control theory for fast response + high utilization of cloud resources. provide a theoretical analysis of the system stability and give guidelines for selection of control parameters. Simulations demonstrate: effective multi-cloud computing controller for ensuring fast response + high resource utilization.

Naixue GSU Slide 27 ICVCI’09 Oct. 22, 2009 Future work Focus on the engineering implementation of the above control scheme in a multi-cloud computing environment that is being developed by several universities as part of the VCL open source community. proposed model can be expanded to address additional parameters related to other aspects of multi-cloud computing: the level of computing security that user applications may require, or even storage availability or dependability.

Naixue GSU Slide 28 ICVCI’09 Oct. 22, 2009 Q & A Thank You!