1. Cloud Computing

2. Copyright © 2012, Elsevier Inc. All rights reserved. 2 - 2 Significance of Cloud Computing Gartner rates cloud computing high on list of critical emerging technologies that are transformational (their highest rating for impact) in the next 2 - 5 years. Clouds form a major industry thrust that IDC estimates will grow to $44.2 billion investment in 2013 while 15% of IT investment in 2011 was related to cloud systems. There are many opportunities for new jobs in cloud computing with a recent European study estimating 2.4 million new cloud computing jobs in Europe alone by 2015. IDC predicts that the cloud will generate nearly 14 million new jobs worldwide by 2015 [TopStories at Microsoft.com, March 5, 2012].

3. In the state of Georgia, Silver lining, a cloud computing company is in the process of adding 900 new jobs in Atlanta [Atlanta Business Chronicle, Feb. 1, 2013] In the state of Georgia, Silver lining, a cloud computing company is in the process of adding 900 new jobs in Atlanta [Atlanta Business Chronicle, Feb. 1, 2013]

4. Copyright © 2012, Elsevier Inc. All rights reserved. 2 - 4 March 5, 2012 Prof. Kai Hwang, USC Cloud in The Future Internet

5. Defintion of Cloud Computing In a simplest sense, Cloud represents a network and, more specifically, the global Internet In a simplest sense, Cloud represents a network and, more specifically, the global Internet Cloud Computing is the use of computational resources that are hosted remotely and delivered through the Internet Cloud Computing is the use of computational resources that are hosted remotely and delivered through the Internet

6. There are many definitions of Cloud Computing. (e.g., definition by Gartner, Forrester, Wikipedia, the 451 Group, NIST) There are many definitions of Cloud Computing. (e.g., definition by Gartner, Forrester, Wikipedia, the 451 Group, NIST) Definition by NIST Definition by NIST Cloud Computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. Cloud Computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. None of the definitions is universally accepted. None of the definitions is universally accepted. Each definition emphasizes some aspects of cloud computing, but do not provides a complete description. Each definition emphasizes some aspects of cloud computing, but do not provides a complete description.

7. A cloud infrastructure provides a framework to manage scalable, reliable, on-demand access to applications A cloud is the “invisible” backend to many of our mobile applications A model of computation and data storage based on “pay as you go” access to “unlimited” remote data center capabilities

8. Copyright © 2012, Elsevier Inc. All rights reserved. 2 - 8 Three Aspects in Hardware that can benefit from Cloud Computing 1. The illusion of infinite computing resources available on demand, thereby eliminating the need for cloud users to plan far ahead for resource provisioning. 2. The elimination of an up-front commitment by cloud users, thereby allowing companies to start small and increase the hardware resources when needed in the future. 3. The ability to pay the costs of computing resources on a short- term basis as needed (e.g., processors by the hour and storage by the day) and release them after done and thereby rewarding resource conservation.

9. Why using “cloud” In order to understand cloud computing, one obvious place to start is the cloud metaphor itself. In order to understand cloud computing, one obvious place to start is the cloud metaphor itself. Why do we call it cloud? Why do we call it cloud?

10. A cloud has long been used in network diagrams to represent a sort of black box where the interfaces are well known but the internal routing and processing is not visible to the network users. A cloud has long been used in network diagrams to represent a sort of black box where the interfaces are well known but the internal routing and processing is not visible to the network users. A cloud, by nature, is opaque A cloud, by nature, is opaque A cloud is typcially very large and distant. A cloud is typcially very large and distant. Furthermore, clouds may be overlapping; they may dynamically intersect or split. Furthermore, clouds may be overlapping; they may dynamically intersect or split.

11. Key attributes of cloud computing Off-Premise Off-Premise Elasticity Elasticity Flexible billing Flexible billing Virtualization Virtualization Service delivery Service delivery Universal access Universal access Simplified management Simplified management Affordable resources Affordable resources Multi-tenancy Multi-tenancy Service level management Service level management

12. Key attributes of cloud computing Off-Premise: the service is hosted and delivered from a location that belongs to a service provider. Off-Premise: the service is hosted and delivered from a location that belongs to a service provider. - The service is deliverred over the public Internet - The service is deliverred over the public Internet - Computing processes occur outside the company firewall. - Computing processes occur outside the company firewall.

13. Elasticity: cloud computing provides an elastic provisioning mechanism for resource allocation, so that resources can be scaled both up and down very rapidly on demand. Elasticity: cloud computing provides an elastic provisioning mechanism for resource allocation, so that resources can be scaled both up and down very rapidly on demand.

14. Flexible Billing: Cloud computing typically charges users by fine-grained metering of resource usages. Flexible Billing: Cloud computing typically charges users by fine-grained metering of resource usages.

15. Virtualization: cloud services are usually offerred through an abstracted infrastructure, which leverage various virtualization mechanisms. Virtualization: cloud services are usually offerred through an abstracted infrastructure, which leverage various virtualization mechanisms.

16. Service delivery: cloud functionality is often available as a service. Typically the services offer programmatic interfaces in addition to the user interfaces. Service delivery: cloud functionality is often available as a service. Typically the services offer programmatic interfaces in addition to the user interfaces.

17. Universal access: Pooled resources are available to anyone authorized to utilize them; Location independence and high levels of resilience allow for an always connected user experience. Universal access: Pooled resources are available to anyone authorized to utilize them; Location independence and high levels of resilience allow for an always connected user experience.

18. Simplified management: Simplified management: - Administration is simplified through automatic provisioning to meet scalability requirements; - Administration is simplified through automatic provisioning to meet scalability requirements; - user self-service expedites businesss process; - user self-service expedites businesss process; - programmatically accessible resources facilites integration into enterprise management frameworks - programmatically accessible resources facilites integration into enterprise management frameworks

19. Affordable resources: The cost of resources is dramatically reduced for two reasons: Affordable resources: The cost of resources is dramatically reduced for two reasons: - From the user side, there is no requirement for spending money on fixed purchases - From the user side, there is no requirement for spending money on fixed purchases - From the service provider side, the economy of scale of the service providers allow them to optimize their cost structure with commodity hardware and fine-tuned operational procedures that are not easily matched by most companies. - From the service provider side, the economy of scale of the service providers allow them to optimize their cost structure with commodity hardware and fine-tuned operational procedures that are not easily matched by most companies.

20. Multi-tenancy: The cloud is used by many organizations (tenants). It can protect and isolate each tenant from all others. Multi-tenancy: The cloud is used by many organizations (tenants). It can protect and isolate each tenant from all others.

21. Service-level management: Cloud services typically offer a service-level definition that sets the expectation with the customer as to how robust that service will be. Service-level management: Cloud services typically offer a service-level definition that sets the expectation with the customer as to how robust that service will be.

22. Related Concepts Service-oriented architecutre (SOA) Service-oriented architecutre (SOA) Grid computing Grid computing Web 2.0 Web 2.0

23. Service-oriented architecture (SOA): SOA decomposes the information technology landscape of an enterprise into loosely coupled functional primitives called services. Service-oriented architecture (SOA): SOA decomposes the information technology landscape of an enterprise into loosely coupled functional primitives called services. These services implement single actions and may be used by many different business applications. These services implement single actions and may be used by many different business applications.

24. SOA and Cloud Computing are two independant notions. SOA and Cloud Computing are two independant notions. - SOA is an architecture, which is technology independent. - SOA is an architecture, which is technology independent. Cloud computing can be a good means of implementing a SOA design Cloud computing can be a good means of implementing a SOA design

25. Grid Computing: It refers to the use of many interconnected computers to solve a problem through highly parallel computaiton. Grid Computing: It refers to the use of many interconnected computers to solve a problem through highly parallel computaiton. There are conceptual similarity between grid and cloud computing. There are conceptual similarity between grid and cloud computing. - Both involve large interconnected systems of computers - Both involve large interconnected systems of computers - distribute their workload - distribute their workload - blur the line between system usage and system ownership. - blur the line between system usage and system ownership.

26. There are also distinctions between these two computing models There are also distinctions between these two computing models - Grid computing is typically used in scientific environment where a job typically requires a huge number of computer processing cycles. It allocates resources in a bath mode. - Grid computing is typically used in scientific environment where a job typically requires a huge number of computer processing cycles. It allocates resources in a bath mode. - Cloud computing is typically process many small tasks simutaneously. It uses real-time resource allocation. - Cloud computing is typically process many small tasks simutaneously. It uses real-time resource allocation.

27. Web 2.0: It refers to the web as not only a static information source for browser access but a platform for web-based communities to facilitate user participation and collaboration. Web 2.0: It refers to the web as not only a static information source for browser access but a platform for web-based communities to facilitate user participation and collaboration. There is no intrinsic connection between cloud computing and web 2.0. There is no intrinsic connection between cloud computing and web 2.0. - Cloud computing is a means of delivering services - Cloud computing is a means of delivering services - Web 2.0 is a class of services that may be deliverred in many different ways. - Web 2.0 is a class of services that may be deliverred in many different ways.

28. History of cloud computing Amazon was arguably the first company to offer an extensive and thorough set of cloud-based services. Amazon was arguably the first company to offer an extensive and thorough set of cloud-based services. Why it is Aamzon? Why it is Aamzon?

29. Amazon started as an online book store in 1995. Amazon started as an online book store in 1995. It later diversified its product portfolio to include a wide range of categories. It later diversified its product portfolio to include a wide range of categories. It also brokered transactions for fee and developed a successful ecosystem of partnership. It also brokered transactions for fee and developed a successful ecosystem of partnership.

30. As Amazon grew, it had to invest larger and larger data center to support its business. As Amazon grew, it had to invest larger and larger data center to support its business. Its data center was provisioned to guarantee the computing capacity in holiday season. Its data center was provisioned to guarantee the computing capacity in holiday season. However, this overprovisioning resulted in the idle of a major share of its data center for 11 out of 12 months. However, this overprovisioning resulted in the idle of a major share of its data center for 11 out of 12 months.

31. In order to turn their weakness into an opportunity, Amazon lanuched Amazon Web Services that sold some of their idle capacity to other organizations. In order to turn their weakness into an opportunity, Amazon lanuched Amazon Web Services that sold some of their idle capacity to other organizations. Organizations can take advantage of Amazon’s secure and reliable infrastructure at reasonable prices without making any financial and strategic commitment. Organizations can take advantage of Amazon’s secure and reliable infrastructure at reasonable prices without making any financial and strategic commitment.

32. Copyright © 2012, Elsevier Inc. All rights reserved. 2 - 32 Challenges in Cloud Computing (1) Concerns from The Industry (Providers)   Replacement Cost   Exponential increase in cost to maintain the infrastructure   Standardization   No standard metric for QoS is limiting the popularity   Security and Confidentiality   Trust model for cloud computing   Control Mechanism   Users do not have any control over infrastructures

33. Copyright © 2012, Elsevier Inc. All rights reserved. 2 - 33 Challenges in Cloud Computing (2) Concerns from Research Community :   Conflict to legacy programs   With difficulty in developing a new application due to lack of control   Provenance   How to reproduce results in different infrastructures   Reduction in Latency   No specially designed interconnect used   Very low controllability in layout of interconnect due to abstraction   Programming Model   Hard to debug where programming naturally error-prone   Details about infrastructure are hidden   QoS Measurement   Especially for ubiquitous computing where context changes