1. Cloud Computing Computation as Utility

2. Computer utilities Leonard Kleinrock, ARPANET, 1969: ”We will probably see the spread of computer utilities, which like electricity will service individual homes and offices.” CS@AUHenrik B Christensen2 Leonard with an Interface Message Processor, the first generation of routers ARPANET was the precursor to the internet

3. Why Utility? Ok, you have made your Android quizz game, but how many servers do you need to support? –1? 10? 1.000? –Depends on no. of users, and usage patterns And what about resilience of the servers? –Put them under my desk? –Backup? Computation as a utility –Electricity and water I pay per usage –How many spare CPU cycles do you have at home? CS@AUHenrik B Christensen 3

4. Utilization problem Either you –Waste hardware resources or –Cannot provide service during peaks –  CS@AUHenrik B Christensen 4

5. Cloud Definitions CS@AUHenrik B Christensen 5

6. Ambrust et al. CS@AUHenrik B Christensen 6

7. Buyya et al. CS@AUHenrik B Christensen 7

8. Vaquero et al. Based up review of a lot of definitions: Clouds are a large pool of easily usable and accessible virtualized resources (such as hardware, development platforms and/or services). These resources can be dynamically re-configured to adjust to a variable load (scale), allowing also for an optimum resource utilization. This pool of resources is typically exploited by a pay-per-use model in which guarantees are offered by the Infrastructure Provider by means of customized SLAs. CS@AUHenrik B Christensen 8

9. Comparing? Similarities? Differences? CS@AUHenrik B Christensen 9 Clouds are a large pool of easily usable and accessible virtualized resources (such as hardware, development platforms and/or services). These resources can be dynamically re-configured to adjust to a variable load (scale), allowing also for an optimum resource utilization. This pool of resources is typically exploited by a pay-per-use model in which guarantees are offered by the Infrastructure Provider by means of customized SLAs.

10. NIST characteristics Comparing CS@AUHenrik B Christensen 10

11. A key enabling technology: Virtualization CS@AUHenrik B Christensen 11

12. CS @ AUHenrik Bærbak Christensen12 Credits Some slides from –E6998 - Virtual Machines Lecture 2 CPU Virtualization Scott Devine VMware, Inc.

13. CS @ AUHenrik Bærbak Christensen13 What is it? virtual (adj): –existing in essence or effect, though not in actual fact Example –ScummVM is a program which allows you to run certain classic graphical point-and-click adventure games, provided you already have their data files. The clever part about this: ScummVM just replaces the executables shipped with the games, allowing you to play them on systems for which they were never designed!

14. CS @ AUHenrik Bærbak Christensen14 A Physical Machine Hardware – Processors, devices, memory, etc. Software – Built to the given hardware (Instruction Set Architecture, e.g. x86) – Built to given OS (App. Programming Interface, e.g. Win XP) – OS controls hardware

15. CS @ AUHenrik Bærbak Christensen15 A Virtual Machine Hardware Abstraction – Virtual processor, memory, devices, etc. Virtualization Software – Indirection: Decouple hardware and OS – Multiplex physical hardware across guest VMs

16. Enabling technology Virtualization allows cloud providers to rent you a machine easily and quickly –No buying equipment, no installing OS, no hooking network cables –Just launch a new VM… Typically through a web interface CS@AUHenrik B Christensen16

17. Example: Amazon EC2 CS@AUHenrik Bærbak Christensen17

18. Example: DigitalOcean CS@AUHenrik B Christensen18

19. Example: Private Cloud/ESXi CS@AUHenrik Bærbak Christensen19

20. One thing for sure… Terminology is victim of branding and trends –Droplet? Instance? Container? – CS@AUHenrik Bærbak Christensen20

21. Service Models & Operations CS@AUHenrik B Christensen 21

22. Service Models SaaS: Software as a service –End user applications accessible in the cloud, typically through web browsers or mobile apps –Exercise: Give examples PaaS:Platform as a service –Programming libraries, services, tools allowing applications to be build utilizing cloud features –Exercise:Give examples CS@AUHenrik B Christensen 22

23. Service Models IaaS: Infrastructure as a Service –Provide virtual processing and storage capacity, i.e. the actual computing infrastructure –Exercise: Give examples CS@AUHenrik B Christensen 23

24. Comparing Why are some cloud service models much easier to spot than others? CS@AUHenrik B Christensen 24

25. Example: NetFlix Adrian Cockcroft / GOTO 2012 CS@AUHenrik B Christensen 25 http://gotocon.com/dl/goto-aar-2012/slides/AdrianCockcroft_GloballyDistributedCloudApplicationsAtNetflix.pdf

26. Deployment models Examples –Public cloud:Give me an example –Private cloud:Give me an example CS@AUHenrik B Christensen 26

27. Obstacles/Opportunities Armbrust et al. –Business Continuity and Service Availability If your cloud provider fails – you fail –Data Lock-in Storage using propriatary API (Amazon S3 etc.) makes ‘getting your data back’ hard –Data Confidentiality/Auditability Who peeks into my data? –Data Transfer Bottlenecks Sending data is costly. Shipping disks are cheaper! CS@AUHenrik B Christensen 27

28. Obstacles/Opportunities Ambrust et al. –Performance Unpredictability Multiple VMs (one the same physical machine) can limit IO – i.e. cross-VM penalties –Scaleable Storage Storage is not as easily scaled as other resources –? Is this an issue of yesterday? –Bugs in Large Scale Dist. Systems How do you debug? NetFlix:Monkeys and Gorillas CS@AUHenrik B Christensen 28

29. Obstacles/Opportunities Ambrust et al. –Scaling Quickly What to do with idling machines? Shutting down means longer time to start... –Reputation Fate Sharing Spamming -> black listed IP addresses. Will you overtake these? –Software Licensing Pay as you go licenses for commercial SW CS@AUHenrik B Christensen 29

30. Operations Architecture of cloud provider CS@AUHenrik B Christensen 30