1. November 29, 2015 1 Our team: Undergrad Thomas de Ruiter, Anand Sawant, Ruben Verboon, … Grad Siqi Shen, Guo Yong, Nezih Yigitbasi Staff Henk Sips, Dick Epema, Alexandru Iosup, Otto Visser Collaborators Ion Stoica and the Mesos team (UC Berkeley), Thomas Fahringer, Radu Prodan, Vlad Nae (U. Innsbruck), Nicolae Tapus, Mihaela Balint, Vlad Posea (UPB), Derrick Kondo, Emmanuel Jeannot (INRIA), Assaf Schuster, Mark Silberstein, Orna Ben-Yehuda (Technion),... Introduction to Cloud Computing Alexandru Iosup Parallel and Distributed Systems Group Delft University of Technology The Netherlands SPEC RG Cloud Meeting

2. November 29, 2015 2

3. 3

4. What is Cloud Computing? 3. A Useful IT Service “Use only when you want! Pay only for what you use!” November 29, 2015 4 Q: What do you use? Q: Why not this level?

5. November 29, 2015 5 Agenda 1.What is Cloud Computing? 2.IaaS Clouds, the Core Idea 3.The IaaS Owner Perspective 4.The IaaS User Perspective 5.Reality Check 6.Conclusion

6. IaaS Cloud Computing VENI – @larGe: Massivizing Online Games using Cloud Computing

7. Joe Has an Idea ($$$) (Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: A. Iosup, 2011.) MusicWave

8. Big up-front commitment Load variability: NOT supported Solution #1 Buy or Rent … 10% (Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: A. Iosup, 2011.)

9. Solution #2 Deploy on IaaS Cloud (Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: V. Nae, 2008.) Q: So are we just shifting the problem to somebody else, that is, the IaaS cloud owner? NO big up-front commitment Load variability: supported

10. Inside an IaaS Cloud Data Center (Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: A. Iosup, 2011.)

11. Time and Cost Sharing Among Users User C User B MusicWave (Source: A. Antoniou, MSc Defense, TU Delft, 2012.)

12. Main Characteristics of IaaS Clouds 1.On-Demand Pay-per-Use 2.Elasticity (cloud concept of Scalability) 3.Resource Pooling 4.Fully automated IT services 5.Quality of Service November 29, 2015 12

13. November 29, 2015 13 Agenda 1.What is Cloud Computing? 2.IaaS Clouds, the Core Idea 3.The IaaS Owner Perspective: How to Deploy a Cloud? 4.The IaaS User Perspective 5.Reality Check 6.Conclusion

14. IaaS Cloud Deployment Models Private On-premises Public Off-premises Hybrid (Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: Mell and Grance, NIST Spec.Pub. 800-145, Sep 2011.)

15. Resource Sharing Models MusicWave November 29, 2015 15 MusicWave OtherApp Space-SharingTime-Sharing IaaS Clouds MusicWave OtherApp Q: Which one is better? Grids Host OS OtherApp

16. Virtualization November 29, 2015 16 Virtualization Host OS MusicWaveOtherApp Q: What to do now? Guest OS Virtual Resources VM Instance Applications Guest OS Virtual Resources VM Instance Applications Q: What is the problem?

17. November 29, 2015 Virtualization and The Full IaaS Stack 17 Guest OS Virtual Resources VM Instance Applications Physical Infrastructure Virtual Infrastructure Manager Virtual Machine Manager Guest OS Virtual Resources VM Instance Applications Virtual Machine Manager Guest OS Virtual Resources VM Instance Applications

18. The Virtual Machine Lifecycle November 29, 2015 18 (Source: A. Antoniou, MSc Defense, TU Delft, 2012.) Q: Is this fair?

19. Use Case: Amazon Elastic Compute Cloud (EC2) Prominent IaaS provider Datacenters all over the world Many VM instance types Per-hour charging November 29, 2015 19 InstanceCapacityUS$/hour m1.small0.10 m1.large0.38 c1.xlarge0.76

20. November 29, 2015 20 Agenda 1.What is Cloud Computing? 2.IaaS Clouds, the Core Idea 3.The IaaS Owner Perspective 4.The IaaS User Perspective: How to Use Clouds? How to Choose Clouds? 5.Reality Check 6.Conclusion

21. Workload November 29, 2015 21 MusicWaveOtherApp Time MusicWave OtherApp Load = 4 RunTime= 6

22. Use Case: Workloads of Zynga (Massively Social Gaming) November 29, 2015 22 Sources: CNN, Zynga. Source: InsideSocialGames.com “Zynga made more than $600M in 2010 from selling in-game virtual goods.” S. Greengard, CACM, Apr 2011 Selling in-game virtual goods: “Zynga made est. $270M in 2009 from.” http://techcrunch.com/2010/ 05/03/zynga-revenue/ http://techcrunch.com/2010/ 05/03/zynga-revenue/

23. Use Case: Workloads of Zynga (Massively Social Gaming) Load can grow very quickly November 29, 2015 23 Load

24. Provisioning and Allocation of Resources November 29, 2015 24 Load Time ProvisioningAllocation

25. Provisioning and Allocation of Resources November 29, 2015 25 Load Time ProvisioningAllocation Q: What is the interplay between provisioning and allocation?

26. Provisioning and Allocation Policies November 29, 2015 26 Where? When? How many? Time Load ProvisioningAllocation From where? Which type? etc. When? etc. Q: How many policies exist?Q: How to select a policy? (Source: A. Antoniou, MSc Defense, TU Delft, 2012.)

27. Use Case: Two Provisioning Policies, Compared November 29, 2015 27 Startup OnDemand Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure- as-a-Service Clouds, (submitted). PDS Tech.Rep.2011-009

28. Use Case: Two Provisioning Policies, Compared Metrics for comparison Job Slowdown (JSD ): Ratio of actual runtime in the cloud and the runtime in a dedicated non-virtualized environment Charged Cost (C c ) Utility (U ) November 29, 2015 28 Q: Charged cost vs Total RunTime? Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure- as-a-Service Clouds, (submitted). PDS Tech.Rep.2011-009

29. Use Case: Two Provisioning Policies, Compared Workloads November 29, 2015 29 Uniform IncreasingBursty Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure- as-a-Service Clouds, (submitted). PDS Tech.Rep.2011-009

30. SystemHardwareVIMHypervisorMax VMs DAS4/Delft20 Dual quad- core 2.4 GHz 24 GB RAM 2x1 TB storage 64 FIU7 Pentium 4 3.0 GHz 5 GB RAM 340 GB Storage 7 Amazon EC2unkown/various-20 Use Case: Two Provisioning Policies, Compared Environments November 29, 2015 30 Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure- as-a-Service Clouds, (submitted). PDS Tech.Rep.2011-009

31. Use Case: Many Provisioning Policies, Compared Job Slowdown (JSD) November 29, 2015 31 Q: Why is OnDemand worse than Startup? A: waiting for machines to boot

32. Use Case: Many Provisioning Policies, Compared Charged Cost (C c ) November 29, 2015 32 Q: Why is OnDemand worse than Startup? A: VM thrashing Q: Why no OnDemand on Amazon EC2?

33. Use Case: Many Provisioning Policies, Compared Utility (U ) 33

34. November 29, 2015 34 Agenda 1.What is Cloud Computing? 2.IaaS Clouds, the Core Idea 3.The IaaS Owner Perspective 4.The IaaS User Perspective 5.Reality Check: Who Uses Public Commercial Clouds? 6.Conclusion

35. November 29, 2015 35 The Real IaaS Cloud “The path to abundance” On-demand capacity Cheap for short-term tasks Great for web apps (EIP, web crawl, DB ops, I/O) “The killer cyclone” Not so great performance for scientific applications (compute- or data-intensive) http://www.flickr.com/photos/dimitrisotiropoulos/4204766418/ Tropical Cyclone Nargis (NASA, ISSS, 04/29/08) VS November 29, 2015

36. 36 (Source: http://www.cca08.org/files/slides/w_vogel.pdf)

37. Zynga zCloud: Hybrid Self-Hosted/EC2 After Zynga had large scale More efficient self-hosted servers Run at high utilization Use EC2 for unexpected demand November 29, 2015 37 (Sources: http://seekingalpha.com/article/609141-how-amazon-s-aws-can-attract-ugly-economics and http://www.undertheradarblog.com/blog/3-reasons-zynga-is-moving-to-a-private-cloud/)http://seekingalpha.com/article/609141-how-amazon-s-aws-can-attract-ugly-economics

38. Other Cloud Customers 218 virtual CPUs 9TB/2TB block/S3 storage 6.5TB/2TB I/O per month November 29, 2015 38 (Source: http://markbuhagiar.com/technical/businessinthecloud/)

39. November 29, 2015 39 Agenda 1.What is Cloud Computing? 2.IaaS Clouds, the Core Idea 3.The IaaS Owner Perspective 4.The IaaS User Perspective 5.Reality Check 6.Conclusion

40. November 29, 2015 40 Conclusion Take-Home Message Cloud Computing = IaaS + PaaS + SaaS Core idea = lease vs self-own On-Demand, Pay-per-Use, Elastic, Pooled, Automated, QoS The Owner Perspective Time-Sharing Virtualization The User Perspective Variable workloads Provisioning and Allocation policies Reality Check: 100s of users http://www.flickr.com/photos/dimitrisotiropoulos/4204766418/

41. November 29, 2015 41 Thank you for your attention! Questions? Suggestions? Observations? Alexandru Iosup A.Iosup@tudelft.nl http://www.pds.ewi.tudelft.nl/~iosup/ (or google “iosup”) Parallel and Distributed Systems Group Delft University of Technology A.Iosup@tudelft.nl http://www.pds.ewi.tudelft.nl/~iosup/ - http://www.st.ewi.tudelft.nl/~iosup/research.htmlhttp://www.st.ewi.tudelft.nl/~iosup/research.html - http://www.st.ewi.tudelft.nl/~iosup/research_cloud.htmlhttp://www.st.ewi.tudelft.nl/~iosup/research_cloud.html - http://www.pds.ewi.tudelft.nl/http://www.pds.ewi.tudelft.nl/ More Info: Do not hesitate to contact me…