1. SOA 16: Computing in the Cloud – Is it in your future? Dr. Sheldon Borkin Gus Björklund Vice Presidents, Technology I've looked at clouds from both sides now From up and down and still somehow It's cloud's illusions I recall I really don't know clouds at all - Joni Mitchell

2. © 2008 Progress Software Corporation2 SOA 16: Computing in the Cloud – Is it in your future? Agenda  What is cloud computing?  Examples  Advantages and potential issues  OpenEdge ® in the Amazon cloud  Lessons-learned  Conclusions Computing in the Clouds – Is it in your future?

3. © 2008 Progress Software Corporation3 SOA 16: Computing in the Cloud – Is it in your future? Clouds - the next evolution of hosting

4. © 2008 Progress Software Corporation4 SOA 16: Computing in the Cloud – Is it in your future? Users The services clouds Compute Services Virtual machine grid Application grid Points-of-presence Storage / Database Relational Storage blobs Entity/object Common Services Provisioning Authentication/Authorization Metering/billing Self-service UI APIs Application / Business Services Enterprise or ISV Business logic User interface Messaging/Integration Queuing Service bus Cloud-to-cloud, or cloud to on-premise Service Providers Application Development As-a-service + (Eclipse) + (Visual Studio) Application Platform Virtual machine Language platform App. framework

5. © 2008 Progress Software Corporation5 SOA 16: Computing in the Cloud – Is it in your future? Service Providers As a Service/Application Provider  You are providing an application accessible over the web  You buy your hosting as services  You optionally buy additional services  You don’t know where your servers are located  You don’t have to speak to a human to provision a new server or install a new application

6. © 2008 Progress Software Corporation6 SOA 16: Computing in the Cloud – Is it in your future? Amazon Web Services Infrastructure-as-a-Service  Infrastructure Services EC2 – Elastic Computing Cloud S3 – Simple Storage Service SQS – Simple Queue Service SimpleDB  Billing and Payment Services Amazon DevPay Flexible Payment Service aws.amazon.com

7. © 2008 Progress Software Corporation7 SOA 16: Computing in the Cloud – Is it in your future? Google App Engine Application Platform-as-a-Service code.google.com/appengine/  Python language only (for now)  Persistent storage (GQL)  Automatic scaling and load balancing  APIs for authenticating users and sending email using Google Accounts  Local development environment that simulates Google App Engine on your computer  Preview release

8. © 2008 Progress Software Corporation8 SOA 16: Computing in the Cloud – Is it in your future? Force.com Application Framework-as-a-Service salesforce.com/developer  Use with or without Salesforce.com CRM  Application development and delivery – emphasis on point-and-click GUI  Customizable data object service (SOQL)  Apex language and JavaScript for UI  Visualforce tools for UI and mashups  Web services API

9. © 2008 Progress Software Corporation9 SOA 16: Computing in the Cloud – Is it in your future? Advantages and potential issues  Advantages Pay just for what you use – generally low cost Easy self-serve scale-up/scale-down Global reach Focus on application, not infrastructure  Potential issues Service level commitments vary widely – most on the weak side Limited control at hardware & network level Limited hand-holding

10. © 2008 Progress Software Corporation10 SOA 16: Computing in the Cloud – Is it in your future? In theory, there is no difference between theory and practice. But in practice, there is. Jan L. A. van de Snepscheut

11. © 2008 Progress Software Corporation11 SOA 16: Computing in the Cloud – Is it in your future? Running OpenEdge on Amazon EC2

12. © 2008 Progress Software Corporation12 SOA 16: Computing in the Cloud – Is it in your future? What is Amazon EC2

13. © 2008 Progress Software Corporation13 SOA 16: Computing in the Cloud – Is it in your future? AMI (vm) sizes AMI SizeHorsepower 4 MemoryDisk slices 0 I/O Perf. small 1 1 cu1.7 GB1 x 150 GBLow large 2 4 cu7.5 GB2 x 420 GBHigh extra large 2 8 cu15 GB4 x 420 GBHigh hi-cpu med 1 5 cu1.7 GB1 x 340 GBMed hi-cpu x-lg 2 20 cu7 GB4 x 420 GBHigh 0: and a 10 GB root partition 1: 32 bit processor 2: 64-bit processor 4: Amazon measures horsepower in “compute units” 1 cu = 1 x 1.2 GHz 2007 Opteron equivalent

14. © 2008 Progress Software Corporation14 SOA 16: Computing in the Cloud – Is it in your future? Amazon Compute Units vs Observed Size Compute Units Virtual cores Observed CPU small1 cu1 x 1 cu2 x 2.6 GHz large4 cu2 x 2 cu2 x 2.0 GHz extra large8 cu4 x 2 cu8 x 2.4 GHz hi-cpu med5 cu2 x 2.5 cu2 x 2.3 GHz hi-cpu x-lg20 cu8 x 2.5 cu8 x 2.3 GHz 1 cu = 1 x 1.2 GHz 2007 Opteron equivalent

15. © 2008 Progress Software Corporation15 SOA 16: Computing in the Cloud – Is it in your future? What does EC2 Cost? Virtual Machine Size Price (per hour) Small$ 0.10 Large$ 0.40 Extra large$ 0.80 Hi-cpu medium$ 0.20 Hi-cpu extra large$ 0.80

16. © 2008 Progress Software Corporation16 SOA 16: Computing in the Cloud – Is it in your future? What is Amazon S3

17. © 2008 Progress Software Corporation17 SOA 16: Computing in the Cloud – Is it in your future? Europe: $ 0.18 per GB-month US: $ 0.15 per GB-month What Does S3 Cost?

18. © 2008 Progress Software Corporation18 SOA 16: Computing in the Cloud – Is it in your future? Other Amazon Web Services  SimpleDB  Simple Queue Services  Premium Support  Mechanical Turk

19. © 2008 Progress Software Corporation19 SOA 16: Computing in the Cloud – Is it in your future? To Get Started  Create your Amazon Web Services account and then Sign up for Amazon S3 Sign up for Amazon EC2 Download command line tools –Needs Java ™ 1.5 Create a certificate Generate public/private keys  Start a virtual machine  Log in via ssh

20. © 2008 Progress Software Corporation20 SOA 16: Computing in the Cloud – Is it in your future? Instructions http://docs.amazonwebservices.com/ AWSEC2/2008-02-01/GettingStartedGuide/ http://developer.amazonwebservices.com

21. © 2008 Progress Software Corporation21 SOA 16: Computing in the Cloud – Is it in your future? Sign Up For AWS

22. © 2008 Progress Software Corporation22 SOA 16: Computing in the Cloud – Is it in your future? Get Identifiers

23. © 2008 Progress Software Corporation23 SOA 16: Computing in the Cloud – Is it in your future? Sign Up For S3

24. © 2008 Progress Software Corporation24 SOA 16: Computing in the Cloud – Is it in your future? Sign Up For EC2

25. © 2008 Progress Software Corporation25 SOA 16: Computing in the Cloud – Is it in your future? Generating A Keypair

26. © 2008 Progress Software Corporation26 SOA 16: Computing in the Cloud – Is it in your future? Firefox EC2 Plugin

27. © 2008 Progress Software Corporation27 SOA 16: Computing in the Cloud – Is it in your future? Start an EC2 VM

28. © 2008 Progress Software Corporation28 SOA 16: Computing in the Cloud – Is it in your future? Log in to your EC2 VM

29. © 2008 Progress Software Corporation29 SOA 16: Computing in the Cloud – Is it in your future? Loading stuff into your EC2 VM (AMI) create a directory to copy into (e.g. /home/gus) scp -i id_rsa-gsg-keypair dlclin32.tar.bz2 \ root@ec2-67-202-43-207.compute-1.amazonaws.com:\ /home/gus create a /home/dlc directory, unpack tarball into it set DLC var, add $DLC/bin to PATH create mount points and mount additional disk slices if needed (e.g. /dev/sdc, /dev/sdd, /dev/sde)

30. © 2008 Progress Software Corporation30 SOA 16: Computing in the Cloud – Is it in your future? Demonstration ! (screenshots of)

31. © 2008 Progress Software Corporation31 SOA 16: Computing in the Cloud – Is it in your future? Logged in to your EC 2VM

32. © 2008 Progress Software Corporation32 SOA 16: Computing in the Cloud – Is it in your future? Linux /proc/version

33. © 2008 Progress Software Corporation33 SOA 16: Computing in the Cloud – Is it in your future? /proc/cpuinfo

34. © 2008 Progress Software Corporation34 SOA 16: Computing in the Cloud – Is it in your future? /proc/meminfo

35. © 2008 Progress Software Corporation35 SOA 16: Computing in the Cloud – Is it in your future? for each customer

36. © 2008 Progress Software Corporation36 SOA 16: Computing in the Cloud – Is it in your future? It’s alive

37. © 2008 Progress Software Corporation37 SOA 16: Computing in the Cloud – Is it in your future? Where Are We In The Cloud Anyway ??? you are here the VM is here www.opte.org/maps

38. © 2008 Progress Software Corporation38 SOA 16: Computing in the Cloud – Is it in your future? Running The ATM Database Benchmark on EC2  Simulated ATM withdrawal/deposit transaction 3 updates, 1 create  150 4GL transaction generators no think time, self-serving mode  Database tables 80,000,000 accounts 80,000 Tellers 8,000 branches 1 history record per transaction What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. - Norbert Weiner

39. © 2008 Progress Software Corporation39 SOA 16: Computing in the Cloud – Is it in your future? ATM Database (physical) Total size 12 gigabytes (data) Data extent size 2,000,000 (2 GB) Data extent count 6 Data block size 4096 bytes Rows per block 64 Data Areas 1 Type II Data cluster size 512 blocks (2 megabytes)

40. © 2008 Progress Software Corporation40 SOA 16: Computing in the Cloud – Is it in your future? ATM Database (other info) Account table data 9.2 gigabytes Branch table data 922 kilobytes Teller table data 9.3 megabytes Indexes 691 megabytes RM blocks 2,588,252 Index blocks 181,334 Free blocks 142,464

41. © 2008 Progress Software Corporation41 SOA 16: Computing in the Cloud – Is it in your future? Standard ATM Workload Configuration  Data block size:4096  BI cluster size:16384  BI blocksize: 16  Server options: –-n 200 -L 10240 –-B 64000 –-spin 50000 –-bibufs 32  Page writers: 4  BI writer: yes  AI writer: no, ai not activated !  Transaction generators:150

42. © 2008 Progress Software Corporation42 SOA 16: Computing in the Cloud – Is it in your future?

43. © 2008 Progress Software Corporation43 SOA 16: Computing in the Cloud – Is it in your future? Creating the database  ~ 12 gigabyte database  Data extents and bi log all on one disk  4 loaders Build time198 minutes Index rebuild20 minutes Small VM

44. © 2008 Progress Software Corporation44 SOA 16: Computing in the Cloud – Is it in your future? Creating the database  ~ 12 gigabyte database  Data extents on 4 disks, bi log on 5th disk  2 loaders Build time68 minutes Index rebuild9 minutes High-cpu, extra large VM

45. © 2008 Progress Software Corporation45 SOA 16: Computing in the Cloud – Is it in your future? ATM Performance Results (the standard workload) 81254380872

46. © 2008 Progress Software Corporation46 SOA 16: Computing in the Cloud – Is it in your future? ATM Performance Results (the standard workload) experimentEC2 smallEC2 largeEC2 high- cpu extra- large 2006 Secret Bunker tps81254380872 disks1356 EC2 cu’s14206.6 est. cpu count2284 cpu speed2.6 GHz2.0 GHz2.3 GHz2.0 GHz cpu width32 bit64 bit 32 bit memory1.7 GB7.5 GB15 GB6 GB cu = “compute unit”, 1 x 1.2 GHz Opteron equivalent

47. © 2008 Progress Software Corporation47 SOA 16: Computing in the Cloud – Is it in your future? Customising your VM Image  Use scp to copy your stuff to it  Put things where you want them  Make sure everything works  edit /etc/rc if you want  Take out the trash !!!

48. © 2008 Progress Software Corporation48 SOA 16: Computing in the Cloud – Is it in your future? Saving Your Customised VM Image  Use scp to copy your certificate to /mnt S3 data are signed and encrypted  Save your current VM image to S3 ec2-bundle-vol ec2-upload-image  Later, you use ec2-run-instances to start it up.

49. © 2008 Progress Software Corporation49 SOA 16: Computing in the Cloud – Is it in your future? Shutting Down Your AMI

50. © 2008 Progress Software Corporation50 SOA 16: Computing in the Cloud – Is it in your future? “I don’t kill my own chicken for Sunday dinner anymore. Why should I provision my own server?” BigJimmy’s blog

51. © 2008 Progress Software Corporation51 SOA 16: Computing in the Cloud – Is it in your future? So What’s Wrong with EC2

52. © 2008 Progress Software Corporation52 SOA 16: Computing in the Cloud – Is it in your future? EC2 Limitations  Performance not as good as very big “real” machines But still decent  Performance varies somewhat day-to-day  Single AMI is I/O bandwidth limited  Single AMI limited to at most 5 disks  EC2 disk storage is volatile Must do backups to S3 or elsewhere  S3 requires SOAP (gross !) or REST  Sadly, EC2 not yet supported by Progress !!! Good stuff, but:

53. © 2008 Progress Software Corporation53 SOA 16: Computing in the Cloud – Is it in your future? AWS: When REALITY is not enough!  Cheap  Easy  Performant  Flexible Try it! You’ll like it! Advantages:

54. © 2008 Progress Software Corporation54 SOA 16: Computing in the Cloud – Is it in your future? Avez Vous des Questions References: aws.amazon.com developer.amazonwebservices.com docs.amazonwebservices.com