1. AWS Amazon Web Services Georges Akpoly CS252

2. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue Service (SQS) Amazon Mechanical Turk (MTurk) Alexa Web Services Amazon E-Commerce Service (ECS) Amazon Flexible Payments Service (FPS)

3. Starting Point One machine: Apache, IIS PHP / Perl / Java / … SQL Server, MySQL, Oracle

4. Worst Case Populariy

5. A Difficult Path

6. Problem: Backup High availability Redundancy Very big data sets

7. Problem: File System Important files have to be accessed by many servers NFS / Samba not practical

8. Problem: Messaging Many servers on different locations have to communicate Creating a reliable and scalable message queue is really hard

9. Don’t reinvent the wheel!

10. Amazon Web Services

11. S3 - Simple Storage Service Redundant storage - as much as you like max. 5 GB per object Organized in “Buckets” Web Service API for uploads Downloads via –Web Service –HTTP / HTTPS –BitTorrent

12. S3 - Buckets Unique over all S3 Contains many key-value-metadata tupel Cannot contain other buckets! Key can contain “/”

13. S3 with AWS::S3 Upload Download

14. S3 with AWS::S3 How do you run a website from S3 –#1 caveat: no index.html support –So it’s only useful to offload traffic and storage from your main site

15. S3 with AWS::S3 Set up a bucket name ‘vanlug’ Store a key in it ‘tux.png’ –Make it publicly accessible Set up a CName ‘static.vanlug.com’ and points it to ‘vanlug.s3.amazonaws.com’ Load up http://static.vanlug.com/tux.pnghttp://static.vanlug.com/tux.png That’s it.

16. S3 with AWS::S3 JungleDisk –This application lets you mount S3 like it is a local drive –Cross platform, support linux, Mac, Windows –Encryption can be pre or post upload.

17. EC2 - Elastic Compute Cloud Based on XEN virtualization On demand virtual servers - controlled with Web Service API Use your favorite Linux distro (Linux 2.6.16), Amazon Machine Images (AMI) are stored on S3 ACLs for hosts/ports access control

18. EC2 - Elastic Compute Cloud How much does it cost –Traffic between EC2 instances and S3 is free. Even if they are not in the same datacenter –$0.10 per instance-hour consumed ( or part of an hour consumed) –Same prices for traffic and storage as S3

19. EC2 - Elastic Compute Cloud What you can do with it –You are the root, do anything –Install software Apache VPN UT2004, Call of Duty Jabber –Load kernel modules

20. SQS - Simple Queue Service Distributed, highly scalable and reliable message system Unlimited number of queues and messages Locking / releasing built-in 256 KB message payload Basic permission model

21. SQS gem Setup Usage

22. MTurk Amazon uses Artificial Artificial Intelligence Submitters enter Human Intelligence tasks into the queue and workers can solve them Workers can be tested for capabilities before they are trusted Submitters can refuse results if they find them unsatisfactory There are feedback system in place so Workers can know if the submitters will pay

23. MTurk Some examples –Podcast transcription services –Image recognition for mapping service –Amazon has used it themselves for internal projects

24. Resources Developer Connection http://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=59 Forums http://developer.amazonwebservices.com/connect/forumindex.jspa Resource Center http://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=59 265,000+ developers

25. Questions???

26. Thank you for your attention