Web Scale Computing Mike Culver Amazon Web Services

Agenda Web Scale Computing Overview Code

The Obligatory Timeline Slide COBOL, Edsel Amazon.com Darkness Web as a Platform Web Services, Resources Eliminated Web Awareness Internet ARPANET Dot-Com BubbleWeb 2.0 Web Scale Computing

Being Relevant Counts

Its All About Ideas

Ideas Cost Money a + bc

But How Much Money? Our favorite numbers: 0.10, 0.15, and 0.20 x

10 Amazon Web Services Are... A set of APIs and business models which give developers access to Amazon technology and content Data As a Service Amazon E-Commerce Service Amazon Historical Pricing Infrastructure As a Service Amazon Simple Queue Service Amazon Simple Storage Service Amazon Elastic Compute Cloud Search As a Service Alexa Web Information Service Alexa Top Sites Alexa Site Thumbnail Alexa Web Search Platform People As a Service Amazon Mechanical Turk

Amazon Web Scale Infrastructure: We Do the Muck Leverage Amazons Core Expertise Scales to the Enterprise Priced for People Reliable Simple to Use Highly Available Using Industry Standards HTTP, XML, REST, SOAP, XSLT With World-Class Developer Support

What do these companies have in common?

Amazon E-Commerce Service

Exposes Amazon's product data plus a shopping cart In 4 th major release Millions of products Rich data schema Product images Reviews Wishlists Commissions via Amazon Associates program

Amazon.com With Your Look

Amazon ECS Cost $0.00

Amazon Simple Storage Service

Amazon S3 is… Simple Data Storage in Amazon Data Center Web Service interface No set-up fee, No monthly minimum Storage: $0.15 per GB/Month Data Transfer: $0.20/GB to transfer data Private and public storage Each object up to 5GB in size

Many ISV Implementations S3 Explorer filicio.usJungle Disk S3 Firefox Organizer MyOwnDB

Amazon Elastic Compute Cloud

Amazon EC2 Is… A Web service that provides resizable compute capacity in the cloud. Designed to make Web-scale computing easier for developers. A simple Web service interface that provides complete control of your computing resources

Amazon EC2 Benefits You Because It Reduces the time required to obtain and boot new server instances to minutes Quickly scales capacity, both up and down, as your computing requirements change Changes the economics of computing: Pay only for capacity that you actually use a + bc becomes just bc

Amazon EC2 Changes Computing Economics No start-up, monthly, or fixed costs $0.10 per CPU hour $0.20 per GB transferred across Net No cost to transfer data between Amazon S3 and Amazon EC2

Amazon EC2 Profile 1.7 Ghz x86 processor 1.7 GB of RAM 160 GB disk 250 Mb/second network

Web-Scale for Mobile Services Used Amazon S3 Amazon EC2 Estimated Savings $650,000 Gumiyo.com

Amazon Mechanical Turk

Amazon Mechanical Turk Is… A web service that exposes an on-demand global workforce ready to complete small tasks in exchange for micro-payments Frictionless. Outsourcing per-se is irrelevant. A web services API

Identify Road Markings

Are These the Same MP3 Players?

30 How It Works Workers Artificial, Artificially Intelligent Software Requester (Developer) Requester (Developer) Human Intelligence Tasks (HITs) Human Intelligence Tasks (HITs) Completed HITs Completed HITs Worker Qualifications Worker Qualifications

Amazon Mechanical Turk is Relevant to Everyone 31 Software Developers Solves problem of building applications that until now have not worked well without human intelligence BusinessesEfficiently, effectively and inexpensively complete millions of tasks that require human intelligence Anyone1.Make money using the skills you already have whenever your schedule allows. 2.Previously unimaginable business ideas are now feasible…

32 Man Versus Machine

33 But Not Really

Podcast transcription service provider Transcribes audio into high-quality text Amazon Mechanical Turk: Workers transcribe podcasts and index text within search engine Amazon Simple Storage: Stores the podcasts and related files

Amazon Simple Queue

Amazon Simple Queue Is A reliable, highly scalable hosted distributed queue for storing messages as they travel between computers. Amazon's web-scale messaging infrastructure as a web service Platform-agnostic, allowing any computer on the Internet to add or read messages without any installed software or special firewall configurations

Amazon SQS Highlights Reliable Runs within Amazon's high-availability data centers. Messages are stored redundantly across multiple servers and data centers. Simple: Only Six Methods Scalable Secure: Strong access controls

Amazon SQS Pricing Pay only for what you use No minimum fee No start-up cost $0.10 per 1,000 messages sent ($ per message sent) $0.20 per GB of data transferred

Alexa Web Services

Four Alexa Web Services: One Vast Web Database Alexa Web Information Service: Web search engine, traffic information for web sites, a web site directory, and more. Alexa Top Sites: Programmatic access top sites data is available for the web as a whole, or for individual countries

Four Alexa Web Services: One Vast Web Database Alexa Site Thumbnail: Programmatic access to thumbnail images for the home pages of web sites. Alexa Web Search Platform: Directly analyze Alexa's Web archive to create and publish new search services

Amazon Historical Pricing

Highlights Access to 3 years of actual sales history from books, music, videos, and DVDs sold on Amazon.com Returns the average, minimum, maximum, and median price for items Up to ten items per request Pricing: $249/mo. for up to 60,000 requests/mo.

Learn More About AWS Explore Read Our Blog at Amazons hiring

Code!!!