Windows Azure For SQL Folk Bob Duffy Database Architect Prodata SQL Centre of Excellence

Speaker Bio – Bob Duffy 20 years in database sector, 250+ projects 20 years in database sector, 250+ projects Senior Consultant with Microsoft Senior Consultant with Microsoft One of about 25 MCA for SQL Server globally (aka SQL Ranger) One of about 25 MCA for SQL Server globally (aka SQL Ranger) SQL MCM on SQL 2005 and 2008 SQL MCM on SQL 2005 and 2008 SQL Server MVP SQL Server MVP SSAS Maestro SSAS Maestro Database/Solution Architect at Prodata SQL Centre of Excellence Database/Solution Architect at Prodata SQL Centre of Excellence Regular speaker for TechNet, MSDN, Users Groups, Irish and UK Technology Conferences Regular speaker for TechNet, MSDN, Users Groups, Irish and UK Technology Conferences

What to Learn Today The bluffers guide to the cloud What MS Azure has to offer What's involved in moving to the cloud Note: we are not just looking at Azure databases!

Agenda The Cloud Basics The Microsoft Cloud “Azure” Cloud Services Cloud Storage Migrating to Windows Azure

What is a “Cloud”? Cloud: on-demand, scalable, multi-tenant, self-service compute and storage resources

IT Continuum

Software (as a Service) Storage Servers Networking O/S Middleware Virtualization Applications Runtime Data Platform (as a Service) Storage Servers Networking O/S Middleware Virtualization Applications Runtime Data Infrastructure (as a Service) Storage Servers Networking O/S Middleware Virtualization Data Applications Runtime You Manage Vendor Manages You Manage Vendor Manages You Manage Vendor Manages The ROI Argument Efficiency v Control On Premises Storage Servers Networking O/S Middleware Virtualization Data Applications Runtime

What is the Microsoft Cloud: Azure Frameworks Global Physical Infrastructure servers / network / datacenters Infrastructure N Central US, S Central US, N Europe, W Europe, E Asia, SE Asia + 24 Edge CDN Locations Automated Managed Resources Elastic Usage Based Services computestoragenetworking virtual machines web sitescloud services SQL database noSQL database blob storageconnectvirtual network traffic manager Fabric

The Microsoft Cloud hardware (gen4) Purpose-built data centre to accommodate containers at large scale   Cost $500 million, 100,000 square foot facility (10 football fields) 40 foot shipping containers can house as many as 2,500 servers   Density of 10 times amount of compute in equivalent space in traditional data centre Can deliver an average PUE of 1.22   Power Usage Effectiveness benchmark from The Green Grid™ consortium on energy efficiency   Typical data centre has PUE of maybe 2.5. Google has 1.12

Data centre Clusters Datacenters are divided into “clusters” Approximately 1000 rack-mounted server (aka “nodes”) Provides a unit of fault isolation Each cluster is managed by a Fabric Controller (FC)

The Fabric Controller (FC) The “kernel” of the cloud operating system Manages datacenter hardware Manages Windows Azure services

Getting Started With Cloud Services - Hello Twitter example

Inside a Cloud Service

VM Sizes SizeCoresGhz (AMD) RAM (GB)Disk (GB)Bandwidth (Mbps) Cost $/year Cost per core per year $ XSShared2.1* Small ,037 Medium ,0641,032 Large ,1401,035 Extra Large ,2921,037  as at 24/11/ “Egress” Bandwidth (outgoing traffic) is also chargeable $11.40 per 100GB in NA and Europe $18.05 per 100GB other locations LOTS of other chargeable services

My Pros and Cons of Cloud Services Pros No more chatting to the storage guys and internal red tape ;-) Elastic resources Great for time based demand and gradual increase in scale Easy to manage (RDP or web management) Cons “Transient Errors Not “stateful” Custom builds tricky We still have “some” OS management Can take 5-30 mins for a full deployment Code updates can be tricky What if we have 100 web sites? What if I want to run something other than a dot.net App Custom Library (dot.net nuke) On premise software like SharePoint

Web Sites “Quick and Easy” web site deployment Many operational benefits over current “Cloud Services”

Getting Started With Web Sites -Hello Twitter Web Site

*new* Infrastructure As a Service (IaaS) Same Size VM as Cloud Services What sort of hardware We benchmark about 100MB/Sec disk Currently about 2.1 Ghz processors Max 8 cores Max 14GB ram ;-(

Getting Started With IaaS -Creating your VM -Deploying to your VM

Azure Storage Options

Storage Types

Storage Concepts

Table Storage Concepts compute data management networking blob connect virtual network traffic manager cloud services VMswebsites SQL database noSQL database Entity Table Account Name =… = … Name =… Add= … contoso customers photos Photo ID =… Date =… Photo ID =… Date =… Scale up to Peta Bytes Table Storage a NoSQL key-value store technology used by applications requiring storing large amounts of data storage that need additional structure at no performance cost.

Table Data Model Table A storage account can create many tables.NET classes and LINQ A table is a set of entities (rows) An entity is a set of properties (columns) Billions of entities and TBs of data Two “key” properties that together are the unique ID of the entity in the table PartitionKey – enables scalability RowKey – uniquely identifies the entity within the partition As of 2011 over 200 Petabytes in Blob Storage

Windows Azure Storage Tables: Challenges Access via REST You can’t use ordinary ADO.NET SDK Provides some tooling No SQL No real joins, aggregates, etc. Very limited indexing An unfamiliar hierarchical structure You can’t easily move relational data to it Supporting services are scarce, e.g., reporting No schema

Storage Performance Tables limited to about 500 entities a sec Blob Stores are the foundation of LUNS in IaaS We benchmark about 100MB/Sec random read About 60ms latency Local disks have same throughput but lower latency Next Generation (gen2) storage Announced Up to 2,000 entities a second single partition 20,000 entities a second multiple partitions storage-and-2012-scalability-targets.aspx storage-and-2012-scalability-targets.aspx

Azure SQL Databases Application Internet Azure Cloud Internet Azure Cloud LB TDS (tcp) Applications use standard SQL client libraries: ODBC, ADO.Net, PHP, … Load balancer forwards ‘sticky’ sessions to TDS protocol tier Security Boundary SQL Gateway Scalability and Availability: Fabric, Failover, Replication, and Load balancing Gateway: TDS protocol gateway, enforces AUTHN/AUTHZ policy; proxy to backend SQL

What's inside each node 8 Cores 32GB RAM 12 spindles (See performance and elasticity guide) Takeaway: Don’t confuse performance and scalability

Objects NOT Supported Heap Table Types Change Data Capture Data Auditing Data Compression Extended Events Extension of spatial types and methods through Common Language Runtime (CLR) External Key Management / Extensible Key Management FILESTREAM Data Integrated Full-Text Search Large User-Defined Aggregates (UDAs) Large User-Defined Types (UDTs) Performance Data Collection (Data Collector) Policy-Based Management Resource Governor USE X Extended Properties Extended Stored Procedures SQL Server Agent/Jobs Common Language Runtime (CLR) and CLR User-Defined Types Database Mirroring Trace Flags System Tables Service Broker Table Partitioning Typed XML and XML indexing is not supported. (The XML data type is supported by SQL Azure Database) Global Temporary Tables Sp_configure SQL Server Replication Transparent Data Encryption SQL Server PowerShell Provider Backup and Restore Replication File Groups

Other Limitations- Throttling Lock Consumption Sessions using > 1M locks Excessive Log Usage Single transaction consuming > 1GB Uncommitted Transactions Single transaction consuming > 20% of the log Excessive TempDB usage Session using > 5GB of TempDB Excessive Memory Usage When the node experiences memory contention… Sessions using > 16MB for > 20 seconds are terminated in descending order Idle Connections (30 mins)

Pricing and Sizes Size$/Month 0-100MB4.995 Up to 1GB GB3.996 per GB over GB45.95 for first 10GB per GB after that GB for 50GB per GB after that Plus Egress Network traffic costsPlus Egress Network traffic costs BUT no licensing costsBUT no licensing costs Azure Storage Costs as a comparison Size$/Month 50GB (geo-replicated) GB (local replication)4.66

Migrating to Azure Use IaaS and just move on-premise Migrate SQL =>Sql Azure Use WebRole or Websites to move applications use of services will complicate migration AuthenticationMessagingStorage Session State Data Caching Content Networks TabEcommerce Legacy code

Migrating the Dell DVD Store to Azure - IaaS -PaaS (WebSite and SQL Azure)

Thank You

Resources Introductions to Windows Azure Inside Windows Azure