Presentation is loading. Please wait.

Presentation is loading. Please wait.

Windows Azure For SQL Folk Bob Duffy Database Architect Prodata SQL Centre of Excellence www.prodata.ie.

Similar presentations


Presentation on theme: "Windows Azure For SQL Folk Bob Duffy Database Architect Prodata SQL Centre of Excellence www.prodata.ie."— Presentation transcript:

1 Windows Azure For SQL Folk Bob Duffy Database Architect Prodata SQL Centre of Excellence www.prodata.ie

2 Speaker Bio – Bob Duffy 20 years in database sector, 250+ projects 20 years in database sector, 250+ projects Senior Consultant with Microsoft 2005-2008 Senior Consultant with Microsoft 2005-2008 One of about 25 MCA for SQL Server globally (aka SQL Ranger) One of about 25 MCA for SQL Server globally (aka SQL Ranger) SQL MCM on SQL 2005 and 2008 SQL MCM on SQL 2005 and 2008 SQL Server MVP 2009+ SQL Server MVP 2009+ SSAS Maestro SSAS Maestro Database/Solution Architect at Prodata SQL Centre of Excellence Database/Solution Architect at Prodata SQL Centre of Excellence Regular speaker for TechNet, MSDN, Users Groups, Irish and UK Technology Conferences Regular speaker for TechNet, MSDN, Users Groups, Irish and UK Technology Conferences

3 What to Learn Today The bluffers guide to the cloud What MS Azure has to offer What's involved in moving to the cloud Note: we are not just looking at Azure databases!

4 Agenda The Cloud Basics The Microsoft Cloud “Azure” Cloud Services Cloud Storage Migrating to Windows Azure

5 What is a “Cloud”? Cloud: on-demand, scalable, multi-tenant, self-service compute and storage resources

6 IT Continuum

7 Software (as a Service) Storage Servers Networking O/S Middleware Virtualization Applications Runtime Data Platform (as a Service) Storage Servers Networking O/S Middleware Virtualization Applications Runtime Data Infrastructure (as a Service) Storage Servers Networking O/S Middleware Virtualization Data Applications Runtime You Manage Vendor Manages You Manage Vendor Manages You Manage Vendor Manages The ROI Argument Efficiency v Control On Premises Storage Servers Networking O/S Middleware Virtualization Data Applications Runtime

8 What is the Microsoft Cloud: Azure Frameworks Global Physical Infrastructure servers / network / datacenters Infrastructure N Central US, S Central US, N Europe, W Europe, E Asia, SE Asia + 24 Edge CDN Locations Automated Managed Resources Elastic Usage Based Services computestoragenetworking virtual machines web sitescloud services SQL database noSQL database blob storageconnectvirtual network traffic manager...... Fabric..............................

9 The Microsoft Cloud hardware (gen4) Purpose-built data centre to accommodate containers at large scale   Cost $500 million, 100,000 square foot facility (10 football fields) 40 foot shipping containers can house as many as 2,500 servers   Density of 10 times amount of compute in equivalent space in traditional data centre Can deliver an average PUE of 1.22   Power Usage Effectiveness benchmark from The Green Grid™ consortium on energy efficiency   Typical data centre has PUE of maybe 2.5. Google has 1.12

10 Data centre Clusters Datacenters are divided into “clusters” Approximately 1000 rack-mounted server (aka “nodes”) Provides a unit of fault isolation Each cluster is managed by a Fabric Controller (FC)

11 The Fabric Controller (FC) The “kernel” of the cloud operating system Manages datacenter hardware Manages Windows Azure services

12 Getting Started With Cloud Services - Hello Twitter example

13 Inside a Cloud Service

14 VM Sizes SizeCoresGhz (AMD) RAM (GB)Disk (GB)Bandwidth (Mbps) Cost $/year Cost per core per year $ XSShared2.1*0.75205173 Small12.11.751651001,037 Medium22.13.53402002,0641,032 Large42.178504004,1401,035 Extra Large 8211418908008,2921,037  http://www.windowsazure.com/en-us/pricing/calculator/?scenario=full as at 24/11/2012 http://www.windowsazure.com/en-us/pricing/calculator/?scenario=full “Egress” Bandwidth (outgoing traffic) is also chargeable $11.40 per 100GB in NA and Europe $18.05 per 100GB other locations LOTS of other chargeable services

15 My Pros and Cons of Cloud Services Pros No more chatting to the storage guys and internal red tape ;-) Elastic resources Great for time based demand and gradual increase in scale Easy to manage (RDP or web management) Cons “Transient Errors Not “stateful” Custom builds tricky We still have “some” OS management Can take 5-30 mins for a full deployment Code updates can be tricky What if we have 100 web sites? What if I want to run something other than a dot.net App Custom Library (dot.net nuke) On premise software like SharePoint

16 Web Sites “Quick and Easy” web site deployment Many operational benefits over current “Cloud Services”

17 Getting Started With Web Sites -Hello Twitter Web Site

18 *new* Infrastructure As a Service (IaaS) Same Size VM as Cloud Services What sort of hardware We benchmark about 100MB/Sec disk Currently about 2.1 Ghz processors Max 8 cores Max 14GB ram ;-(

19 Getting Started With IaaS -Creating your VM -Deploying to your VM

20 Azure Storage Options

21 Storage Types

22 Storage Concepts

23 Table Storage Concepts compute data management networking blob connect virtual network traffic manager cloud services VMswebsites SQL database noSQL database Entity Table Account Name =… Email = … Name =… EMailAdd= … contoso customers photos Photo ID =… Date =… Photo ID =… Date =… Scale up to Peta Bytes Table Storage a NoSQL key-value store technology used by applications requiring storing large amounts of data storage that need additional structure at no performance cost.

24 Table Data Model Table A storage account can create many tables.NET classes and LINQ A table is a set of entities (rows) An entity is a set of properties (columns) Billions of entities and TBs of data Two “key” properties that together are the unique ID of the entity in the table PartitionKey – enables scalability RowKey – uniquely identifies the entity within the partition As of 2011 over 200 Petabytes in Blob Storage

25 Windows Azure Storage Tables: Challenges Access via REST You can’t use ordinary ADO.NET SDK Provides some tooling No SQL No real joins, aggregates, etc. Very limited indexing An unfamiliar hierarchical structure You can’t easily move relational data to it Supporting services are scarce, e.g., reporting No schema

26 Storage Performance Tables limited to about 500 entities a sec Blob Stores are the foundation of LUNS in IaaS We benchmark about 100MB/Sec random read About 60ms latency Local disks have same throughput but lower latency Next Generation (gen2) storage Announced Up to 2,000 entities a second single partition 20,000 entities a second multiple partitions http://blogs.msdn.com/b/windowsazure/archive/2012/11/02/windows-azure-s-flat-network- storage-and-2012-scalability-targets.aspx http://blogs.msdn.com/b/windowsazure/archive/2012/11/02/windows-azure-s-flat-network- storage-and-2012-scalability-targets.aspx

27 Azure SQL Databases Application Internet Azure Cloud Internet Azure Cloud LB TDS (tcp) Applications use standard SQL client libraries: ODBC, ADO.Net, PHP, … Load balancer forwards ‘sticky’ sessions to TDS protocol tier Security Boundary SQL Gateway Scalability and Availability: Fabric, Failover, Replication, and Load balancing Gateway: TDS protocol gateway, enforces AUTHN/AUTHZ policy; proxy to backend SQL

28 What's inside each node 8 Cores 32GB RAM 12 spindles (See performance and elasticity guide) Takeaway: Don’t confuse performance and scalability

29 Objects NOT Supported Heap Table Types Change Data Capture Data Auditing Data Compression Extended Events Extension of spatial types and methods through Common Language Runtime (CLR) External Key Management / Extensible Key Management FILESTREAM Data Integrated Full-Text Search Large User-Defined Aggregates (UDAs) Large User-Defined Types (UDTs) Performance Data Collection (Data Collector) Policy-Based Management Resource Governor USE X Extended Properties Extended Stored Procedures SQL Server Agent/Jobs Common Language Runtime (CLR) and CLR User-Defined Types Database Mirroring Trace Flags System Tables Service Broker Table Partitioning Typed XML and XML indexing is not supported. (The XML data type is supported by SQL Azure Database) Global Temporary Tables Sp_configure SQL Server Replication Transparent Data Encryption SQL Server PowerShell Provider Backup and Restore Replication File Groups

30 Other Limitations- Throttling Lock Consumption Sessions using > 1M locks Excessive Log Usage Single transaction consuming > 1GB Uncommitted Transactions Single transaction consuming > 20% of the log Excessive TempDB usage Session using > 5GB of TempDB Excessive Memory Usage When the node experiences memory contention… Sessions using > 16MB for > 20 seconds are terminated in descending order Idle Connections (30 mins)

31 Pricing and Sizes Size$/Month 0-100MB4.995 Up to 1GB9.99 1-10GB3.996 per GB over 1 10-50GB45.95 for first 10GB 1.996 per GB after that 50-150GB125.874 for 50GB 0.999 per GB after that Plus Egress Network traffic costsPlus Egress Network traffic costs BUT no licensing costsBUT no licensing costs Azure Storage Costs as a comparison Size$/Month 50GB (geo-replicated)6.25 50GB (local replication)4.66

32 Migrating to Azure Use IaaS and just move on-premise Migrate SQL =>Sql Azure Use WebRole or Websites to move applications use of services will complicate migration AuthenticationMessagingStorage Session State Data Caching Content Networks TabEcommerce Legacy code

33 Migrating the Dell DVD Store to Azure - IaaS -PaaS (WebSite and SQL Azure)

34 Thank You

35 Resources Introductions to Windows Azure http://channel9.msdn.com/Events/BUILD/BUILD2011/SAC-852F http://channel9.msdn.com/Events/BUILD/BUILD2011/SAC-852F Inside Windows Azure http://channel9.msdn.com/Events/BUILD/BUILD2011/SAC-853T http://channel9.msdn.com/Events/BUILD/BUILD2011/SAC-853T


Download ppt "Windows Azure For SQL Folk Bob Duffy Database Architect Prodata SQL Centre of Excellence www.prodata.ie."

Similar presentations


Ads by Google