Download presentation
Presentation is loading. Please wait.
Published byMitchell Cox Modified over 8 years ago
1
Windows Azure For SQL Folk Bob Duffy Database Architect Prodata SQL Centre of Excellence www.prodata.ie
2
Speaker Bio – Bob Duffy 20 years in database sector, 250+ projects 20 years in database sector, 250+ projects Senior Consultant with Microsoft 2005-2008 Senior Consultant with Microsoft 2005-2008 One of about 25 MCA for SQL Server globally (aka SQL Ranger) One of about 25 MCA for SQL Server globally (aka SQL Ranger) SQL MCM on SQL 2005 and 2008 SQL MCM on SQL 2005 and 2008 SQL Server MVP 2009+ SQL Server MVP 2009+ SSAS Maestro SSAS Maestro Database/Solution Architect at Prodata SQL Centre of Excellence Database/Solution Architect at Prodata SQL Centre of Excellence Regular speaker for TechNet, MSDN, Users Groups, Irish and UK Technology Conferences Regular speaker for TechNet, MSDN, Users Groups, Irish and UK Technology Conferences
3
What to Learn Today The bluffers guide to the cloud What MS Azure has to offer What's involved in moving to the cloud Note: we are not just looking at Azure databases!
4
Agenda The Cloud Basics The Microsoft Cloud “Azure” Cloud Services Cloud Storage Migrating to Windows Azure
5
What is a “Cloud”? Cloud: on-demand, scalable, multi-tenant, self-service compute and storage resources
6
IT Continuum
7
Software (as a Service) Storage Servers Networking O/S Middleware Virtualization Applications Runtime Data Platform (as a Service) Storage Servers Networking O/S Middleware Virtualization Applications Runtime Data Infrastructure (as a Service) Storage Servers Networking O/S Middleware Virtualization Data Applications Runtime You Manage Vendor Manages You Manage Vendor Manages You Manage Vendor Manages The ROI Argument Efficiency v Control On Premises Storage Servers Networking O/S Middleware Virtualization Data Applications Runtime
8
What is the Microsoft Cloud: Azure Frameworks Global Physical Infrastructure servers / network / datacenters Infrastructure N Central US, S Central US, N Europe, W Europe, E Asia, SE Asia + 24 Edge CDN Locations Automated Managed Resources Elastic Usage Based Services computestoragenetworking virtual machines web sitescloud services SQL database noSQL database blob storageconnectvirtual network traffic manager...... Fabric..............................
9
The Microsoft Cloud hardware (gen4) Purpose-built data centre to accommodate containers at large scale Cost $500 million, 100,000 square foot facility (10 football fields) 40 foot shipping containers can house as many as 2,500 servers Density of 10 times amount of compute in equivalent space in traditional data centre Can deliver an average PUE of 1.22 Power Usage Effectiveness benchmark from The Green Grid™ consortium on energy efficiency Typical data centre has PUE of maybe 2.5. Google has 1.12
10
Data centre Clusters Datacenters are divided into “clusters” Approximately 1000 rack-mounted server (aka “nodes”) Provides a unit of fault isolation Each cluster is managed by a Fabric Controller (FC)
11
The Fabric Controller (FC) The “kernel” of the cloud operating system Manages datacenter hardware Manages Windows Azure services
12
Getting Started With Cloud Services - Hello Twitter example
13
Inside a Cloud Service
14
VM Sizes SizeCoresGhz (AMD) RAM (GB)Disk (GB)Bandwidth (Mbps) Cost $/year Cost per core per year $ XSShared2.1*0.75205173 Small12.11.751651001,037 Medium22.13.53402002,0641,032 Large42.178504004,1401,035 Extra Large 8211418908008,2921,037 http://www.windowsazure.com/en-us/pricing/calculator/?scenario=full as at 24/11/2012 http://www.windowsazure.com/en-us/pricing/calculator/?scenario=full “Egress” Bandwidth (outgoing traffic) is also chargeable $11.40 per 100GB in NA and Europe $18.05 per 100GB other locations LOTS of other chargeable services
15
My Pros and Cons of Cloud Services Pros No more chatting to the storage guys and internal red tape ;-) Elastic resources Great for time based demand and gradual increase in scale Easy to manage (RDP or web management) Cons “Transient Errors Not “stateful” Custom builds tricky We still have “some” OS management Can take 5-30 mins for a full deployment Code updates can be tricky What if we have 100 web sites? What if I want to run something other than a dot.net App Custom Library (dot.net nuke) On premise software like SharePoint
16
Web Sites “Quick and Easy” web site deployment Many operational benefits over current “Cloud Services”
17
Getting Started With Web Sites -Hello Twitter Web Site
18
*new* Infrastructure As a Service (IaaS) Same Size VM as Cloud Services What sort of hardware We benchmark about 100MB/Sec disk Currently about 2.1 Ghz processors Max 8 cores Max 14GB ram ;-(
19
Getting Started With IaaS -Creating your VM -Deploying to your VM
20
Azure Storage Options
21
Storage Types
22
Storage Concepts
23
Table Storage Concepts compute data management networking blob connect virtual network traffic manager cloud services VMswebsites SQL database noSQL database Entity Table Account Name =… Email = … Name =… EMailAdd= … contoso customers photos Photo ID =… Date =… Photo ID =… Date =… Scale up to Peta Bytes Table Storage a NoSQL key-value store technology used by applications requiring storing large amounts of data storage that need additional structure at no performance cost.
24
Table Data Model Table A storage account can create many tables.NET classes and LINQ A table is a set of entities (rows) An entity is a set of properties (columns) Billions of entities and TBs of data Two “key” properties that together are the unique ID of the entity in the table PartitionKey – enables scalability RowKey – uniquely identifies the entity within the partition As of 2011 over 200 Petabytes in Blob Storage
25
Windows Azure Storage Tables: Challenges Access via REST You can’t use ordinary ADO.NET SDK Provides some tooling No SQL No real joins, aggregates, etc. Very limited indexing An unfamiliar hierarchical structure You can’t easily move relational data to it Supporting services are scarce, e.g., reporting No schema
26
Storage Performance Tables limited to about 500 entities a sec Blob Stores are the foundation of LUNS in IaaS We benchmark about 100MB/Sec random read About 60ms latency Local disks have same throughput but lower latency Next Generation (gen2) storage Announced Up to 2,000 entities a second single partition 20,000 entities a second multiple partitions http://blogs.msdn.com/b/windowsazure/archive/2012/11/02/windows-azure-s-flat-network- storage-and-2012-scalability-targets.aspx http://blogs.msdn.com/b/windowsazure/archive/2012/11/02/windows-azure-s-flat-network- storage-and-2012-scalability-targets.aspx
27
Azure SQL Databases Application Internet Azure Cloud Internet Azure Cloud LB TDS (tcp) Applications use standard SQL client libraries: ODBC, ADO.Net, PHP, … Load balancer forwards ‘sticky’ sessions to TDS protocol tier Security Boundary SQL Gateway Scalability and Availability: Fabric, Failover, Replication, and Load balancing Gateway: TDS protocol gateway, enforces AUTHN/AUTHZ policy; proxy to backend SQL
28
What's inside each node 8 Cores 32GB RAM 12 spindles (See performance and elasticity guide) Takeaway: Don’t confuse performance and scalability
29
Objects NOT Supported Heap Table Types Change Data Capture Data Auditing Data Compression Extended Events Extension of spatial types and methods through Common Language Runtime (CLR) External Key Management / Extensible Key Management FILESTREAM Data Integrated Full-Text Search Large User-Defined Aggregates (UDAs) Large User-Defined Types (UDTs) Performance Data Collection (Data Collector) Policy-Based Management Resource Governor USE X Extended Properties Extended Stored Procedures SQL Server Agent/Jobs Common Language Runtime (CLR) and CLR User-Defined Types Database Mirroring Trace Flags System Tables Service Broker Table Partitioning Typed XML and XML indexing is not supported. (The XML data type is supported by SQL Azure Database) Global Temporary Tables Sp_configure SQL Server Replication Transparent Data Encryption SQL Server PowerShell Provider Backup and Restore Replication File Groups
30
Other Limitations- Throttling Lock Consumption Sessions using > 1M locks Excessive Log Usage Single transaction consuming > 1GB Uncommitted Transactions Single transaction consuming > 20% of the log Excessive TempDB usage Session using > 5GB of TempDB Excessive Memory Usage When the node experiences memory contention… Sessions using > 16MB for > 20 seconds are terminated in descending order Idle Connections (30 mins)
31
Pricing and Sizes Size$/Month 0-100MB4.995 Up to 1GB9.99 1-10GB3.996 per GB over 1 10-50GB45.95 for first 10GB 1.996 per GB after that 50-150GB125.874 for 50GB 0.999 per GB after that Plus Egress Network traffic costsPlus Egress Network traffic costs BUT no licensing costsBUT no licensing costs Azure Storage Costs as a comparison Size$/Month 50GB (geo-replicated)6.25 50GB (local replication)4.66
32
Migrating to Azure Use IaaS and just move on-premise Migrate SQL =>Sql Azure Use WebRole or Websites to move applications use of services will complicate migration AuthenticationMessagingStorage Session State Data Caching Content Networks TabEcommerce Legacy code
33
Migrating the Dell DVD Store to Azure - IaaS -PaaS (WebSite and SQL Azure)
34
Thank You
35
Resources Introductions to Windows Azure http://channel9.msdn.com/Events/BUILD/BUILD2011/SAC-852F http://channel9.msdn.com/Events/BUILD/BUILD2011/SAC-852F Inside Windows Azure http://channel9.msdn.com/Events/BUILD/BUILD2011/SAC-853T http://channel9.msdn.com/Events/BUILD/BUILD2011/SAC-853T
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.