Accounting for Azure in Your Data Architecture PASS Data Architecture Virtual Chapter http://dataarch.sqlpass.org Steve Hughes Practice Lead, Magenic March 21, 2013
Agenda Quick Intro Data Storage Data Integrity Business Continuity Wrap Up
Steve Hughes Principal Consultant with Magenic Over 15 years with SQL Server PASS Regional Mentor for US-NorthEast Region Contact Info Blog: http://www.dataonwheels.com Twitter: @DataOnWheels Email: steveh@magenic.com Email: steve@dataonwheels.com
Data Storage Options Azure Storage Service Table (structured) Storage Blob (unstructured) Storage Azure SQL Database SQL Server in the cloud Relational Database Azure HDInsight Microsoft’s Hadoop Distribution in Azure Big Data Out of Scope for Today
Azure Storage Service – Table Service Essentially NoSQL database Structured data Non-relational No support for joins Total Account Storage: 100TB OData and LINQ support URL Format: http://<<Storage Account>>.table.core.windows.net/<<Table>> Storage Account Table Entity Steve Books ISBN=“” Title=“” Author=“” Movies YearReleased=“”
Azure Storage Service – Blob Service Unstructured Storage Pictures Files VM images Blobs can be over 100GB Storage capacity of 100TB HTTP or HTTPS access to data URL Format: http://<<Storage Account>>.blob.core.windows.net/<<Container>>/<<Blob>> Storage Account Container Blob Steve Pictures IMAGE001.JPG IMAGE002.JPG TextFiles NameList.CSV
Azure SQL Database Relational data storage SQL Server as a Service (Platform as a Service) “5 Minute Setup time” From create server to functional database Develop online, with SSMS, or with Visual Studio – SQL Server Data Tools LCD Database Development
Data Storage Costs Azure Storage Service 1 TB, Geo Redundant ~ $100/month 1 TB, Locally Redundant ~$75/month 1 million transactions $0.10/month Azure SQL Database 100 GB ~$175/month 100 GB outbound data ~$12/month Inbound data is free
Pick the Best Storage Type for Your Data Table Storage Structured Non relational Key Value Pairs Low Cost Blob Storage Unstructured Images, Files SQL Database Relational Higher Cost
Data Integrity Considerations Cloud services will fail, plan for it Types of Issues Loss of connectivity Transient faults Time outs Resiliency patterns are a must
Sidebar: Performance in Azure Caching Is Required For Good Performance
Business Continuity High Availability All storage options have high availability built in Multiple copies within each data center Disaster Recovery Duplicate environment Backup on SQL Database BACPAC with SQL Database copied to Blob Storage Database copy 99.9% uptime Take note of outages How does it really compare to what you have today?
Other Data Tools to Consider in Azure Windows Azure SQL Data Sync Used to synchronize data between Azure SQL Databases or to on-premise databases Currently in Preview Windows Azure Virtual Machines Can host SQL Server with data files on blob storage SQL Reporting Still too expensive for simple use - ~$120/month entry level Supports RDL, similar to SSRS native reporting
Resources and Q&A Resiliency and Design Patterns http://blogs.msdn.com/b/adonet/archive/2013/03/11/sql-database-connectivity-and-the-idempotency-issue.aspx http://www.windowsazure.com/en-us/develop/net/architecture/#header-2 http://msdn.microsoft.com/en-us/library/hh680918(v=pandp.50).aspx http://msdn.microsoft.com/en-us/library/windowsazure/jj853352.aspx#bkmk_ResiliencyPatterns Brent Stineman’s Blog Azure storage: http://brentdacodemonkey.wordpress.com/category/windows-azure-platform/azure-storage/ SQL Azure: http://brentdacodemonkey.wordpress.com/category/windows-azure-platform/sql-azure/ Caching: http://brentdacodemonkey.wordpress.com/2012/08/02/local-file-cache-in-windows-azure/ Azure Storage Explorer: http://azurestorageexplorer.codeplex.com/ SQL Database Backup and Restore: http://msdn.microsoft.com/en-us/library/windowsazure/jj650016.aspx