Why you should be thinking hybrid with SQL Server 2016

Slides:



Advertisements
Similar presentations
SQL Server 2014 Platform for Hybrid Cloud (Level 300 Deck)
Advertisements

Windows Azure Migrating SQL Server Workloads Speaker Title Organization.
Azure.
Use relational database as a service
Dev and Test Solution reference architecture.
Data Platform and Analytics Foundational Training
Data Platform and Analytics Foundational Training
SQL Server 2016 How can Hoster Partners make money with SQL 2016?
Data Platform and Analytics Foundational Training
Data Platform and Analytics Foundational Training
Dev and Test Solution reference architecture.
System Center Marketing
Dev and Test Solution reference architecture.
Azure File Sync Setup, configuration and management
System Center Marketing
Implementacija SharePoint 2016 farme pomoću Azure IaaS
Microsoft Ignite /4/2018 8:46 AM
SQL 2016 new Hosting Offers Secure Database Hybrid HyperScale
Microsoft SQL Server 2017 Maximum Availability & Read Scale-Out
Modern application lifecycle with DevOps
6/17/2018 5:54 AM OSP322 Getting the best of both worlds, making the most of SharePoint hybrid search solutions Shyam Narayan Microsoft © 2013 Microsoft.
Dev and Test Solution reference architecture.
Lessons learned from moving to Microsoft Azure
TechEd /5/ :50 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Microsoft Ignite /31/ :08 AM
8/6/ :17 AM THR2214 Hybrid Cloud Activated A customer case study optimizing on-premises & Azure performance and cost Mor Cohen-Tal Senior Product.
Dev and Test Solution reference architecture.
Introduction Module 16 9/5/2018 9:26 PM
Design and Implement Cloud Data Platform Solutions
Mission-critical performance with Microsoft SQL Server 2016
Server & Tools Business
Design and Implement Cloud Data Platform Solutions
9/13/2018 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
Business Critical Application Platform
TechEd /15/ :37 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
TechEd /16/2018 2:45 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Azure.
Required 9s and data protection: introduction to sql server 2012 alwayson, new high availability solution Santosh Balasubramanian Senior Program Manager.
BRK3286 SQL Server 2016 High Availability and Disaster Recovery in private and hybrid cloud deployments Denny Cherry
SharePoint Online Management and Control
SQL Server BI on Windows Azure Virtual Machines
SQL On Azure Parikshit Savjani, Sr. Premier Field Engineer.
Microsoft Azure P wer Lunch
Microsoft Ignite NZ October 2016 SKYCITY, Auckland.
Microsoft Virtual Academy
TechEd /23/ :44 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
Microsoft Ignite /28/2018 8:58 AM
TechEd /28/ :51 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
Office 365 and Azure Active Directory Premium
Microsoft Virtual Academy
Dev and Test Solution reference architecture.
M318.
TechEd /11/ :54 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
TechEd /15/2019 8:08 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Surviving identity management in a hybrid world
2/27/2019 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
TechEd /28/2019 7:27 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Pushing Data to and from the Cloud with SQL Azure Data Sync
TechEd /11/ :25 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
DevOps Deep Dive / DevOps in action
Andrew Fryer Microsoft UK
Business Continuity and the Microsoft Cloud
Taking Windows Security to the Next Level with Group Policy
Windows Azure Hybrid Architectures and Patterns
*AZs available across US, Europe and Asia
ATC323 Architecting Highly Available, Geo-Redundant Cloud Solutions with Windows Azure Graham Elliott Asia Time Zone Director Global Technical Evangelism.
Microsoft Virtual Academy
Day 2, Session 2 Connecting System Center to the Public Cloud
Microsoft Virtual Academy
Microsoft Virtual Academy
Presentation transcript:

Why you should be thinking hybrid with SQL Server 2016 Scott Klein M324

A little about Scott… www.scottLklein.com scottkl@microsoft.com 1/12/2019 6:12 PM A little about Scott… www.scottLklein.com scottkl@microsoft.com @sqlscott © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

The Evolution of Microsoft Data Platform Modern DB platform Mission Critical Performance & Productivity Self-Service BI Cloud-Ready Mission Critical & Cloud Performance Mission Critical & Hyperscale Cloud XML ● KPIs SQL Server 2000 Management Studio ● Mirroring SQL Server 2005 Compression ● Policy-Based Mgmt ● Programmability SQL Server 2008 PowerPivot ● SharePoint Integration ● Master Data Services SQL Server 2008 R2 AlwaysOn ● ColumnStore Index ● Data Quality Services ● Power View ● Cloud Connectivity SQL Server 2012 In-Memory Across Workloads ● Performance & Scale ● Hybrid Cloud Optimized ● HDInsight ● Cloud BI SQL Server 2014 SQL Server 2016 Operational Analytics ● StretchDB ● PolyBase ● R Integration ● Temporal ● Query Data Store ● RLS ● Always Encrypted

SQL Server 2014 and the Data Platform Server & Tools Business 1/12/2019 SQL Server 2014 and the Data Platform Mission Critical Deeper Insights Hyperscale Cloud © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server 2014 and the Data Platform Server & Tools Business 1/12/2019 SQL Server 2014 and the Data Platform Mission Critical Deeper Insights Hyperscale Cloud © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Agenda StretchDB PolyBase Disaster Recovery Data Files in the cloud Backup to Cloud

Objectives What How Why Definition And Details Creation and Configuration Why Scenarios and Application

Stretchdb

Server & Tools Business 1/12/2019 Stretch SQL Server into Azure Stretch warm and cold tables to Azure with remote query processing Capability Stretch cold database tables from on-premises SQL Server Databases to Azure with remote query processing Benefits Cost effective historical data Entire table is online and remains queryable from on-premises apps Transparent to applications Supports Always Encrypted & Row Level Security Microsoft Azure Jim Gray ox7ff654ae6d 3/18/2005 Order history   Name SSN Date Jane Doe cm61ba906fd 2/28/2005 Jim Gray ox7ff654ae6d 3/18/2005 John Smith i2y36cg776rg 4/10/2005 Bill Brown nx290pldo90l 4/27/2005 Sue Daniels ypo85ba616rj 5/12/2005 Sarah Jones bns51ra806fd 5/22/2005 Jake Marks mci12hh906fj 6/07/2005 Eric Mears utb76b916gi 6/18/2014 Rachel Hogan px61hi9306fj 7/1/2014 Sam Johnson ol43bi506gd 7/12/2014 David Simon tx83hal916fi 7/29/2014 Michelle Burns nb95re926gi 8/10/2014 Reed Dean vc61ira536fe 8/23/2014 Order history   Name SSN Date Jane Doe cm61ba906fd 2/28/2005 Jim Gray ox7ff654ae6d 3/18/2005 John Smith i2y36cg776rg 4/10/2005 Bill Brown nx290pldo90l 4/27/2005 Customer data Product data Order History Stretch to cloud Query  SQL Server App © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

StretchDB

PolyBase

PolyBase What - Big Picture RDBMS Hadoop 1/12/2019 6:12 PM What - Big Picture RDBMS Hadoop PolyBase Provides a scalable, T-SQL compatible query processing framework for combining data from both worlds © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

PolyBase in SQL Server 16 Query Results SQL Server Azure Blob Storage Hadoop Azure Blob Storage

PolyBase

Why - PolyBase allows… Ad-hoc queries on Hadoop data Import data from Hadoop/Azure Storage to SQL Server for persistent storage Export data from SQL Server to Hadoop/Azure Storage for cold but queryable storage Seamless BI integration Push-down computation to Hadoop

Disaster recovery

What? Windows Azure On Premise TechReady 16 1/12/2019 © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What? Replicas continuously synchronize Political considerations TechReady 16 1/12/2019 What? Deploy one or more secondary replicas for on-premise SQL Server Replicas continuously synchronize At best region: West US, East US, East Asia, Southeast Asia, North Europe, West Europe Political considerations Latency Low TCO VM and storage © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What? Technologies Supported Technology SQL Server Version Zero Data Loss Scope # Secondaries Automatic Failover Readable Secondaries Availability Groups SQL Server 2012 SQL Server 2014 SQL Server 2016 Yes* (Sync Mode) DB(s) 4 Yes (w/ additional cluster member)** Database Mirroring SQL Server 2008 R2 (High Safety Mode) DB 1 (w/ Witness)** Limited (database snapshots) Log Shipping No N (standby state) * Most customers use Async Mode (High Performance) to avoid impacting primary performance **Async Mode only supports Force Failover to make DR (and potential data loss) a conscious decision

How? Requires a VPN device today Availability Groups TechReady 16 1/12/2019 How? Configure VPN tunnel Virtual Network from on-premise to Azure Requires a VPN device today https://www.windowsazure.com/en-us/manage/services/networking/cross-premises-connectivity/ Configure SQL Server technology as on-premise Availability Groups Add VM to on-premise Windows domain and Windows Cluster Tutorial: http://msdn.microsoft.com/en-us/library/jj870959.aspx Database Mirroring Tutorial: http://msdn.microsoft.com/en-us/library/jj870964.aspx Log Shipping Tutorial: http://msdn.microsoft.com/en-us/library/jj889442.aspx © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Example of Availability Group spanning On-premise and Azure redmond.corp.microsoft.com Availability Group S1 uswest.internal.cloudapp.net CSNB2252108-TA VPN Device Virtual Network AD / DNS P VPN tunnel CSNB2252109-TA S2 Windows Cluster VPN Gateway On Prem AGHybrid2 Windows Azure

Disaster Recovery

Why? Temporarily (e.g. gateway failure) Permanently (e.g. flooding) TechReady 16 1/12/2019 Why? An event can cause on-prem SQL Server to become unavailable Temporarily (e.g. gateway failure) Permanently (e.g. flooding) A disaster recovery site is expensive Site rent + maintenance Hardware Ops © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Why? Integrated HA/DR Offload Read workloads to Azure Provide additional benefits: Integrated HA/DR Offload Read workloads to Azure Connect reporting/BI apps Migrate apps and run against local secondaries Offload Backups to Azure A solution for policy compliance Remember it requires: Same Windows Domain Needs an Active Directory Domain Controller

Backup to cloud

What Windows Azure Storage Windows Azure VM On-premise box

What Backup and restore times are proportional to bandwidth Backup times fairly constant up to 1000ms latency Restore times proportional to latency Example Backup Size is: 138215424 (131.8MB)

How Requirements: Create using: Storage Account CREDENTIAL (SQL) T-SQL SMO Powershell

How $url = "https://[storage].blob.core.windows.net/backups/db.bak" CREATE CREDENTIAL mystoragecred WITH IDENTITY = ‘mystorage', SECRET = ‘<your storage access key>    BACKUP DATABASE mydb TO URL ='https://mystorage.blob.core.windows.net/backup-container/mydb-20130411.bak' WITH CREDENTIAL = ‘mystoragecred', FORMAT, COMPRESSION, STATS = 5, MEDIANAME = ‘mydb backup 20130411', MEDIADESCRIPTION = 'Backup of mydb' using Microsoft.SqlServer.Management.Smo; … Backup mybackup = new Backup(); mybackup.CredentialName = strCredential; mybackup.Database = strDatabase; mybackup.CompressionOption = BackupCompressionOptions.On; mybackup.Devices.AddDevice(desturl, DeviceType.Url); mybackup.SqlBackup(myLocalServer); $url = "https://[storage].blob.core.windows.net/backups/db.bak" $credential = "mycredential" $server = "SQLSERVER:\SQL\[computer]\DEFAULT" CD $server Backup-SqlDatabase -Database AdventureWorks2012 -backupFile $url -SqlCredential $credential -CompressionOption On

Backup to Cloud

Why Near “bottomless” storage Off-site, geo-redundant No provisioning No device management Media Safety (decay free) Remote accessibility

Data files in cloud

What Windows Azure Storage Windows Azure VM Native support for SQL Server database files stored as Windows Azure blobs. Windows Azure Storage DB1 DB2 DB3 On-premise box DB3 DB4 DB5 DB6 DB6

What Windows Azure Storage sp_attach_db Migrate Database to another machine Basic Disaster Recovery Separation of Compute and Storage For Azure VM, expand drive and size of Xdrive Better together: IaaS VM per minute billing Node1 Windows Azure Storage DB1 Node2 sp_attach_db DB1 DB1

How Additional considerations: Can be combined with Delayed Durability to reduce latencies ALTER DATABASE … SET DELAYED_DURABILITY = { DISABLED | ALLOWED | FORCED } Good candidate for use with Columnstore Indexes CREATE CLUSTERED COLUMNSTORE INDEX index_name … CREATE CREDENTIAL [https://mystorage.blog.core.windows.net/data] WITH IDENTITY = ‘Shared Access Signature', SECRET = ‘<your SAS key>    CREATE DATABASE mydb ON ( NAME = mydb_dat, FILENAME = 'https://mystorage.blob.core.windows.net/data/mydb.mdf' ) LOG ON ( NAME = foo_log, FILENAME = 'https://mystorage.blob.core.windows.net/data/mydblog.ldf')

Data Files in Cloud

Why Near “bottomless” storage Off-site, geo-redundant No provisioning No device management Media Safety (decay free) Remote accessibility

Why Additional considerations: Can be combined with Delayed Durability to reduce latencies ALTER DATABASE … SET DELAYED_DURABILITY = { DISABLED | ALLOWED | FORCED } Good candidate for use with Columnstore Indexes CREATE CLUSTERED COLUMNSTORE INDEX index_name …

Related Ignite NZ Sessions Required Slide *delete this box once you have listed content that is related to your session. Speakers, please list the other Breakout Sessions that relate to your session. Also indicate where and when they can find you, to continue the discussion. If you’re going to be at Hub Happy Hour (5.30-6.30pm Wed and Thu, let them know) Related Ignite NZ Sessions 1 5 Azure Consistent Service Delivery Overview NZ1 Wed 10:00am Security and Assurance Overview NZ4 Fri 9:00am 6 What’s New in System Centre for Management NZ1 Fri 11:00am 2 Server Virtualisation Overview NZ2 Wed 1:30pm 3 Networking Overview SKYCITY Theatre Thu 11:00am Find me later at… Hub Happy Hour Wed 5:30-6:30pm Hub Happy Hour Thu 5:30-6:30pm Closing drinks Fri 3:00-4:30pm 4 Storage Overview SKYCITY Theatre Thu 3:30pm

Resources Microsoft Virtual Academy TechNet & MSDN Flash 1/12/2019 Microsoft Virtual Academy Resources TechNet & MSDN Flash Free Online Learning http://aka.ms/mva Subscribe to our fortnightly newsletter http://aka.ms/technetnz http://aka.ms/msdnnz Sessions on Demand http://aka.ms/ch9nz © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Complete your session evaluation now and be in to win! 1/12/2019 6:12 PM Complete your session evaluation now and be in to win! © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

1/12/2019 6:12 PM © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.