Design and Implement Cloud Data Platform Solutions

Slides:



Advertisements
Similar presentations
Keith Burns Microsoft UK Mission Critical Database.
Advertisements

SQL Server 2014 Platform for Hybrid Cloud (Level 300 Deck)
Windows Azure Networking & Active Directory Nasir (Muhammad Nasiruddin) Developer Evangelist - Azure Microsoft Corporation
Windows Azure Migrating Applications and Workloads Speaker Title Organization.
Speaker Name 00/00/2013. Solution Requirements.
Course Topics Administering SQL Server 2012 Jump Start 01 | Install and Configure SQL Server04 | Manage Data 02 | Maintain Instances and Databases05 |
Azure.
Microsoft Azure Speed >> Economics Scale. Microsoft Azure Speed >> Economics Scale.
Backups for Azure SQL Databases and SQL Server instances running on Azure Virtual Machines Session on backup to Azure feature (manual and managed) in SQL.
Use relational database as a service
Dev and Test Solution reference architecture.
1/26/2018 Hosting Windows Desktops and Applications Using Remote Desktop Services and Azure Windows Server Azure Resource Manager © 2014 Microsoft.
Run Azure Services in your datacenter
IT Operations Management
Building AD-SQL-APP Server on AZURE
Business Continuity & Disaster Recovery
Data Platform and Analytics Foundational Training
Microsoft Virtual Academy
Dev and Test Solution reference architecture.
Dev and Test Solution reference architecture.
Implementacija SharePoint 2016 farme pomoću Azure IaaS
Microsoft Azure: The only consistent Hybrid Cloud
SaaS Application Deep Dive
Dev and Test Solution reference architecture.
IT Operations Management
Dev and Test Solution reference architecture.
Server & Tools Business
Design and Implement Cloud Data Platform Solutions
Azure.
Required 9s and data protection: introduction to sql server 2012 alwayson, new high availability solution Santosh Balasubramanian Senior Program Manager.
Cloud Database Based on SQL Server 2012 Technologies
BRK3286 SQL Server 2016 High Availability and Disaster Recovery in private and hybrid cloud deployments Denny Cherry
Business Continuity & Disaster Recovery
IaaS Part II Stefan Geiger Gerry
Enterprise Modernization
SQL On Azure Parikshit Savjani, Sr. Premier Field Engineer.
Microsoft Ignite NZ October 2016 SKYCITY, Auckland.
Microsoft Azure P wer Lunch
Azure Active Directory
Microsoft Ignite NZ October 2016 SKYCITY, Auckland.
Microsoft Virtual Academy
Microsoft Virtual Academy
TechEd /23/ :44 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
Microsoft Virtual Academy
TechEd /28/ :51 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
Microsoft Virtual Academy
Disaster Recovery as a Service
SQL Server on Linux: High Availability And Disaster Recovery
Microsoft Virtual Academy
Microsoft Virtual Academy
Dev and Test Solution reference architecture.
Microsoft Virtual Academy
Building continuously available systems with Hyper-V
Microsoft Virtual Academy
TechEd /28/2019 7:27 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Building global and highly-available services using Windows Azure
Windows Azure Hybrid Architectures and Patterns
A - E Cloud Enterprise Symbols
ATC323 Architecting Highly Available, Geo-Redundant Cloud Solutions with Windows Azure Graham Elliott Asia Time Zone Director Global Technical Evangelism.
Microsoft Virtual Academy
Day 2, Session 2 Connecting System Center to the Public Cloud
Microsoft Virtual Academy
Microsoft Virtual Academy
Microsoft Virtual Academy
Microsoft Virtual Academy
Microsoft Virtual Academy
Microsoft Virtual Academy
Azure SQL Database for Business Critical Cloud Applications
Microsoft Virtual Academy
Presentation transcript:

Design and Implement Cloud Data Platform Solutions 9/11/2018 Design and Implement Cloud Data Platform Solutions © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

05 | Hybrid HA/DR Scenarios with SQL Server

Agenda 1 5 2 6 3 7 4 8 Microsoft Cloud Data Platform Hybrid HA/DR Scenarios with SQL Server 2 Implement SQL Server on Azure VM 6 Design and Implement Security 3 Implement SQL Database 7 Monitor and Manage Implementations on Azure 4 SQL Database High Availability and Disaster Recovery 8 Design and Implement Database Solutions for SQL Server and SQL Database

In this module HA/DR deployment architectures Log Shipping AlwaysOn availability groups Backup to Azure AlwaysOn Failover Clustering Managed Backups Database Mirroring SQL Server data files on Azure

HA/DR deployment architectures AlwaysOn Availability Groups AlwaysOn Failover Clustering Database Mirroring Log Shipping Backup to Azure (blob storage) Azure Site Recovery Azure Only Availability replicas running across multiple datacenters in Azure VMs for disaster recovery. Cross-region solution protects against complete site outage. Hybrid Some replicas running in Azure VMs and other replicas running on-premises for cross-site disaster recovery. HA only, not DR FCI on a two-node WSFC running in Azure VMs with storage supported by a third-party clustering solution. FCI on a two-node WSFC running in Azure VMs with remote iSCSI Target shared block storage via ExpressRoute. Azure Only Principal and mirror and servers running in different datacenters for disaster recovery. Principal, Mirror, and Witness run within same Azure data center, deployed using a DC or server certificates for HA. Hybrid One partner running in an Azure VM and the other running on-premises for cross-site disaster recovery using server certificates. For DR only / Hybrid One server running in an Azure VM and the other running on- premises for cross- site disaster recovery. Log shipping depends on Windows file sharing, so a VPN connection between the Azure virtual network and the on- premises network is required. Requires AD deployment on DR site. On-premises production databases backed up directly to Azure blob storage for disaster recovery. Simpler BCDR story Site Recovery makes it easy to handle replication, failover and recovery for your on-premises workloads and applications. Flexible replication You can replicate on- premises servers, Hyper-V virtual machines, and VMware virtual machines. Eliminate the need for secondary

AlwaysOn Availability Groups Azure Only Availability replicas running across multiple datacenters in Azure VMs for disaster recovery. Cross-region solution protects against complete site outage. Hybrid Some replicas running in Azure VMs and other replicas running on-premises for cross-site disaster recovery. All availability replicas running in Azure VMs for high availability within the same region. You need to configure a domain controller VM, because Windows Server Failover Clustering (WSFC) requires an Active Directory domain. For more information, see Configure AlwaysOn Availability Groups in Azure (GUI). Availability replicas running across multiple datacenters in Azure VMs for disaster recovery. This cross-region solution protects against complete site outage. Within a region, all replicas should be within the same cloud service and the same VNet. Because each region will have a separate VNet, these solutions require VNet to VNet connectivity. For more information, see Configure a Site-to-Site VPN in the Azure classic portal.

Add Azure Replica Wizard 9/11/2018 7:39 PM Add Azure Replica Wizard Automatic Listener Configuration Today: Requires manual configuration of the Listener In SQL Server 2016: Ability to configure the Availability Group Listener in Azure Clients can connect to the Azure replica after failover using the Listener name © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Before extending AlwaysOn configuration 9/11/2018 Before extending AlwaysOn configuration Configure site-to-site VPN tunnel between on-premises SQL Server and Azure Tutorial: http://msdn.microsoft.com/en-us/library/dn636917.aspx © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

AlwaysOn replica in Azure Sample deployment VPN Device VPN Gateway S1 S2 Availability Group Virtual Network P VPN Tunnel On-premises Microsoft Azure AD/DNS AGCloudReplica

Demo AlwaysOn Availability Groups on Azure

AlwaysOn Failover Clustering HA only, not DR FCI on a two-node WSFC running in Azure VMs with storage supported by a third-party clustering solution. FCI on a two-node WSFC running in Azure VMs with remote iSCSI Target shared block storage via ExpressRoute. FCI on a two-node WSFC running in Azure VMs with storage supported by a third-party clustering solution. An FCI on a two-node WSFC running in Azure VMs with remote iSCSI Target shared block storage via ExpressRoute. For example, NetApp Private Storage (NPS) exposes an iSCSI target via ExpressRoute with Equinix to Azure VMs. For third-party shared storage and data replication solutions, you should contact the vendor for any issues related to accessing data on failover. Note that using FCI on top of Azure File storage is not supported yet, because this solution does not utilize Premium Storage. We are working to support this soon.

Database Mirroring Database Mirroring Azure Only Principal and mirror and servers running in different datacenters for disaster recovery. Principal, Mirror, and Witness run within same Azure data center, deployed using a DC or server certificates for HA. Hybrid One partner running in an Azure VM and the other running on-premises for cross-site disaster recovery using server certificates. Principal and mirror and servers running in different datacenters for disaster recovery. You must deploy using server certificates because an Active Directory domain cannot span multiple datacenters.

Backup to Azure (blob storage) On-premises production databases backed up directly to Azure blob storage for disaster recovery. Block blobs Reduced storage costs Significantly improved restore performance More granular control over Azure Storage Azure Storage snapshot backup Fastest method for creating backups and running restores Support of SQL Server database files on Azure Blob Storage Managed backup Granular control of the backup schedule Local staging for faster recovery and greater network resiliency System database support Simple recovery mode support CREATE CREDENTIAL [https://<account>.blob.core.windows.net/<container>] WITH IDENTITY = 'Shared Access Signature', SECRET = 'sig=mw3K6dpwV%2BWUPj8L4Dq3cyNxCI' BACKUP DATABASE database TO URL = N'https://<account>.blob.core.windows.net/<container>/<blob1>', URL = N'https://<account>.blob.core.windows.net/<container>/<blob2>'

Demo Backup to URL

SQL Server data files in Azure DB3 DB3 Near “bottomless” storage Off-site, geo-redundant No provisioning No device management Media safety (decay free) Remote accessibility Native support for SQL Server data files stored as Azure blobs DB1 DB2 Azure Virtual Machines DB6 DB6 Azure Storage DB4 DB5 On-premises CREATE CREDENTIAL [https://mystorage.blog.core.windows.net/data] WITH IDENTITY = ‘Shared Access Signature', SECRET = ‘<your SAS key>    CREATE DATABASE mydb ON ( NAME = mydb_dat, FILENAME = 'https://mystorage.blob.core.windows.net/data/mydb.mdf' ) LOG ON ( NAME = foo_log, FILENAME = 'https://mystorage.blob.core.windows.net/data/mydblog.ldf') Separation of compute and storage Database migration to other machines Basic disaster recovery Increased storage on Azure Virtual Machines

SQL Server 2016: Backup to Azure with file snapshots SQL Server data files MDF MDF BAK LDF LDF Database Azure Storage BACKUP DATABASE database TO URL = N'https://<account>.blob.core.windows.net/<container>/<backupfileblob1>‘ WITH FILE_SNAPSHOT

Point-in-time restore with file snapshots SQL Server 2016 Traditional backup Multiple backup types Complex point-in-time restore process Full Log Diff Backup to Azure with file snapshots Full backup only once Point-in-time restore only needs two adjacent backups Log Full

SQL Server 2014 Managed Backup to Azure What is it? An agent that manages and automates SQL Server backup policy Benefits Simple and flexible Minimal input (controls retention period) Manages entire instance or individual databases Leverages backup to Azure (page blob) Supports backup encryption Inherently off-site and geo-redundant Minimal storage cost and hardware management Built-in intelligence Retention Context-aware (for example, workload/throttling) Backups consider log accumulation Example: EXEC smart_admin.sp_set_db_backup                 @database_name='TestDB',                 @retention_days=30,                 @credential_name='MyCredential',                 @encryption_algorithm='NO_ENCRYPTION',                 @enable_backup=1 GO

Managed Backup to Azure in SQL Server 2016 Supports system databases Supports databases in simple recovery mode Leverages backup to block blobs for more granular control Allows customized backup schedules for full backup and log backup

Managed Backup to Azure in SQL Server 2014 9/11/2018 7:39 PM Managed Backup to Azure in SQL Server 2014 Prerequisites SQL credential based on Azure Storage account Enable SQL Server Agent Backup logic Full: 1 week, or 1 GB log growth; initial and log chain broken Log: 2 hours, or 5 MB log growth Retention Up to 30 days (capable of point-in-time recovery) Limitations Full and log backups only Recovery models: full or bulk-logged User databases only Max backup size of 1 TB (Azure page blob limit) © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

High Availability Best Practices Configure a SQL HA technology (AlwaysOn / Database Mirroring) if You want failure detection for SQL Server (e.g., service down) You can’t stand recovery times due to Service Healing (12 minutes couple of times p/month) or Azure monthly upgrades (15 minutes p/month) Put replicas in the same Affinity Group (Cluster) Availability Set (Different Racks and Upgrade Domains) VNet (Maintain VM IPs) Use secondary replicas to offload reads/backups Load balance using Windows Azure’s Load Balancer

A sample configuration Availability Group Listener Azure Load Balancer Reporting App P S1 Automatic Failover S4 (Readable) S3 S2 OLTP App

Connectivity Best Practices Remove unused endpoints on the virtual machine Use endpoint ACLing to control connections Don’t disable Windows Firewall If clients are in Azure, host them in same VNET as SQL Server If Windows Authentication is needed: Configure Domain Controller Configure a VPN tunnel from on-premise and use on-premise Domain Controller If not, use SQL authentication

Hands-on Lab Implement HA/DR with SQL Server in Azure VMs