Thanks to our Sponsors Platinum Sponsor: Gold Sponsors:

Slides:



Advertisements
Similar presentations
System Center 2012 R2 Overview
Advertisements

Your CMDB and PowerShell DSC: DevOps Techniques
Continuous Integration for Databases Learn how to automate your build and test Steve Jones Red Gate Software Part II of the Continuous Delivery for Databases.
Windows Azure Conference 2014 Running Docker on Windows Azure.
& Dev Ops. Sherwin-Williams & DevOps Introduction to Sherwin-Williams.
Migrating Data to SQL Azure Arunraj Chandrasekaran Twitter June 21, 2011.
Copyright © New Signature Who we are: Focused on consistently delivering great customer experiences. What we do: We help you transform your business.
Alfresco on Azure Shah Rahman Founder and CEO, CloudlyIO.
Testing and Release Procedures/Tools Cristina Aiftimiei (INFN-CNAF) Mario David (LIP)
Backups for Azure SQL Databases and SQL Server instances running on Azure Virtual Machines Session on backup to Azure feature (manual and managed) in SQL.
12/29/2017 3:36 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
IT06 – HAVE YOUR OWN DYNAMICS NAV TEST ENVIRONMENT IN 90 MINUTES
Bringing DevOps to the Database
Bringing DevOps to the Database
Getting & Running EdgeX Docker Containers
Building ARM IaaS Application Environment
Joonas Sirén, Technology Architect, Emerging Technologies Accenture
Agenda:- DevOps Tools Chef Jenkins Puppet Apache Ant Apache Maven Logstash Docker New Relic Gradle Git.
Stress Free Deployments with Octopus Deploy
4/24/ :07 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Microsoft Virtual Academy
Dockerize OpenEdge Srinivasa Rao Nalla.
Welcome to WideWorld Importers
Lead SQL BankofAmerica Blog: SQLHarry.com
Continuous Deployments using SSDT
In-Depth Introduction to Docker
Cloud Data platform (Cloud Application Development & Deployment)
Dmytro Mykhailov How HashiCorp platform tools can make the difference in development and deployment Target and goal of HashiCorp.
Andrew Pruski SQL Server & Containers
Exploring Azure Event Grid
9/20/ :55 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Get Amazon AWS-DevOps-Engineer-Professional Exam Real Questions - Amazon AWS-DevOps-Engineer-Professional Dumps Realexamdumps.com
Kubernetes Container Orchestration
Bringing DevOps to the Database
Continuous Integration For Databases
Using docker containers
Oracle DB and Docker Get Your Dockerized Oracle Sandbox Running in the Cloud or On- Premises Martin Knazovicky Dbvisit Software.
TechEd /21/2018 5:20 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
Cloud Migrations Pose Important Questions
Developing for the cloud with Visual Studio
12/5/ :36 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Bringing DevOps to the Database
Cloud Data Replication with SQL Data Sync
Continuous Deployments using SSDT
Continuous Deployments using SSDT
Delivering Business Value Faster
Daniel Mennell Mesosphere, Inc.
Delivering Business Value Faster
TechEd /23/2019 9:23 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Gold Sponsors.
DEVOPS & THE FUTURE OF TESTING
OpenShift as a cloud for Data Science
IST346: Virtualization and Containerization
Node.js Test Automation using Oracle Developer Cloud- Simplified
SSDT, Docker, and (Azure) DevOps
Containers and Clones Paul Stanton Co-founder Windocks
Keeping your SQL Code safe
SSDT, Docker, and (Azure) DevOps
Johan Lindberg, inRiver
SQL Server Data Mobility
Containers and DevOps.
SQL Server Devops with production data
Azure DevOps Simplified with Production Data
Continuous Integration and Delivery (CI/CD) in Azure Data Factory
SSDT, Docker, and (Azure) DevOps
Environment Automation
06 | SQL Server and the Cloud
The Future of Database Development (with containers)
SSDT, Docker, and (Azure) DevOps
SQL Server on Containers
Presentation transcript:

Thanks to our Sponsors Platinum Sponsor: Gold Sponsors: Global Alliance Partners:

SQL Server DevOps Simplified with Production Database Clones Paul Stanton, Co-founder pauls@windocks.com

Agenda What is SQL Server Devops? Choices: production or stubbed data Choices: containers or VMs Architecture for use of database clones Steps and Demo Resources to get started

SQL Server DevOps begins with . . Database environments for . . . . Development and Test Staging Production DB debugging for hotfixes Reporting and BI ETL and Data Warehousing Develop, test and deploy of upgrade and rollback scripts What form of database -- production or stubbed database? How to deliver -- SQL Server containers or virtual machines?

Production database clones Built DB with stubbed data (DacPac) What form of database? Production database clones Built DB with stubbed data (DacPac) Highest quality artifact, includes production data, schema and objects Artifact limited to schema and objects, with stubbed test data Test development is simplest possible Test development must simulate production data Delivery in 30 seconds A multi-DB environment will take 20 – 60 minutes Improved release as data and performance issues are recognized and fixed Data and performance issues are recognized at a later point, complicating the DevOps process Supports prod DB debug & Hot Fix, other uses NA

SQL containers or instances? SQL Server Containers Instances 20+ SQL Server environments per 4 core VM, drives ~5-10:1 reduction in VMs Typically 1 SQL Server instance per VM Provision and tear down in seconds Several minutes to 30+ for multi-database environment Maintenance dramatically reduced On-going maintenance, configuration drift Cloud native and Kubernetes ready NA

Architecture

Steps and Demo 1. Build an image (database snapshot) with included Git repo clone 2. Set automated image updates with Diff or Transaction Log backups 3. Self-provision SQL Server containers and cloned databases 4. Manage a multi-stage pipeline with Azure DevOps

Build the Image FROM mssql-2017 SETUPCLONING FULL db \\pathto\db.bak COPY datamasking.sql . RUN datamasking.sql Build the Image

Build an image with Git repo clones The Docker images includes a “git pull” to ensure each container include repo scripts, with run time control over scripts: >docker create -e RUN=“scripts/upgrade.sql” gitclone1 >docker create gitclone1 >docker create -e RUN=“scripts/upgrade.sql, scripts/rollback.sql” <image>

2. Set the image update schedule

Provision SQL Server containers w/clones Docker clients >docker create <imagename> Web application One click to deliver an environment from an image REST API curl, any code base Any orchestrator - Azure devops, Jenkins

4. Implement Azure DevOps pipeline Download the Azure DevOps pipeline yaml from Windocks Update pipeline yaml to reflect your pipeline environment variables: Server IP address Image name Migration scripts for testing

Conclusions Speed: ~20 seconds per environment Scales to large/complex environments Improve release quality: identify performance and data issues earlier Economy and efficiency (20+ containers on a 4 core VM), simplified Test development Reliability: no configuration drift, no changes in CI pipeline Database clones combined with containers is cloud-native and Kubernetes ready

Resources to get started Database cloning with containers with a free Windocks Community Edition: www.windocks.com ask for the Azure DevOps yaml file Setup your own free Azure DevOps pipeline https://azure.microsoft.com/en-us/services/devops/ Red Gate SQL Clone: https://www.red-gate.com/products/dba/sql-clone/