1. SQL Server Devops with production data
Ramesh Parameswaran, Founder Windocks

2. Challenges with sql server in devops
Large data sizes
How to deliver multiple copies of terabyte databases to test and staging devops environments
How to keep the databases current with production every hour
Large number of test and staging environments in azure devops pipeline
How to deliver dozens of sql servers on demand
one sql server for each test and staging environment in the devops pipeline
How to deliver sql server data into Kubernetes clusters
Incompatible networks and workflows between storage networks and Kubernetes network
Older sql server versions

3. Solution components Containers current Snapshots Clones
Delivers sql server on demand for each test and staging environment
SQL server, ssrs for all sql versions (2008 +), standard, enterprise, dev
Based on docker’s container project
current Snapshots
snapshot the production database once, after that only incremental updates forever with diff or transaction logs
Keeps database current with production quickly because of incremental
Clones
FAST, thin Clones from snapshots in seconds (even for terabyte databases)
Multiple databases in each clone, automatically attached to any type of sql container or any instance across network

4. AZURE DEVOPS Test env 1 Test env 2 Staging env 2
Current snapshot
1. Transaction log every hour
Containers with clones
Azure devops pipeline
2. REST API or docker client
3. SQL containers for devops environments
Test env 1
Test env 2
Staging env 2
Clones
4. SQL instances for devops
Windocks server (Windows)
SQL Server instances
Azure

5. Azure devops sample Create your own azure devops pipeline shown before
Download sample pipeline YAML
Setup azure devops account and import the pipeline yaml
Download free windocks community edition and install
windocks.com/azure-devops

6. Kubernetes challenges
large Databases
incompatible WORKFLOWS - K8s deployments & PROD DB backups
incompatible networks - production SAN & K8s networks
legacy SQL server versions & editions on WINDOWS
SQL Server is not cloud native ?

7. Kubernetes solution

8. SQL Containers, snapshots, clones DEMO
CREATE a snapshot from a full backup
Deliver containers with the CLONED production data using a docker client
APPLY an incremental transaction log backup
Deliver containers with the current production data CLONE using a docker client

9. DEMO DETAILS DOCKERFILE FROM mssql-2017
SETUPCLONING FULL cars C:\windocks\dbbackups\cars.bak
COPY C:\windocks\dbbackups\maskingscript.sqL .
RUN maskingscript.sql
DOCKEr BUILD –t imagename path/to/dockerfile – ONE time
DOCKER exec image name path/to/transaction/log/backup – every hour

10. Kubernetes DEMO Redis slave pod Redis slave pod .NET API pod
K8s cluster on Google Cloud
DB network on AWS
Redis
slave pod
Redis
master pod
1. Get cached token or query results
SAN
Redis
slave pod
SQL Server containers
3. Cache token or query results
.NET API
pod
Vhd
…..
2. Not cached? get from SQL
.NET
Website pod
Windocks SQL proxy pod
Windocks server

11. KUBERNETE SAMPLE Create your own K8s cluster with the demo above