Agile Analytics: Automated Builds and Deployments Mike Diehl | Practice Lead, Databases and Business Intelligence Miked@Imaginet.Com Winnipeg , Calgary, Dallas, and everywhere!

Please Support Our Sponsors SQL Saturday is made possible with the generous support of these sponsors. You can support them by opting-in and visiting them in the sponsor area.

Don’t forget to silence your phone

Post Con

Before Agile… Chaos? Waterfall? Big design up front (BDUF)

Dev, Test, Prod – hard to synchronize Where are you? Dev, Test, Prod – hard to synchronize No source code control for database/BI assets Hard to control quality of Change scripts Fear of Change Chaos/Paralysis

What is Agile? Value-driven development Production Quality Iterative, incremental, evolutionary Minimize ceremony Just In Time Design Repeatable (and automatable) processes Collaboration

Agile Analytics http://theagilist.com/ Ken Collier, author of “Agile Analytics: A Value-Driven Approach to Business Intelligence and Data Warehousing”

Business Intelligence Assets SQL Database project(s) SQL Analysis Database project(s) SQL Integration Services project(s) SQL Reporting Server project(s)

Source Code Control Declarative Project Model The source code defines “how you want it”, not “how you change it” Source Code Control provides historical change records A target database is updated at deployment by determining what changes are required to make it match the compiled project You can o

Tools Visual Studio 2015 SQL Server Data Tools (SSDT) SQL Server 2016 SQL Management Studio Visual Studio Team Services https://you.visualstudio.com Free for five users

Agile Development Cycle Developer Code Compile Test Check In Build Agent Build (Test) Release

Build Environment VSTS Build/release agent SQL Server Hosted On premise SQL Server

VSTS Build/Release Agent Default hosted agent (runs in Azure cloud) Single one is free, can purchase more (~$40/month) On-premise agent ~$15/month for additional parallel builds Install once, self-updating Run as a service, use a domain account (easier for connecting to SQL Server services) Installed tools: Visual Studio 2015, SSDT, SQL Management Studio

VSTS Build Steps Trigger Compile Solution Copy Build Artifacts Check In By Request Scheduled Compile Solution Devenv.exe Copy Build Artifacts *.dacpac *.ispac *.asdatabase Deployment files

DEVENV.EXE (Compile Projects) Project support from MSBuild Compilation outputs: Database projects (*.sqlproj) - *.dacpac SSAS projects (*.tabproj) - *.asdatabase SSIS projects (*.dtsproj) - *.ispac SSRS projects (*.rptproj) – none!

VSTS Release Steps Trigger Get Build Artifacts Deploy artifacts Successful Build Release Pre-approval By Request Get Build Artifacts *.dacpac *.ispac *.asdatabase Deployment files Deploy artifacts Complete Release Post-approval

SQLPACKAGE.EXE (Database Deployment) C:\Program Files (x86)\Microsoft SQL Server\130\DAC\bin Connects to SQL Server (or Azure SQL Database) /Action:Publish /SourceFile:<project>.dacpac /Profile:<Database>.publish.xml Publish profiles Target server, database SqlCmd environment $(variable)s Uses compilation output <project>.dacpac and <db>.publish.xml profile

SQLPACKAGE.EXE (Database Update Script) C:\Program Files (x86)\Microsoft SQL Server\130\DAC\bin Connects to SQL Server (or Azure SQL Database) /Action:Script /SourceFile:<project>.dacpac /OutputPath:<database_name>.sql /Profile:<Database>.publish.xml Generates change script only Use in a Build definition and save the script as a build artifact Include the script in the pre-release approval workflow for review

SQLPACKAGE.EXE (Deployment Report) C:\Program Files (x86)\Microsoft SQL Server\130\DAC\bin Connects to SQL Server (or Azure SQL Database) /Action:DeployReport /SourceFile:<project>.dacpac /OutputPath:<database_deploy>.xml /Profile:<Database>.publish.xml Generates Xml summary of deployment actions Use in a Build definition and save the report as a build artifact Include the report in the pre-release approval workflow for review Bonus points: Use a PowerShell script and an XSLT file to transform the Xml report into an html file

Deployment Wizard (SSAS Deployment) C:\Program Files (x86)\Microsoft SQL Server\130\Tools\Binn\ManagementStudio\ Microsoft.AnalysisServices.Deployment.exe /a Answer Mode generates .deploymenttargets .deploymentoptions .configsettings Uses compilation output <Model>.asdatabase and answer files

ISDEPLOYMENTWIZARD.EXE (SSIS Deployment) C:\Program Files (x86)\Microsoft SQL Server\130\DTS\Binn Connects to SQL Server Integration Services server Project Deployment Model SSISDB configured Create Folders for Dev, Test, Prod Create Environments Uses compilation output <Project>.ispac IsDeploymentWizard will not Create folders Create environments Configure projects with environment SSISDB has stored procedures to do this

SSRS Reports (Report deployment) Use Devenv.exe with Deploy target Use project/solution configurations for Dev, Test, Prod

VSTS Agent Security Connections to SQL Server services generally use Trusted Connections Using passwords is difficult, especially if you don’t want them in plain text anywhere SQLPACKAGE Agent account requires VIEW ANY DEFINITION permission for DeployReport and Script actions Requires dbo permission in target database Sysadmin server role allows for creation of new databases SSAS Deployment Agent account requires Administrator role membership for SSAS SSIS Deployment Agent account requires sysadmins role membership or SSISDB database role package_admins SSRS Deployment Agent account requires Contributor or Administrator permissions at the target server URL

Environment Configurations Database <db>.publish.xml Target server Target database SqlCmd variables SSAS <model>.deployoptions <model>.deploytarget <model>.something Overwrite options Retain, Deploy Processing option Full, Default SSIS SSISDB Environments Variables Connection Strings Deploy will not overwrite SSRS Project configuration Target server URL Target Folders

Thank you Mike Diehl Practice Lead, Databases and Business Intelligence Miked@Imaginet.Com Twitter: @xhead Winnipeg , Calgary, Dallas, and everywhere!