Bob Duffy 22 years in database sector, 250+ projects SQL Server MCA, MCM, MVP SSAS Maestro Senior Data Platform Consultant with Microsoft 2005-2008 Database Architect at Prodata SQL Centre of Excellence http://blogs.prodata.ie/author/bob.aspx bob@prodata.ie
Agenda What is DevOps for BI folk SSIS Build SSIS Release Introducing DevOps Build and Release Pipeline Demo: Automated Build and Release Q+A
What is DevOps Automation of Build, Integration, Testing, Deployment Movement from: large batch deployment to small batch Deployment each quarter to 10 deploys a day It’s a cultural change https://www.amazon.com/Phoenix-Project-DevOps-Helping-Business/dp/0988262509
SSIS Deployment Models Project Deployment Legacy Package Deployment Entire Project deployed Per Package Deployment Project and Package Parameters Configurations “Builds” into and ispac file Separate dtsx and dtsconfig files Deployed to SSISDB Deployed to file or MSDB Executed via sql Dtexec compatible Executed via dtexec
Building Packages with SSIS Use Build Menu in Visual Studio Produces ispac file Can be automated from VS command line Some plug in for deployment products build too
Freebie – Powershell Script to Build SSIS http://blogs.prodata.ie/post/Automating-SSIS-Build-and-Deployment-with-Powershell.aspx
Deploying SSIS Packages SSIS Deployment Wizard Deploys ispac files Programmable Support for SSIS as well Microsoft.SqlServer.Management.IntegrationServices Class
Freebie – Powershell Script to Deploy SSIS http://blogs.prodata.ie/post/Automating-SSIS-Build-and-Deployment-with-Powershell.aspx
What we don’t automate (yet) Creation of SSISDB Creation of Environment Variables Binding of Environment Variables This can be automated but we don’t as once off
Introducing Azure DevOps (Was VSTS)
Azure DevOps Features
Step 1 Source Code https://www.mattmasson.com/2012/02/thoughts-on-branching-strategies-for-ssis-projects/ https://nvie.com/posts/a-successful-git-branching-model/?
Step 2 – Automate Testing ssisUnit for opensource getting started LegiTest as commercial test platform Write your own tests in Visual Studio Test
Step 3 – The Build Pipeline
Step 4 – The Release Pipeline
Step 5 – The Release Pipeline
The Build and Release Process Flow https://dev.azure.com/bobduffy Source Code Build Pipeline (CI) Release Pipeline (CD) Unit Test Build Msg ispac Check Out Deploy to Target Server Build ispac Check-In Build Agent Release Agent
End to End SSIS DevOps Build Release Test Ops Dashboard Rollback Bug Tracking Regression Testing
Prioritising DevOps Features for SSIS Projects Get Everything in Source Control Automate Testing Automate Build Automate Code Deployments Automate Platform Deployments
BIG Thanks to SQL Sat Denmark sponsors GOLD SILVER BRONZE
Raffle and goodbye Beer Remember to visit the sponsors, stay for the raffle and goodbye beers Join our sponsors for a lunch break session in : cust 0.01 and cust 1.06 We hope you’ll all have a great Saturday. Regis, Kenneth
Q+A
Thank You