Bob Duffy 22 years in database sector, 250+ projects

Slides:



Advertisements
Similar presentations
HIGH PERFORMANCE CONTINUOUS DELIVERY VERSIONING AND RELEASE MANAGEMENT ALIGNED.
Advertisements

USING CI & CD WITH MICROSOFT SQL SERVER Tim Giorgi Senior Software Developer Northwest Evaluation
SQL Server Integration Services (SSIS) Presented by Tarek Ghazali IT Technical Specialist Microsoft SQL Server (MVP) Microsoft Certified Technology Specialist.
ADAPTING YOUR ETL SOLUTION TO USE SSIS 2012 Presentation by Devin Knight
Metadata-driven Automatic Package Creation with Notes from the field.
Scripting Just Enough SSIS to be Dangerous. 6/13/2015 Visit the Sponsor tables to enter their end of day raffles. Turn in your completed Event Evaluation.
Load Testing Analysis Services 30 th march 2012 Bob Duffy Database Architect Prodata SQL Centre of Excellence.
Why you should be using VSTSWhy you should be using VSTS Visual Studio Team Services (VSTS) Nathan Lasnoski Vice President of blog.concurrency.com.
SSIS 2012: The Quiet Revolution Presented by Bryan Cafferky Business Intelligence Consultant BPC Global Solutions LLC
Declarative Configuration Management with Azure Automation DSC and ARM Nathan Lasnoski Vice President of blog.concurrency.com Concurrency.
DevOps in the cloud Peter’s personal journey on how I found out, I need Dev skills to optimize my ‘Azure’ work… and so do you!!
DevOps for the IT Pro with Azure and Visual Studio Team Services
DevOps with ASP.NET Core and Entity Framework Core
Bringing DevOps to the Database
Presented By: Jessica M. Moss
Stress Free Deployments with Octopus Deploy
What Is The SSIS Catalog and Why Do I Care?
Explore the Integration Services Catalog
Microsoft’s shiny dashboard-tool
Agile Analytics: Automated Builds and Deployments
SQL Server deployments
Where Dev meets Ops Session Code Paul Glavich / Chris Padgett.
Microsoft /23/2018 8:20 PM THR3038 Implement dev and test scenarios using Azure and Visual Studio Team Services Alex Mang Azure MVP © 2016 Microsoft.
A whirlwind tour through the Microsoft DevOps landscape Jesse Houwing | xpirit.com/jesse Trainer, Coach, Tinkerer.
SSIS Project Deployment: The T-SQL Way
Building an Automated Cloud Image Factory
Deploying and Configuring SSIS Packages
SQL Server Integration Services
Building a Continuous Integration Pipeline using VSTS
Administering and Deploying Power BI Solutions
Introducing New Team-based Data Integration with SSIS
SSIS & PowerShell SQL Saturday Holland 2016 Joost van Rossum
Dimodelo Solutions.
SQL Server Integration Services SSIS and PowerShell
Boosting SSAS Productivity with Tabular Editor
Database Code Management with VS 2017 and RedGate
Bob Duffy 22 years in database sector, 250+ projects
SQL Server Analysis Services Fundamentals
Building ETL/ELT Workloads with Azure Data Factory V2
SSIS Project Deployment: The T-SQL Way
Orchestration and data movement with Azure Data Factory v2
SSIS in the Cloud Integration Runtime in Azure Data Factory V2
Welcome to SQL Saturday Denmark
Hugo Kornelis Now where does THAT estimate come from? The nuts and bolts of cardinality estimation.
Entity Framework from a database perspective
Johan Hedberg Consultant & XLENT | Cloud and Integration specialist | Microsoft MVP Using VSTS to deploy BizTalk Server solutions, what you.
SSIS Deployment Smackdown!
SSIS Deployment Smackdown!
Designing Complex Tabular Models
SSIS Project Deployment: The T-SQL Way
Real World Scrum with TFS & VSTS / Azure DevOps
Your code is not just…your code
Planning and Deploying PBIRS
SSDT and Database Project Basics
Building ETL/ELT Workloads with Azure Data Factory V2
SSIS Project Deployment: The T-SQL Way
HCL’s Viewpoint – DevOps on MS Cloud
Hybrid Power BI With the on Premise Data Gateway
SSIS Project Deployment: The T-SQL Way
Bob Duffy 27 years in database sector, 250+ projects
Azure Data Factory V2 Templates
Office 365 Development July 2014.
SSIS - Overview John Manguno. SSIS - Overview John Manguno.
Just Enough SSIS Scripting to be Dangerous.
Beyond orchestration with Azure Data Factory
Continuous Integration and Delivery (CI/CD) in Azure Data Factory
SSDT, Docker, and (Azure) DevOps
Bringing source control to BI world!
Applying 3C DevOps approach in Mobility World
Your code is not just…your code
Presentation transcript:

Bob Duffy 22 years in database sector, 250+ projects SQL Server MCA, MCM, MVP SSAS Maestro Senior Data Platform Consultant with Microsoft 2005-2008 Database Architect at Prodata SQL Centre of Excellence http://blogs.prodata.ie/author/bob.aspx bob@prodata.ie

Agenda What is DevOps for BI folk SSIS Build SSIS Release Introducing DevOps Build and Release Pipeline Demo: Automated Build and Release Q+A

What is DevOps Automation of Build, Integration, Testing, Deployment Movement from: large batch deployment to small batch Deployment each quarter to 10 deploys a day It’s a cultural change https://www.amazon.com/Phoenix-Project-DevOps-Helping-Business/dp/0988262509

SSIS Deployment Models Project Deployment Legacy Package Deployment Entire Project deployed Per Package Deployment Project and Package Parameters Configurations “Builds” into and ispac file Separate dtsx and dtsconfig files Deployed to SSISDB Deployed to file or MSDB Executed via sql Dtexec compatible Executed via dtexec

Building Packages with SSIS Use Build Menu in Visual Studio Produces ispac file Can be automated from VS command line Some plug in for deployment products build too

Freebie – Powershell Script to Build SSIS http://blogs.prodata.ie/post/Automating-SSIS-Build-and-Deployment-with-Powershell.aspx

Deploying SSIS Packages SSIS Deployment Wizard Deploys ispac files Programmable Support for SSIS as well Microsoft.SqlServer.Management.IntegrationServices Class

Freebie – Powershell Script to Deploy SSIS http://blogs.prodata.ie/post/Automating-SSIS-Build-and-Deployment-with-Powershell.aspx

What we don’t automate (yet) Creation of SSISDB Creation of Environment Variables Binding of Environment Variables This can be automated but we don’t as once off

Introducing Azure DevOps (Was VSTS)

Azure DevOps Features

Step 1 Source Code https://www.mattmasson.com/2012/02/thoughts-on-branching-strategies-for-ssis-projects/ https://nvie.com/posts/a-successful-git-branching-model/?

Step 2 – Automate Testing ssisUnit for opensource getting started LegiTest as commercial test platform Write your own tests in Visual Studio Test

Step 3 – The Build Pipeline

Step 4 – The Release Pipeline

Step 5 – The Release Pipeline

The Build and Release Process Flow https://dev.azure.com/bobduffy Source Code Build Pipeline (CI) Release Pipeline (CD) Unit Test Build Msg ispac Check Out Deploy to Target Server Build ispac Check-In Build Agent Release Agent

End to End SSIS DevOps Build Release Test Ops Dashboard Rollback Bug Tracking Regression Testing

Prioritising DevOps Features for SSIS Projects Get Everything in Source Control Automate Testing Automate Build Automate Code Deployments Automate Platform Deployments

BIG Thanks to SQL Sat Denmark sponsors GOLD SILVER BRONZE

Raffle and goodbye Beer Remember to visit the sponsors, stay for the raffle and goodbye beers  Join our sponsors for a lunch break session in : cust 0.01 and cust 1.06 We hope you’ll all have a great Saturday. Regis, Kenneth

Q+A

Thank You