SSIS Deployment Smackdown! Package vs. Project! Peter Kral, Lead Database Engineer, FTD Companies Phil Helmer, Database Architect, EDF Renewables

Support Our Sponsors

OregonSQL User Group www.OregonSQL.org Meetings Every 2nd Wednesday, 6:00PM – 9:00PM 1515 SW 5th Ave, Suite 900, Portland

Lead Database Engineer, FTD Companies Inc Microsoft SQL Server Engineer Professional experience as a database administrator and developer. Has worked with Microsoft SQL Server since version 6.5. Microsoft Certified Microsoft SQL Server MCSA 2012/2014/2016 Microsoft SQL Server MCSE Data Platform Microsoft SQL Server MCSE Data Management and Analytics Peter Kral Lead Database Engineer, FTD Companies Inc Speaker Idol 2016 Winner of the Speaker Idol Award at the PASS Summit 2016. /peterkral @pkral peter.kral

Phil Helmer Database Architect, EDF Renewables Database Architect Phil has been designing and building relational databases in a variety of industries ever since he first realized how many people don't understand the limitations of Excel and sticky notes as databases. Recovering MS Access User Phil Helmer When he was a poor college student, that meant teaching himself MS Access. Database Architect, EDF Renewables SQL Family After moving to SQL Server 13 years ago, he found out about the PASS community and never looked back. He now spends his days developing databases using T-SQL, exploring data management tools & techniques and trying to make sense of Microsoft's marketing. /philhelmer @philhelmer philhelmer

Intended Audience We’ll be assuming some knowledge SQL Server Integration Services (SSIS) SSIS packages SSIS projects SSIS deployment and configuration

Agenda Our topics A brief history, from DTS to SSIS A summary of the main aspects of Package and Project deployment Compare the two deployment methods Smackdown! Debate the merits of the two methods point-by-point Summary Q & A

Data Transformation Services (DTS)

Data Transformation Services (DTS)

Data Transformation Services (DTS)

Data Transformation Services (DTS)

Data Transformation Services (DTS)

SQL Server Integration Services: A History Year Product Packages Milestone Details 1998 SQL Server 7 DTS New feature VBScript or Jscript source files 2000 SQL Server 2000 Improvements New FTP, Execute Package, Dynamic Properties tasks 2005 SQL Server 2005 SSIS Redeveloped .Net based packages 2012 SQL Server 2012 Project Deployment New deployment model, SSISDB

Deployment Demo

Deployment DTSX content stored in msdb or file system Package Project DTSX content stored in msdb or file system Project contents stored in SSISDB Packages (.dtsx extension) Project deployment file (.ispac extension) Configurations (.dtsConfig extension) Manifest (.SSISDeploymentManifest ext.) Environment deployment script Use wizard, DTUTIL, or Visual Studio Use wizard, T-SQL, or Visual Studio

Configuration Demo

Configuration Package Project Configurations are used to assign values to package properties Parameters are used to assign values to package properties Environment-specific configuration values are stored in configuration files Environment-specific parameter values are stored in environment variables (SSISDB) Configuration values storage options: XML configuration file Environment variable Registry entry Parent package variable SQL Server table SSISDB

Execution Demo

Execution The dtExec utility: Package Project The dtExec utility: loads the package applies the configurations applies the Parent Package Variable configs runs the package Packages are executed by starting an execution on the database engine You can also execute packages using dtExec A log provider must be added to the package to capture events. Events are logged in SSISDB automatically.

Troubleshooting Demo

Troubleshooting Package Project No logging by default Five standard logging settings: None, Basic (the default), Performance, Verbose, RuntimeLineage Event logging is highly configurable Customized Logging Level option (SQL Server 2016) Events logged to msdb.dbo.sysssislog Events logged to: SSISDB.catalog.event_messages Error messages appear in SQL Agent Job log Error messages do not appear in SQL Agent Job log Log evaluation via T-SQL Standard SSRS reports for log evaluation

Resources Compare Project Deployment Model and Legacy Package Deployment Model https://docs.microsoft.com/en-us/sql/integration-services/packages/deploy-integration-services-ssis-projects-and-packages?view=sql-server-2017 SSIS Package Store vs. MSDB https://stackoverflow.com/questions/29089860/ssis-package-store-vs-msdb SSIS Custom Logging Levels https://www.timmitchell.net/post/2016/12/22/ssis-custom-logging-levels/ Business Intelligence Markup Language (BIML) https://varigence.com/BimlExpress SSIS Project Deployment: The T-SQL Way (Presentation by Peter Kral) YouTube (SQLSaturdayLA) PPT Slides and Demo Files

Support Our Sponsors

Learn more from Peter Kral and Phil Helmer @pkral pkral@ftdi.com @philhelmer philhelmer@philhelmer.com