Presentation is loading. Please wait.

Presentation is loading. Please wait.

SSIS in the Cloud Integration Runtime in Azure Data Factory V2

Similar presentations


Presentation on theme: "SSIS in the Cloud Integration Runtime in Azure Data Factory V2"— Presentation transcript:

1 SSIS in the Cloud Integration Runtime in Azure Data Factory V2
Joost van Rossum

2 Employed as BI Consultant at ilionx
Joost van Rossum Employed as BI Consultant at ilionx Working in IT since 1999, switched to BI in 2005 Married, 3 sons microsoft-ssis.blogspot.com microsoft-bitools.blogspot.com @SSISJoost nl.linkedin.com/in/joostvanrossum Data Platform MVP since 2014

3 Agenda Configure Integration Runtime Lift and Shift SSIS to Azure
Deploying projects Scheduling packages On-Premises sources Pricing ADF and Integration Runtime Pause and resume Integration Runtime

4 Configure Integration Runtime
V2 + = SSIS in Azure = IR = Virtual Machine with SSIS ADF = Orchestrator and configurator SQL DB = hosting Catalog Azure Data Factory Azure SQL Server Integration Runtime

5 Create new Azure Data Factory (Or use PowerShell)

6 The ADF Portal

7 The ADF Dashboard

8 Enterprise: Change Data Capture (CDC) components
Oracle, Teradata, and SAP BW connectors SQL Server Analysis Services (SSAS) and Azure Analysis Services (AAS) connectors and transformations Fuzzy Grouping and Fuzzy Lookup transformations Term Extraction and Term Lookup transformations Or use PowerShell 20 minute startup

9 Clean Logs and Remove old Versions not yet working

10 Lift and Shift SSIS to Azure
Azure Data Factory SSIS Packages As is migration Copy Data Activity SSIS package Redesign Copy Data Activity Data Lake U-SQL Alternative Copy Data Activity Databricks Spark Alternative

11 SSIS Project Deployment to Azure
Visual Studio PowerShell

12 Demo Deployment Visual Studio / SSDT PowerShell SSMS

13 Scheduling packages SQL Server Agent (on-premises or on VM)
SQL Database elastic jobs Azure Data Factory pipeline trigger Also see

14 Demo Schedule

15 On-Premises sources Classic Virtual Network
Azure Resource Manager Virtual Network VPN Site 2 Site VPN Site 2 Peer Don't do this as a BI-consultant, but ask help from a network specialist.... More details

16 Blob Source ≠ Flat File source

17 Blob Source ≠ Flat File source

18 Blob Source ≠ Flat File source

19 Pricing Integration Runtimes
ADF Activity € €0.633 per activity for 1000 runs Data movement € €0.106 per hour Outbound data transfers (> 5GB) € €0.074 per GB Inactive pipelines €0.338 per month Integration Runtimes (Preview prices) S - € €1.011 per hour (≈€ € per month if running 24*7) E - € €1.916 per hour (≈€ € per month if running 24*7) Inactive is not triggered once a week Bring your own license: 33 to 93% discount

20 Pause and resume Integration Runtimes
Scheduled window Pause and resume each run

21 SQL Saturday Holland 2018 October 13 in Utrecht We need sponsors

22 Questions?


Download ppt "SSIS in the Cloud Integration Runtime in Azure Data Factory V2"

Similar presentations


Ads by Google