SQL Server Integration Services Johnley John SQL Saturday #582, Melbourne 11th February 2017

Housekeeping Mobile Phones Evaluations Coffee Please set to “stun” during sessions Evaluations Please complete a session Evaluation to provide feedback to our wonderful speakers! Also complete the Event Evaluation forms – please fill them in and return them at the end of the day Coffee There a Coffee cart provided by WardyIT outside if you need a caffeine hit before the next session (speakers, please remove the line about coffee if your presentation is in the afternoon)

Housekeeping SQL Clinic Lunchtime Sponsor Sessions Don’t forget to check out the SQL Clinic to talk directly to Microsoft staff and MVP’s about your biggest pain points or suggestions for the next versions of SQL Server Lunchtime Sponsor Sessions Learn more over lunch, come hear presentations from our gold sponsors including WardyIT, SanDisk, RockSolid and Insight Enterprises

SQL Server Integration Services

SQL Server Business Intelligence Microsoft SQL Server Integration Services Microsoft SQL Server Analysis Services Microsoft SQL Server Reporting Services Integrate Analyze Report Data acquisition from source systems and integration Data transformation and synthesis Data enrichment, with business logic, hierarchical views Data discovery via data mining Data presentation and distribution Data access for the masses

What is SQL Server Integration Services? SQL Server Integration Services (SSIS) is a component of the Microsoft SQL Server database software. A fast and flexible data warehousing tool used for data extraction, transformation, and loading (ETL)

What is SQL Server Integration Services? A Microsoft SQL Server Business Intelligence application The successor to Data Transformation Services The platform for a new generation of high performance data integration technologies

What is ETL? ETL = Extract – Transform – Load Extract Get the data from source system as efficiently as possible Transform Perform Calculations on data Load Load the data in the target storage

How SSIS Operates Data sources can be diverse, including custom or scripted adapters Transformation components shape and modify data in many ways. Data is routed by rules or error conditions for cleansing and conforming. Flows can be as complex as your business rules, but highly concurrent. And finally data can be loaded in parallel to many varied destinations.

Customer benefits of SSIS Performance Data flows process large volumes of data efficiently Facility Many prebuilt adapters and transformations reduce hand coding Highly productive visual environment Data cleansing features Data mining

Feature drilldown: Data Integration Traditional data sources Custom data sources Integrate diverse sources Parallel loading of diverse destinations

Feature drilldown: Data Warehousing Sorting and aggregation during loading Multicast and partition Slowly changing dimensions Load and process Analysis Services cubes

Feature drilldown: Intelligent Data Handling Capture error rows Fuzzy lookup and grouping Data mining on the data flow

Feature drilldown: Large Data Volumes Efficient data sources High performance processing Unique SQL Server Destination Advanced data flow architecture Enables flexible concurrent processing

Feature drilldown: Development Visual studio integration Visual designer Visual debugging Build and deploy Custom code integration

Sample Server Layout Packages on file system Source data SSIS packages stored in SQL Integration Services Package Execution Destination data Source Flat Files SSIS package Logging SSIS package error rows SSIS support Server(s)

Demo

Summary SQL Server Integration Services is an exceptionally high performance integration and transformation tool Some processes benefit more from parallelism, some from memory Many new tasks and transforms Separation of control flow and data flow

Resources Microsoft SQL Server community on the web www.sqlservercentral.com SQL Server Integration Services on the web www.sqlis.com SQL Server Developer Center http://msdn.microsoft.com/sql/

Questions? Please make sure you visit our fantastic sponsors to get your card stamped to be in the running for a raffle prize:

How did we do? Please complete an Evaluation to provide feedback to our wonderful speakers! SQL Clinic Don’t forget to check out the SQL Clinic to talk directly to Microsoft staff and MVP’s about your biggest pain points or suggestions for the next versions of SQL Server Lunchtime Sponsor Sessions Learn more over lunch, come hear presentations from our gold sponsors including WardyIT, SanDisk, RockSolid and Insight Enterprises Evaluations Also complete the Event Evaluation forms – please fill them in and return them at the end of the day