Presentation is loading. Please wait.

Presentation is loading. Please wait.

SSIS Demo Michael A. Fudge, Jr.

Similar presentations


Presentation on theme: "SSIS Demo Michael A. Fudge, Jr."— Presentation transcript:

1 SSIS Demo Michael A. Fudge, Jr.
IST722 Data Warehousing SSIS Demo Michael A. Fudge, Jr.

2 Recall: Kimball Lifecycle
Describes an approach for data warehouse projects

3 SSIS Demo… Using the Fudgemart Employee Timesheets Dimensional Model from before

4 High-Level Source to Target Map
Fudgemart STAGE Employee_timesheets DW Stage DW stgFudgemartEmployeeTimesheets FactEmployeeTimesheets Employees Supervisors stgFudgemartEmployees DimEmployees External Sources stgDate DimDate Date Dimension STAGING Stage_EmployeeTimeSheets.dtsx “Truncate and Load Patten” LOAD TO DW DW_EmployeeTimesheets.dtsx “Type 1/2 SCD Pattern”

5 The ETL Packages DateDimensionImport.dtsx
Imports the Date Dimension. (One time deal) One package to go from source to stage to target. Stage_EmployeeTimesheets.dtsx Stage Dimension and Fact Data as-is using the truncate and load pattern. DW_EmployeeTimesheets.dtsx Transform staged data into the required Dimensions and Facts. Load with Type 2 or 1 SCD pattern, as to not re-process the same data. Package.dtsx Combine steps 1-3 into one package.

6 1. DateDimensionImport.dtsx
We will walk through how it works. We’ll skip making it because it’s covered in the lab!

7 2. Stage_EmployeeTimesheets.dtsx
Staging Process for Truncate and load: Data Flow – From Source to Stage Source – Use an SQL Command to match target attributes Target – Create new staged table and import data as-is. Include an SQL task to truncate the table before import Repeat for each Source to Stage 2 1 3 1.1 1.2

8 Demo: Stage Fudgemart Timesheet Data

9 3. DW_EmployeeTimesheets.dtsx
1 Type 2 SCD Processing of Dimensions Data Flow from Stage To Dimension Load Data Source from Stage Transform Data from Source to Match Target Lookup Surrogate Key Pipeline Process changes using SCD Type 2 Repeat these steps for each dimension Steps 1.2 and 1.3 vary based on the dimension 1.1 1.2 1.3 1.3 1.3 1.4

10 Demo: DW Fudgemart Timesheet Data Dimension Processing

11 3. DW_EmployeeTimesheets.dtsx
Type 1 SCD Processing of Facts. Data Flow from Stage To Fact Load Data source from stage Transform Data from Source to Match Target – Calculate facts. Lookup Surrogate Key Pipeline Process changes using SCD Type 2 All steps are required for most fact tables. 2 2.1 2.2 2.3 2.3 2.4

12 4. Package.dtsx Once package to execute the others.
This package would get scheduled to execute on a routine basis. Production Changes: No Date Dimension Do not stage all data, but stage based on last processed.

13 Demo: Create Main Package

14 SSIS Demo Michael A. Fudge, Jr.
IST722 Data Warehousing SSIS Demo Michael A. Fudge, Jr.


Download ppt "SSIS Demo Michael A. Fudge, Jr."

Similar presentations


Ads by Google