1. BI Methodologies and Best Practices
blog.bizdataviz.com
@bizdataviz
Digging Deeper:
BI Methodologies and Best Practices

3. Who Am I? CIO American Holdco Group BI Consulting Engagements
blog.bizdataviz.com
@bizdataviz
CIO American Holdco Group
Seafood Processing and Wholesaling
~700 Employees
BI Architect by Default
BI Consulting Engagements
SSIS, SSRS, PowerBI, PowerPivot, PowerView
Speaker, Blogger, General BI Enthusiast

4. Session Goals Mutually Beneficial Presentation Canned Examples of ETL
blog.bizdataviz.com
@bizdataviz
Mutually Beneficial Presentation
Canned Examples of ETL
Lessons Learned, Best Practices
“New” Stuff?
Get More Twitter Followers

5. BI Components Sources Extract Transform Load (ETL)
blog.bizdataviz.com
@bizdataviz
Sources
Extract Transform Load (ETL)
Presentation Mediums

6. Sources chris@bizdataviz.com blog.bizdataviz.com @bizdataviz THE GOOD
THE BAD
THE UGLY
Cobol
Fortran
Legacy Data
Foxpro

7. ETL Tools Data Transforms 3rd Party Tools SSIS PowerQuery Views
blog.bizdataviz.com
@bizdataviz
Tools
SSIS
PowerQuery
Views
Stored Procedures
Functions
Etc.
Data Transforms
Aggregation
Deduplication
Cleansing
Calculations
3rd Party Tools
Pragmatic Works
CozyRoc
KingswaySoft
Devart

8. Delivery Mediums
blog.bizdataviz.com
@bizdataviz

9. New SSRS 2016 Stuff Redesigned Portal Mobile Reports (Datazen) HTML 5
blog.bizdataviz.com
@bizdataviz
Redesigned Portal
Mobile Reports (Datazen)
Hosted in PowerBI Mobile App
HTML 5
New Charts
Export to PowerPoint
Customize Parameter Display
Pin reports to PowerBI
No more ActiveX
Full Details:

10. Example 1: Air Freight Match
blog.bizdataviz.com
@bizdataviz
SQL
COBOL
Sources:
ETL:
ParkWay Cobol Connector
Calendar, Flight, Invoice Info
Match
Records
DELIVERY:

12. File Move Operations

13. Cleansing/Matching

14. Example 2: Research Collection
blog.bizdataviz.com
@bizdataviz
SQL
Sources:
ETL:
DELIVERY:

16. Check if File Exists?
Yes No

17. Compare and Insert Records

18. Lessons Learned and Best Practices
blog.bizdataviz.com
@bizdataviz
Use Source Control
Standardize transform names
Document inside your Code and ETL Workflow
Setup Detailed Alerts for failures
Standard File and Folder Names and Locations
Have a Development and Testing Platform
Have a “Report Request Form”
Experiment to fine tune and improve performance
Set your Backup Type to Basic or Bulk-logged on staging tables
Temp Tables may help your ETL run faster than Staging Tables