Carlos Bossy Quanta Intelligence SQL Server MCTS, MCITP BI CBIP, Data Mining Real-time Data Warehouse and Reporting Solutions

My Background o 10 years Business Intelligence Consultant o 15+ years software development Experience Speaker o PASS Summit, TDWI, SQL Rally, SQL Saturday, User Groups PASS Performance Virtual Chapter o President (4 th Thursday at 1pm) Social Media o o Blog: TDWI o Colorado Board Member

Platinum Level Sponsors Gold Level Sponsors Pre Conference Sponsor Venue Sponsor Key Note Sponsor

Silver Level Sponsors Bronze Level Sponsors

Session Takeaways This demonstration showcases how much SQL Server can do for you Process only the data you must, and nothing more Don’t Impact the Source Systems Move data in Parallel

Patterns and Tools Change Data Capture Replication Merge Data Vault Timestamps Triggers SSIS Data Flows Analysis Services Proactive Caching Partitioning ROLAP Direct Query Staging Caching Isolation Levels

ReplicationSSISCDC Isolation Levels SQL Server Features

Success Inhibitors To Succeed, Stay away from: o Impacts on Source Applications o Locking and Blocking o Monopolizing system resources: CPU, Disk I/O, Memory o Unnecessary Data Access

Solution and Architecture Patterns  Get Data directly from Source  READ_COMMITTED_SNAPSHOT  Does Source DB have Create / Update Time Stamp?  Does Source DB have proper indexing?  Get Data from Copy  Transactional Replication  Add Time Stamps and Indexes  Get Data from Change Tables  Change Data Capture (CDC)  Customize Data Access Window  Use both Replication and CDC

Replication and CDC SQL Server Transactional SQL Server Read Only Data Warehouse (Dimensional) SQL Server Replication CDC SSIS Changes SSIS SQL Server Analysis Services SSIS Cubes SQL Server Staging SSIS

Replication with Indexing SQL Server Transactional SQL Server Read Only Replication SSIS SQL Server Analysis Services SSIS Cubes SQL Server Staging SSIS Data Warehouse (Dimensional)

Direct from Source to DW SQL Server Transactional SQL Server SSIS Analysis Services SSIS Cubes SQL Server Staging SSIS Data Warehouse (Dimensional)

Replication Transactional ReplicationSelect ArticlesCreate SnapshotContinuousBackground Process

Replication – Keep it Simple Low Latency No Filters Update Subscriber Carefully Change Subscriber thru Publisher Easy to Manage

Change Data Capture Inserts Updates Deletes CDC Schema Query Functions Background Process

Data Integration SSIS for data Transformation into Dimensional Data Warehouse Run Continuously Process Changes Combine CDC with Static Data Build in Sanity Checks

Demo Replication, CDC and ETL Setup Real-time Data Warehouse Real-time Reporting

Summary Consider Alternatives Do what works for You Use SQL Server Features Test, Test, Test

Thank you for attending this session and the 2016 Phoenix SQL Saturday