1. How To Load A Fact Table Really, Really Fast
J. H. Blackburn
How To Load A Fact Table Really, Really Fast

2. Introductions

3. Who am I? Education: B.S. in Physics (2011) – UNF
M.S. in Mathematics (2014) – UNF
Work:
Business Intelligence Analyst – Infinite Energy, Inc. ( )
Software Developer at One Call Care Management ( present)

4. What are we doing?
Describing typical DW implementation and best practices
Quantifying your decisions
Arming you with a framework for testing your tuning
Exploring what we can do to make loading faster

5. But First… A Word From our Sponsors

7. Please Take Pictures and Post!

8. https://tinyurl.com/y6spgfwn
Slack Channel –
#jssug #sqlhelp #jobhelp #sqlsatjax

9. 501 Legion Charitable Donation
Thank the 501 Legion for Supporting Our Event!
JSSUG Will Match Donations up to $200
Donation Bucket on Registration Table

12. Modern Migration Tour Register: https://tinyurl.com/y6qom9n3
When: June 15, 2019
Where: UNF
Sponsored by:
PASS, Microsoft & Intel
In the lead up to SQL Server 2008 end of support, PASS has recruited Sandy—an expert in all things migration—along with an all-star lineup of speakers from Microsoft and Intel®, to smoothly guide you to your final destination—a modern data platform.
Whether you’re interested in moving to an updated on-premises, cloud, or hybrid solution; PASS, Microsoft, Intel®, and Sandy (of course!) have teamed up for a must attend series of webinars, in-person events, and migration resources, dedicated to giving you the tools you need to migrate with confidence.

13. What is a data warehouse?
Optimized for read with complex queries
Typically leverages star schema
Often the reporting center of a business
Often very large with billions of rows and hundreds of drives
Loaded periodically with an Extract Transform and Load (ETL) process

14. Fact Table
Documents that something happened as described by a set of dimensions and measures
E.g., FactSale

15. My Experience One very large fact table (800,000,000 rows)
Consisting of three foreign keys
Took hours to load
Dropped and recreated every day (why?)

16. Experimental Methods

17. <Demo>

18. Some Take Aways

19. Question #0 – Do you need all this data?
YAGNI
How about a view?

20. Question #1 – Have you optimized your E in ETL?
Add indexes where possible to OLTP
Don’t concern yourself with sorting if you don’t have to
Don’t minimize the results size, minimize the time to return results

21. Question #2 – Are you using SSIS?
SSIS uses all the cores on your machine
Use fast load mode on data flow
Create a Sproc to get your data out of OLTP tables as fast as possible
Use package deployment

22. Question #3 – Should you have all those indexes your DW?
Non-Clustered Indexes are expensive
Drop or disable them
Beware of dropping indexes on Standard Edition
Clustered Columnstore (2016+) will do the job and aren’t as expensive

23. <Live Coding Demo>
Let’s Play
<Live Coding Demo>

24. Questions?

25. Contact
LinkedIn:
Download the sample DB and SSIS on GitHub:

26. Don’t forget Session Eval’s for Speakers!
Don’t forget Event Evals for xBox Raffle!
Schedule is Online and in GuildBook App