1. Data Management Conference ETL In SQL Server 2008 Allan Mitchell allan.mitchell@konesans.com London September 29th

2. Why am I here Worked with DTS since the beginning Worked onsite with SSIS before RTM Co-Author on Wrox Professional SSIS Book Run −www.SQLDTS.com andwww.SQLDTS.com −www.SQLIS.comwww.SQLIS.com I am not Microsoft.

3. Agenda/Content Slide What is ETL and why would I use it? Microsoft ETL through the Years −Data Transformation Services −SQL Server Integration Services −What makes Microsoft ETL a good choice Demos

4. What is ETL? Extraction, Transformation and Load Moving data from A  B Transform, conform data Most often used in Data Warehouse loads Also used for −Data Synchronisation −Data Replication

5. Traditional ETL Architecture In this traditional scenario, the integration process simply conforms data and loads the database server The database performs aggregations, sorting and other operations … … but has to contend with competing demands for resources from user queries This solution does not scale to very large volumes of data and multiple, complex aggregations Traditional warehouse loading ELT

6. Rethinking ETL Architecture Leveraging SQL Server Integration Services

7. Is it important? Getting ETL right is very Important 70% of a BI project is about the ETL Why? −No matter how good the cube guy, the reporter. −Bad data and they are dead in the water

8. Microsoft ETL through the years SQL Server 7 −Introduced Data Transformation Services −Drag and Drop paradigm −Easy to use −Freely redistributable −Quick −Forgiving

9. Microsoft ETL through the years SQL Server 2000 −Enhancements to DTS −Mainly engine based changes −Some things however were painful.

10. Microsoft ETL through the years SQL Server 2005 −Microsoft listened to years of input −Complete rewrite −Separates control flow and data flow logic −Containers −Looping −Transactions boundaries −Restart Points −Easy to make environment agnostic

11. Microsoft ETL through the years SQL Server 2008 −Enhances SSIS from SQL Server 2005 −Engine multi threading −Persisted lookups −Better feedback from the engine

12. Demos

13. Contact eMail −Allan.mitchell@konesans.comAllan.mitchell@konesans.com Live Meetings −www.SQLServerFAQ.comwww.SQLServerFAQ.com Websites −www.SQLIS.comwww.SQLIS.com −www.SQLDTS.com

14. © 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.