1. Data Quality Services + Whats new in SSIS in SQL Server 2012 James Beresford www.bimonkey.com @BI_Monkey

2. But first….

3. Data Quality Services SQL 2012 RC0 Edition

4. The Data Quality problem !=

5. Hands up if youve been 2 years old

6. Your first data quality problem

7. Data Quality = Shape Sorting

8. There is Good Data

9. There is Bad Data

10. There is Repairable Data

11. Data Quality Services Terms A Shape = Domain

12. Data Quality Services Terms Collection of Shapes = Knowledge Base

13. Data Quality Services Terms Shape Sorting = Domain Rule

14. The Data Quality Client Allows you to: Create or Maintain Knowledge Bases Data Quality Projects Manage and Configure DQS

15. The Data Quality Client Create a Knowledge Base

16. The Data Quality Client Create a Knowledge Base What did we see? Create a Knowledge Base from Data using Knowledge Discovery Set values as Correct, Error or Invalid Teach the KB some simple auto correction using Domain Rules

17. The Data Quality Client Pop Quiz: Who owns a Knowledge Base? Maintaining KBs is done by: a)Qualified Data Professionals b)A BI Developer c)Users d)Tony Abbott

18. The Data Quality Client Pop Quiz: Who owns a Knowledge Base? Maintaining KBs is done by: a)Qualified Data Professionals b)A BI Developer c)Users d)Tony Abbott

19. The Data Quality Client Create a Composite Domain + n

20. The Data Quality Client Create a Composite Domain What did we see? Use values from one domain to affect another

21. The Data Quality Client Other Domain Functions Things that I wont demonstrate Term Based Relations – autocorrect substrings (e.g. Inc. > Incorporated) Reference Data – Validation against external sources on Azure DataMarket, e.g. Melissa Data

22. The Data Quality Client Create a Data Quality Project

23. The Data Quality Client Create a Data Quality Project What did we see? Interactive Cleansing of data Export of cleansed data set

24. The Data Quality Client Matching Policies Fuzzy & Domain matching Matching Polices Exact – Must match to count in score Similar – Approximate match counts Prerequisite – Must match or match fails De-Duplication

25. Automation with SSIS

26. The DQS Cleansing Task

27. Whats new in SSIS Denali CTP3 Edition

28. Whats new in SSIS Projects & Parameters

29. Whats new in SSIS The SSIS Catalog

30. Whats new in SSIS Developer Experience Visual Studio 2010 &.Net 4 support Undo / Redo Auto-save project recovery

31. Whats new in SSIS Developer Experience New Toolbox

32. Whats new in SSIS Developer Experience Expressions New Expressions LEFT TOKEN TOKENCOUNT Removal of 4000 character limit

33. Whats new in SSIS Developer Experience New Data Flow Column Mapper

34. Whats new in SSIS Developer Experience Expression Markers on icons

35. Whats new in SSIS Developer Experience Variable Window improvements 1.Package Scope by Default 2.Change Scope button

36. Whats new in SSIS Developer Experience Data Quality Services Integration – DQS Cleansing Task

37. Whats new in SSIS Administration Experience Simplified deployment & configuration Automatic logging Management dashboard Built-in reports Improved SSMS management experience Advanced troubleshooting features Package performance analysis

38. Whats new in SSIS SQL 2012 RC0 Edition

39. Whats new in SSIS Developer Experience Change Data Capture

40. Whats new in SSIS Developer Experience ODBC Support Source and Destination Adapters

41. Whats new in SSIS Developer Experience Connection Manager Changes

42. Whats new in SSIS Developer Experience Flat File Source Improvements

43. Whats new in SSIS Developer Experience Package Format Changes Visual Studio Configurations Scripting Improvements Troubleshooting & Logging

44. Whats new in SSIS Administration Experience Data Taps Server Management with PowerShell

45. Whats new in SSIS Developer Experience Other Changes Updated look for the Control Flow and Data Flow Pivot UI Row Count UI New Expression: REPLACENULL BIDS is now SQL Server Data Tools Many small fixes and improvements based on CTP feedback