1. Introducing Data Quality Services and its role in an Enterprise Information Management (EIM) Process James Beresford Group Manager, Avanade DBI217

2. Who am I? … and what am I doing here?

3. Introducing Data Quality Services and its role in an Enterprise Information Management (EIM) Process Goals of session: Introduce DQS Concepts Terminology Showcase Automation Integration into an EIM process

4. Data Quality Services and its role in an Enterprise Information Management (EIM) Process Outcomes for you: Manage data quality Automate data cleansing Support Master Data Management

5. The Data Quality Problem !=

6. Hands up if you’ve been 2 years old

7. Your first data quality problem

8. Data Quality = Shape Sorting

9. There is Good Data

10. There is Bad Data

11. There is Repairable Data

12. Data Quality Services Terms Collection of Shapes = Knowledge Base

13. Data Quality Services Terms A Shape = Domain

14. Data Quality Services Terms Shape Sorting = Domain Rule

15. The Data Quality Client Allows you to: Create or Maintain Knowledge Bases Data Quality Projects

16. demo Create a Knowledge Base using Knowledge Discovery

17. The Data Quality Client Create a Knowledge Base What did we see? Create a Knowledge Base from Data using Knowledge Discovery Set values as Correct, Error or Invalid Teach the KB some simple auto correction using Domain Rules

18. The Data Quality Client Create a Knowledge Base What can we do? Keep our knowledge about data quality in one location Accept, Correct or Reject values Update it as an ongoing process

19. The Data Quality Client Pop Quiz: Who owns a Knowledge Base? Maintaining KB’s is done by: a)Qualified Data Professionals b)A BI Developer c)Users d)Microsoft

20. The Data Quality Client Pop Quiz: Who owns a Knowledge Base? Maintaining KB’s is done by: a)Qualified Data Professionals b)A BI Developer c)Users d)Microsoft

21. The Data Quality Client Create a Composite Domain + n

22. demo Create a Composite Domain with a Domain Rule

23. The Data Quality Client Composite Domains What did we see? Use values from one domain to interact with another

24. The Data Quality Client Composite Domains What can we do? Manage interdependent data fields for quality purposes

25. The Data Quality Client Other Domain Functions Things that I won’t demonstrate Term Based Relations – autocorrect substrings (e.g. Inc. > Incorporated) Reference Data – Validation against external sources on Azure DataMarket, e.g. Melissa Data

26. The Data Quality Client Data Quality Projects Application of a Knowledge Base through the DQS Client Interactively process data Output results

27. demo Create a Data Quality Project

28. The Data Quality Client Create a Data Quality Project What did we see? Interactive Cleansing of data Export of cleansed data set

29. The Data Quality Client Create a Data Quality Project What can we do? Clean Data Export results

30. The Data Quality Client Other DQS Features Things that I won’t demonstrate Matching De-Duplication

31. Automation with SSIS

32. The DQS Cleansing Task

33. demo Automation with SSIS and the DQS Cleansing Task

34. What did we see? Automatic Cleansing of data Managing different results Automation with SSIS The DQS Cleansing Task

35. What can we do? Clean data in an integrated manner User input to data quality can affect DW Updating DQ is independent of updating ETL Automation with SSIS The DQS Cleansing Task

36. Data Quality Services Master Data Services Integration Services EIM: Credible, Consistent Data

37. Master Data Services (MDS) MDS Provides A central store of reliable data Web and Excel UI’s Easy access to Master Data

38. Loading MDS Creating our Entity

39. Updating MDS Handling new, trusted data

40. Feeding from MDS Publishing with Subscription Views ?

41. demo Integrating DQS processes with MDS processes

42. DQS + MDS As part of an EIM process What did we see? Knowledge from DQS captured in MDS using Excel New knowledge captured in DQS transferred to MDS using SSIS

43. MDS As part of an EIM process What can we do? Use DQS to provide the foundation for Master Data Use DQS as a means of providing updated Master Data Have a user driven EIM process

44. Introducing Data Quality Services and its role in an Enterprise Information Management (EIM) Process Goals of session: Introduce DQS Concepts Terminology Showcase Automation Integration into an EIM process

45. Introducing Data Quality Services and its role in an Enterprise Information Management (EIM) Process You can find me at the speaker meet & greet – 11.00-11.30, speakers lounge, Thursday 13th And follow me at: Blogger @ www.bimonkey.comwww.bimonkey.com Tweeter @BI_Monkey MSDN SSIS & DQS Forums

46. Introducing Data Quality Services and its role in an Enterprise Information Management (EIM) Process