1. The IT Perspective: Data Warehousing, Management, and Analytical Structures
Rafal Lukawiecki Strategic Consultant, Project Botticelli Ltd

2. Objectives Explain the basics of: Master Data Management
Data Warehousing
ETL
OLAP/Multidimensional Data
This seminar is based on a number of sources including a few dozen of Microsoft-owned presentations, used with permission. Thank you to Chris Dial, Tara Seppa, Aydin Gencler, Ivan Kosyakov, Bryan Bredehoeft, Marin Bezic, and Donald Farmer with his entire team for all the support.
The information herein is for informational purposes only and represents the opinions and views of Project Botticelli and/or Rafal Lukawiecki. The material presented is not certain and may vary based on several factors. Microsoft makes no warranties, express, implied or statutory, as to the information in this presentation.
Portions © 2010 Project Botticelli Ltd & entire material © 2010 Microsoft Corp. Some slides contain quotations from copyrighted materials by other authors, as individually attributed or as already covered by Microsoft Copyright ownerships. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Project Botticelli Ltd as of the date of this presentation.  Because Project Botticelli & Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft and Project Botticelli cannot guarantee the accuracy of any information provided after the date of this presentation. Project Botticelli makes no warranties, express, implied or statutory, as to the information in this presentation. E&OE.

3. BUSINESS DECISION MAKERS
IT PROFESSIONALS
Power Users
INFORMATION WORKERS
DEVELOPERS
MICROSOFT BI PLATFORM
ANALYZE
REPORT
STEAWARDSHIP
MANAGE
INTEGRATE

4. SQL Services – Why? Install only the ones you need Which?
Integration Services
Get your data from the world outside (ETL)
Analysis Services
Cubes, Data Mining, support for PowerPivot on SharePoint
Reporting Services
DIY Report Builder and traditional “big” reports
Master Data Services
Quality of critical master data (cities, colours, customers)
Database Engine
Data warehouse and OLTP relational storage

5. Master Data Management

6. MDM Ensures consistency of data across all organisational uses
Impacts overall data quality
Processes and tools for:
Collection, aggregation, matching, distribution, and persistence of master data
Consistently
Related to Federated Data Management
Key to MDM: Modelling

7. MDM Processes Import & Integration Modeling Export & Subscription
Batched Acquisition from Staging Tables
Members, Attributes, Parent-Child Relationships
SQL Integration Services
Import & Integration
Versioning Changes
Auditing
Compliance
Tracking of Instances
Modeling
Subscription Views
Export to:
Operational Systems
Data Warehouses
BI Analytics
Reporting Tools
Export & Subscription

8. Microsoft Master Data Services SQL 2008 R2 Enterprise, Datacenter, Developer
Tools:
Master Data Manager
Primary tool for managing your master data
MDS Configuration Manager
IT Pro tool
MDS Web Service
For developers wanting to extend MDS
Concepts:
Models
Entities
Attributes
Members
Hierarchies
Collections
Versions
Database

9. Modelling Master Data Model organises data at highest level
Allowing versioning of changes to data
There are typically four categories of models:
People (Customers, Staff)
Places (Geographies, Cities, Countries)
Things (Products)
Concepts (Accounts, Behaviours, Transactions)

10. Example: Product MDM Model
Product (model)
Product (entity)
Name (free-form attr)
Code (free-form attr)
Subcategory (domain-based attr)
Category (domain-based attr)
StandardCost (free-form attr)
ListPrice (free-form attr)
Photo (file attr)

11. Reviewing a Data Model Using Master Data Services
demos
Reviewing a Data Model Using Master Data Services
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

12. Data Warehouse

13. Rich Connectivity Data Providers
ODBC
SQL Server
SAP NetWeaver BI
SQL Server Report Server Models
SQL Server Integration Services
Teradata
XML
OLE DB
DB2
MySAP
SQL Server Data Mining Models
Oracle
SQL Server Analysis Services
Hyperion Essbase

14. Microsoft BI Voyage
Star Schema

15. Star Schema Benefits Simple, not-so-normalized model
Microsoft BI Voyage
Star Schema Benefits
Simple, not-so-normalized model
High-performance queries
Especially with Star Join Query Optimization
Mature and widely supported
Low-maintenance

16. Snowflake Dimension Tables
Microsoft BI Voyage
Snowflake Dimension Tables
Define hierarchies using multiple dimension tables
Support fact tables with varying granularity
Simplify consolidation of heterogeneous data
Potential for slower query performance in relational reporting
No difference in performance in Analysis Services database

17. Slowly Changing Dimensions
Microsoft BI Voyage
Slowly Changing Dimensions
Maintain historical context as dimension data changes
Three common ways (there are more):
Type 1: Overwrite the existing dimension record
Type 2: Insert a new ‘versioned’ dimension record
Type 3: Track limited history with attributes

18. Integration and ETL

19. Let’s do ETL with SSIS SQL Server Integration Services (SSIS) service
Microsoft BI Voyage
Let’s do ETL with SSIS
SQL Server Integration Services (SSIS) service
SSIS object model
Two distinct runtime engines:
Control flow
Data flow
32-bit and 64-bit editions

20. Control Flow Control flow is a process-oriented workflow engine
Microsoft BI Voyage
Control Flow
Control flow is a process-oriented workflow engine
A package contains a single control flow
Control flow elements
Containers
Tasks
Precedence constraints
Variables

21. Data Flow The Data Flow Task Performs traditional ETL and more
Microsoft BI Voyage
Data Flow
The Data Flow Task
Performs traditional ETL and more
Fast and scalable
Data Flow Components
Extract data from Sources
Load data into Destinations
Modify data with Transformations
Service Paths
Connect data flow components
Create the pipeline

22. Using SQL Server Integration Services for Splitting Data
11/21/2018 5:03 AM
demos
Using SQL Server Integration Services for Splitting Data
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

23. OLAP/Multidimensional Data

24. Cube = Unified Dimensional Model
Microsoft BI Voyage
Cube = Unified Dimensional Model
Multidimensional data
Combination of measures and dimensions as one conceptual model
Measures are sourced from fact tables
Dimensions are sourced from dimension tables

25. Hierarchy Defined in Analysis Services
11/21/2018 5:03 AM
Hierarchy
Defined in Analysis Services
Ordered collection of attributes into levels
Navigation path through dimensional space
Very important to get right!
Customers by Geography
Customers by Demographics
Country
Marital
State
Gender
City
Customer
Customer

26. Measure Group Group of measures with same dimensionality
Analogous to a fact table
Cube can contain more than one measure group
E.g. Sales, Inventory, Finance
Defined by dimension relationships

27. Measure Group Measure Group Dimension Sales Inventory Finance
11/21/2018 5:03 AM
Measure Group
Measure Group
Sales
Inventory
Finance
Customers X
Products
Time
Promotions
Warehouse
Department
Account
Scenario
Dimension

28. Using BIDS to Review Dimension Design Cube Design and Functionality
11/21/2018 5:03 AM
demos
Using BIDS to Review Dimension Design
Cube Design and Functionality
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

29. Summary
As a platform for enterprise Business Intelligence you should consider four services:
Data Warehouse (can be relational)
Process for Data Management (MDS)
Process for Data Integration (ETL)
Analysis (OLAP, Data Mining, Columnar)
= SQL Server 2008 R2

30. © 2010 Microsoft Corporation & Project Botticelli Ltd
© 2010 Microsoft Corporation & Project Botticelli Ltd. All rights reserved.
The information herein is for informational purposes only and represents the opinions and views of Project Botticelli and/or Rafal Lukawiecki. The material presented is not certain and may vary based on several factors. Microsoft makes no warranties, express, implied or statutory, as to the information in this presentation.
Portions © 2010 Project Botticelli Ltd & entire material © 2010 Microsoft Corp. Some slides contain quotations from copyrighted materials by other authors, as individually attributed or as already covered by Microsoft Copyright ownerships. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Project Botticelli Ltd as of the date of this presentation.  Because Project Botticelli & Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft and Project Botticelli cannot guarantee the accuracy of any information provided after the date of this presentation. Project Botticelli makes no warranties, express, implied or statutory, as to the information in this presentation. E&OE.