Bought to you by
Master Data Services in SQL Server 2012 (An Introduction)
Presentation Outline Microsoft Business Intelligence (The Stack) What is Master Data? What is Master Data Management? Do you have these issues? SQL Server Master Data Services (MDS) MDS - Key Capabilities Data Steward MDS – Models, Improving Data Quality, Moving Data, Web Service Demo Summary Resources
Microsoft Business Intelligence SharePoint Collaboration Excel Workbooks PowerPivot Applications Dashboards & Scorecards Analysis Services Reporting Integration Master Data Data Quality Services OData Feeds Line of Business Applications Hadoop Big Data
What is Master Data? “Master Data is data that is at the core of an organization and used across multiple systems, applications, and/or processes…” Requires; Centralized curated activities and maintenance Data Quality Management Easy access for business users (not only IT) Effective collaboration and sharing Master Data contains different attributes for distinct usage (marketing, finance, operations, business groups…)
What is Master Data Management? “Are sets of processes, governance, policies, standards and tools that defines and manage Master Data…”
Why is Master Data Management Important? Reduces, eliminate duplicate data entry and maintenance Improve compliance, reporting, profitability, decision making and data quality Enables data stewards to manage critical business data Provide a single view of critical information funnels
Main Scenarios Data Warehouse / Data Marts Mgmt Data Solutions Operational Data Management Provides storage and management of the objects and metadata used as the application knowledge Object mappings Reference Data / managed object lists Metadata management / data dictionary Enable business users to manage the dimensions and hierarchies of DW / Data Marts BI scenarios Central data records mgmt and consumption sourced by other operational systems A company has adopted 6 “best of breed” systems from different vendors. They need to be able to propagate the correct customer information to each system in a consistent way. MDS provides a platform for central schema, integration points and validation for SI/ISV/Internal IT to develop a custom solution
Why is Master Data Management Important?
Do you have these issues? Instances or sets of invalid data impacting business processes? Wish your business users could manage the data themselves? IT resources fixing data and/or managing hierarchy definitions for users? Systems which could benefit from a single source view of domain data? SQL Server Master Data Services can help you!
MDS Capabilities MDS Enabling Integration & Sharing Validation Authoring business rules to ensure data correctness Modeling Entities, Attributes, Hierarchies MDS Excel Add-In Web UI Data Matching (DQS Integrated) Role-based Security and Transaction Annotation Master Data Stewardship Versioning Enabling Integration & Sharing Loading batched data through Staging Tables Registering to changes through APIs Consuming data through Views Workflow / Notifications External (CRM, ..) Excel DWH
MDS Architecture
What type of Data are we taking about? People Things Places Abstract Customers Products Locations Accounts Vendors Business Units Stores Warranties Employees Bill of Materials Power Lines Time Partners Parts Geographic Areas Metrics Patients Equipment Warehouses Contracts
SQL Server Master Data Services (MDS) SQL Server Master Data Services provides a central data hub that ensures the integrity of information and consistency of data is constant across different applications. Enables cleansing, matching, standardizing and enriching data. New in SQL Server 2012; Redesigned web interface to add, delete, and move members quickly. Excel front-end (MDS add-in) allowing business users to autonomously add and edit data in the underlying systems on their own. Improved performance, security, robustness, and scalability. Integrated with Data Quality Services (DQS) to do data matching before loading. Installation part of SQL Server.
Master Data Services – Key Capabilities Create Master Data By Standardizing Data Definitions For Key Business Entities Collect and maintain accurate and complete master data to ensure standardized data definitions of key business entities across all of your IT assets. Manage data consistency across different environments. (Oracle, Microsoft SQL Azure, HP, and IBM) Manage the superset of all data attributes across all systems. Create explicit hierarchies based on traditional parent-child relationships. Produce derived hierarchies from pre-existing data relationships found within master data models.
Master Data Services – Key Capabilities Create a Master Data Hub for Your Enterprise Implement a master data management hub to manage the master data that is stored in the database and keep it synchronized with the transactional systems that use the master data. Effectively track all known attributes across the enterprise. Create versions for each model at different time intervals. Commit versions of master data only after business rules have been met.
Master Data Services – Key Capabilities Empower Business Users to Manage Data Governance Trust the experience of business-knowledgeable users, so organizations can improve master data maintenance and avoid the delays and mistakes that occur when non-business specialists manage and maintain data. End users can directly manage the underlying database and data warehouse dimensions and hierarchies using Excel. Free IT responsibilities so they can focus on the oversight of the overall data warehouse.
Data Steward Key role - Is usually a Business User and not from the Information Technology side Nutshell: Responsible for maintaining data elements in a metadata registry… Data Steward -> MDS Client (Web based and Excel add-in) Create and edit Models, Hierarchies, Business Rules… Run, process and validate data continually, iteratively, improving… Maintain high level of data quality Create & Edit MDS/DQS Data Steward Matching Cleansing MDS/DQS Data Steward DQS SSIS Developer
Master Data Services - Type of Users Business users – Data stewards - Functional area Administrators - Administrative area
Master Data Services – Models Models are the highest level of data organization in Master Data Services. A model defines the structure of data in your master data management solution. A model contains the following objects: Entities Attributes and attribute groups Explicit and derived hierarchies Collections Accounts; which could include entities such as balance sheet accounts, income statement accounts, statistics, and account type. Customer; which could include entities such as gender, education, occupation, and marital status. Geography; which could include entities such as postal codes, cities, counties, states, provinces, regions, territories, countries, and continents.
Master Data Services – Improving Data Quality In order to ensure the quality and accuracy of your master data these are the following features that are available to you: Business Rules (Automatically update data, send email, start a business process or workflow) Validation (Business rule – Data type content validations) Versions (Audit records, prevent from making changes, lock down models) Notifications (Send email when biz rule fails or model version status changes) Security
Master Data Services – Moving Data Importing Data Import data into Staging Tables and process the staged data as batch stg_nameLeaf stg_nameConsolidated stg_nameRelationship Exporting Data Subscribe systems can view data through subscription views Deploying Models Package, XML format which contains a deployable model structure Tools: MDSModelDeploy, Model Deployment wizard, Model Package Editor
Master Data Services – Extending with Web Services Master Data Manager Web Service WCF service that enables you to control MDS programmatically Custom Workflows A custom workflow calls code that you write, which can take whatever action you require to process the workflow. Developer’s Guide (Master Data Services) http://msdn.microsoft.com/en-us/library/hh230994.aspx
Demo Master Data Services
Enterprise Information Management (EIM) The EIM Stack as a whole is the ‘Master Data Management’ solution from Microsoft and consist of the following: SQL Server Data Quality Services (DQS) - Capture and record knowledge, rules, and actions SQL Server Master Data Services (MDS) - Master Data Management repository, Dimension data SQL Server Integration Services (SSIS) – Moves data, integration Enterprise Information Management (EMI) ‘Master Data Management’
Summary Master Data Management issues are pervasive within organizations and will always exist. SQL Server Master Data Services is built to be deployed rapidly, the intent is to make it accessible for all type of organizations and enable them to create solutions for themselves. An implementation can be successfully achieved by business users without any programming knowledge.
Resources SQL Server 2012 Master Data Services - http://bit.ly/16ei8w0 MSDN, Master Data Services - http://bit.ly/z8crur TechNet, Master Data Services - http://bit.ly/12BfwBH Channel 9, Master Data Services - http://bit.ly/19ab2Y4 Master Data Services Team Blog - http://bit.ly/170Ecuc James Serra’s Blog - http://bit.ly/M3MYI2 SQL Chick’s Blog - http://bit.ly/ietII4 Amazon, Microsoft SQL Server 2012 Master Data Services - http://amzn.to/UtVHaO
Questions?