Integration Services XxxxMicrosoft

Agenda Microsoft BI Platform ChallengesVision SSIS Differentiators Enterprise Data Integration Enhanced Productivity ExtensibilityReferences

Data Marts Data Warehouses CRM LOB ERP Source Systems Data Analysis (OLAP, Data Mining) Why Is It So Difficult To Achieve A Higher Return Of Information Today… Most companies today have a tangled web of IT and human systems. This tangled web has a high degree of inefficiency, complexity, and risks. Human input… prone to error Multiple solutions… more costly, and frustrates users Many disconnected systems… incomplete data… multiple versions of truth High IT involvement… longer time-to- value Many points of data integration… poor data integrity and reliability High degree of data cleansing and re-entry…labor-intensive Handcoding Text Mining ETL ETL

Delivered through a familiar environment Integrated into a business productivity infrastructure Built on a trusted & extensible platform Improving organizations by providing business insights to all employees leading to better, faster, more relevant decisions

BUSINESS COLLABORATION PLATFORM BUSINESS COLLABORATION PLATFORM BUSINESS USER EXPERIENCE DATA INFRASTRUCTURE & BI PLATFORM DATA INFRASTRUCTURE & BI PLATFORM Get more out of products you already own

Cut costs and complexity by leveraging existing IT investments Reduce reporting backlog and bottlenecks with managed Self-Service capabilities Scale-out to support the growing needs of your business Empower Your People with Business InsightEmpower Your People with Business Insight Enable IT EfficiencyEnable IT Efficiency Improve Organizational EffectivenessImprove Organizational Effectiveness Increase team & organizational productivity through dashboards Improve visibility into key team and organizational objectives and metrics Increase business user efficiency with a unified platform Increase individual productivity through familiar & intuitive tools Enable your end users to create their own BI solutions Improve end user sharing and discovery of insights

The Magic Quadrant is copyrighted February, 2008 by Gartner, Inc. and is reused with permission. The Magic Quadrant is a graphical representation of a marketplace at and for a specific time period. It depicts Gartner’s analysis of how certain vendors measure against criteria for that marketplace, as defined by Gartner. Gartner does not endorse any vendor, product or service depicted in the Magic Quadrant, and does not advise technology users to select only those vendors placed in the “Leaders” quadrant. The Magic Quadrant is intended solely as a research tool, and is not meant to be a specific guide to action. Gartner disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. SQL Server is a Leader in Data WarehousingSQL Server is a Leader in Data Warehousing Microsoft is the most aggressive DBMS vendor with a strong road mapMicrosoft is the most aggressive DBMS vendor with a strong road map SQL Server is a Leader in Data WarehousingSQL Server is a Leader in Data Warehousing Microsoft is the most aggressive DBMS vendor with a strong road mapMicrosoft is the most aggressive DBMS vendor with a strong road map GartnerGartner ForresterForrester IDCIDC SQL Server ships more units than Oracle and IBM combinedSQL Server ships more units than Oracle and IBM combined SQL Server is the fastest growing of the top 5 Data Warehouse VendorsSQL Server is the fastest growing of the top 5 Data Warehouse Vendors SQL Server ships more units than Oracle and IBM combinedSQL Server ships more units than Oracle and IBM combined SQL Server is the fastest growing of the top 5 Data Warehouse VendorsSQL Server is the fastest growing of the top 5 Data Warehouse Vendors

Mission Critical Platform CloudDesktop & MobileServer & Datacenter Empowered IT Pervasive Insight Dynamic Development

Data acquisition from source systems and integration Data transformation and synthesis Data enrichment, with business logic, hierarchical views Data discovery via data mining Data presentation and distribution Data access for the masses ReportAnalyzeIntegrate Integration Services Analysis Services Reporting Services

Scalable Platform – Connect – Connect to data – Multi-threaded architecture – Comprehensive transformations – Profile your data – Cleanse your data Enhanced Productivity − Visual Development Environment − Powerful debugging capabilities − Integrated with SQL BI Platform Extensible Platform – C# and VB.Net scripting – Reuse business logic – Embeddable tasks Enterprise Data Integration Platform

Data Integration Architecture: Before Integration Services Call centre data: semi structured Legacy data: binary files Application database ETL Warehouse Reports Mobile data Data mining Alerts and escalation Integration and warehousing require separate, staged, operations. Preparation of data to ETL tools requires work to provide flat files Proliferation of custom coding as developers are unable to leverage expensive ETL products Developers forced to learn proprietary expressions and languages Hand coding Staging Text Mining ETL Staging Cleansing & ETL Staging ETL

SQL Server Integration Services – In Action Call centre: Semi-structured data Legacy data: Binary files Application database Alerts and escalation Integration and warehousing are a seamless, manageable, operation. Connect, Clean, Transform and Load in a single, auditable process. Scales to handle heavy and complex data requirements. Data is routed by rules or error conditions for cleansing and conforming. Load data directly into any destination, from RDBMS to in memory ADO.Net recordsets SQL Server Integration Services Text mining components Custom Adapter Standard sources Custom components Merges Data mining components Warehouse Reports Mobile data Cube Integration Services

 Extensive Connectivity – High speed connectors for Oracle, Teradata and SAP – Standards-based support – XML, flat files, and Excel – Binary files – Connection to Applications via BizTalk, MS Message Queues – Partner ecosystem  Change Data Capture – Transparently capture changes – Real time integration Heterogeneous Sources and Targets Unstructured data Legacy data: Binary files Application database Change Tables OLTP DW

Enhanced Productivity

Development Productivity Visual Development Environment Drag and Drop Package Designer Edit and Debug in Visual Studio Environment Breakpoints, watches, variable inspection Data viewers enable visualization of data flow Full Source Control management Build and deploy Impact analysis and with build and validate Deployment utility moves packages from development, and test to production Custom code integration Script objects using VB.NET Custom components using C#.NET Integrate existing code, or develop new solutions

Extensible Architecture

Intelligent Data Handling

Data Profiling Train mining models on incoming data Use mining models to predict values for missing data Identify outlying rows from patterns of known good data Conditionally route outlying rows for smart escalation of potential anomalies Intelligent Data Handling

Data Cleansing Extract key terms from text fields Lookup from text to reference tables for matching terms Build processes which manage structured and semi-structured data together

Intelligent Data Handling Data Auditing Identify exceptions to business rules with expressions Route type conversion or other data errors to error outputs of components Save exceptions and errors to files, databases… or transform exceptions and errors, to merge back into the main process

Pluggable Components Components can work with data set Aggregation Sorting Fuzzy (best match) Lookups and De-duplication Components work with data row by row Calculating new columns Converting data Character conversions Look-up joins to reference tables

Components can work with data set Aggregation Sorting Fuzzy (best match) Lookups and De-duplication Components work with data row by row Calculating new columns Converting data Character conversions Look-up joins to reference tables Pluggable Components

SSIS Customer References Process 14 million rows in 20 minutes Minimize coding, resulting in faster turnaround for data cleansing and transformation Provide real time store performance data to address business situations Source real time messages from Microsoft Message Queue Using SSIS, data warehouse has grown to over 4 TB, handling 12- fold increase of data loads without increasing loading window “SSIS is delivering sizable performance improvements even with a marked increase in the amount of data it is handling” “Now we can build our business logic into ETL processes, we can make a change to business rule in one place” “Creation of dynamic packages and data marts is automatic…. Scalability of Integration Services was essential to managing massive amounts of data that we work with. “

© 2006 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Better view of the business Enterprise-grade scalability Easier database maintenance Efficient ETL with Integration Services Data compression Microsoft ® SQL Server ® 2008 Enterprise (64-bit) Microsoft Windows Server 2003 Datacenter Edition for Itanium- based Systems Visual Studio ® 2008 Needed to enhance its BI infrastructure for its 17-terabyte data warehouse Required greater scalability Sought easier db maintenance Reduce scheduled downtime Credit Card Company Runs its Business with 17-Terabyte Mission Critical BI Solution “We’re in a business where some of the most important questions asked by upper management begin with ‘What if.’ SQL Server Analysis Services is a tremendous tool for answering those questions.” Dan Zerfas, Vice President of Software Development, PREMIER Bankcard

New in SQL Server 2008 A few SSIS and data warehousing improvements 26 ©2009 Microsoft Corporation

SAP BW 3.5B ON SQL SERVER 2005 BW and SQL Non-SAP Applications Persistent Staging Area BW Object Sharepoint BI portal End User R/3 SQL Server Reporting Services SSRS BW Provider SSIS ETL Platform Staging Area BW DB Connect BW Open Hub SSAS Cube Excel SharePoint SSRS on BW Enterprise reporting on existing business data Build SSRS Reports directly on SAP BW infocubes Certified Connectivity through “Microsoft.Net Data Provider for SAP NetWeaver BI” SQL Server DB Fastest Growing platform for SAP installations Investment in product team to optimize SQL for SAP with co-located product team members in SAP Germany