Cedric Labuschagne Solutions Architect BI-Lateral BIN301

Agenda What is new in SSIS 2008? Connectivity components Connectivity Categories New SSIS connectors

ERP Thinking Bigger About Business Intelligence Majority of the content for decision making are in multiple heterogeneous sources (e.g. ERP systems, databases, flat files) Need to integrate & consolidate data from all these sources, and make quality data available to users Connectivity is the key to address these challenges Flat File ERP Systems Excel XML Databases

What is new in SSIS 2008? Improved and new task components New Lookup Capabilities (caching enhanced) Data Profiling Task (data quality checking) C# Scripting. VSA replaced by VSTA Scalable Data Flow (thread pooling) Enhanced and new connectivity support ADO.NET Source and Destination New connectors for Oracle, Teradata and SAP BI

SSIS Connectivity Components SSIS Package Data Flow Task FTPFTPFLATFILEFLATFILEADO.NETADO.NETOLEDBOLEDB FTPFTP Execute SQL Task FlatFileFlatFile LookupLookup ADO.NETADO.NET Connection Manager TaskTask Data Source/ Destination Data Transformation Note: Execute SQL Task can also make use of ADO.Net, ODBC Connection Managers

Component Interaction SSIS Data Storage AcquireConnection() Connection Object Write()Read() Task or Component Connection Manager

Data Flow Connectivity Options Data Flow Task OLEDB Connector ADO.NET Connector Custom Connector OLEDB Provider Native ADO.NET Adapter ADO.NET ODBC Data Source Specific Interface/ Protocol ODBCODBC Data Storage

Data Access APIs and SSIS "When developing in BIDS, 32-bit data providers are always used at design time, if 64-bit providers will be used in production packages, the equivalent 32-bit provider must be available at design time." APIProsCons OLEDB Comprehensive support with SSIS 64-bit OLE DB providers less prevalent. ADO.NET Good support with SSIS Direct support with ADO.Net Source & ADO.Net Destination Somewhat limited availability of out of the box ADO.NET providers ODBC ODBC drivers for possible data sources widely available Requires the use of a bridge - introduces performance and reliability issues Custom-API Designed for performance of native utilities Limited availability for most databases Inconsistent support with SSIS - varies according to architecture

SSIS Enterprise Data Connectivity VersionsSuggested Connector SSIS Source & Destination SSIS Connection Manager SQL ServerAllSQL Data Access Components ADO.NET OLEDB ADO.NET OLEDB Oracle9iR2, 10, 11Microsoft Connector for Oracle Oracle MSORA TeradataV2R6.0/1/2, 12Microsoft Connector for Teradata Teradata MSTERA SAP BI7Microsoft Connector for SAP BI SAP BI DB28.1, 9.x Microsoft OLEDB Provider for DB2 OLEDB SAP R/34.6c, 4.7, 5, 6BizTalk Adapter 3.0 for mySAP ADO.NET Siebel7.5, 7.7, 7.8, 8BizTalk Adapter 3.0 for Siebel ADO.NET

Connectivity Categories Database Systems (RDBMS) Microsoft SQL Server Oracle Sybase IBM DB2 Teradata MS Access Queue Systems & Protocols MSMQ (Message Queue Task) (s)FTP (FTP Task) ** HTTP/HTTPs (Web Service Task) IBM MQ Series* Tibco Rendezveus* Unstructured,Semi-structured Data Microsoft Excel, CSV Text XML EDI (Electronic Data Interchange) Application Systems Siebel Microsoft Excel Hyperion (Essbase, Planning, Financial Management) SAP R/3 & SAPBI * not supported out-of-the-box, however, custom components can do this. ** sFTP is not supported out-of-the-box

Microsoft Connector for SAP BI Provider Microsoft Version SAP NetWeaver BI Version 7 Pre-requisites SQL Server Enterprise License SAP librfc32 library SAP OpenHub license Platform x86, x64, ia64

Microsoft Connector for SAP BI Data Flow Task SAP BI Connection Mgr Remote Function Calls (RFC’s) * SAP BI SAP BI Data Source SAP BI Data Destination OpenHubOpenHubBAPIBAPI *standard programming interface used by SAP

SQL Server Application Scenario 1 Extracting data from SAP BI into SQL Server SAP BI OHS Destination SSIS SSIS Package OLE dB Destination SAP BI Source Open Hub Info Cube Process Chain Triggered SAP BI Connection Manager

SAPBI Connector

Microsoft Connector for SAP BI Extracting data from SAP BI to SQL Server 1.SAP BI Configuration 1. Set up the RFC Destination 2. Configure and create the Open Hub Destination 3. Create the Data Transfer Process (DTP) and transformation 4. Configure the process chain 2.SSIS Package 1. Setup the SAP BI Source 2. Setup the connection manager for SAP BI 3. Setup the Destination (OLE DB, SQL Destination) 4. Construct Workflow 3.Run the SSIS package

SAP BI Staging BAPI Application Scenario 2 Loading non-SAP data into SAP BI SSIS SSIS Package SAP BI Connection Manager OLE DB Source SAP BI Destination SQL Server XML Flat File InfoSource/ InfoPackage

Microsoft Connector for Oracle Provider Attunity Supported by Microsoft Version Oracle 9iR2, 10, and 11 Pre-requisites SQL Server Enterprise License *Oracle client components Platform SSIS: x86, x64, ia64 * 32 time, 64 runtime)

Microsoft Connector for Oracle Data Flow Task Oracle Connection Mgr OCIOCI Oracle dB Oracle Data Source OCI Array Binding Oracle Data Destination OCI Direct Path OCI

Performance of Oracle Connectors

Performance of Microsoft Connector for Oracle

Microsoft Connector for Oracle Custom Properties ComponentAccess ModeProperty (Default) Oracle SourceTable NameBatch Size (100) Prefetch Count (0) SQL Oracle DestinationTable NameBatch Size (100) Transaction Size No Logging (False) Table Name – Fast LoadParallel (False) No Logging (False) Buffer Size (64KB)

Oracle Connector

Microsoft Connector for Teradata Provider Attunity Supported by Microsoft Version Teradata V2R6.0/1/2, 12 Pre-requisites SQL Server Enterprise License Teradata ODBC driver TPT 12 for high-performance Platform x86, x64

Microsoft Connector for Teradata Data Flow Task Teradata Connection Mgr TPT12TPT12 Teradata DW Teradata Data Source Teradata Data Destination TPT Fast Load TPT TPUMP TPT Fast Export

Microsoft Connector for Teradata Custom Properties ComponentAccess ModeProperty (Default) Teradata SourceTable Name – TPT ExportBlockSize (64330) DataEncryption (False) Max Sessions (1) Min Sessions (1) TenacityHours(4) TenacitySleep(6) SQL Command – TPT Export Teradata DestinationTable Name – TPT StreamBlockSize (64330) DataEncryption(False) MaxErrors (0) MaxSessions (1) MinSessions(1) TenacityHours(4) TenacitySleep(6) Table Name – TPT Load

TeraData Connector

Recap SSIS connectivity Provides a robust connectivity architecture Provides an extensible connectivity architecture Provides rich connectivity options to enterprise data via : Built-in connectors Additional connectors (available from Microsoft downloads) *Third party connectors Rich ecosystem for SSIS connectors *[codeplex or custom dev]

International Content & Community Resources for IT Professionals Resources for Developers Microsoft Certification & Training Resources Resources Required Slide Speakers, TechEd 2009 is not producing a DVD. Please announce that attendees can access session recordings from Tech-Ed website. These will only be available after the event. Required Slide Speakers, TechEd 2009 is not producing a DVD. Please announce that attendees can access session recordings from Tech-Ed website. These will only be available after the event. Tech ·Ed Africa 2009 sessions will be made available for download the week after the event from:

Related Content Breakout Sessions BIN207 Upgrading DTS Packages to Microsoft SQL Server Integration Services Required Slide Speakers, please list the Breakout Sessions, TLC Interactive Theaters and Labs that are related to your session. Required Slide Speakers, please list the Breakout Sessions, TLC Interactive Theaters and Labs that are related to your session.

SSIS Community Resources SSIS Community wiki SSIS Codeplex SSIS Junkies : Attunity Support Forums : Additional Community Resources TechNet Community for IT Professionals Developer Center SQL Server 2008 Learning Portal

Additional Resources External Resources SSIS ETL Record – Loaded 1TB in 30 Minutes! Connectivity Options for Microsoft SQL Server 2008 Integration Services Microsoft Connectors for Oracle and Teradata by Attunity 32E9-4D34-A381-6F9231D84F1E 32E9-4D34-A381-6F9231D84F1E 32E9-4D34-A381-6F9231D84F1E Using SQL Server 2008 Integration Services with SAP BI SQL Server 2008 Business Value Calculator: Team Forum: US/sqlintegrationservices/threads/

Required Slide Complete a session evaluation and enter to win! 10 pairs of MP3 sunglasses to be won

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Required Slide