1. virtual techdays INDIA │ 18-20 august 2010 SQL Data Loading Techniques Praveen Srivatsa │ Director, AsthraSoft Consulting Microsoft Regional Director, Bangalore MVP, ASP.NET

2.  Replication Choices  Managing Replication  Syncing up replication virtual techdays INDIA │ 18-20 august 2010 S E S S I O N A G E N D A

3. Overview Tools and functionality in SQL Server for: Data transport out of the database Data transport into the database Tools and functionality in SQL Server for data transport into, out of, and within a database and across multiple databases, multiple file formats, and other data sources and destinations

4. Data Out Overview SQL Server 2008

5. Data In Overview Input PartsPayrollPerson SQL Server 2008

6. SQL Server Data Transport SQL Server offers several Bulk Copy commands and tools: BCP, the Bulk Copy utility, is used to transfer large volumes of data in and out of a database To export—data is dumped into a flat file in a delimited format To import—data is first exported from the source database or program and then imported into SQL Server database BULK INSERT command can be used within Transact-SQL programs to insert large volumes of data from a flat file Bulk copy API can be used in ODBC, OLE DB, SQL-DMO and SMO applications OPENROWSET (BULK…) can also be used to bulk import large object data in SQL Server

7. SQL Server Integration Services (SSIS) SQL Server Integration Services offers several tools to extract, transform and load data from multiple data sources into SQL Server databases and vice versa Provides control over data flow, looping and conditioning Packages can be built using SSIS designer in Business Intelligence Development Studio Import / Export Wizard Database Export Utility

8. Elements of Integration Services SQL Server Integration Services Service (MsDtsSrvr.exe) Package Control Flow Elements Containers Tasks Precedence Constraints Data Flow Elements Event Handlers Variables Configurations

9. SSIS Tools SSIS tools are used to create, modify and execute Packages SSIS Import / Export Wizard Assists in building simple Packages to import, export, and transform data or to copy database objects SSIS Designer inside Business Intelligence Development Studio Graphical application that lets us build and debug packages containing complex workflows, multiple connections to heterogeneous data sources, and event- driven logic SSIS Package Execution Utilities dtexecui.exe dtexec.exe dtutil.exe is a tool used to manage SSIS packages

10. 10 Functionality Integration Services BULK INSERTBCP INSERT … SELECT SQL Dest.OLE DB Dest Protocol Shared Memory TCP/IP In Memory TCP/IP In Memory Named Pipes Shared Memory Named Pipes Speed Faster / Fastest(4) Fast / Fastest (1) FastestFast Slow / Fastest (2) Data SourceAny Data File Only Any OLE DB Bulk API Support Not Native Not ORDER All No Hints Allowed Not Native Comparisions

11. 11 Functionality Integration Services BULK INSERTBCP INSERT … SELECT SQL Dest.OLE DB Dest Can transform in transit Yes No Yes I/O Read block Size Depends(3) 64 kilobytes (KB) 64 KBUp to 512 KB SQL Server Version 2005 and 2008 7.0, 2000, 2005, and 2008 6.0, 7.0, 2000, 2005, and 2008 2008 Invoked from DTEXEC / BIDS Transact-SQL Command Line Transact-SQL Comparisons

12. Review We reviewed tools used in Oracle for transferring data out of a database — Data Pump Export utility, SQL*Plus, SBMS_UTILITY and UTL_FILE packages and their SQL Server equivalents — bcp utility, sqlcmd.exe tool, SSIS, print and SELECT statements We have seen tools used in Oracle for transferring data into a database — Data Pump Import utility, SQL*Plus, SQL*Loader and command, SSIS, OPENROWSET We discussed in detail the Bulk Copy commands in SQL Server We discussed SSIS in detail, including: SSIS Package components such as tasks, transformations and workflow constraints SSIS tools such as Import//Export Wizard, SSIS Designer Copy Database Wizard

13. virtual techdays THANKS │ 18-20 august 2010 praveens@asthra.net │ asthratimes.asthrasoft.com