SQL Server Warehousing (Fast Track 4.0 & PDW)

SQL Server Warehousing (Fast Track 4.0 & PDW)
DBI331 SQL Server Warehousing (Fast Track 4.0 & PDW) Stephen Strong, Matthew Winter

Agenda Fast Track Data Warehouse SQL Server 2012
TechReady 14 4/21/2017 3:42 AM Agenda Fast Track Data Warehouse SQL Server 2012 The Problem Balanced Architecture Performance Gains Lessons Learnt SQL Server Parallel Data Warehouse What is Parallel Data Warehouse PDW Architecture & Components AU3.0 Enhancements Roadmap Q & A © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

The Problem OLTP – Tune your application (DW less control)
TechReady 14 4/21/2017 3:42 AM The Problem OLTP – Tune your application (DW less control) Business Case - Budget Time to value © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Solution Step 1: Buy new shiny SAN array Step 2: Buy big server
TechReady 14 4/21/2017 3:42 AM Solution Step 1: Buy new shiny SAN array Step 2: Buy big server Step 3: Install SQL Server 2012 Step 4: Bulk load 30TB DW with SSIS Step 5: Grant access 30TB Users © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SOLUTION COMPLETE TechReady 14 4/21/2017 3:42 AM
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Why that “solution” doesn’t work with DW
TechReady 14 4/21/2017 3:42 AM Why that “solution” doesn’t work with DW Infrastructure Cost Large scans of huge fact tables Audience Survey – SAN throughput © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

DATA WAREHOUSING OFFERINGS WHERE FAST TRACK FITS IN
Self Build Business Data Warehouse Fast Track Reference Architectures Parallel Data Warehouse Half Rack Parallel Data Warehouse Full Rack Effort to Build Variable Very low Moderate Capacity 5TB 14TB – 95TB 80TB 500TB + Concurrency Light Light – high Very high Query Complexity Medium Medium – high Architecture SMP MPP Form factor Software only Appliance Reference Architecture

Fast Track DW Reference Architectures
TechReady 14 4/21/2017 3:42 AM Fast Track DW Reference Architectures Workload specific Software & System designs that help Customers accelerate their SQL Server 2012 projects. Software: SQL Server 2012 Enterprise Windows Server 2008 R2 Database Configuration: Workload Specific Database Architecture SQL Server settings Windows Server settings Performance Guidance Hardware System Design: Tight specifications for servers, storage and networking Resource Balanced & Validated Latest generation Servers & Storage © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Key benefits Still Windows Server & SQL Server for admins & mgmt
TechReady 14 4/21/2017 3:42 AM Key benefits Still Windows Server & SQL Server for admins & mgmt Can select from a range of HW vendors Engineered by expert from HW vendor and Microsoft Pre-tested for predictable results Faster implementation Great performance/price ratio Low SQL Server license count © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Under the covers – the “secret” sauce
TechReady 14 4/21/2017 3:42 AM Under the covers – the “secret” sauce Sequential Reads Parallel reads across multiple disk sets Balanced architecture Difficult to achieve in large server / share SAN environment Database layout matches hardware layout Matching throughput for each component LUNs mapped to Storage Processors, network paths, CPUs © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

TechReady 14 4/21/2017 3:42 AM © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

400MB/sec each 1.6GB/sec each 6.4GB/sec total 2 socket x8 core
TechReady 14 4/21/2017 3:42 AM Server Fiber Switch Storage Enclosure Storage Processor 3GB/sec RAID10 400MB/sec each Windows Server 2008 R2 SQL Server 2012 1.6GB/sec per port Storage Enclosure Storage Processor 3GB/sec RAID10 1.6GB/sec each 6.4GB/sec total 2 socket x8 core 16-cores total 5.8GB/sec total CPU HBA Storage Enclosure Storage Processor 3GB/sec RAID10 CPU HBA HBA HBA Storage Enclosure Storage Processor 3GB/sec RAID10 6.4GB/sec total PCIe 3.0 © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Performance Enhancements over Fast Track 3.0
TechReady 14 4/21/2017 3:42 AM Performance Enhancements over Fast Track 3.0 Take DL380 FT 3.0 hardware – 20TB solution SQL Server 2008 R2 – 2.4GB/sec benchmark queries SQL Server 2012 – 5GB/sec with ColumnStore Indexes No hardware changes No Solid State Drives 10x – 100x query improvement with ColumnStore © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server Configuration
TechReady 14 4/21/2017 3:42 AM SQL Server Configuration Trace Flags DB file placement Tempdb: 8-12 files max Index light – optimise for sequential scan throughput Capacity is based on Page and ColumnStore compression Support for AlwaysOn Failover Clustering © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Fast Track Integration
TechReady 14 4/21/2017 3:42 AM Fast Track Integration Cubes (SSAS) Excel SSRS Source Systems Fast Track SQL Server 2012 SP2010 ETL (SSIS) Source Systems Power View Source Systems 3rd Party © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Lessons Learnt Use SQLIO for validation
TechReady 14 4/21/2017 3:42 AM Lessons Learnt Use SQLIO for validation Aim for consistent MB/sec above published #s Take care with DB file placement On 30TB+ configuration pay attention to SP-LUN mappings Simulate FT LUN layout in Dev environment Take advantage of ColumnStore for extra performance Set MAXDOP to number of physical cores Use Resource Governor to limit memory/query to 10-15% © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Agenda Fast Track Data Warehouse SQL Server 2012
TechReady 14 4/21/2017 3:42 AM Agenda Fast Track Data Warehouse SQL Server 2012 The Problem Balanced Architecture Performance Gains Lessons Learnt SQL Server Parallel Data Warehouse What is Parallel Data Warehouse PDW Architecture & Components AU3.0 Enhancements Roadmap Q & A © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What is Parallel Data Warehouse
Scalable Scales from 10’s to 100’s of TB of Data Implemented as Massively Parallel Processing (MPP) System Standards Based Leverages Commodity Hardware Speaks SQL Server Language (T-SQL) Flexible Offers Hardware of Choice (HP/Dell) Supports Multiple Hardware Architectures Cost Effective Low Price/TB Ratio

SQL Server vs. PDW SQL Server Parallel Data Warehouse
TechReady 14 4/21/2017 3:42 AM SQL Server vs. PDW SQL Server Symmetric Multiprocessing (SMP) System ‘Shared Everything’ Architecture High Contention for System Resources (e.g. I/O, CPU) Extremely High Concurrency for Some Workloads Limited Scalability (up to 95TB) Requires Building High Availability Rich Functionality for OLTP and Data Warehousing Parallel Data Warehouse Massively Parallel Processing (MPP) System ‘Shared Nothing’ Architecture Balanced Resource Utilization (e.g. I/O, CPU, Memory) Higher Concurrency for Very Complex Workloads Excellent Scalability (up to 1PB) Built-in High Availability and Redundancy Tuned for Data Warehousing © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

PDW Architecture TechReady 14 4/21/2017 3:42 AM Control Rack Data Rack
Compute Nodes Storage Nodes Control Nodes Active / Passive SQL SQL Client Drivers SQL SQL SQL Management Servers SQL Support / Patching Dual Infiniband Dual Fiber Channel SQL SQL Landing Zone ETL Load Interface SQL SQL Backup Node Corporate Backup Solution SQL Spare Compute Node © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Control Node Client Drivers TechReady 14 4/21/2017 3:42 AM SQL

Control Node and Client Drivers
TechReady 14 4/21/2017 3:42 AM Control Node and Client Drivers Client Connections Always Go Through The Control Node Contains No Persistent User Data PDW “Secret Sauce” Processes SQL requests Prepares execution plan Orchestrates distributed execution Local SQL Server Final Query Plan Processing Result Aggregation Drivers TDS Protocol (SQL Native 10) Wire Protocol (SeQuel Link) ODBC, OLE-DB, ADO.NET and JDBC Client Drivers for both 32-bit and 64-bit © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Management Node Support / Patching TechReady 14 4/21/2017 3:42 AM

Management Node Runs the Windows Domain Controller (Active Directory)
TechReady 14 4/21/2017 3:42 AM Management Node Runs the Windows Domain Controller (Active Directory) Used for deploying patches to all nodes in the appliance Holds images in case a node needs reimaging © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Landing Zone ETL Load Interface TechReady 14 4/21/2017 3:42 AM

TechReady 14 4/21/2017 3:42 AM Landing Zone Provides High-Capacity Storage for Data Files from ETL processes Integration Services available on the Landing Zone Connected to Internal Network Available as Sandbox for other Applications and Scripts that Run on Internal Network Source Landing Zone Files Data Loader Compute Nodes DWLOADER or SSIS © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Backup Node Corp. Backup Solution TechReady 14 4/21/2017 3:42 AM

Backup Node Coordinated Backup across Nodes Database-Level Backup
TechReady 14 4/21/2017 3:42 AM Backup Node Coordinated Backup across Nodes Database-Level Backup Full or Differential Metadata Backup Can Restore to a Larger Appliance Optional Item – 1 Size per Configuration Up to 654TB of Capacity Orderable in Different Capacities © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

“PDW Node” Compute Node Storage node TechReady 14 4/21/2017 3:42 AM

TechReady 14 4/21/2017 3:42 AM Compute Node Each MPP Node is a Highly Tuned SMP Node with Standard Interfaces Dedicated Hardware, Database, and Storage Running SQL Server 2008 Enterprise Edition SQL as Primary Interface © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Compute Node Compute Node Hardware
TechReady 14 4/21/2017 3:42 AM Compute Node Compute Node Hardware Enterprise-Class DBMS Dual Multi-Core Processors TempDB Workspace CPU RAM DUAL 4Gb FC Dual InfiniBand Pre-Configured for Each SQL Server Instance on Each Compute Node. Drives Configured as RAID 1 to Avoid Appliance Failover for a Single-Drive Failure Configured with 3 LUNs (i.e. 3 RAID 1 Pairs) TempDB Used for the Following Purposes: Sort-Work Area for Data Loading into Clustered Index Tables Spill Area for Hash Joins Not Fitting into Memory Temporary PDW Tables © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Storage Node Dual Fiber Channel Controllers Active/Active
TechReady 14 4/21/2017 3:42 AM Storage Node Dual 8 GB Fiber Storage Processor Data/Log Drives (RAID 1) - LFF Hot Spare Dual Fiber Channel Controllers Active/Active Provides Fault Tolerance © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Storage Node – Drive Array (User Databases)
TechReady 14 4/21/2017 3:42 AM Storage Node – Drive Array (User Databases) Small Form Factor Drives (SFF) (24) – 8 RAID 1 groups containing a single LUN Large Form Factor Drives (LFF) (11) – 4 RAID 1 groups containing 2 LUNs each LUN1 LUN2 LUN3 LUN4 LUN5 LUN6 LUN7 LUN8 User Database LUN1 LUN2 LUN3 LUN4 LUN5 LUN6 LUN7 LUN8 LUN 9 LUN 9 LUN 9 Hot Spare SFF – 6 disk in a RAID group LFF – 2 disk in a RAID 1 group SFF - 2 Hot Spares LFF – 1 Hot Spare Log LUN 9 LUN 9 LUN 9 Hot Spare (SFF) © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Storage Node – Physical File Layout
TechReady 14 4/21/2017 3:42 AM Storage Node – Physical File Layout LUN1 LUN2 LUN3 LUN4 LUN5 LUN6 LUN7 LUN8 FG UDB_Dist_A FG UDB_Dist_B FG UDB_Dist_C FG UDB_Dist_D FG UDB_Dist_E FG UDB_Dist_F FG UDB_Dist_G FG UDB_Dist_H User Database UDBDist.ndf UDBDist.ndf UDBDist.ndf UDBDist.ndf UDBDist.ndf UDBDist.ndf UDBDist.ndf UDBDist.ndf UDB Replicated FG UDBRepl.ndf UDBRepl.ndf UDBRepl.ndf UDBRepl.ndf UDBRepl.ndf UDBRepl.ndf UDBRepl.ndf UDBRepl.ndf LUN 9 LUN 9 LUN 9 8 Distribution Filegroups 1 Replicated Filegroup with 8 Files 1 Log Filegroup Log LUN 9 LUN 9 LUN 9 © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

PDW Benefits – Massive Parallel Processing
TechReady 14 4/21/2017 3:42 AM PDW Benefits – Massive Parallel Processing Control Rack Data Rack Compute Nodes Storage Nodes Query 1 is Submitted to SQL Server via the Control Node. Control Nodes Active / Passive ? SQL ? SQL Query 1 SQL SQL SQL Query is Executed on All 10 Nodes. Management Node SQL Dual Infiniband Dual Fiber Channel SQL SQL Landing Zone Results are Sent Back to the Client. SQL SQL Backup Node SQL Spare Compute Node © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Stock Exchange in the US
TechReady 14 4/21/2017 3:42 AM Customer Successes CUSTOMER EXAMPLE: Stock Exchange in the US Data Volume 80 TB data warehouse analyzing data from exchanges Existing system based on SQL SMP farm 2 different clusters of 6 servers each Requirement Linear scalability with additional hardware Support hourly loads with SSIS – 300GB/day BI Integration: SSRS, SSAS and PowerPivot AU3 Feedback SP and increased T-SQL support was great Migrating SMP SSRS to PDW was painless 142x for scan heavy queries & no summary tables Enabled queries that do not run on existing system Reports Dashboards Scorecards Portal ETL PDW Operational DB’s © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Major Retailer in the US
TechReady 14 4/21/2017 3:42 AM Customer Successes CUSTOMER EXAMPLE: Major Retailer in the US Data Volume Currently 11 TB data warehouse analyzing data from transactional and clickstream sources (2 years data) Business need to expand to 7 year data window, i.e. ~39 TB. Requirement Scalability - growing data volume does not affect performance Performance and ad-hoc analysis for interactive querying by users BI Integration with Microsoft BI stack - SSAS and SSRS AU3 Feedback SSAS cubes worked ‘out-of-box’ Performance an order of magnitude faster than existing system (~30x on an expanded data set) PDW Nielsen OLTP system SSAS Click-Stream © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Parallel Data Warehouse Loading Data Breaking the Marketing Numbers
4/21/2017 3:42 AM Demo Parallel Data Warehouse Loading Data Breaking the Marketing Numbers Matthew Winter Architect PDW & Appliance CoE © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What’s New in Appliance Update 3.0 (AU3)
TechReady 14 4/21/2017 3:42 AM What’s New in Appliance Update 3.0 (AU3) 10X Performance Best-in-class Manageability Low Entry Cost More BI Tools, Any Language © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

New in AU3: Breakthrough Performance
TechReady 14 4/21/2017 3:42 AM New in AU3: Breakthrough Performance Breakthrough Performance Faster Query Performance Drives Greater Productivity Support More Users with High Concurrency 10X Improvement in Data Movement in the appliance Faster Throughput for Mixed Workloads 6X © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

New in PDW AU3: Best-in-Class Manageability
TechReady 14 4/21/2017 3:42 AM New in PDW AU3: Best-in-Class Manageability Best-in-Class Manageability Reduced operational cost through unified management of appliances and other SQL instances Reduced cost of Upgrading from Scale Up SQL Server to MPP PDW Integration with Cost © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

New in PDW AU3: Low Entry Cost
TechReady 14 4/21/2017 3:42 AM New in PDW AU3: Low Entry Cost Low Entry Cost New Lower Cost Half Rack Solution Order From Your Preferred Vendor HP DELL © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

New in PDW AU3: More BI Tools, Any Language
TechReady 14 4/21/2017 3:42 AM New in PDW AU3: More BI Tools, Any Language More BI Tools, Any Language Greater Support for Non-Microsoft BI & ETL Tools Use PDW on Data in Any Language SAS Hadoop Informatica Microstrategy SAP Business Objects International Data Support © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

In Review Session Objectives Key Takeaways
TechReady 14 4/21/2017 In Review Session Objectives Scaling Microsoft SQL Server to manage the trend to analyse and report on increasing data volumes. Key Takeaways The Fast Track Reference Architecture provides a cost-effective approach to accelerate your data warehouse strategy. Providing a guide to building a reliable, scalable solution that will help you reduce your risk and save time. Parallel Data Warehouse is a preconfigured appliance based upon the proven SQL Server database technology. PDW is capable of scaling out as your data volumes grow, reducing the maintenance overhead to a minimum and provides the raw performance an Enterprise Data Warehouse requires. © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Data Warehousing with SQL Server (Fast Track & PDW)
4/21/2017 3:42 AM Q & A Data Warehousing with SQL Server (Fast Track & PDW) Stephen Strong, Matthew Winter © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4/21/2017 3:42 AM © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server Warehousing (Fast Track 4.0 & PDW)

Similar presentations

Presentation on theme: "SQL Server Warehousing (Fast Track 4.0 & PDW)"— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

SQL Server Warehousing (Fast Track 4.0 & PDW)

Similar presentations

Presentation on theme: "SQL Server Warehousing (Fast Track 4.0 & PDW)"— Presentation transcript:

Similar presentations

About project

Feedback