SQL Server Data Warehouse reference architectures

SQL Server Data Warehouse reference architectures
11/19/ :12 PM SQL Server Data Warehouse reference architectures Matt Goswell Microsoft Technical Product Manager for Data Warehousing & Information Management Vinay Kulkarni Lenovo Lead Architect for Microsoft Solutions Lenovo Data Center Group © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Big data and data warehousing impacts all verticals
Banking Minimize losses with more accurate fraud detection and assess exposure to asset, credit and market risk using a holistic approach Boost operational efficiency and improve patient acre experience with intelligent detection and in time service. Healthcare Government Empower citizens and improve their engagement with relevant information and personalized citizen services. Retail Turn individual customer interactions into contextual engagements and increase customer satisfaction with highly personalized offers and content Manufacturing Eliminate downtime and increase efficiency by enabling better predictive maintenance for your capital assets. Heartland Bank prevents fraud and boosts profits Rolls Royce decreases costs with Predictive Maintenance The UK NHS transforms healthcare with faster access to information. City of Barcelona boosts citizen unsegmented with intelligent app Jet.com transforms customer engagement with truly aerosolized experience

The data warehouse has evolved into
a Data Management Solution for Analytics LOB CRM Graph Image Social IoT Hybrid Operational databases Operational databases Data warehouses Data warehouses Data lakes Data lakes Reason over any data, anywhere Flexibility of choice Security and privacy

An integrated platform that delivers end-to-end
LOB CRM Graph Image Social IoT Hybrid SQL Server Azure Data Services Easiest lift and shift with no code changes Industry leader 2 years in a row Operational databases Operational databases 70% faster than Aurora #1 TPC-H performance Data warehouses Data warehouses 2x global reach than Redshift T-SQL query over any data Data lakes Data lakes No Limits with 99.9% SLA Security and privacy Flexibility of choice Reason over any data, anywhere AI built-in | Most secure | Lowest TCO

Business intelligence
A complete data warehouse portfolio designed for businesses of all shapes, sizes and locations Scale up Scale out + across Azure SQL Database Up to 4TB compressed (per DB) Azure SQL DW Unlimited columnar storage Azure HDInsight Data Prep Built-in Analytics Business intelligence Machine learning On-premises Cloud SQL Server Up to 150TB compressed Analytics Platform System Up to 4PB compressed

On premises data warehouse solution
Build 2015 On premises data warehouse solution 11/19/ :12 PM Prep & Ingest Store Analyze Consume Business apps Data Warehouse Fast Track for SQL Server <150TB compressed, SMP Web & mobile apps INTEGRATION SERVICES UP TO 150TB MACHINE LEARNING REPORTING SERVICES Custom apps PolyBase Operational reports Analytics Platform System >150TB compressed, MPP Your big data store Sensors and devices Analytical dashboards DATA INTELLIGENCE ACTION © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Why choose Data Warehouse Fast Track for SQL Server?
11/19/ :12 PM Why choose Data Warehouse Fast Track for SQL Server? © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Reference Architectures work
11/19/ :12 PM Reference Architectures work Built using trusted and proven hardware and software Designed to deliver a balanced configuration Highly tuned to deliver optimal performance Data Warehouse Fast Track is NOT an appliance Range of fully scalable offerings from partners (IHV, Storage\SI) A data warehouse solution you can trust with ‘everything built-in’ Big Data integration ‘built-in’ using Polybase and\or SQL Server Integration Services Full database, analysis and reporting capabilities within a single solution Available across Windows & Linux platforms © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11/19/ :12 PM The Top 10 reasons why customers demand SQL Server Data Warehouse Fast Track Microsoft is the recognized industry leader Delivers the most secure & least vulnerable database Provides ground-breaking performance and scale Is the only end-to-end mobile BI solution in the market Boasts the fastest in-memory technology on the planet across workloads Enables mission-critical intelligent applications Introduces accelerated hybrid cloud scenarios with Azure Tackles big data workloads Provides platform choice Has everything built-in 1 2 3 4 5 6 7 8 9 10 SQL Server © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Server & Tools Business
11/19/2018 Data Warehouse Fast Track for SQL Server Make smarter decisions faster. In-memory built-in In-memory columnstore Data Warehouse Fast Track Real-time Operational Analytics. Efficient analytics queries directly on operational data – no ETL lag or complexity Up to 30x faster transactions with in-memory operations Queries from minutes to seconds Complete Data Management Solution for Analytics 2-24 hrs Min /sec ETL Real-time business insight Business problem SQL Server OLTP In-memory OLTP © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Data Warehouse Fast Track for SQL Server is your
Data Management Solution for Analytics Easily manage increasing data volumes, new data sources and types, and Big Data & DW workloads End-to-end Data Management Solution for Analytics Apps + insights Change Data Capture Data Quality Master Data Management LOB PREP & INGEST STORE PREP & TRAIN MODEL & SERVE Data orchestration and monitoring Big data store Hadoop/Spark and machine learning Data warehouse CRM Graph Image Social SQL Server Integration Services Local and Cloud Storage Polybase R SQL Server Database Services SQL Server Analysis Services IoT Cloud Hadoop integration ‘built-in’ SQL Server Reporting Services Enable the Enterprise-compatible Data Lake

SQL Server 2017 Industry-leading performance and security NOW ON LINUX and DOCKER 1/10th the cost of Oracle Choice of platform and language Industry-leading performance Most secure over the last 7 years Only commercial DB with AI built-in End-to-end mobile BI on any device Microsoft Tableau Oracle $120 $480 $2,230 R Self-service BI per user T-SQL Java C/C++ C#/VB.NET PHP Node.js Python Ruby #1 TPC-H performance 1TB, 10TB, 30TB #1 TPC-E performance #1 price/performance R and Python + in-memory at massive scale A fraction of the cost In-memory across all workloads Most consistent data platform Private cloud Public cloud

SQL SERVER 2017 Analyze complex relationships with support for graph data Advanced Machine Learning with R & Python, now with native T-SQL scoring Continuous performance with Automatic Plan Correction & Adaptive Query Processing Enhanced support for Columnstore indexes and In-memory OLTP

Introduction to Data Warehouse Fast Track for SQL Server
11/19/ :12 PM Introduction to Data Warehouse Fast Track for SQL Server © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What is Data Warehouse Fast Track for SQL Server?
11/19/ :12 PM What is Data Warehouse Fast Track for SQL Server? A reference architecture based program which certifies partner solutions for SQL Server data warehousing workloads. Tuned for SQL Server Data Warehouse workloads Compute & Storage tightly integrated Not an appliance – CPU, Memory & Storage are fully and independently scalable High performance and balanced configurations Rigorously tested (100% system stress) Certified workloads from 6TB to 145TB © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Data Warehouse Fast Track for SQL Server Optimized SMP architectures get you up and running—fast
Fast Track reference architecture Software Database configuration Workload-specific Database architecture SQL Server settings Windows Server settings Performance guidance Saves time and resources with pre- tuned DW query workloads Reduces risk and complexity Offers scalable server architecture to scale as data volumes grow Attractive price\perf $0.89 (price per query) Azure IaaS VM (GS5) offering available Windows Server R2 SQL Server 2016 Hardware Hardware system design Tight specifications for servers, storage, and networking Resource balanced and validated Latest-generation servers & storage, including solid-state disks (SSDs) Processors Networking Servers Storage

11/19/2018 Best-in-class TPC-H (10 TB, non-clustered) performance Better use of memory and CPU with in-memory columnstore SQL Server 2016 running on Lenovo 38501 Xeon E7-8890v4 2.2 GHz (96 cores) 6 TB RAM $0.89 USD 10,000GB SQL Server improves performance / core, handles more cores and more RAM 606,821 QphH SQL 2014 Win2012R2 3TB RAM 4S/72C HPE DL580 G9 1,106,832 QphH +82% SQL2016 Win2016 6TB RAM 4S/96C Lenovo x3850 with in-memory columnstore TPC-H 10 TB result on 4-socket processor SQL, OS Upgrade Haswell-EX (18C) to Broadwell-EX (24C) SQL Server 2014 to SQL Server 2016 Windows 2012R2 to Windows 2016 SQL Server 2014 running on HPE DL 5802 Xeon E7-8890v GHz (60 cores) 3 TB RAM $1.82 USD 10,000GB 1http:// http:// As of July 11, 2016 © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Pre-Tested, Performance-Tuned
2017 Lenovo. All rights reserved. Pre-Tested, Performance-Tuned Fully integrated and tested solutions with the flexibility to choose what you need Reduce costs and minimize risk with pre-tested choices Faster time to value: performance-optimized configurations minimize onsite tuning Build, tune and deploy with confidence Eliminate bottlenecks with optimized rapid data reads and query aggregations

DWFT Reference Configuration
11/19/ :12 PM DWFT Reference Configuration The DWFT certified capacities are based on a reference configuration Processor: Intel Xeon E (2/16/16) Memory: 256GB Storage: 8 x 1.1 TB SSDs for data and tempdb 4 x 400GB SSDs for log The reference system produced a Rated User Data Capacity of 25 TB with relative throughputs for Row Store and Column Store of 100 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Data Warehouse Fast Track Features
11/19/ :12 PM Data Warehouse Fast Track Features Page Compression Introduced in SQL Server 2008 for traditional row based data warehouse tables Typically achieves 2x to 5x data compression Recommended for smaller tables (less than a few million rows) that require equality or short range scans Column Store Indexes Stores data in a columnar format enabling 10x+ data compression and significantly speeds up query performance Recommended for larger tables Operator Pushdown Move both the filter and aggregation query operations closer to the data so they can be done in scan operations Dramatically reduces the volume of data which needs to be passed up in query processing Batch Mode Processing Processes many rows at a time rather than serially doing calculations on a single row Leverages Single Instruction Multiple Data (SIMD) vector processing found in Intel architectures © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Introducing our DWFT partners….

Overview of offerings Matt Goswell (Microsoft) 11/19/2018 12:12 PM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Microsoft Database Solutions on Lenovo Servers

First to be certified for SQL Server 2017
New 9TB offering ThinkSystem SR630 Intel™ Xeon™ Platinum 8176 128GB RAM Windows Server 2016 SQL Server 2017 Enterprise Edition New 44TB offering ThinkSystem SR650 768GB RAM

Lenovo Database Configuration for Microsoft SQL Server DWFT – 9TB
Lenovo Database Configuration for Microsoft SQL Server 2016 – 9TB Microsoft certified SQL 2016 DWFT configuration Based on ThinkSystem SR630 1U rack server Two socket Intel processors and GB memory Micron M500DC SATA Solid State Drives Relative Performance: Row Store Throughput: 3,069 MBps Colum Store Throughput: 826 Q/Hr/TB Max. User Data Capacity: 9TB Benefits of this solution: Reduces time to value with pretested hardware configurations Provides a configuration that is Microsoft Certified with performance data Reduces TCO through better performance, rapid deployment and advanced hardware Optimizes performance with pretested ThinkSystem SR630 hardware configurations Consolidates storage and match IT investment-to-information-value with Lenovo NVMe Enterprise Mainstream Flash Adapters ThinkSystem 630 Server and Micron M500DC SATA Solid State Drives 2017 Lenovo. All rights reserved.

Lenovo Database Configuration for Microsoft SQL Server 2016 – 44TB Microsoft certified SQL 2016 DWFT configuration Based on ThinkSystem SR650 2U rack server Two socket Intel processors and GB memory Lenovo NVMe Enterprise Mainstream AIC Flash Adapters 3.84 TB (Qty 4) Relative Performance: Row Store Throughput: 4,546 MBps Colum Store Throughput: 1,572 Q/Hr/TB Max. User Data Capacity: 44TB Benefits of this solution: Reduces time to value with pretested hardware configurations Provides a configuration that is Microsoft Certified with performance data Reduces TCO through better performance, rapid deployment and advanced hardware Optimizes performance with pretested ThinkSystem SR650 hardware configurations Consolidates storage and match IT investment-to-information-value with Lenovo NVMe Enterprise Mainstream Flash Adapters ThinkSystem 650 Server and Lenovo NVMe Enterprise Flash Adapters 2017 Lenovo. All rights reserved.

Benefits of this solution: Reduces time to value with pretested hardware configurations Provides a configuration that is Microsoft Certified with performance data Reduces TCO through better performance, rapid deployment and advanced hardware Optimizes performance with pretested ThinkSystem SR650 hardware configurations Consolidates storage and match IT investment-to-information-value with Lenovo NVMe Enterprise Mainstream Flash Adapters Lenovo Database Configuration for Microsoft SQL Server 2016 – 90TB Based on ThinkSystem SR950 4U rack server Four socket Intel processors and 1,536 GB memory Lenovo NVMe Enterprise Mainstream AIC Flash Adapters 3.84 TB (Qty 8) Relative Performance: Row Store Throughput: 10,981 MBps Colum Store Throughput: 3,015 Q/Hr/TB Max. User Data Capacity: 88TB ThinkSystem 950 Server and Lenovo NVMe Enterprise Flash Adapters 2017 Lenovo. All rights reserved.

Lenovo Database Configurations for Microsoft SQL Server OLTP
Description: Microsoft SQL database solutions on Microsoft Windows Server for accelerating transactional workloads. Lenovo ThinkSystem SR650 and SR630 servers deliver higher IOPS and high TPM essential for MS SQL server OLTP workloads. Deployed in a high availability configuration Solution Elements Servers: Lenovo ThinkSystem SR630 and SR650 compute nodes Storage: Server based storage Networking: Existing networking Management: XClarity Software ThinkSystem SR650 Workload: Microsoft SQL OLTP Server Enterprise Edition ThinkSystem SR630 Workload: Microsoft SQL OLTP Server Standard Edition Benefits of this solution: Reduce time to value with pretested hardware configurations Reduce TCO through better performance, rapid deployment and advanced hardware Optimize cost and performance with pretested ThinkSystem SR650 and ThinkSystem SR630 configurations. Solutions deployed in two server high availability configurations. Available on ThinkSystem SR650 servers w Microsoft SQL Server Enterprise Edition. Available on ThinkSystem SR630 servers w Microsoft SQL Server Standard Edition. ThinkSystem 650 Server and ThinkSystem 630 Server 2017 Lenovo. All rights reserved.

#1 #1 #1 #1 #2 58 #24 A Strong Foundation Customer Satisfaction
In the latest TBR survey (1H 2017), Lenovo was #1 for the 7th consecutive study going back to January 2015, and in 23 of 29 studies since 2H Also, lead in 22 of 22 satisfaction attributes in latest survey. #1 Customer Satisfaction #1 in ITIC Reliability Survey for 4 ½ years running. #1 x86 Server Reliability #1 Microsoft SQL 2017 Performance SR650 TPC-E Performance and Price/Performance1 and SR950 TPC-H2 SAP runs their SAP on Lenovo. Lenovo has the lowest TCO with X6 systems providing up to 31% lower cost over three years for SAP HANA. SAP HANA TCO #1 Lenovo is the fastest growing TOP500 HPC vendor worldwide and ranks 2nd in the number of fastest systems. TOP500 HPC Vendor #2 58 Current World Record x86 Benchmarks Lenovo enables faster performance and data analysis for mission critical applications. Of 300 companies over $12B rev across industries recognizing supply chain leadership and best practices. Gartner Supply Chain #24 2017 Lenovo. All rights reserved.

#1 new world record benchmarks
42 #1 new world record benchmarks Best Price/Performance TPC-E Best 15 of 17 Mean Response-Time STAC-M3 (Antuco) Best Performance Big Data/Complexity TPC-H Best Energy Efficiency for all Virtualized Workloads SPECvirt_sc2013 Best Performance JAVA (1,2,4,8-socket) SPECjbb-2015 Best MPI-Parallel, Compute Intensive Performance SPECmpiM 2007 Best 11 of 15 ‘Big Memory’ Ops STAC-M3 (Shasta)

Data Warehouse Fast Track Evaluation Process
11/19/ :12 PM Data Warehouse Fast Track Evaluation Process © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Fast Track evaluation high-level process
11/19/2018 Fast Track evaluation high-level process Select from 30+ certified reference architectures Test sample workload on selected configuration Validate scenario Fine tune performance Final decision © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Data Warehouse Fast Track Process
11/19/ :12 PM Data Warehouse Fast Track Process The test sponsor enters the system configuration information into the DWFT Reference spreadsheet The spreadsheet is uploaded to Microsoft for review The sponsor executes test runs for the Row Store and Column Store configurations with 12, 24, and 48 sessions each doing a CPU stress test and an I/O stress test (At least 8 hours of runtime) Extract the data collected by the DWFT tool (perfmon and query stats) and update the DWFT Reference spreadsheet Upload the spreadsheet to Microsoft for review and final certification Sponsor publishes a White Paper/Technical Brief of the solution © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Data Warehouse Fast Track Workload
11/19/ :12 PM Data Warehouse Fast Track Workload Test database derived from the TPC-H schema and data The workload executes for a fixed duration of 1 hour for each test We measure I/O stress and CPU stress across 12, 24, and 48 sessions/streams Memory is limited during the workload run to force I/O 1 or 2 Sockets  118GB Max SQL Server Memory 4 Sockets  236GB Max SQL Server Memory 8+ Sockets  472GB Max SQL Server Memory For published results, we specify a minimum amount of memory the system must be configurable with 1 Socket  10GB per TB of rated capacity 2 Sockets  12GB per TB of rated capacity 4 Sockets  15GB per TB of rated capacity 8 Sockets  18GB per TB of rated capacity For example: a 2 socket system with a 60TB certification must be configured at a minimum of 720GB © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

TPC-H Schema PART PARTSUPP ORDERLINE ORDERS CUSTOMER SUPPLIER NATION
11/19/ :12 PM TPC-H Schema PARTKEY NAME MFGR BRAND TYPE SIZE CONTAINER RETAILPRICE COMMENT PART PARTKEY SUPPKEY AVAILQTY SUPPLYCOST COMMENT PARTSUPP ORDERKEY PARTKEY SUPPKEY LINENUMBER QUANTITY EXTENDEDPRICE DISCOUNT TAX RETURNFLAG LINESTATUS SHIPDATE COMMITDATE RECEIPTDATE SHIPINSTRUCT SHIPMODE COMMENT ORDERLINE ORDERKEY CUSTKEY ORDERSTATUS TOTALPRICE ORDERDATE ORDERPRIORITY CLERK SHIPPRIORITY COMMENT ORDERS CUSTKEY NAME ADDRESS NATIONKEY PHONE ACCTBAL MKTSEGMENT COMMENT CUSTOMER SUPPKEY NAME ADDRESS NATIONKEY PHONE ACCTBAL COMMENT SUPPLIER NATIONKEY NAME REGIONKEY COMMENT NATION REGIONKEY NAME COMMENT REGION © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

TPC-H Table Cardinalities
11/19/ :12 PM TPC-H Table Cardinalities Table Name Row Counts 1TB Database 2TB Database 4TB Database CUSTOMER 150,000,000 300,000,000 600,000,000 LINEITEM 5,999,989,709 11,999,979,418 23,999,958,836 NATION 25 ORDERS 1,500,000,000 3,000,000,000 6,000,000,000 PART 200,000,000 400,000,000 800,000,000 PARTSUPP 1,600,000,000 3,200,000,000 REGION 5 SUPPLIER 10,000,000 20,000,000 40,000,000 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Data Warehouse Fast Track Workload
11/19/ :12 PM Data Warehouse Fast Track Workload The query distribution is Complex Average Simple The test database size is based on the number of physical sockets on the test system. 1 or 2 Sockets 1TB 4 Sockets 2TB 8+Sockets 4TB Workload intensity Average CPU usage must be 60% or higher for all runs Ratio of the column store throughput and row store throughput must be 1.6 or lower Sponsor must also provide: SQL Server error log(s) for all runs Output of sp_configure Setting for the SQL Server Resource Governor © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

(Your mileage may vary!)
11/19/ :12 PM Column Store Indexes Space Used in GB (101 Million Row Table) Provides significant compression and query performance 20.0 15.0 10.0 5.0 Up to 90% Data is physically stored as a series of row groups A row group typically will have 100,000 to 1,000,000 rows in it Updateable CCI supports update/delete operations as well as bulk insert 0.0 Table with Customary Indexes Table with Customary Indexes (Page Comp.) Table with No Indexes Table with No Indexes (Page Comp.) Table with Non-Clustered Column Store Index Table with Clustered Column Store Index (Your mileage may vary!) © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

DWFT Simple Query SELECT SUM(l_extendedprice * l_discount) AS revenue
11/19/ :12 PM DWFT Simple Query SELECT SUM(l_extendedprice * l_discount) AS revenue FROM lineitem WHERE l_discount BETWEEN (0.04 – 0.01) AND ( ) AND l_quantity = 25 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

DWFT Average Query SELECT l_returnflag, l_linestatus,
11/19/ :12 PM DWFT Average Query SELECT l_returnflag, l_linestatus, SUM(l_quantity) AS sum_qty, SUM(l_extendedprice) AS sum_base_price, SUM(l_extendedprice * (1 – l_discount)) AS sum_disc_price, SUM(l_extendedprice * (1 – l_discount) * (1 + l_tax)) AS sum_charge, AVG(l_quantity) AS avg_qty, AVG(l_extendedprice) AS avg_price, AVG(l_discount) AS avg_disc, COUNT_BIG(*) AS count_order FROM lineitem WHERE l_shipdate <= DATEADD(dd, -90, ‘ ’) GROUP BY l_returnflag, l_linestatus ORDER BY l_returnflag, © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

DWFT Complex Query SELECT 100.00 * SUM (CASE WHEN p_type LIKE ‘PROMO%’
11/19/ :12 PM DWFT Complex Query SELECT * SUM (CASE WHEN p_type LIKE ‘PROMO%’ THEN l_extendedprice * (1 – l_discount) ELSE 0 END) / SUM (l_extendedprice * (1 – l_discount)) AS promo_revenue FROM lineitem WHERE l_partkey = p_partkey AND l_shipdate >= ‘ ’ AND l_shipdate < DATEADD(mm, 1, ‘ ’) © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Data Warehouse Fast Track Throughput Metrics
11/19/ :12 PM Data Warehouse Fast Track Throughput Metrics © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

DWFT Published Metrics
11/19/ :12 PM DWFT Published Metrics Primary Metrics Row Store Relative Throughput Calculated as a percent ratio of the Row Store throughput to the Row Store throughput of the DWFT Reference Configuration Column Store Relative Throughput Calculated as a percent ratio of the Column Store throughput to the Column Store throughput of the DWFT Reference Configuration © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

DWFT Published Metrics
11/19/ :12 PM DWFT Published Metrics Primary Metrics Rated User Data Capacity (TB) Calculated value based on the Row Store Relative Throughput, the Column Store Relative Throughput, available storage and the physical system memory. The calculations assume a compression ratio of 5:1 Maximum User Data Capacity (TB) Calculated value based on the total disk capacity of all disks allocated to primary data storage and assumes a compression ratio of 5:1 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Reference Websites Whitepapers BI & DW use cases
11/19/ :12 PM Reference Websites Whitepapers BI & DW use cases DWFT Introduction Guide DWFT Reference Guide © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Please evaluate this session Your feedback is important to us!
11/19/ :12 PM Please evaluate this session Your feedback is important to us! The slide will be replaced onsite through Silver Fox Productions with an updated QR code. This slide is required. Do NOT delete or alter the slide. From your PC or Tablet visit MyIgnite at From your phone download and use the Ignite Mobile App by scanning the QR code above or visiting © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server Data Warehouse reference architectures

Similar presentations

Presentation on theme: "SQL Server Data Warehouse reference architectures"— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

SQL Server Data Warehouse reference architectures

Similar presentations

Presentation on theme: "SQL Server Data Warehouse reference architectures"— Presentation transcript:

Similar presentations

About project

Feedback