Download presentation
Presentation is loading. Please wait.
1
Microsoft Ignite 2016 5/22/2018 7:21 PM BRK2007 SQL Server 2016 HTAP Performance with Windows 2016 and HPE Persistent Memory (Hybrid Transaction Processing and Analytics Processing) Lindsey Allen Microsoft SQL Server Tobias Klima Microsoft Windows Server © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
2
Agenda SQL 2016 HTAP Technology
5/22/2018 7:21 PM Agenda SQL 2016 HTAP Technology What is HTAP SQL 2016 is the best HTAP engine In-memory HTAP reference Accelerate HTAP on SQL Server with Persistent Memory Overview Windows 2016 Persistent Memory HPE Persistent Memory © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
3
What is HTAP? Hybrid Transaction and Analytics Processing
Microsoft Ignite 2016 5/22/2018 7:21 PM What is HTAP? Hybrid Transaction and Analytics Processing Runs OLTP and OLAP on the same database Real time analytics without data latency Minimum performance impact to OLTP workload OLAP has access to up-to-date data as we eliminate need to ETL data SQL Server 2016 is the best HTAP engine Integrated column-store and row-store, both In-Memory and on-disk © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
4
Traditional Analytics Architecture
Microsoft Ignite 2015 5/22/2018 7:21 PM Traditional Analytics Architecture Select ProduceName, ExpiryDate, SUM (inventory – item_sold) From <transactions> where [Date] >= DATEADD(day, -1, GETDATE()) Group by ProductName, ExpiryDate, DATEPART(HOUR, [Date]) Insert into <transactions> values (‘<upc-code>, ‘flowers’, $20.00) SQL Server Database Application Tier Presentation Layer IIS Server BI and analytics Dashboards Reporting SQL Server Analysis Server Key Issues Complex Implementation Requires two Servers (CapEx and OpEx) Data Latency in Analytics More businesses demand/require real-time Analytics SQL Server Relational DW Database ETL Hourly, Daily, Weekly © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
5
Microsoft Ignite 2015 5/22/2018 7:21 PM SQL Server 2016 HTAP Technology Real-Time Analytics without compromise OLTP Performance Select ProduceName, ExpiryDate, SUM (inventory – item_sold) From <transactions> where [Date] >= DATEADD(day, -1, GETDATE()) Group by ProductName, ExpiryDate, DATEPART(HOUR, [Date]) Insert into <transactions> values (‘<upc-code>, ‘flowers’, $20.00) SQL Server Database Application Tier Presentation Layer IIS Server Benefits No Data Latency No ETL No Separate DW Challenges Minimizing Impact on OLTP workload Delivering Performant Analytics BI and analytics Dashboards Reporting This is Real-Time ANALYTICS SQL Server Analysis Server Add columnstore index © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
6
SQL Server 2016 HTAP Demo Lindsey Allen Microsoft Ignite 2016
5/22/2018 7:21 PM SQL Server 2016 HTAP Demo Lindsey Allen © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
7
SQL In-Memory Technologies
5/22/2018 SQL In-Memory Technologies SQL Real-Time Analytics In 2016 and Azure DB Faster Transactions Faster Analytics + IN-MEMORY OLTP + IN-MEMORY DW Up to 30x faster transaction processing with In-Memory OLTP Over 100x analytics query speed and significant data compression with In-Memory ColumnStore Using the same tables © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
8
SQL Server 2016 HTAP Case Study
Microsoft Ignite 2016 5/22/2018 7:21 PM SQL Server 2016 HTAP Case Study Dell IT monitoring system collecting data from more than 2000 database servers Used to take more than 10 hours to processing data In-Memory HTAP reduced the data processing to less than an hour, enable Dell to collect and process more data points Data visualization from minutes to seconds “10X performance improvement in data processing pipeline, and can visualize richer insights in seconds” – Reinaldo Kibel, Dell © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
9
Accelerate SQL Server with Persistent Memory
5/22/2018 7:21 PM Accelerate SQL Server with Persistent Memory © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
10
More Transactions, Lower Latency
How do I increase my transaction throughput? How do I reduce my transaction latency? Options: More CPU! 2S system 4S system More Memory! 128GB 256GB 1TB+ Faster Storage! HDD SATA SSD NVMe SSD SQL Server 2016 “Tail Of Log” (preview) on Persistent Memory
11
SQL Server 2016 “Tail- of-Log” (preview) on Persistent Memory
Tobias Klima
12
Faster Transaction Processing via Persistent Memory Use
Microsoft Ignite 2016 5/22/2018 7:21 PM Faster Transaction Processing via Persistent Memory Use NVDIMM-N (Byte) 1 In the Past: Copy log records into buffer, building up block Close log block once commit arrives Schedule I/O to persist block on SSD Complete transaction when I/O completes Log Buffers 2 3 With ToL: Copy log records into buffer, building up block Complete transaction when commit arrives Close log block when full Schedule I/O to persist full block on SSD Red indicates the critical path for a transaction SSD (Block) 4 Log File © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
13
Native NVDIMM-N Support in WS 2016
Windows exposes a latency-optimized “disk” device (block interface) DirectAccess (DAX): enlightened apps (SQL 2016) can directly access their data on the Persistent Memory (PM) device via Load/Store instructions Use of DAX on NVDIMM-N provides DRAM-like performance 4K Random Write Thread Count IOPS Latency (us) NVDIMM-N (Block) 1 187,302 5.01 NVDIMM-N (DAX) 1,667,688 0.52 Data gathered on pre-release hardware and software, final results may differ. Workload: 4KB random writes against a 1GB file on NTFS, MSFT-internal testing tool
14
Demo Configuration & References
Hardware Server: HPE Proliant® DL380® Gen9 CPU: 2x Intel® Xeon® CPU E GHz Memory: 96GB PM: 2x HPE 8GB NVDIMM Storage: 2x NVMe SSDs (1.6TB) (Log, Tables) Software: Windows Server 2016 (RTM) SQL Server 2016 Internal Load Generation Tool for In-Memory OLTP Reference Material: WS 2016 NVDIMM Support (Block) ( WS 2016 NVDIMM Support (Byte) ( WS SQL 2016 ToL (preview) (
15
HTAP on Nextgen HPE Server
Microsoft Ignite 2016 5/22/2018 7:21 PM HTAP on Nextgen HPE Server © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
16
HPE Persistent Memory on ProLiant DL3x0 Gen9
Delivering the performance of memory with the persistence of traditional storage HPE Persistent Memory for SQL Server Up to 64 GB persistent memory per socket Removes the bottleneck of SQL Server log write times Increases throughput and resource utilization Hewlett Packard Enterprise is here to help Don’t take any chances Future-proof your SQL Server environment Design an optimal SQL Server environment with purpose-built, HPE scale-up servers with persistent memory Take advantage of HPE tested and validated configurations
17
HTAP on NextGen HPE Server Demo
Microsoft Ignite 2016 5/22/2018 7:21 PM HTAP on NextGen HPE Server Demo Lindsey Allen © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
18
Takeaways HTAP empowers application leaders to innovate and improved business agility. SQL Server 2016 is the best HTAP Engine Accelerate your SQL Server 2016 deployments using Windows Server 2016 and HPE Persistent Memory Servers.
19
Free IT Pro resources To advance your career in cloud technology
Microsoft Ignite 2016 5/22/2018 7:21 PM Free IT Pro resources To advance your career in cloud technology Plan your career path Microsoft IT Pro Career Center Cloud role mapping Expert advice on skills needed Self-paced curriculum by cloud role $300 Azure credits and extended trials Pluralsight 3 month subscription (10 courses) Phone support incident Weekly short videos and insights from Microsoft’s leaders and engineers Connect with community of peers and Microsoft experts Get started with Azure Microsoft IT Pro Cloud Essentials Demos and how-to videos Microsoft Mechanics Connect with peers and experts Microsoft Tech Community © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
20
Please evaluate this session
5/22/2018 7:21 PM Please evaluate this session Your feedback is important to us! From your PC or Tablet visit MyIgnite at From your phone download and use the Ignite Mobile App by scanning the QR code above or visiting © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.