SQL Server 2016, New Database Features

SQL Server 2016, New Database Features
With a focus for Dynamics NAV partners and users Kennie Nybo Pontoppidan, Microsoft

About me Senior Program Manager at Microsoft
Have worked with data since 1998 17+ years in the IT industry Have no humor @KennieNP linkedin.com/in/kennie

Agenda Learn about SQL Server 2016 new features
See SQL Server as a way to extend NAV SQL Server “partner features” SQL Server “customer features”

Pop quiz (before we start)
9/24/2017 7:30 AM Pop quiz (before we start) © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Who are you? Using the database for NAV out of the box
9/24/2017 7:30 AM Who are you? Image source: Using the database for NAV out of the box Using database features (eg. Auditing, AlwaysOn, …) Installing SQL Server Tuning the application Tuning the database server Database administrators © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What do you run (in production)
9/24/2017 7:30 AM What do you run (in production) SQL Server 2000 SQL Server 2005 SQL Server 2008 SQL Server 2008R2 SQL Server 2012 SQL Azure SQL Server 2014 SQL Server 2016 SQL Server on Linux How many of you are running SQL Server 2000, 2005, 2008, 2008R2, 2012, 2014, in production? 2000/2005/2008 – outside support in some way or the other 2012/2014 – upgrade to It just runs faster © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

NAV architecture 101 NAV server Client SQL Black magic C/AL

What if… Backend (Black box) Client Client SQL Server
NAV Server (black box)

Before we dive in… 9/24/2017 7:30 AM
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

A few small improvements…
Deadlock detection and logging Who’s blocking who SQLIndex bugfix

Deadlock detection and logging
Setup SQL Server privileges NAV Server (Administration tool or Powershell cmdlet) Monitor Eventlog (filter on trace tag 00000DI) Examine Save deadlock graph as deadlock XML (.xdl) file Open in SQL Server Management Studio (SSMS)

Who’s blocking who? New virtual table 'Database locks‘
information about current locks and their owners data for transactions against tables in current company Additional data regarding username and AL scope is shown if virtual table is build on the same NAV server where user have aquired the lock. Added page 9511

SQLIndex bugfix sqlindex

Cliff jumping world record
Height- 58.8m or ft Top Speed- 123km/h or 76 mph Pool Depth- 8m or 26 ft Hang Time seconds

SQL Server 2012 new features
Standard Edition SSIS project model Audit Enterprise Edition SSAS tabular model Non-clustered column store indexes (non-updatable) Data Quality Services (DQS) Always On Availability Groups Change in license model: CPU->cores

SQL Server 2016 SP1 – Standard edition
Faster transaction performance from In-memory OLTP, faster query performance from In-memory ColumnStore, and the ability to combine the two for real-time Hybrid Transactional and Analytical Processing, also known as Operational Analytics; Data warehousing or data mart performance features such as partitioning, compression, change data capture, database snapshot, and the ability to query across structured and unstructured data with a single node of PolyBase; and The innovative security feature Always Encrypted for encryption at rest and in motion, as well as fine-grained auditing which captures more detailed audit information for your compliance reporting needs. In addition, row-level security and dynamic data masking are being made available to Express edition for the first time. service-pack-1-generally-available/

Audit Who accessed your sensitive tables in the last week?
track and log events that occur on the Database Engine Who accessed your sensitive tables in the last week? What has your administrator changed in the past month? Server level auditing – all editions Database level auditing - only Enterprise edition

Data Quality Services (DQS)
enables a data steward or IT professional to maintain the quality of their data and ensure that the data is suited for its business usage

Always On Availability Groups
high-availability (HA) and disaster- recovery (DR) solution

Carowinds Fury 325 roller coaster
Height- 99m Top Speed- 153km/h Max vertical angle – 81 degr

SQL Server 2014 new features
Standard Edition SQL engine memory limit increase 64GB->128GB Buffer pool extension Backup encryption Enterprise Edition In-memory OLTP Clustered column store indexes Non-clustered column store indexes (updatable)

SQL engine memory limit increase
We use memory for OS Data (pages) Connections … More memory for data => less traffic to storage (I/O) Memory limit is per instance SQL engine (128GB) SSAS (64 GB) SSRS (64 GB) Max memory for SQL engine increased 64GB->128GB

Buffer pool extension seamless integration of solid- state drive (SSD) extension to the Database Engine buffer pool to significantly improve I/O throughput

Consider using Buffer pool extension when
9/24/2017 7:30 AM Consider using Buffer pool extension when your total actively queried data set is bigger than you can fit in memory you have already maxed out the memory on the server business requirements force you to use shared storage or magnetic local storage your server have room for locally attached PCI Express or SAS/SATA solid state drives 512GB fast SSD PCI Express costs < 500 USD about-the-next-version-of-sql-server/ © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Backup encryption Just do it…

SQL Server 2014 new hybrid cloud features
Standard Edition Backup to Azure Data+log files on Azure blob storage Enterprise Edition AlwaysOn replica in Azure

System Center Marketing
9/24/2017 SQL Server 2016 editions – what’s new SQL Server 2016 is the biggest leap forward in the Microsoft data platform history with real-time operational analytics, rich visualizations on mobile devices, built-in advanced analytics, new advanced security technology, and new hybrid cloud scenarios. Enterprise SQL Server Enterprise delivers comprehensive datacenter capabilities for mission-critical database, business intelligence, and advanced analytics workloads. Standard SQL Server Standard provides core data management and business intelligence capabilities for non-critical workloads with minimal IT resources. Express SQL Server Express is a free edition of SQL Server ideal for development and production for desktop, web and small server applications. Developer SQL Server Developer is now a free edition providing the full feature set of SQL Server Enterprise. For development and test only, and not for production environments or use with production data. Mission critical performance Security Data warehousing Business intelligence Advanced analytics Hybrid cloud Operating system max cores and memory Enhanced in-memory OLTP performance Operational analytics Enhanced AlwaysOn with no domain join (WS 2016) Query Store Temporal Always Encrypted Row-level security Dynamic data masking Enhanced separation of duties Enhanced SQL Server auditing Transparent data encryption Policy-based management Enhanced in-memory ColumnStore PolyBase in scale-out configuration (head and compute nodes) License rights to (the APS) MPP appliance” Distributed query processing Support for JSON End-to-end mobile BI on all major platforms Enhanced DirectQuery In-memory analytics Advanced data mining Advanced tabular Web portal experience (all reports in one place) Modernized reports Pin reports to Power BI Enhanced multi-dimensional models In database advanced analytics R integration with massive parallel processing for performance and scale Works with in-memory technology Run in database or standalone Connectivity to R Open Stretch Database Enhanced backup to Azure Enhanced HA and DR with Azure – ease of use, no domain join (Windows Server 2016) SSIS integration with Azure Data Factory and Azure SQL Data Warehouse Disk-based OLTP 24 cores max and 128 GB max memory 2-node single database failover (non-readable secondary) Basic auditing Separation of duties PolyBase (compute node only) Basic tabular (16GB memory per instance) Web portal experience Single-threaded for RRE Backup to Azure 1 GB memory, max 10 GB memory Basic OLTP Basic reporting and analytics Enterprise Standard Express This content was developed prior to the product or service’s release and as such, we cannot guarantee that all details included herein will be exactly as what is found in the shipping product. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. The information represents the product or service at the time this document was shared and should be used for planning purposes only. Information subject to change at any time without prior notice. © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server 2016 features by edition
Developer1 Express Standard Enterprise Mission critical performance Maximum number of cores New Unlimited 4 cores 24 cores Maximum memory utilized per instance OS Max 1 GB 128 GB Maximum size 524 PB 10 GB Production use rights  Basic OLTP Manageability (Management Studio, Policy-Based Management) Basic high availability (2-node single database failover, non-readable secondary) Enterprise data management (Master Data Services, Data Quality Services) Advanced OLTP (In-memory OLTP, Operational analytics) Advanced HA (Always On - multi-node, multi-db failover, readable secondaries) Security Basic security (Row-level security, data masking, basic auditing, separation of duties) Advanced security (Transparent Data Encryption, Always Encrypted) Data warehousing Advanced data integration (Fuzzy grouping and look ups, change data capture) Data warehousing (In-Memory ColumnStore, Partitioning) PolyBase2 Business intelligence Programmability & developer tools (T-SQL, CLR, Data Types, FileTable, JSON) Basic reporting & analytics Basic data integration (SSIS, built-in connectors) Basic Corporate Business Intelligence (Multi-dimensional models, Basic tabular model) Mobile BI (Datazen) Advanced Corporate Business Intelligence (Advanced tabular model, DirectQuery, in-memory analytics, advanced data mining) Advanced analytics Basic “R” integration (Connectivity to R Open, Limited parallelism for RRE) Advanced “R” integration (Full parallelism for RRE) Hybrid cloud Stretch Database 1 SQL Server 2016 Developer Edition offers the full feature set of SQL Server 2016 Enterprise Edition, but Developer Edition is for development and test only, and not for production environments or use with production data. 2 Scale out relational and non-relational data queries with the simplicity of T-SQL using PolyBase, which requires single Microsoft SQL Server 2016 Enterprise Edition as head node. © 2016 Microsoft Corporation. All rights reserved. This document is provided "as-is." Information and views expressed in this document, including URL and other Internet Web site references, may change without notice. You bear the risk of using it. This document does not provide you with any legal rights to any intellectual property in any Microsoft product. You may copy and use this document for your internal, reference purposes. You may modify this document for your internal, reference purposes.

SQL Server 2016 new features – std. edition
Mission critical performance Security Data warehousing Business intelligence Advanced analytics Hybrid cloud 24 cores max 2-node single database failover Query Store Temporal Row-level security Dynamic data masking Support for JSON Basic tabular Web portal experience Modernized reports Pin reports to Power BI Single- threaded for RRE Connectivity to R Open Stretch Database

SQL engine core limit increase
We use CPU cores for OS Execution Connections … Core limit is per instance SQL engine (24) SSAS (24) SSRS (24) Max cores increased 16->24

2-node single database failover
9/24/2017 7:30 AM 2-node single database failover Primary database Secondary replica Same location or in Azure Commit modes synchronous-commit, or asynchronous-commit Licensing info B7A3/SQL_Server_2016_Licensing_Guide_EN_US.pdf “… For each server licensed with SQL Server 2016 and covered by active SA, customers can run up to the same number of passive failover instances in a separate, OSE to support failover events” Key take away: no extra license cost for HA Possible DR solution for std. edition © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/24/2017 7:30 AM Query store Query Store automatically captures a history of queries, plans, and runtime statistics, and retains these for your review © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/24/2017 7:30 AM Temporal System-versioned state tables SQL2011 standard Audit: who changed it Temporal: what changed © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Row Level Security (RLS)
9/24/2017 7:30 AM Row Level Security (RLS) control access to rows in a table based on the user Filter predicates filter rows available to read operations Block predicates block write operations © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/24/2017 7:30 AM Dynamic Data Masking limit sensitive data exposure by masking it to non-privileged users Not a encryption feature Mask/unmask privilege on database level © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/24/2017 7:30 AM SQL Server 2016 new features – std. edition Mission critical performance Security Data warehousing Business intelligence Advanced analytics Hybrid cloud 24 cores max 2-node single database failover Query Store Temporal Row-level security Dynamic data masking Support for JSON Basic tabular Web portal experience Modernized reports Pin reports to Power BI Single- threaded for RRE Connectivity to R Open Stretch Database © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

JSON Parse JSON text and read or modify values
9/24/2017 7:30 AM JSON Parse JSON text and read or modify values Transform arrays of JSON objects into table format Format the results of T-SQL queries in JSON format © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Basic tabular Analysis Services databases 16GB limit In-memory
9/24/2017 7:30 AM Basic tabular Analysis Services databases 16GB limit In-memory © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Web portal experience Reporting Services web portal View KPIs
9/24/2017 7:30 AM Web portal experience Reporting Services web portal View KPIs mobile reports paginated reports browsers-and-mobile-devices © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Modernized reports SSRS reports now render on modern browsers (HTML5)
9/24/2017 7:30 AM Modernized reports SSRS reports now render on modern browsers (HTML5) © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/24/2017 7:30 AM Pin reports to Power BI Pin an on-prem SSRS report to a Power BI dashboard power-bi-dashboards-with-sql-server-2016-ctp-3-0/ © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/24/2017 7:30 AM R is… a language and environment for statistical computing and graphics provides a wide variety of statistical and graphical techniques free to use open source © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

R statistic examples Comprehensive R Archive Network (CRAN)
Currently 9224 available packages Example techniques linear and nonlinear modelling classical statistical tests time-series analysis classification clustering

Source: http://www. ats. ucla
R graphical examples Source: Source:

R in SQL Server 2016 Run R code in the database
9/24/2017 7:30 AM R in SQL Server 2016 Run R code in the database Embed R code in T-SQL stored procedures Return Results plots © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Stretch database Migrate (part of) table to Azure
9/24/2017 7:30 AM Stretch database Migrate (part of) table to Azure Cost-effective availability for cold data No changes to queries or applications Streamlines on-premises data maintenance Data secure during migration © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server 2016 new features – enterpr. edition
Mission critical performance Security Data warehousing Business intelligence Advanced analytics Hybrid cloud Operational analytics Always Encrypted PolyBase Mobile BI Enhanced DirectQuery In-memory analytics Parallel R R server

Non-clustered column store indexes
ability to run both analytics and OLTP workloads on the same database tables at the same time

Always Encrypted Security controlled by client Data is encrypted
over the network in memory on the database in database data files

PolyBase Execute T-SQL queries against relational data in SQL Server
Hadoop Azure Blob Storage Query Results Execute T-SQL queries against relational data in SQL Server semi-structured data in Hadoop or Azure Blob Storage Leverage existing T-SQL skills and BI tools to gain insights from different data stores Access any data

Mobile BI Reporting Services mobile reports, optimized for mobile devices Design for phones/tablets View on any device iOS, Microsoft, Android Access any data

SSAS direct query No data stored in SSAS database
Access any data

R in SQL Server 2016 enterprise edition
9/24/2017 7:30 AM R in SQL Server 2016 enterprise edition Dedicated R server Run R code in parallel © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server 2016 themes It just works Traceflags 1117, 1118
Database Instant File Initialization It just runs faster Number of tempdb datafiles Multiple log writers server-2016-changes-in-default-behavior-for-autogrow- and-allocations-for-tempdb-and-user-databases/ it-just-runs-faster-automatic-tempdb-configuration/ it-just-runs-faster-multiple-log-writer-workers/

Want to learn more? Watch more than 30 videos on SQL Server 2016 features Visit (free) SQL Saturday conferences world-wide 3-Dec-16 SQLSaturday #569 - Prague 2016 10-Dec-16 SQLSaturday #567 - Slovenia 2016 20-Jan-17 SQLSaturday #579 - Vienna 2017 25-Feb-17 SQLSaturday #589 - Pordenone 2017 11-Mar-17 SQLSaturday #583 - Lisbon 2017 18-Mar-17 SQLSaturday #602 - Iceland 2017 SQLSaturday #601 - Belgrade 2017 25-Mar-17 SQLSaturday #590 - Portsmouth, UK 2017 27-May-17 SQLSaturday #599 - Plovdiv 2017

Thank you! kepontop@microsoft.com @KennieNP linkedin.com/in/kennie
9/24/2017 7:30 AM Thank you! @KennieNP linkedin.com/in/kennie © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server 2016, New Database Features

Similar presentations

Presentation on theme: "SQL Server 2016, New Database Features"— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

SQL Server 2016, New Database Features

Similar presentations

Presentation on theme: "SQL Server 2016, New Database Features"— Presentation transcript:

Similar presentations

About project

Feedback