Sunil Agarwal | Principal Program Manager

Slides:



Advertisements
Similar presentations
Tuning: overview Rewrite SQL (Leccotech)Leccotech Create Index Redefine Main memory structures (SGA in Oracle) Change the Block Size Materialized Views,
Advertisements

Adam Jorgensen Pragmatic Works Performance Optimization in SQL Server Analysis Services 2008.
Dos and don’ts of Columnstore indexes The basis of xVelocity in-memory technology What’s it all about The compression methods (RLE / Dictionary encoding)
IIS Server ETL IIS Server This is OPERATIONAL ANALYTICS.
©Silberschatz, Korth and Sudarshan12.1Database System Concepts Chapter 12: Part A Part A:  Index Definition in SQL  Ordered Indices  Index Sequential.
Architecting a Large-Scale Data Warehouse with SQL Server 2005 Mark Morton Senior Technical Consultant IT Training Solutions DAT313.
IT The Relational DBMS Section 06. Relational Database Theory Physical Database Design.
Oracle Data Block Oracle Concepts Manual. Oracle Rows Oracle Concepts Manual.
September 2011Copyright 2011 Teradata Corporation1 Teradata Columnar.
VLDB2012 Hoang Tam Vo #1, Sheng Wang #2, Divyakant Agrawal †3, Gang Chen §4, Beng Chin Ooi #5 #National University of Singapore, †University of California,
1099 Why Use InterBase? Bill Todd The Database Group, Inc.
SQL Server Indexes Indexes. Overview Indexes are used to help speed search results in a database. A careful use of indexes can greatly improve search.
Indexes and Views Unit 7.
SQL/Lesson 7/Slide 1 of 32 Implementing Indexes Objectives In this lesson, you will learn to: * Create a clustered index * Create a nonclustered index.
Partition Architecture Yeon JongHeum
Roy Ernest Database Administrator Pinnacle Sports Worldwide
Connect with life Nauzad Kapadia Quartz Systems
Chapter 5 Index and Clustering
Session 1 Module 1: Introduction to Data Integrity
Sofia Event Center November 2013 Margarita Naumova SQL Master Academy.
Last Updated : 27 th April 2004 Center of Excellence Data Warehousing Group Teradata Performance Optimization.
Chap 5. Disk IO Distribution Chap 6. Index Architecture Written by Yong-soon Kwon Summerized By Sungchan IDS Lab
5 Trends in the Data Warehousing Space Source: TDWI Report – Next Generation DW.
October 15-18, 2013 Charlotte, NC Accelerating Database Performance Using Compression Joseph D’Antoni, Solutions Architect Anexinet.
Boosting DWH-Performance with SQL Server 2016 ColumnStore Index.
--A Gem of SQL Server 2012, particularly for Data Warehousing-- Present By Steven Wang.
APRIL 13 th Introduction About me Duško Mirković 7 years of experience.
SQL Basics Review Reviewing what we’ve learned so far…….
Oracle Announced New In- Memory Database G1 Emre Eftelioglu, Fen Liu [09/27/13] 1 [1]
Doing fast! Optimizing Query performance with ColumnStore Indexes in SQL Server 2012 Margarita Naumova | SQL Master Academy.
SQL Server 2016: Real-time operational analytics
Best Practices for Columnstore Indexes Warner Chaves SQL MCM / MVP SQLTurbo.com Pythian.com.
IIS Server ETL Key Issues  Complex Implementation  Requires two Servers (CapEx and OpEx)  Data Latency in Analytics  More businesses demand/require.
Enable Operational Analytics (HTAP) in SQL Server 2016 and Azure SQL Database Sunil Agarwal Principal Program Manager, SQL Server Product Tiger Team
Clustered Columnstore index deep dive
In-Memory Capabilities
5/25/2018 5:29 AM BRK3081 Delivering High Performance Analytics with Columnstore Index on Traditional DW and HTAP Workloads Sunil Agarwal (Microsoft) Aaron.
Indexes By Adrienne Watt.
Indexing Goals: Store large files Support multiple search keys
Indexing and hashing.
Operational Analytics in SQL Server 2016 and Azure SQL Database
Antonio Abalos Castillo
AlwaysOn Readable Secondary
Inside of SQL Server Indexes
Real-Time Operational Analytics overview:
Tech Ed North America /23/2018 1:32 AM Required Slide
Hustle and Bustle of SQL Pages
Four Rules For Columnstore Query Performance
මොඩියුල විශ්ලේෂණය Buffer Pool Extension භාවිතය.
The Five Ws of Columnstore Indexes
PREMIER SPONSOR GOLD SPONSORS SILVER SPONSORS BRONZE SPONSORS SUPPORTERS.
Real world In-Memory OLTP
Azure SQL Data Warehouse Performance Tuning
SQL 2014 In-Memory OLTP What, Why, and How
TechEd /20/ :49 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
11/29/2018 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
Transactions, Locking and Query Optimisation
TechEd /2/2018 7:32 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Managing batch processing Transient Azure SQL Warehouse Resource
The Five Ws of Columnstore Indexes
Microsoft Ignite /1/ :19 PM
Sunil Agarwal | Principal Program Manager
Four Rules For Columnstore Query Performance
Clustered Columnstore Indexes (SQL Server 2014)
CSTORE E0261 Jayant Haritsa Computer Science and Automation
Partition Switching Joe Tempel.
Chapter 11: Indexing and Hashing
Using Columnstore indexes in Azure DevOps Services. Lessons learned
Using Columnstore indexes in Azure DevOps Services. Lessons learned
SQL Server 2016 High Performance Database Offer.
Presentation transcript:

Sunil Agarwal | Principal Program Manager 03 | Materialized Views and Concurrency Sunil Agarwal | Principal Program Manager

Clustered Columnstore Index: Materialized View Enforcing Uniqueness Create a materialized view create view dbo.myview_t_account with schemabinding as select accountkey,accounttype, accountcodealternatekey from dbo.T_ACCOUNT -- create a materialized view create unique clustered index clix_my_t_account on myview_t_account (accountkey) Avoiding Scan of Clustered Columnstore Index Create nonclustered index on MV with included column(s) Pros – good for equality and short-range scans Cons – Storage overhead and expensive DML operations Columnstore technology was first introduced in SQL Server 2012 and has been significantly enhanced for SQL Server 2014. Columnstore indexes can not only accelerate data warehouse workloads by an order of magnitude but also reduce storage requirements by an order of magnitude. Columnstore indexes are a hybrid technology leveraging the best of disk & in-memory capabilities. In this session we cover how to take advantage of columnstore capabilities in your applications and dive into the internals of how columnstore works.

Clustered Columnstore Index: Concurrency Querying Higher Granularity Locks for efficiency: ROWGROUP granularity Will cause blocking with concurrent DMLs. No support of RCSI or SI Recommendation: use Read Uncommitted Isolation level with concurrent DML Insert Optimized for DW load: Concurrent Inserts are allowed into same ROWGROUP DELETE Takes X lock on the ROWGROUP Does not block INSERT as they go into a new ROWGROUP UPDATE Done as DELETE followed by INSERT

Columnstore Index: Catalog Views sys.column_store_row_groups Visibility into all columnstore row groups (in columnar + delta store) Use this DMV to determine number of delta stores Every partition has at least one delta store Each partition can have multiple delta stores Use this DMV to determine quality of clustered columnstore index: If rowgroup contains <1M rows, investigate why sys.column_store_segments Find ranges of column value for segment elimination Dictionary usage Segment size sys.column_store_dictionaries number of entries in primary and secondary Size

Materialized Views and Concurrency [Sunil Agarwal]