Why Should I Care About … Partitioned Views?

Slides:



Advertisements
Similar presentations
Big Data Working with Terabytes in SQL Server Andrew Novick
Advertisements

Tables Lesson 6. Skills Matrix Tables Tables store data. Tables are relational –They store data organized as row and columns. –Data can be retrieved.
Module 6 Implementing Table Structures in SQL Server ®2008 R2.
Architecting a Large-Scale Data Warehouse with SQL Server 2005 Mark Morton Senior Technical Consultant IT Training Solutions DAT313.
Dual Partitioning for improved performance in VLDBs Ashwin Rao Karavadi, Rakesh Parida Microsoft IT.
DBSQL 14-1 Copyright © Genetic Computer School 2009 Chapter 14 Microsoft SQL Server.
SQL Server Indexes Indexes. Overview Indexes are used to help speed search results in a database. A careful use of indexes can greatly improve search.
Partitioning Design For Performance and Maintainability Martin Cairns
Incremental Index Maintenance A Solution “That Just Works” AL NOEL PRINCIPAL CONSULTANT, MICROSOFT
Lec 7 Practical Database Design and Tuning Copyright © 2004 Pearson Education, Inc.
Session 1 Module 1: Introduction to Data Integrity
Student Centered ODS ETL Processing. Insert Search for rows not previously in the database within a snapshot type for a specific subject and year Search.
SSMS SQL Server Management System. SQL Server Microsoft SQL Server is a Relational Database Management System (RDBMS) Relational Database Management System.
Retele de senzori Curs 2 - 1st edition UNIVERSITATEA „ TRANSILVANIA ” DIN BRAŞOV FACULTATEA DE INGINERIE ELECTRICĂ ŞI ŞTIINŢA CALCULATOARELOR.
October 15-18, 2013 Charlotte, NC Accelerating Database Performance Using Compression Joseph D’Antoni, Solutions Architect Anexinet.
 What is DB Testing ?  Testing at the Data Access Layer  Need for Testing DB Objects  Common Problems that affect the Application  Should Testers.
SQL Basics Review Reviewing what we’ve learned so far…….
Splits, Merges and Purges THE HOW TO OF TABLE PARTITIONING.
Views / Session 3/ 1 of 40 Session 3 Module 5: Implementing Views Module 6: Managing Views.
Data Integrity & Indexes / Session 1/ 1 of 37 Session 1 Module 1: Introduction to Data Integrity Module 2: Introduction to Indexes.
SQL IMPLEMENTATION & ADMINISTRATION Indexing & Views.
Memory-Optimized Tables Querying at the speed of light.
DBMS Programs MS SQL Server & MySQL
Introduction to Partitioning in SQL Server
Understanding Data Storage
Temporal Databases Microsoft SQL Server 2016
10 Amazing Things About Power BI You Don’t Know
Prepared by : Moshira M. Ali CS490 Coordinator Arab Open University
Temporal Databases Microsoft SQL Server 2016
Introduction to SQL 2016 Temporal Tables
Instructor: Jason Carter
Power Query Tips & Tricks
UFC #1433 In-Memory tables 2014 vs 2016
T-SQL: Simple Changes That Go a Long Way
Finding more space for your tight environment
SQL Server Integration Services
Why Should I Care About … Partitioned Views?
Why Should I Care About … Partitioned Views?
The Ins and Outs of Partitioned Tables
Beginner Table Partitioning
Module 5: Implementing Data Integrity by Using Constraints
Super Scaling The LMAX Queue Pattern.
SQL 101.
Simple Partitioning Building a simple partitioning solution with SQL Server Stephen Fulcher.
Populating a Data Warehouse
In-Memory OLTP (IMOLTP) What Can It Do For Me?
Introduction to partitioning
Teaching slides Chapter 8.
Why Should I Care About … Partitioned Views?
Why Should I Care About … Partitioned Views?
Mobile, Paginated, KPIs, and Power BI, Oh My!
Practical Database Design and Tuning
Populating a Data Warehouse
Populating a Data Warehouse
Let’s Get Started! Rick Lowe
Table Partitioning Intro and make that a sliding window too!
Package Management in R with Checkpoint
Microsoft SQL Server 2014 for Oracle DBAs Module 7
Why Should I Care About … Partitioned Views?
Indexing For Optimal Performance
Data Management Innovations 2017 High level overview of DB
Why Should I Care About … Partitioned Views?
Table Partitioning Intro and make that a sliding window too!
Why Should I Care About … Partitioned Views?
Table Partitioning Intro and make that a sliding window too!
Power Query Tips & Tricks
Data Definition Language
SQL Server Query Design and Optimization Recommendations
Using Columnstore indexes in Azure DevOps Services. Lessons learned
An Introduction to Partitioning
Presentation transcript:

Why Should I Care About … Partitioned Views? Rick Lowe Data FLowe Solutions

Please Support Our Sponsors SQL Saturday is made possible with the generous support of these sponsors. You can support them by opting-in and visiting them in the sponsor area.

Don’t Forget Silence your cell phones Online Evaluations www.sqlsaturday.com/572/sessions/sessionevaluation.aspx www.sqlsaturday.com/572/eventeval.aspx Submit for raffles by 3:30PM

Frederick (Rick) Lowe rick@data-flowe.com DataFLowe

I’m Not Here to Start the Retrolution Partitioned tables are awesome for almost all partitioning cases Main takeaway from this talk – you’re not doomed if you have Standard Also, there are a couple of cases where views make sense even in EE

Overview of Partitioned Tables (Opposed to Partitioned Views) Appears to be a normal table Table is broken into multiple partitions based on the value of a single column Migrating a partition in or out is a metadata-only operation (i.e. basically instantaneous) Select statements can eliminate partitions Enterprise edition, MSSQL 2008 and higher

Working With Partitioned Tables Create a partition function and scheme Build clustered and nonclustered indexes on the partition scheme Views, CRUD etc reference a partitioned table pretty much like any other table SQL Server does all the heavy lifting

Partitioned Table MyTable 2005? 2006? 2007? 2008? Update/Insert/Select MyTable 2005? 2006? 2007? 2008? Partition Scheme Associated With Table P1 … P2 … P3 … P4 …

Defining a Partitioned Table CREATE PARTITION FUNCTION MyFunction(DATE) AS RANGE RIGHT FOR VALUES (…); CREATE PARTITON SCHEME MyPartitionScheme AS PARTITION MyFunction TO( … ); CREATE TABLE Sales.SalesOrderHeader( OrderDate DATETIME2(3), SalesOrderID INT IDENTITY NOT NULL, … CONSTRAINT PK_SalesOrderHeader PRIMARY KEY CLUSTERED(OrderDate, SalesOrderID) ON MyPartitionScheme( OrderDate ) );

Working With Partitioned Views Build individual tables Typically, create check constraints on tables View unions together all underlying tables *Create procedure determines which table to insert the data into *Update/Delete also need to either determine which table to work on or operate on all * indicates operations on view can save work

Partitioned View Insert Select UpdateMyTable CreateMyTable vwMyTable 2005? 2006? 2007? 2008? Data Boundaries Coded Into View / Procs MyTbl_05 … MyTbl_06 … MyTbl_07 … MyTbl_08 …

Defining a Partitioned View CREATE VIEW Sales.vwSalesOrderHeader AS SELECT OrderDate, SalesOrderID, … FROM Sales.SalesOrderHeader_2005 UNION ALL SELECT OrderDate, SalesOrderID, … FROM Sales.SalesOrderHeader_2006 SELECT OrderDate, SalesOrderID, … FROM Sales.SalesOrderHeader_2007 SELECT OrderDate, SalesOrderID, … FROM Sales.SalesOrderHeader_2008; CREATE PROCEDURE Sales.SalesOrderHeader_Create … AS INSERT INTO Sales.SalesOrderHeader_2008( OrderDate, SalesOrderID, ….) VALUES( …. )

Limitations of Partitioned Tables Enterprise feature Horizontal partitioning scheme only Prior to MSSQL 2014, Statistics only tracked at table (not partition) level Indexing defined at the table level Partitioning can only occur on one column Prior to MSSQL 2014, online rebuild only supported at table level

Vertical (vs Horizontal) Partitioning Horizontal partitioning separates groups of rows into partitions (table) or tables (view) Vertical partitioning on the other hand separates columns from the rest of the table Can be driven by normalization In practice, this term is more often associated with row splitting

Horizontal Partition

Vertical Partition

Before Row Splitting ID_Int ID_GUID Name … Big_xml LastDoc 1 1a23… Anna <… /> 2 2ff0… Bubba 9001 10ab… Goku

After Row Splitting ID_Int ID_GUID Name … 1 1a23… Anna 2 2ff0… Bubba 9001 10ab… Goku ID_Int Big_xml LastDoc 1 <… /> … 2 9001

Statistics Sampling

Common Answer

Possible Answer

Moving Data Around – Partitioned Table To extract an entire partition from a table Use ALTER TABLE SWITCH to instantly switch the partition out to a new table Archive / delete / manipulate the new table To add existing data to partitioned table Get data into table with same structure/indexing Add check constraints Switch the new table into the partitioned table

Moving Data Around – Partitioned View To separate a table from the view Alter the view so that it no longer references table Update stored procedures if necessary To add existing data to partitioned view Get data into table with same structure Ideally, add check constraints Update view and stored procedures to reference new table

Demo Startup Conditions in Execution Plan

Multi Dimensional Partitioning Demo Multi Dimensional Partitioning

QUESTIONS

Thank You This FREE SQL Saturday is brought to you courtesy of these sponsors, speakers and volunteers who staff this event