Why Should I Care About … Partitioned Views?

Slides:



Advertisements
Similar presentations
Copyright © 2007 Ramez Elmasri and Shamkant B. Navathe Slide
Advertisements

Application Generator Merrill Networking Services.
Big Data Working with Terabytes in SQL Server Andrew Novick
Tables Lesson 6. Skills Matrix Tables Tables store data. Tables are relational –They store data organized as row and columns. –Data can be retrieved.
Module 6 Implementing Table Structures in SQL Server ®2008 R2.
Architecting a Large-Scale Data Warehouse with SQL Server 2005 Mark Morton Senior Technical Consultant IT Training Solutions DAT313.
Dual Partitioning for improved performance in VLDBs Ashwin Rao Karavadi, Rakesh Parida Microsoft IT.
DAT702.  Standard Query Language  Ability to access and manipulate databases ◦ Retrieve data ◦ Insert, delete, update records ◦ Create and set permissions.
Module 9: Managing Schema Objects. Overview Naming guidelines for identifiers in schema object definitions Storage and structure of schema objects Implementing.
Database Design for DNN Developers Sebastian Leupold.
DBSQL 14-1 Copyright © Genetic Computer School 2009 Chapter 14 Microsoft SQL Server.
Insert, Update & Delete Performance Joe Chang
SQL Server Indexes Indexes. Overview Indexes are used to help speed search results in a database. A careful use of indexes can greatly improve search.
Database Unit Test MSSQL 2008 & VS 2010 Aung Kyaw Myo.
Partitioning Design For Performance and Maintainability Martin Cairns
Chapter 16 Practical Database Design and Tuning Copyright © 2004 Pearson Education, Inc.
Application Data and Database Activities Auditing Dr. Gabriel.
Information Building and Retrieval Using MySQL Track 3 : Basic Course in Database.
SQL Basic. What is SQL? SQL (pronounced "ess-que-el") stands for Structured Query Language. SQL is used to communicate with a database.
Constraints cis 407 Types of Constraints & Naming Key Constraints Unique Constraints Check Constraints Default Constraints Misc Rules and Defaults Triggers.
Introduction to Database System Adisak Intana Lecturer Chapter 7 : Data Integrity.
Database Fundamental & Design by A.Surasit Samaisut Copyrights : All Rights Reserved.
Visual Programing SQL Overview Section 1.
Working with SQL Server Database Objects Faculty: Nguyen Ngoc Tu.
Lec 7 Practical Database Design and Tuning Copyright © 2004 Pearson Education, Inc.
Chapter 5 Index and Clustering
Session 1 Module 1: Introduction to Data Integrity
Student Centered ODS ETL Processing. Insert Search for rows not previously in the database within a snapshot type for a specific subject and year Search.
Distribution of Marks For Second Semester Internal Sessional Evaluation External Evaluation Assignment /Project QuizzesClass Attendance Mid-Term Test Total.
SQL Query Analyzer. Graphical tool that allows you to:  Create queries and other SQL scripts and execute them against SQL Server databases. (Query window)
Introduction to MySQL  Working with MySQL and MySQL Workbench.
 What is DB Testing ?  Testing at the Data Access Layer  Need for Testing DB Objects  Common Problems that affect the Application  Should Testers.
SQL Basics Review Reviewing what we’ve learned so far…….
Views / Session 3/ 1 of 40 Session 3 Module 5: Implementing Views Module 6: Managing Views.
In this session, you will learn to: Manage databases Manage tables Objectives.
Data Integrity & Indexes / Session 1/ 1 of 37 Session 1 Module 1: Introduction to Data Integrity Module 2: Introduction to Indexes.
SQL IMPLEMENTATION & ADMINISTRATION Indexing & Views.
Introduction to Partitioning in SQL Server
Practical Database Design and Tuning
Temporal Databases Microsoft SQL Server 2016
Temporal Databases Microsoft SQL Server 2016
Introduction to SQL 2016 Temporal Tables
MIS2502: Data Analytics SQL – Putting Information Into a Database
Applied CyberInfrastructure Concepts Fall 2017
Why Should I Care About … Partitioned Views?
Why Should I Care About … Partitioned Views?
The Ins and Outs of Partitioned Tables
මොඩියුල විශ්ලේෂණය Buffer Pool Extension භාවිතය.
Beginner Table Partitioning
Module 5: Implementing Data Integrity by Using Constraints
Simple Partitioning Building a simple partitioning solution with SQL Server Stephen Fulcher.
Introduction to partitioning
Teaching slides Chapter 8.
Why Should I Care About … Partitioned Views?
Why Should I Care About … Partitioned Views?
Practical Database Design and Tuning
Table Partitioning Intro and make that a sliding window too!
Microsoft SQL Server 2014 for Oracle DBAs Module 7
Why Should I Care About … Partitioned Views?
Data Management Innovations 2017 High level overview of DB
Why Should I Care About … Partitioned Views?
Table Partitioning Intro and make that a sliding window too!
Introduction To Structured Query Language (SQL)
Table Partitioning Intro and make that a sliding window too!
Data Definition Language
MIS2502: Data Analytics SQL 4– Putting Information Into a Database
Partition Switching Joe Tempel.
Why Should I Care About … Partitioned Views?
Managing Table Partitions at the Extreme
Using Columnstore indexes in Azure DevOps Services. Lessons learned
Presentation transcript:

Why Should I Care About … Partitioned Views? Attendees : I will upload my sample scripts but I’m still cleaning up my DB creation code. Check back in a few days. Why Should I Care About … Partitioned Views? Let’s Partition Like It’s 1999

Frederick (Rick) Lowe rick@data-flowe.com DataFLowe

Overview of Partitioned Tables (Opposed to Partitioned Views) Appears to be a normal table Table is broken into multiple partitions based on the value of a single column Migrating a partition in or out is a metadata-only operation (i.e. basically instantaneous) Select statements can eliminate partitions Enterprise edition, MSSQL 2008 and higher

Working With Partitioned Tables Create a partition function and scheme Build clustered and nonclustered indexes on the partition scheme Views, CRUD etc reference a partitioned table pretty much like any other table SQL Server does all the heavy lifting

Partitioned Table Update/Insert/Select MyTable 2005? 2006? 2007? 2008? Partition Scheme Associated With Table P0 … P1 … P2 … P3 …

Defining a Partitioned Table CREATE PARTITION FUNCTION MyFunction(DATE) AS RANGE RIGHT FOR VALUES (…); CREATE PARTITON SCHEME MyPartitionScheme AS PARTITION MyFunction TO( … ); CREATE TABLE Sales.SalesOrderHeader( OrderDate DATETIME2(3), SalesOrderID INT IDENTITY NOT NULL, … CONSTRAINT PK_SalesOrderHeader PRIMARY KEY CLUSTERED(OrderDate, SalesOrderID) ON MyPartitionScheme( OrderDate ) );

Working With Partitioned Views Build individual tables Typically, create check constraints on tables View unions together all underlying tables *Create procedure determines which table to insert the data into *Update/Delete also need to either determine which table to work on or operate on all * indicates operations on view can save work

Partitioned View Update Insert Select UpdateMyTable CreateMyTable vwMyTable 2005? 2006? 2007? 2008? Data Boundaries Coded Into View / Procs MyTbl_05 … MyTbl_06 … MyTbl_07 … MyTbl_08 …

Defining a Partitioned View CREATE VIEW Sales.vwSalesOrderHeader AS SELECT OrderDate, SalesOrderID, … FROM Sales.SalesOrderHeader_2005 UNION ALL SELECT OrderDate, SalesOrderID, … FROM Sales.SalesOrderHeader_2006 SELECT OrderDate, SalesOrderID, … FROM Sales.SalesOrderHeader_2007 SELECT OrderDate, SalesOrderID, … FROM Sales.SalesOrderHeader_2008; CREATE PROCEDURE Sales.SalesOrderHeader_Create … AS INSERT INTO Sales.SalesOrderHeader_2008( OrderDate, SalesOrderID, ….) VALUES( …. )

Limitations of Partitioned Tables Enterprise feature Horizontal partitioning scheme only Prior to MSSQL 2014, Statistics tracked at table (not partition) level Indexing defined at the table level Partitioning can only occur on one column Prior to MSSQL 2014, online rebuild only supported at table level

Vertical Partitioning Horizontal partitioning separates groups of rows into partitions (table) or tables (view) Vertical partitioning on the other hand separates columns from the rest of the table Can be driven by normalization In practice, this term is more often associated with row splitting

Horizontal Partition

Vertical Partition

Before Row Splitting ID_Int ID_GUID Name … Big_xml LastDoc 1 1a23… Anna <… /> 2 2ff0… Bubba 9001 10ab… Goku

After Row Splitting ID_Int ID_GUID Name … 1 1a23… Anna 2 2ff0… Bubba 9001 10ab… Goku ID_Int Big_xml LastDoc 1 <… /> … 2 9001

Statistics Sampling

Common Answer

Possible Answer

Moving Data Around – Partitioned Table To extract an entire partition from a table Use ALTER TABLE SWITCH to instantly switch the partition out to a new table Archive / delete / manipulate the new table To add existing data to partitioned table Get data into table with same structure/indexing Add check constraints Switch the new table into the partitioned table

Moving Data Around – Partitioned View To separate a table from the view Alter the view so that it no longer references table Update stored procedures if necessary To add existing data to partitioned view Get data into table with same structure Ideally, add check constraints Update view and stored procedures to reference new table

Demo Startup Conditions in Execution Plan

Thank You Rick Lowe – rick@data-flowe.com DataFLowe