Filegroup “Stage A” Filegroup “Stage A” Filegroup “A” Partition 1,2 Filegroup “B” Partition 3,4 Filegroup “C” Partition 5,6 Filegroup “D” Partition.

Slides:



Advertisements
Similar presentations
Module 3: Creating and Tuning Indexes. Planning Indexes Creating Indexes Optimizing Indexes.
Advertisements

SQL Server Storage Engine.  Software architect at Red Gate Software  Responsible for SQL tools: ◦ SQL Compare, SQL Data Compare, SQL Packager ◦ SQL.
Big Data Working with Terabytes in SQL Server Andrew Novick
6.830/6.814 Lecture 5 Database Internals Continued September 17, 2014.
Data warehousing with MySQL MySQLMS-SQLOracleDB2 MySQL Flat Files.
1 Copyright 2004 MySQL AB The World’s Most Popular Open Source Database Data warehousing with MySQL By Anand Pandey MySQLMS-SQLOracleDB2 MySQL Flat Files.
Physical Database Design Data Migration/Conversion.
Quick-and-dirty.  Commands end in a semi-colon ◦ If you forget, another prompt line shows up  Either continue the command or…  End it with a semi-colon.
Midterm Review Lecture 14b. 14 Lectures So Far 1.Introduction 2.The Relational Model 3.Disks and Files 4.Relational Algebra 5.File Org, Indexes 6.Relational.
Database Systems: A Practical Approach to Design, Implementation and Management International Computer Science S. Carolyn Begg, Thomas Connolly Lecture.
Physical Database Monitoring and Tuning the Operational System.
Chapter 17 Methodology – Physical Database Design for Relational Databases Transparencies © Pearson Education Limited 1995, 2005.
Team Dosen UMN Physical DB Design Connolly Book Chapter 18.
Denny Cherry twitter.com/mrdenny.
DBI308. What are SQL Server Fast Track Reference Configurations General Fast Track Recommendations Reference Configurations and Best Practices FT 3.0.
ETL By Dr. Gabriel.
SQL Basics. SQL SQL (Structured Query Language) is a special-purpose programming language designed from managing data in relational database management.
With Michelle Ufford.  Sr. DBA for GoDaddy.com  Working with SQL for 6 years, focused on performance tuning and VLDB’s  Member of the PASS Performance.
Module 4: Data Objects. Overview Tables are the main objects that store data Indexes, views, stored programs and other objects are the support structures.
ISV Innovation Presented by ISV Innovation Presented by Business Intelligence Fundamentals: Data Loading Ola Ekdahl IT Mentors 9/12/08.
Lecture 9 Methodology – Physical Database Design for Relational Databases.
Information Systems Today (©2006 Prentice Hall) MySQL 1CS3754 Class Note #8, Is an open-source relational database management system 2.Is fast and.
Chapter 16 Methodology – Physical Database Design for Relational Databases.
Architecture Rajesh. Components of Database Engine.
SQL pepper. Why SQL File I/O is a great deal of code Optimal file organization and indexing is critical and a great deal of code and theory implementation.
Insert, Update & Delete Performance Joe Chang
SQL pepper. Why SQL File I/O is a great deal of code Optimal file organization and indexing is critical and a great deal of code and theory implementation.
SESSION CODE: BIE07-INT Eric Kraemer Senior Program Manager Microsoft Corporation.
Partitioning Design For Performance and Maintainability Martin Cairns
Table Indexing for the.NET Developer Denny Cherry twitter.com/mrdenny.
Data Warehouse Design Xintao Wu University of North Carolina at Charlotte Nov 10, 2008.
10/10/2012ISC239 Isabelle Bichindaritz1 Physical Database Design.
SQL: DDL. SQL Statements DDL - data definition language –Defining and modifying data structures (metadata): database, tables, views, etc. DML - data manipulation.
Application Data and Database Activities Auditing Dr. Gabriel.
Incremental Index Maintenance A Solution “That Just Works” AL NOEL PRINCIPAL CONSULTANT, MICROSOFT
Denny Cherry twitter.com/mrdenny.
Methodology – Physical Database Design for Relational Databases.
Database Fundamental & Design by A.Surasit Samaisut Copyrights : All Rights Reserved.
- Joiner Transformation. Introduction ►Transformations help to transform the source data according to the requirements of target system and it ensures.
Praveen Srivatsa Director| AstrhaSoft Consulting blogs.asthrasoft.com/praveens |
SQL/Lesson 7/Slide 1 of 32 Implementing Indexes Objectives In this lesson, you will learn to: * Create a clustered index * Create a nonclustered index.
SQLintersection Putting the "Squeeze" on Large Tables Improve Performance and Save Space with Data Compression Justin Randall Tuesday,
SQL SERVER DAYS 2011 Table Indexing for the.NET Developer Denny Cherry twitter.com/mrdenny.
B. Information Technology (Hons.) CMPB245: Database Design Physical Design.
Student Centered ODS ETL Processing. Insert Search for rows not previously in the database within a snapshot type for a specific subject and year Search.
Stories from the trenches - Partitioning as a design pattern About the FLIS project Data warehouse heroes and architecture Partitioning in many disguises.
Query Processing – Implementing Set Operations and Joins Chap. 19.
Working with MySQL A290/A590, Fall /07/2014.
Table Structures and Indexing. The concept of indexing If you were asked to search for the name “Adam Wilbert” in a phonebook, you would go directly to.
SQL pepper. Why SQL File I/O is a great deal of code Optimal file organization and indexing is critical and a great deal of code and theory implementation.
Introduction to MySQL  Working with MySQL and MySQL Workbench.
# CCNZ What is going on here???
SAP Tuning 실무 SK㈜ ERP TFT.
Big Data Yuan Xue CS 292 Special topics on.
DB Programming – Basic analysis
Data Warehouse ETL By Garrett EDmondson Thanks to our Gold Sponsors:
Indexes By Adrienne Watt.
Finding more space for your tight environment
Methodology – Physical Database Design for Relational Databases
Physical Database Design for Relational Databases Step 3 – Step 8
Chapter Overview Understanding the Database Architecture
The Ins and Outs of Partitioned Tables
Free Dumps - Try Demo - Dumps4download
Table Indexing for the .NET Developer
Real world In-Memory OLTP
In Memory OLTP Not Just for OLTP.
Bulk Load and Minimal Logging
Weird Stuff I Saw While … Working With Heaps
SQL AUTO INCREMENT Field
Presentation transcript:

Filegroup “Stage A” Filegroup “Stage A” Filegroup “A” Partition 1,2 Filegroup “B” Partition 3,4 Filegroup “C” Partition 5,6 Filegroup “D” Partition 7,8 Filegroup “Stage B” Filegroup “Stage B” 8 Source Data Files 8 Core Server Base Heap StageTable Target Database Partition 2 Destination CI Partition 1 Destination CI Partition 4 Destination CI Partition 3 Destination CI Partition 6 Destination CI Partition 5 Destination CI Partition 8 Destination CI Partition 7 Destination CI 8 Concurrent Bulk Insert Step 1 “Base Load” Step 1 “Base Load” Step 2 “Stage Insert” Step 2 “Stage Insert” Step 3 “Transform” Step 3 “Transform” Step 4 “Final Append” Step 4 “Final Append” 8 Heap Stage Table Constraint on CI Part Key 8 Heap Stage Table Constraint on CI Part Key 8 Concurrent Inserts 2 CI Stage Tables 2 sets, 4 concurrent Create Cluster Index with Compression INTO “Final Destination” 2 sets, 4 concurrent Create Cluster Index with Compression INTO “Final Destination” Create CI 8 Concurrent Partition Switch Part Switch Destination Partitioned CI Table

Target Database Primary Partitioned CI Table Current Partition 1 Source Data File Step 1 Incremental Load Step 1 Incremental Load Bulk Insert

Filegroup “Current” Filegroup “Historical” Target Database Bulk Insert Volatile Holding Tables Primary Partitioned CI Table Partition Destination CI Primary View Unions Holding & Primary Tables Step 1 DDL Step 1 DDL Step 2 Primary View Step 2 Primary View 1 Source Data File Step 3 Incremental Load Step 3 Incremental Load Partition 48 Destination CI Partition 47 Destination CI Step 4 Manage Partitions Step 4 Manage Partitions Partitions 47,48 Partitions 1-46

select db_name(ps.database_id) as database_name,object_name(ps.object_id) as table_name,ps.index_id,i.name,cast (ps.avg_fragmentation_in_percent as int) as [Logical Fragmentation],cast (ps.avg_page_space_used_in_percent as int) as [Avg Page Space Used],cast (ps.avg_fragment_size_in_pages as int) as [Avg Fragment Size In Pages],ps.fragment_count as [Fragment Count],ps.page_count,(ps.page_count * 8)/1024/1024 as [Size in GB] from sys.dm_db_index_physical_stats (DB_ID() -- NULL = All Databases, OBJECT_ID('$(TABLENAME)'), 1, NULL, 'SAMPLED') AS ps -- DETAILED, SAMPLED, NULL = LIMITED inner join sys.indexes AS i on (ps.object_id = i.object_id AND ps.index_id = i.index_id) where ps.database_id = db_id() and ps.index_level = 0;