Presentation is loading. Please wait.

Presentation is loading. Please wait.

…the secret sauce! Diagrams and video from Microsoft white papers and slide decks.

Similar presentations


Presentation on theme: "…the secret sauce! Diagrams and video from Microsoft white papers and slide decks."— Presentation transcript:

1 …the secret sauce! Diagrams and video from Microsoft white papers and slide decks

2  LobsterPot Solutions  MCM  MVP  MCT  Adelaide SQL Server User Group leader  Formerly on the PASS Board of Directors  Only certified PDW Trainer in Asian region (outside Microsoft, of course)

3  What is PDW?  How is it different to ordinary SQL Server?  How does it achieve so much better performance?

4  SQL Server uses Symmetric Multi-Processing (SMP)  PDW uses Massively Parallel Processing (MPP)  …but at its core, PDW is just lots of SQL Servers, talking in an interesting way.  …and previously known as “Project Madison”

5 Dell JBOD 1 Compute Node 2 Compute Node 3 JBOD 2 Compute Node 1  An appliance (rack) provided by HP or Dell  Devices connected by InfiniBand (56 Gbps)  Control Node and Compute Nodes  Disks provided using JBOD arrays  Systems expandable from ¼ rack to multi HP Infiniband Infiniband Ethernet Ethernet Control Node Failover Node JBOD 1 Compute Node 1 Compute Node 2 JBOD 2 Compute Node 3 Compute Node 4 JBOD 3 Compute Node 5 Compute Node 6 JBOD 4 Compute Node 7 Compute Node 8 CustomerUse Infiniband Infiniband Ethernet Ethernet Control Node Failover Node JBOD 5 Compute Node 8 Compute Node 9 JBOD 6 Compute Node 7 CustomerUse JBOD 3 Compute Node 5 Compute Node 6 JBOD 4 Compute Node 4

6

7

8  Control Node has a shell database  Compute Nodes have  Distributed Data - hashed on a column across eight distributions per compute node  Replicated Data - copied across each compute node  Clustered Columnstore available

9  T-SQL sent to Control Node  Control Node works out an MPP Plan  MPP Plan made up of DSQL  SQL commands  Movement operations  Temporary table operations  Return operations

10  What if the data you need is on the wrong node?  Shared Nothing v Redistribution

11  Let’s get out the whiteboard!!!  Partition Move  (Control-Node) Move  Broadcast Move  Shuffle Move  Trim Move  Replicated Broadcast

12

13

14

15  PDW provides the scale-out that your warehouse needs  If you’re looking at 32 cores of Enterprise Edition, get PDW instead  The power comes from distributing the load across all nodes as much as possible  Key reference:  White paper “Query Optimization in Microsoft SQL Server PDW” from Microsoft Research (DeWitt and others)


Download ppt "…the secret sauce! Diagrams and video from Microsoft white papers and slide decks."

Similar presentations


Ads by Google