Srik Raghavan Principal Lead Program Manager Kevin Cox Principal Program Manager SESSION CODE: DAT206.

Slides:



Advertisements
Similar presentations
Big Data Working with Terabytes in SQL Server Andrew Novick
Advertisements

Performance and Scalability. Optimizing PerformanceScaling UpScaling Out.
Balmukund Lakhani Technical Lead – SQL Support Team
Meanwhile RAM cost continues to drop Moore’s Law on total CPU processing power holds but in parallel processing… CPU clock rate stalled… Because.
Chapter 9 Overview  Reasons to monitor SQL Server  Performance Monitoring and Tuning  Tools for Monitoring SQL Server  Common Monitoring and Tuning.
Jason Tolley Technical Director ROK Technology Pty Ltd SESSION CODE: WEM305.
DBI308. What are SQL Server Fast Track Reference Configurations General Fast Track Recommendations Reference Configurations and Best Practices FT 3.0.
Fast Track, Microsoft SQL Server 2008 Parallel Data Warehouse and Traditional Data Warehouse Design BI Best Practices and Tuning for Scaling SQL Server.
Sunil Agarwal Senior Program Manager Microsoft Corporation SESSION CODE: DAT309.
Performance and Scalability. Performance and Scalability Challenges Optimizing PerformanceScaling UpScaling Out.
Mark Harmsworth – Architecture Nate Bruneau – Engineering Scott Kleven – Program Management Microsoft Corporation SESSION CODE: OSP321.
Chris Kabat Vice President Connected Business Systems MPS Partners SESSION CODE: ASI305 Elizabeth Graham Director Connected Business Systems MPS Partners.
Juergen Thomas Principal Program Manager Microsoft Corporation SESSION CODE: DAT314.
Activity Running Time DurationIntro0 2 min Setup scenario 2 2 min SQL BI components & concepts 4 5 min Data input (Let’s go shopping) 9 7 min Whiteboard.
The Secrets of Effective Technical Talks: How to Explain Tech without Tucking Them In! Presented by Mark Minasi and Mark Russinovich SESSION CODE: SIA334.
1 Robert Wijnbelt Health Check your Database A Performance Tuning Methodology.
Ashwin Sarin Program Manager Microsoft Corporation SESSION CODE: COS204.
Dan Kershaw Principal Program Manager Microsoft Corporation SESSION CODE: COS206.
Maciej Pilecki Consultant, SQL Server MVP Project Botticelli Ltd. SESSION CODE: DAT403.
Boris Jabes Senior Program Manager Microsoft Corporation SESSION CODE: DEV319 Scale & Productivity in Visual C
Peter Provost Sr. Program Manager Microsoft Corporation SESSION CODE: DEV403.
SESSION CODE: BIE07-INT Eric Kraemer Senior Program Manager Microsoft Corporation.
Kevin Cox – SQL CAT Microsoft Corporation What are the largest SQL projects in the world? SESSION CODE: DAT305 Srik Raghavan –
Applications hitting a wall today with SQL Server Locking/Latching Scale-up Throughput or latency SLA Applications which do not use SQL Server.
Gail Warren Director, Online Services Microsoft Corporation SESSION CODE: COS201.
Adam Machanic Database Consultant SQLblog SESSION CODE: DAT318.
END USER TOOLS AND PERFORMANCE MANAGEMENT APPS Excel PerformancePoint Svcs/ProClarity BI PLATFORM SQL Server Reporting Services SQL Server Reporting Services.
Joe Yong Chief Architect Scalability Experts SESSION CODE: DAT 205.
Brad Younge Principal Statera, Inc. SESSION CODE: COS304.
Bradley Millington Senior Program Manager Microsoft Corporation SESSION CODE: WEB 306.
Suhail Dutta Program Manager Microsoft Corporation SESSION CODE: DEV402.
Sudhir Hasbe Sr. Product Manager Microsoft Corporation SESSION CODE: SIA307 Renga Srinivas Sr. Program Manager Paul Larsen Product Unit Manager.
Matt winkler program manager microsoft corporation SESSION CODE: ASI303.
Chandrika Shankarnarayan Senior Program Manager Microsoft Corporation SESSION CODE: ASI301.
Satya SK Jayanty Director & Principal Architect D BI A Solutions Peter Saddow Senior Program Manager Microsoft Corporation -SQL Server SESSION CODE: DAT312.
Thomas Deml Principal Program Manager Web Platform and Tools Microsoft Corporation SESSION CODE: WEB308.
Paul Litwin Programmer Manager Fred Hutchinson Cancer Research Center SESSION CODE: WEB206.
Jeff King Senior Program Manager, Visual Studio Microsoft Corporation SESSION CODE: WEB305.
Lori Dirks Expression Community Manager Microsoft Corporation SESSION CODE: WEB309.
Solution to help customers and partners accelerate their data.
Bob Beauchemin Developer Skills Partner SQLskills SESSION CODE: DAT402.
Olivier Bloch Technical Evangelist Microsoft Corporation SESSION CODE: WEM308.
Richard Campbell Co-Founder Strangeloop Networks SESSION CODE: WEB315.
Reza Chitsaz Senior Program Manager Microsoft Corporation SESSION CODE: DEV302 Building a SharePoint Collaboration Application in Visual Studio 2010.
Your Data Any Place, Any Time Performance and Scalability.
Andrew Connell, MVP Developer, Instructor & Author Critical Path Training, LLC. SESSION CODE: OSP305.
1 Copyright © 2005, Oracle. All rights reserved. Following a Tuning Methodology.
Introducing Visual Studio 2010: What It Is and Why You Should Care
Pat Altimore Sr. Consultant Microsoft Corporation SESSION CODE: WCL321.
BIO202 | Building Effective Data Visualizations and Maps with Microsoft SQL Server 2008 Reporting Services BIU08-INT | Using.
Martin Woodward Program Manager Microsoft Corporation SESSION CODE: DEV308.
Don Jones Senior Partner and Technologist Concentrated Technology, LLC SESSION CODE: DAT203.
SESSION CODE: COS301. So what do we do?
David A. Carley Senior SDE Microsoft Corporation SESSION CODE: DEV318.
Tobias Ternstrom Senior Program Manager Lead SQL Server Engine SESSION CODE: DAT405 Itzik Ben-Gan Mentor and Co-Founder Solid Quality Mentors.
By: Paul D. Sheriff or SESSION CODE: WCL206.
Cube Measure Group Measure Partition Cube Dimension Dimension Attribute Attribute Relationship Hierarchy Level Cube Attribute Cube Hierarchy.
Christophe Fiessinger & Jan Kalis Senior Technical Product Manager Microsoft Corporation SESSION CODE: OSP209.
Ken Getz Senior Consultant MCW Technologies, LLC SESSION CODE: WCL202.
Tobias Ternstrom Senior Program Manager Lead SQL Server Engine SESSION CODE: DAT404.
Luke Hoban Senior Program Manager Microsoft Corporation SESSION CODE: DEV307.
Clint Kunz Data Platform Technology Specialist
This document is provided for informational purposes only and Microsoft makes no warranties, either express or implied, in this document. Information.
Andrew Connell, MVP Developer, Instructor & Author Critical Path Training, LLC. SESSION CODE: OSP319.
Tim Laverty – Diego Vega – Program Managers Microsoft Corporation SESSION CODE: DEV305.
Stephen Forte Chief Strategy Officer Telerik stephenforte.net SESSION CODE: DEV303 Building Data Driven RESTful Applications.
Real world In-Memory OLTP
SQL 2014 In-Memory OLTP What, Why, and How
Very large Databases in your future Eric Peterson.
මොඩියුල විශ්ලේෂණය SQL Server Waits. Tables රැසක් එකට එකතු කිරීම.
Presentation transcript:

Srik Raghavan Principal Lead Program Manager Kevin Cox Principal Program Manager SESSION CODE: DAT206

OLTP workload characteristics OLTP application design principles Scalability determinants and bottlenecks SQL Server 2008 R2 Performance and Scale features Demo Scaling Up – Hardware to the rescue Summary

Typically used by line-of-business (LOB) applications Has both read-write Fine-grained inserts and updates High transaction throughput e.g., 10s K/sec Usually very short transactions e.g., 1–3 tables Sometimes multi-step e.g., financial Relatively small data sizes

LOGICAL DESIGN PHYSICAL DESIGN ER MODEL INDEXES

Ensure good logical (E-R Model) and physical (indexes) DB design Leverage set-oriented processing power of SQL Server Update Statistics – ensure it is up to date! Use DTA to assist with physical design Avoid too many joins Now let’s talk Physical Design

OLTP workload characteristics OLTP application design principles Scalability determinants and bottlenecks SQL Server 2008 R2 Performance and Scale features Demo Scaling Up – Hardware to the rescue Summary

Bottleneck Transaction takes longer Transaction holds resources Poor scaling Transaction throughput No. of concurrent users Data size and growth rate CPU Memory IO Network Key Design Pattern for Scalability: Divide and Conquer

Plan compilation and recompilations Plan reuse < 90% is bad Parallel queries Parallel wait type cxpacket > 10% of total waits High runnable tasks or sos_scheduler_yield waits Queries not parameterized Inefficient Query plan Not enough stored procedures MAXDOP is not set to 1 Statistics not updated Table scan, range scan SET option changes within SP

OLTP workload characteristics OLTP application design principles Scalability determinants and bottlenecks SQL Server 2008 R2 Performance and Scale features Demo Scaling Up – Hardware to the rescue Summary

Better query plans Plan guides Optimize for Unknown Lock escalation hints Resource governor Transparency and Diagnostics – Xevent, DMV’s > 64 thread support Dynamic affinity (hard or soft) Hot-add CPU support Data Compression Especially if you have I/O issues Partitioning Snapshot Isolation, RCSI Control Point

Benefits Provide deterministic Quality Of Service Prevent run-away queries Tames ill behaved Apps DW & Consolidation scenarios SQL Server 2008 RG Workloads are mapped to Resource Pools Online changes of groups and pools Real-time Resource Monitoring Up to 20 Resource Pools SQL Server 2008 Min Memory 10% Max Memory 20% Max CPU 20% Min Memory 10% Max Memory 20% Max CPU 20% Admin Workload Backup Admin Tasks OLTP Workload OLTP Activity Report Workload Ad-hoc Reports Executive Reports High Max CPU 90% Application Pool Admin Pool

OLTP workload characteristics OLTP application design principles Scalability determinants and bottlenecks SQL Server 2008 R2 Performance and Scale features Demo Scaling Up – Hardware to the rescue Summary

Disk Subsystem Server NIC Memory Network SQL File Layout HBA The key is to build a Balanced System without bottlenecks SQL Server is only part of the equation. Eco system needs to scale.

Memory LP 0 LP 1LP 2LP 3 LP 4 LP 5LP 6LP 7 Front side bus contention increases w/ higher #CPUs Symmetric Multiprocessor Architecture Non-Uniform Memory Access Local Memory Access ForeignMemoryAccess Foreign memory access > local memory access

For OLTP Design for IO/sec and data warehouse design for throughput

Upgrade to Windows Server 2008 to gain these benefits

CategoryMetric Largest single database80 TB Largest table20 TB Biggest total data 1 customer2.5 PB Highest transactions per second 1 db36,000 Fastest I/O subsystem in production18 GB/sec Fastest “real time” cube15 sec latency Data load for 1TB20 minutes Largest cube4.2 TB

Sponsored by DellSponsored by Dell

Required Slide Track PMs will supply the content for this slide, which will be inserted during the final scrub.

Sign up for Tech·Ed 2011 and save $500 starting June 8 – June 31 st You can also register at the North America 2011 kiosk located at registration Join us in Atlanta next year