Kevin Kline, SQL Sentry Director of Engineering Services, Microsoft SQL Server MVP since 2003 Twitter, Facebook, KEKline.

Slides:



Advertisements
Similar presentations
Meeting Date: October 16, 2007 Topic: The 64-bit Question by Rick Heiges
Advertisements

Agenda Speaker bio Fundamentals of Disk Hardware Architecture and Disk Sector Alignment Fundamentals of the Hardware Architecture Basics of IO, or Acronym.
DAT 342 Advanced SQL Server Performance and Tuning Bren Newman Program Manager SQL Server Development Microsoft Corporation.
new database engine component fully integrated into SQL Server 2014 optimized for OLTP workloads accessing memory resident data achive improvements.
6 SQL Server Integration Same manageability, administration & development experience Integrated queries & transactions Integrated HA and backup/restore.
SQL Server Wait Statistics Capture, Report, Analyse Rob Risetto Principal Consultant with StrataDB
Log Tuning. AOBD 2007/08 H. Galhardas Atomicity and Durability Every transaction either commits or aborts. It cannot change its mind Even in the face.
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 16 – Intro. to Transactions.
Meanwhile RAM cost continues to drop Moore’s Law on total CPU processing power holds but in parallel processing… CPU clock rate stalled… Because.
1 I/O Management in Representative Operating Systems.
Microsoft SQL Server Administration for SAP SQL Server Architecture.
Module 1: Database and Instance. Overview Defining a Database and an Instance Introduce Microsoft’s and Oracle’s Implementations of a Database and an.
SQL Server memory architecture and debugging memory Issues
Module 15: Monitoring. Overview Formulate requirements and identify resources to monitor in a database environment Types of monitoring that can be carried.
1 CSE544 Database Architecture Tuesday, February 1 st, 2011 Slides courtesy of Magda Balazinska.
Kevin Kline, SQL Sentry Director of Engineering Services, Microsoft SQL Server MVP since 2003 Twitter, Facebook, KEKline.
Key Perf considerations & bottlenecks Windows Azure VM characteristics Monitoring TroubleshootingBest practices.
Chapter Oracle Server An Oracle Server consists of an Oracle database (stored data, control and log files.) The Server will support SQL to define.
DBMS Transactions and Rollback Recovery Helia / Martti Laiho.
Oracle Tuning Considerations. Agenda Why Tune ? Why Tune ? Ways to Improve Performance Ways to Improve Performance Hardware Hardware Software Software.
DBI313. MetricOLTPDWLog Read/Write mixMostly reads, smaller # of rows at a time Scan intensive, large portions of data at a time, bulk loading Mostly.
© Dennis Shasha, Philippe Bonnet 2001 Log Tuning.
Process Architecture Process Architecture - A portion of a program that can run independently of and concurrently with other portions of the program. Some.
CS 540 Database Management Systems
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 7 – Buffer Management.
DMBS Architecture May 15 th, Generic Architecture Query compiler/optimizer Execution engine Index/record mgr. Buffer manager Storage manager storage.
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 16 – Intro. to Transactions.
SQL SERVER CONFIGURATION OPTIONS AND TRACE FLAG SECRETS Kevin Kline SQL Sentry, Director of Engineering on Twitter, FB, LI Blogs at
SQL Server Deep Dive Denis Reznik Data Architect at Intapp.
Scott Fallen Sales Engineer, SQL Sentry Blog: scottfallen.blogspot.com.
Kevin Kline Director of Engineering Services, SQL Sentry SQL Server MVP since 2003 Twitter, FB, LI: KEKline Blog:
Vedran Kesegić. About me  M.Sc., FER, Zagreb  HRPro d.o.o. Before: Vipnet, FER  13+ years with SQL Server (since SQL 2000)  Microsoft Certified.
What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently and safely. Provide.
Kevin Kline Technical Evangelist, SQL Sentry SQL Server MVP since 2003 Twitter, FB, LI, KEKline Blog:
Kevin Kline Director of Engineering Services, SQL Sentry SQL Server MVP since 2003 Twitter, FB, LI, KEKline Blog:
No more waiting. Sponsors About me  Database Technology Specialist  MVP  Blogger  Author 3
4 Copyright © 2004, Oracle. All rights reserved. Managing the Oracle Instance.
Oracle Database Architectural Components
SQLSTARTER - INTRO TO DATABASE DEVELOPMENT Kevin Kline Technical Evangelist, SQL Sentry SQL Server MVP since 2003 Twitter, FB, LI, KEKline Blog:
Chapter 21 SGA Architecture and Wait Event Summarized & Presented by Yeon JongHeum IDS Lab., Seoul National University.
SQL Server Internals & Architecture Naomi Williams, SQL DBA LinkedIn
Memory-Optimized Tables Querying at the speed of light.
Dropping acid - Why Does SQL Server Do what it Does?
CS 540 Database Management Systems
SQL Server Internals & Architecture
An introduction to Wait Statistics
SQL Server Internals Overview
End-to-End Troubleshooting CHECKLIST for Microsoft SQL Server
Chapter Overview Understanding the Database Architecture
Software Architecture in Practice
SQL Server Internals & Architecture
Hustle and Bustle of SQL Pages
SQL Server Internals & Architecture
Introduction of Week 3 Assignment Discussion
Working with Very Large Tables Like a Pro in SQL Server 2014
Troubleshooting SQL Server Basics
The Vocabulary of Performance Tuning
SQL Server Internals & Architecture
Proving Hardware Bottlenecks &
What Is a Latch? …and Why Do I Care? Eddie Wuerch, mcm
SQL Server 2014 Hidden Treasures Denis Reznik Microsoft SQL Server MVP
SQL Server Internals & Architecture
The Vocabulary of Performance Tuning
Hidden Gems of SQL Server 2014
Статистика ожиданий или как найти место "где болит"
Transaction Log Performance Tuning
The Vocabulary of Performance Tuning
Using wait stats to determine why my server is slow
Working with Very Large Tables Like a Pro in SQL Server 2017
SQL Server Internals And Architecture.
Presentation transcript:

Kevin Kline, SQL Sentry Director of Engineering Services, Microsoft SQL Server MVP since 2003 Twitter, Facebook, KEKline Website:

Free Plan Explorer download: Free query tuning consultations: Free new ebook (regularly $10) to attendees. Send request to SQL Server educational videos, scripts, and slides: Tuning blog: Monthly eNews tips and tricks:

ACID properties of Transactions o Atomic o Consism tent o Isolated o Durable Speed, scalability, and performance; Maximize hardware Competitive features

Talk nerdy to me, baby!

Relational Engine Optimizer Query Executor Cmd Parser Storage Engine Trans- action Manager Buffer Manager Access Methods Protocol Layer SNI Data File T- Log Buffer Pool Data Cache Plan Cache Buffer Pool Data Cache Plan Cache SQL Server Network Interface TDS Language Event SELECT ? Query Tree Query Plan OLE DB ?

1 Cash Register = 1 Scheduler Users are assigned to a thread Uh oh! The out of soda! No problem. Step aside… More syrup for the sodas! Goes to the waiting, i.e. “suspended queue” Yeah! I’m next in line!

Relational Engine Optimizer Query Executor Cmd Parser Storage Engine Trans-action Manager: Log & Lock Mgr Trans-action Manager: Log & Lock Mgr Buffer Manager Access Methods Protocol Layer SNI Data File(s) T- Log Buffer Pool Data Cache Plan Cache Buffer Pool Data Cache Plan Cache SQL Server Network Interface TDS Language Event SQL OS ? Query Tree Query Plan OLE DB Data Write ? Check Point Lazywriter Latches Locks Async_Network_IO SOS_Scheduler_Yield Pagelatch_x, Latch_x, Resource_Semaphore LCK_x, LCK_M_x Writelog, Logbuffer PageIOLatch_x, Async_IO_Completion, IO_Completion

Windows Memory, 64-bit Two otherwise identical servers 16gb of RAM Limitations of 32- bit: /3gb switch opens more RAM AWE needed to utilize anything above 4gb on The “give & take” dichotomy Buffer Pool Plan Cache (no restrictions) Special caches: Sort Cache, Hashing Cache, etc…xxx Data Cache (no restrictions) Buffer Pool Plan Cache (no restrictions) Special caches: Sort Cache, Hashing Cache, etc…xxx Data Cache (no restrictions) Windows Memory, 32-bit Buffer Pool Plan Cache (only RAM under the 4GB AWE threshold can only be used for Plan Cache) Special caches: Sort Cache, Hashing Cache, etc…xxx Data Cache (any RAM available to the instance can be used for Data Cache, but RAM over the 4GB AWE threshold can be used only for Data Cache) Buffer Pool Plan Cache (only RAM under the 4GB AWE threshold can only be used for Plan Cache) Special caches: Sort Cache, Hashing Cache, etc…xxx Data Cache (any RAM available to the instance can be used for Data Cache, but RAM over the 4GB AWE threshold can be used only for Data Cache)

How long does a page of data or a block of code stay in cache? Uses a LRU algorithm Usually performed by the lazy- writer, but can also be done by any worker thread after scheduling its own I/O

getord Memory finduser sp_1sp_ What about buffer cache?

Relational Engine Optimizer Query Executor Cmd Parser Storage Engine Transaction Manager: Log & Lock Mgr Buffer Manager Access Methods Protocol Layer SNI Data File T- Log Buffer Pool Data Cache Plan Cache Buffer Pool Data Cache Plan Cache SQL Server Network Interface TDS Language Event INSERT, UPDATE, or DELETE ? Query Tree Query Plan OLE DB Data Write ? Oooh! So dirty! CheckPoint Lazywriter

Relational Engine Optimizer Query Executor Cmd Parser Storage Engine Trans-action Manager: Log & Lock Mgr Trans-action Manager: Log & Lock Mgr Buffer Manager Access Methods Protocol Layer SNI Data File(s) T- Log Buffer Pool Data Cache Plan Cache Buffer Pool Data Cache Plan Cache SQL Server Network Interface TDS Language Event SQL OS ? Query Tree Query Plan OLE DB Data Write ? Check Point Lazywriter Latches Locks

Understanding the internals is as important as any other bit of info you might have Remember: ACID!!! key components of the relational engine? key components of the storage engine? Key areas of cache? Key areas of the transaction manager? What two processes conduct writes? More info?