Got stress? Sometimes the SQL Server needs some too Peter Shore SQL Saturday Pittsburgh 2017

Agenda Introduction Testing Why we want stress Distributed Replay OStress SQL Query Stress HammerDB

Specialize in remote database administration, operating system, and enterprise application support services 24x7, 100% onshore support across all major database platforms including SQL Server, MySQL, PostgreSQL, Oracle, Oracle Applications, and DB2 Full suite of Microsoft Business Intelligence and Database Activity Monitoring services available Currently support hundreds of customers and thousands of databases daily www.rdx.com

Who am I? SQL Server DBA – Remote Database Experts (RDX) Intentionally Accidental DBA Over 20 years IT experience Server Engineer Desktop Engineer Network Infrastructure Desk side support President CBusPASS Co-Organizer SQL Saturday Columbus Member Multiple Virtual Chapters How to find me Twitter: @pshore73 E-mail: pshore73@outlook.com

Stress The non-specific response of the body to any demand for change Fulfillment of an infinite number of requests via finite set of resources The confusion caused when ones mind overrides the body’s natural desire to choke the living **** out of some ***hole that desperately needs it.

Stress SQL Server – Why & Where Development Testing Application development Stored Procs/Functions/Queries Problem Resolution Duplicate production load Solve problems Benchmark Learning Dev/QA/Test/UAT Pre-Production Lab

Stress To Emulate Query Database Instance Noisy Neighbors Poorly written query/queries Death by 1,000 cuts Database Many users/queries interacting with the database Instance Other databases that are highly active Noisy Neighbors Other SQL instances on the server Other applications on the server Other servers on the virtualization host

Stress Testing SQL Server Write our own test Mission specific High degree of control Time consuming Single Query tools Ostress SQL Query Stress Database tools HammerDB Instance Tools Distributed Replay OStress

Distributed Replay Microsoft supplied and supported Debuted SQL Server 2012 Uses Profiler Trace to capture a workload Must capture from SQL 2005 or later Similar to replaying trace Playback against a different server Can be played through multiple clients simultaneously Any number from 1 through 16

Distributed Replay

Distributed Replay Use Cases Installation & Configuration Test SQL Version upgrade Test Windows/SQL service packs/cumulative updates/patches Test hardware upgrades Test virtualization Provide load for performance testing When multiple replay clients are needed Installation & Configuration Installs from SQL Server installation media Use local or domain service accounts Firewall exceptions may be needed

Distributed Replay Requirements Usage All logins/users contained in trace data must be present in the same database on target Must have same permissions Database IDs ideally should match, matching can be performed by database name if present in trace Usage Create new trace using the TSQL – Replay template Capture workload & save trace Preprocess the trace files to prepare for distributed clients Replay against target server using 1 or more clients

Distributed Replay Reference Links Overview Installation Usage Forum https://docs.microsoft.com/en-us/sql/tools/distributed-replay/sql-server-distributed-replay Installation https://technet.microsoft.com/en-us/library/ff878239(v=sql.110) https://blogs.msdn.microsoft.com/mspfe/2012/11/08/using-distributed-replay-to-load-test-your-sql- serverpart-1/ https://www.sqlskills.com/blogs/jonathan/installing-and-configuring-sql-server-2012-distributed- replay/ http://www.slideshare.net/stevedxu/sql-server-distributed-replay Usage https://blogs.msdn.microsoft.com/mspfe/2012/11/14/using-distributed-replay-to-load-test-your-sql- serverpart-2/ https://technet.microsoft.com/en-us/library/ff878406(v=sql.110) https://www.sqlskills.com/blogs/jonathan/performing-a-distributed-replay-with-multiple-clients- using-sql-server-2012-distributed-replay/ Forum https://social.technet.microsoft.com/Forums/sqlserver/en-US/home?forum=sqldru

OSTRESS Part of RML Utilities Command prompt based Multi-threaded Can be used as part of a script Multi-threaded ODBC based Simulates multiple connections Is able to replay trace files or run scripts

OSTRESS In-line query Query from file All the script files in a folder ostress -E -d"StackOverflow" -Q"select U.Reputation, C.Text from dbo.Users as U inner join dbo.Comments as C on U.Id = C.Id" -n"10" - o"C:\temp“ Query from file Ostress.exe –ic:\AmitStresTest\stress_01.sql –n200 –r2000 –oc:\ AmitStresTest \output (sample from SQLServergeeks.com) All the script files in a folder Ostress.exe –ic:\temp\*.sql – n100 – r1000 –oc:\temp\output (sample from SQLConsulting.com)

OSTRESS OStress Replay Control Agent (ORCA) Conceptually similar to Distributed Replay Requires same hardware architecture and version of RML Utilities Use the OStress control.ini to point to ORCA server

OSTRESS Background and link to installer ORCA and OStress https://support.microsoft.com/en-us/help/944837/description-of-the-replay- markup-language-rml-utilities-for-sql-server ORCA and OStress https://blogs.msdn.microsoft.com/psssql/2009/01/23/inf-multi-machine- replay-using-orca-and-ostress/ Miscellaneous https://www.brentozar.com/archive/2017/02/simulating-workload-ostress- agent-jobs/ https://www.sqlshack.com/sql-server-stress-testing-using-ostress/

SQL Query Stress Originally written by Adam Machanic Maintained by Erik Ejlskov Jensen Single exe GUI based tool to run one query multiple times Able to run multiple times on the same machine

SQL Query Stress Reference links GitHub https://github.com/ErikEJ/SqlQueryStress Too many references to link on Adam Machanic’s site http://sqlblog.com/blogs/adam_machanic

Benchmark TPC Non-profit organization founded to define transaction & database benchmarks http://www.tpc.org/default.asp TPC-C OLTP Benchmark Simulates complete computing environment Users execute transactions against a database http://www.tpc.org/tpc_documents_current_versions/pdf/tpc-c_v5.11.0.pdf TPC-H Decision Support Benchmark Business oriented ad hoc queries and concurrent data modifications http://www.tpc.org/tpc_documents_current_versions/pdf/tpc-h_v2.17.3.pdf

HammerDB Open source Load test/benchmarking tool Not official TPC scoring GUI based graphical database Limits command line functionality Customizable workloads, if you know TCL Not just for SQL Server Oracle DB2 PostgreSQL MySQL Redis Trafoion

HammerDB Usage Change BENCHMARK to MS SQL Server Schema Build Set name of server Can change name of database, but the target must be empty Adjust number of warehouses & users to build warehouses Double click build Driver Script Set database connection Set number of transactions per user or the length of the test in time Double click load Click green arrow to run test

HammerDB Reference http://www.hammerdb.com/index.html All documentation can be found on the site

Questions?