Patrick Partin What just happened?

Slides:



Advertisements
Similar presentations
© 2008 Quest Software, Inc. ALL RIGHTS RESERVED. Perfmon and Profiler 101.
Advertisements

House of tails dogs charity All donations go 100% to the charity #MMSGIVEBACK.
PowerApps and Microsoft Flow for SharePoint Developers Brian T. Jackett Sr. Premier Field Engineer, Microsoft.
Network measurements with InfluxDB
Let’s Get Started! Steve Rezhener SQL Malibu and SQL Saturday in LA
Power BI Internals Eugene
Make Power BI Your Own with the Power BI APIs
5/22/2018 1:39 AM BRK2156 Power BI Report Server: Self-service BI and enterprise reporting on-premises Christopher Finlan Senior Program Manager © Microsoft.
David Taylor, Pimp my spreadsheet, FAST LANE BI
Microsoft /2/2018 3:42 PM BRK3129 Query Big Data using the Expanded T-SQL footprint with PolyBase in SQL Server 2016 Casey Karst Program Manager.
Make Power BI Your Own with the Power BI APIs
Solving the Hard Problems
SSIS Project Deployment: The T-SQL Way
Deploying and Configuring SSIS Packages
Managing Documents on the Web Using Drupal, Alfresco & Cloud
Simplifying XEvents Management with dbatools
Auditing in SQL Server 2008 DBA-364-M
Make Power BI Your Own with the Power BI APIs
SharePoint Saturday Omaha April 2016
Introducing the SQL Server 2016 Query Store
Introducing the SQL Server 2016 Query Store
Tips for SQL Server Performance and Resiliency
Database Code Management with VS 2017 and RedGate
Populating a Data Warehouse
Populating a Data Warehouse
Save Time & Resources: Job Performance Tuning Strategies
It’s About Time : Temporal Table Support in SQL Server 2016/2017
Easy Website Creation Using WordPress
Transforming Your Brain with SQL 2017 on Linux
dbatools - PowerShell and SQL Server Working Together
Task recorder in Dynamics AX
Introducing the SQL Server 2016 Query Store
Stop Wasting Time & Resources: Performance Tune Your Jobs
SSIS Project Deployment: The T-SQL Way
Make Power BI Your Own with the Power BI APIs
Populating a Data Warehouse
Visual Studio Database Tools (aka SQL Server Data Tools)
SQL Saturday #662 - Sioux Falls, SD Hosted by (605) SQL
Populating a Data Warehouse
The Mac DBA, using Docker and SQL Operations Studio
Let’s Get Started! Rick Lowe
Microsoft Azure for SQL Server Professionals
PowerShell & PowerBi Reducing DBAs Context Switching
PowerShell & PowerBi Reducing DBAs Context Switching
Designing SSIS Packages for Performance
SQL Saturday San Diego #802
Chris Harris Program Manager Microsoft Corporation
Patrick Flynn | Link Group Australia
Moving from SQL Profiler to xEvents
Git started with git: 2018 edition
Crimson® 3.1 Updates January 2019.
Collecting Performance Metrics
Power BI.
Have you seen this screen?
Use PowerShell & dbatools to Manage your SQL Server Environment
5/3/2019 Desktop Virtualization Corey Hynes Kyle Rosenthal President Technical Lead HynesITe Inc Spider Consulting @windowspcguy.
Michael Wall Senior DBA, Great Western Malting
Managing and monitoring SQL Server on Linux from the command line
Michelle Haarhues Keeping up with SSMS.
The Fast and Easy Methods to Automate your SQL Server builds
Welcome to 2019 SQL Saturday in Los Angeles (#891)
SSRS – Thinking Outside the Report
Patrick Partin What just happened? Creating your own real-time dashboard with Grafana, Influx, and Telegraf Congratulations on successfully downloading.
Simplify your daily tasks with DBATools!
Mastering Master Data Services
Power BI Security Fundamentals
Brodie Brickey SSIS Basics.
Do-It-Yourself Performance Monitoring
Simplify your daily tasks with DBATools!
Patrick Partin What just happened?
Presentation transcript:

Patrick Partin What just happened? Creating your own real-time dashboard with Grafana, Influx, and Telegraf Congratulations on successfully downloading this slide deck! Inside is valuable information, and since there’s absolutely no cost other than your time, why not try it out?

Session Agenda Influx Telegraf Grafana Install and Configure it to store your data Telegraf Install and Configure to pull and push to Influx Grafana Install and Configure to pull from Influx Create a few simple Dashboards Create an Alert that when triggered, posts to Slack Note to Self - Before you get started, extract that Grafana.zip because it has like 15k tiny files and depending on the day, might take 2 mins unlike the others. 2 | #SQLSatLA

Background Patrick Partin Admin, Architect, DBA, Developer, Engineer Manager of Data and Systems Infrastructure at SmartDrive @GingerDBA – Twitter @Paddyrick – SQLCommunity.Slack.com You could go on and on, but they’re here for the information, not the backstory. Shut up, move on. 3 | #SQLSatLA

Please Support Our Sponsors SQL Saturday in Los Angeles is made possible with the generous support of these sponsors. You can support them by opting-in and visiting them in the sponsor area. #SQLSatLA

Orange County User Group Orange County Power BI User Group Regional Local User Groups LA Data Platform (a.k.a. SQL Malibu) 3rd Wednesday of each month ladataplatform.pass.org - Join us remotely! L.A. User Group 3rd Thursday of each odd month sqlla.pass.org Los Angeles - Korean Every Other Tuesday sqlangeles.pass.org San Diego User Group 1st & 3rd Thursday of each month meetup.com/sdsqlug meetup.com/sdsqlbig Orange County User Group 2rd Thursday of each month bigpass.pass.org Orange County Power BI User Group meetup.com/OC-Power-BI-User-Group/ Sacramento User Group 1st Wednesday of each month http://sac.pass.org/ #SQLSatLA

Regional 2019 SQL Saturday events SQL Saturday in Sacramento When: August 17, 2019 Where: Patrick Hays Learning Center https://www.sqlsaturday.com/885 #SQLSatSac #SQLSat885 SQL Saturday in San Diego When: September 21, 2019 Where: San Diego – UCSD Extension Center, University Center https://www.sqlsaturday.com #SQLSatSanDiego #SQLSat909 #SQLSatLA

If you want to follow along… Influx 1.7.6 (April 17th) – 48mb Telegraf 1.11 (June 11th) – 19mb https://portal.influxdata.com/downloads/ Grafana (June 5th) – 52mb https://grafana.com/get/ Slack (often?) – 0mb https://slack.com/create/ Today, I will show you this starter set which works, I swear. The beauty of this, is that it’s so flexible, and can work with anything as you may become more polyglot. 7 | #SQLSatLA

Why are we doing this? In all seriousness, knowing your data is important. Having the ability to capture, track, and display is relatively easy, and shouldn’t be a blocker to your success. #SQLSatLA

Data Acquisition Push/Pull Data Storage Time Structured Merge Tree Data Visualization Alerting Monitoring

Getting to know our lab, Chooch and Halladay Connect to Chooch, push Perf Counters Chooch:8086 Connect to Halladay, grab DMVs Macbook-Pro:3000 Run Influx queries, pull JSON to display metrics, call Slack 10 | #SQLSatLA

Install InfluxDB Demo Pretty much straight out of the box. Run InfluxD.exe in a command prompt window, and the Influx.exe in another. #SQLSatLA

InfluxDB Quickies CasE SenSITiVe select * X LIMIT 5 instead of select TOP 5 * X Influx < - > SQL speak Measurements < - > Table Series < - > Columns Tag – Optional Metadata that’s indexed Field – Required metadata that’s not indexed Can’t do epoch conversions in your head? Precision rfc3339 There is soooooooo much more about this database that I love and wish that I could cover, but 60 minutes only gives so much coverage. Please do go to their website and read their well documented documentation and community forums. #SQLSatLA

Install Telegraf Demo A little less much straight out of the box. Run Telegraf.exe in a command prompt window, but do a little config on the telegraf.conf. Chooch is connecting to Halladay using the mssql input. Halladay will have Telegraf pushing to Chooch with some Perf Counters, including SSAS. #SQLSatLA

Telegraf Quickies Telegraf can push and pull We pulled from SQL Server We pushed SSAS Metrics from the SQL Server Database was created on the fly Measurements were created on the fly typeperf –q Dumped all of the hosts’s perf counters These differ between hosts and configurations This is such a fantastic program, and I cannot stress it enough. This has such amazing community support, amazing to see how much it has grown in just the few years I’ve been doing this talk. #SQLSatLA

Install Grafana Demo This program is so seriously sweet. This space is getting crowded, but it’s awfully hard to find something better. #SQLSatLA

Grafana Quickies In \conf, copy sample.ini to custom.ini Uncomment out the port, it defaults to 3000 Know your data! Ever-increasing counter? Perhaps Derivative? Non-Negative? Grab a Slack, it’s free! This is such a fantastic program, and I cannot stress it enough. This has such amazing community support, amazing to see how much it has grown in just the few years I’ve been doing this talk. #SQLSatLA

Wrapping it all up - We were able to stand up a server to take metrics We were able to push and pull metrics from Perf Counters and Inputs We were able to run some basic queries inside Influx to see how it looked We were able to create some simple dashboards, and configure thresholds and alerts 17 | #SQLSatLA

More Information - Telegraf does LOTS more than I covered https://github.com/influxdata/telegraf#input-plugins https://github.com/influxdata/telegraf#output-plugins Grafana has plenty of generic dashboards https://grafana.com/dashboards/ https://www.youtube.com/watch?v=sKNZMtoSHN4 SQL Server 2017 Developer Edition (free!) https://go.microsoft.com/fwlink/?linkid=853016 If serving from Windows, you’ll need NSSM https://nssm.cc/ 18 | #SQLSatLA

Not covered, but perhaps helpful DBATools.io Powershell pretty much everything https://ramblingcookiemonster.github.io/PSSlack/ Write into Slack from Powershell #SQLSatLA

Questions? If not, catch me after the session, or on the interwebs… Thank you! 20 | #SQLSatLA