1. TANGO MONITORING SYSTEM
ELI BEAMLINES, Dolní Břežany, Česká republika, 07.06
Michał Gajda
National Synchrotron Radiation Center SOLARIS

2. M/Monit – monitoring tool watching over your hosts
Table of Contents
M/Monit – monitoring tool watching over your hosts
ABRT – monitoring tool reporting crashes of applications
Splunk-light – monitoring and collecting tool for device logs

3. Difference between Monit and M/Monit Easy to install Easy to configure
Easy to use
Permanent license

4. What can it monitor? System Services Clustering Services RAID
Monit - possibilities
What can it monitor?
System Services
Clustering Services
RAID
Name Services
FTP Services
WWW Services
Mail Services
Files and directories
and more…

5. Monit instance on one of our host
Monit – use case
Monit instance on one of our host

6. Monit - configuration
Examplary Monit configuration file:
Setting polling
Logging system
Setting port, address of http interface
Login and password to access http interface
Eventqueue directory
Setting M/Monit instance
Setting system monitoring
Setting network interface to monitor

7. Extends Monit capabilities Manages Monit instances
M/Monit
M/Monit:
Extends Monit capabilities
Manages Monit instances
Collects data from Monit instances
Storage for Monit instances

8. Quick status overview: Hosts status Events from 24-hours period
M/Monit – dashboard
Quick status overview:
Hosts status
Events from 24-hours period
Active errors and warnings

9. M/Monit - use case

10. Events history for host/host groups sorted by: Service group
M/Monit - use case
Events history for host/host groups sorted by:
Service group
Service type
Event type
Period of time

11. Network incoming/outgoing
M/Monit - use case
Statistics:
CPU % usage
Memory % usage
Disk read [bytes/s]
Process threads
Process children
Network incoming/outgoing

12. M/Monit - use case

13. ABRT – automatic bug reporting tool
Free Linux tool for crash reporting
Easy to install and configure
Can catch and send crash reports from various applications and send them via

14. What can it report: Java crashes Python crashes C/C++ crashes
ABRT – possibilities
What can it report:
Java crashes
Python crashes
C/C++ crashes
Ruby crashes
Kernel crashes
Xorg crashes

15. After ABRT installation:
ABRT – configuration
After ABRT installation:
Install addons(python, java, etc.) from Linux repository
Allow core dumps, from cli: ulimit –c unlimited
Configure libreport mailx plugin to send an /etc/libreport/plugin/mailx.conf:
Configure mail transfer agent(MTA) to send via mail server

16. ABRT – use case
Examplary from ABRT
includes:
Abrt version
Analyzer
Architecture
Core backtrace
Cmdline
Count
Duphash
Last occurance
Reason
Environment variables
And more…

17. Splunk-light free – possibilities and limitations
Used for:
Real time log monitoring
Log acquisition
Log analyzation
Log visualisation
Log buckets rotation

18. Splunk-light free – installation
Download and install Splunk-light i.e using .rpm file
Start Splunk-light from /opt/splunk/bin:

19. Splunk-light free - splunkforwarder
Download, install and configure splunkforwarder on each host to send data to splunk indexer(database):
Install splunkforwarder from .rpm file
Configure splunk forwarder, from cli /opt/splunkforwarder/bin:

20. Splunk-light free – Tango devices
Before collecting logs from splunk:
Configure logging level for devices
Configure logging target for devices
Configure rolling file threshold(RFT- 20MB default)

21. Splunk-light free - possibilities
Splunk-light features:
Searches
Hosts
Sources
Sourctypes
Patterns
Reports
Errors
Dashboards
Charts
Tables
and more…

22. Splunk-light free – dashboard
Possibility to create custom dashboards to visualize data inputs:
Charts
Tables
Gauges
Single values
Maps

23. Splunk-light free – use case
Custom dashboard to visualize specific data

24. Splunk-light free – use case
Ramping procedure example:
Search from last hour
Over logs in 5 minutes

25. Splunk-light free – use case
Quick log analyzation:
Checking log levels

26. Splunk-light free – use case
Results:
224 error logs

27. Splunk-light free – use case
Checking patterns to see errors scale

28. Thank you for your attention
Questions