Database Monitoring with BusyBee Agenda  What is BusyBee ?  Architecture  XML Configuration File  Domain Inspectors  Alert Examples  Interface to.

Slides:



Advertisements
Similar presentations
MQ Series Cross Platform Dominant Messaging sw – 70% of market Messaging API same on all platforms Guaranteed one-time delivery Two-Phase Commit Wide EAI.
Advertisements

Module 13: Performance Tuning. Overview Performance tuning methodologies Instance level Database level Application level Overview of tools and techniques.
DBA Intranet Web - based monitoring tool Jan Dryak System Support Specialist - DBA Informix DHL Information Services (Europe) s.r.o. Session A04 Day 4/22.
Self-Validation Tech Guide
Module 20 Troubleshooting Common SQL Server 2008 R2 Administrative Issues.
© 2012 IBM Corporation What’s new in OpenAdmin Tool for Informix? Erika Von Bargen May 2012.
Computer Monitoring System for EE Faculty By Yaroslav Ross And Denis Zakrevsky Supervisor: Viktor Kulikov.
Manageware For Documentum ESI SOFTWARE 2006
ManageEngine TM Applications Manager 8 Monitoring Custom Applications.
What is SDM? SDM : Server and Database Monitoring  SDM is the web-based real-time server and database monitoring and reporting tool  Service Items Server.
1 - Oracle Server Architecture Overview
Performed by:Gidi Getter Svetlana Klinovsky Supervised by:Viktor Kulikov 08/03/2009.
SONG – Stellar Observations Network Group - The robotic software for the SONG network S.Frandsen 1, Eric Weiss 1, J. Skottfelt 2, M.F. Andersen 1, F.Grundahl.
1 I/O Management in Representative Operating Systems.
1 © 2006 Cisco Systems, Inc. All rights reserved. Session Number Presentation_ID Cisco Technical Support Presentation Using the Cisco Technical Support.
Sharepoint Portal Server Basics. Introduction Sharepoint server belongs to Microsoft family of servers Integrated suite of server capabilities Hosted.
© 2009 GroundWork Open Source, Inc. PROPRIETARY INFORMATION: Information contained herein is not for use or disclosure outside of GroundWork Open Source,
1 Copyright © 2005, Oracle. All rights reserved. Introduction.
Today’s Agenda Chapter 12 Admin Tasks Chapter 13 Automating Admin Tasks.
Module 15: Monitoring. Overview Formulate requirements and identify resources to monitor in a database environment Types of monitoring that can be carried.
© 2011 IBM Corporation 11 April 2011 IDS Architecture.
Module 8: Server Management. Overview Server-level and instance-level resources such as memory and processes Database-level resources such as logical.
NSDI/NBII Clearinghouse Server Training Slide 1 NSDI/NBII Clearinghouse Server Training Yellowstone to Yukon Initiative 7. December University of.
Monitoring Scale-Out with the MySQL Enterprise Monitor Andy Bang Lead Software Engineer MySQL-Sun, Enterprise Tools Team Wednesday, April 16, :15.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
DBSonar - Slice and Dice Performance Tuning and Management for IDS 7.x, 9.x and 10.x Eric Lam CTO/Cobrasonic.
LSC Segment Database Duncan Brown Caltech LIGO-G Z.
Instant Messaging for the Workplace A pure collaborative communication tool that does not distract users from their normal activities.
Jordan Bruce I07 – Open Source and IDS Major Canadian Retail Drugstore’s Prescription For Success Tuesday 3 rd October :15 – 16:15.
The Pipeline Processing Framework LSST Applications Meeting IPAC Feb. 19, 2008 Raymond Plante National Center for Supercomputing Applications.
Instant Messaging for the Workplace A pure collaborative communication tool that does not distract users from their normal activities.
1 Apache. 2 Module - Apache ♦ Overview This module focuses on configuring and customizing Apache web server. Apache is a commonly used Hypertext Transfer.
Informix IDS Administration with the New Server Studio 4.0 By Lester Knutsen My experience with the beta of Server Studio and the new Informix database.
Module 10: Monitoring ISA Server Overview Monitoring Overview Configuring Alerts Configuring Session Monitoring Configuring Logging Configuring.
Improved Scripting of IDS Alarms and Events Thomas Horner Senior DBA/S1 Corporation Informix User Forum 2005 Moving Forward With Informix Atlanta, Georgia.
3 rd Party Integration – Paxton Apr, Agenda Solution Partner Introduction Integration Introduction Product Demo Technical Issue Escalation Quick.
TWSd - Security Workshop Part I of III T302 Tuesday, 4/20/2010 TWS Distributed & Mainframe User Education April 18-21, 2010  Carefree Resort  Carefree,
INFN-GRID Testbed Monitoring System Roberto Barbera Paolo Lo Re Giuseppe Sava Gennaro Tortone.
SQLRX – SQL Server Administration – Tips From the Trenches SQL Server Administration – Tips From the Trenches Troubleshooting Reports of Sudden Slowdowns.
Sonic EventMonitor Monitoring your Sonic environment Tako Grijpma Progaia Resource Solutions 09 november 2006.
© 2008 IBM Corporation November 17, 2015 Informix Administration Overview John F. Miller III March 2008.
Consulting Services JobScheduler Architecture Decision Template Information for Consulting Parties Information for Consulting Parties.
© 2007 OPNET Technologies, Inc. All rights reserved. OPNET and OPNET product names are trademarks of OPNET Technologies, Inc. An Open Source ARM 4 Implementation.
1 MSRBot Web Crawler Dennis Fetterly Microsoft Research Silicon Valley Lab © Microsoft Corporation.
Processes & Threads Introduction to Operating Systems: Module 5.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
Windows Server 2003 系統效能監視 林寶森
Benchmark 2 progress report and future directions Sergey Lyskov
Introduction Contain two or more CPU share common memory and peripherals. Provide greater system throughput. Multiple processor executing simultaneous.
Status of tests in the LCG 3D database testbed Eva Dafonte Pérez LCG Database Deployment and Persistency Workshop.
EGEE is a project funded by the European Union under contract IST Installation and configuration of gLite services Robert Harakaly, CERN,
Analyzing Code with CAST RPA SCAN. IDENTIFY. ACT..
3 Copyright © 2004, Oracle. All rights reserved. Database Architecture Comparison.
Monitoring Dynamic IOC Installations Using the alive Record Dohn Arms Beamline Controls & Data Acquisition Group Advanced Photon Source.
Oracle Database Architectural Components
APACHE Apache is generally recognized as the world's most popular Web server (HTTP server). Originally designed for Unix servers, the Apache Web server.
Slide 1. Reality V12 Slide 3 Reality V12 - Headlines Web Services & XML External File Integration Fast Backup and Recovery Windows Printer Support Reality.
The Holmes Platform and Applications
SAP Performance Tuning
File System Implementation
IBM INFORMIX online Training in Hyderabad
Time Gathering Systems Secure Data Collection for IBM System i Server
Backup Monitoring – EMC NetWorker
Backup Monitoring – EMC NetWorker
APACHE WEB SERVER.
TN19-TCI: Integration and API management using TIBCO Cloud™ Integration
Web Application Development Using PHP
Presentation transcript:

Database Monitoring with BusyBee Agenda  What is BusyBee ?  Architecture  XML Configuration File  Domain Inspectors  Alert Examples  Interface to SystemManagement Platform  OS-/ Databaseserver-Support  Future Plans  BusyBee Links BusyBee Overview April 28, consulting.de Slide 1

What is BusyBee ?  Free of charge Database Monitoring Solution for IBM Informix Dynamic Server and IBM DB2 UDB  Multi-Process-Architecture where each subprocess inspects an individual Database Domain  Easy customization of individual thresholds and time intervals thru an XML configuration file  Early Warning System with 4 escalation levels (Warning, Minor, Critical and Fatal)  Simple integration with existing System Management Platforms thru a userexit mechanism BusyBee Overview April 28, consulting.de Slide 2

Architecture I  BbWatch is the daemon process which runs in the background  According to the XML configuration file BbWatch forks several independent Domain Inspectors  Each Domain Inspector is fully configurable: Wakeup Interval Threshold Values (Warning, Minor, Critical, Fatal) Include/Exclude Search Patterns External script which should be triggered (userexit)  Signal Handling implemented to re-start (SIGHUP) or shutdown (SIGTERM) these Domain Inspectors BusyBee Overview April 28, consulting.de Slide 3

BusyBee Overview April 28, consulting.de Architecture II (BbWatch Daemon) BbWatch Master Daemon /BusyBee/etc/BbWatchIfxCfg..x ml Inspector Domain Inspector DbmStatusCheck Fork individual Domain Inspectors. Each Inspector observes an individual Database Resource. Inspector Domain Inspector DbspaceFullChec k Inspector Domain Inspector OnlineLogCheck Domain Inspector Other Parse the XML configuration file. IDS Utility (onstat) Observe the IDS Message Logfile FileParsing (online.log) Check Databaserv er Availability SQL-Query (DB sysmaster) Check filling degree of Dbspaces Slide 4

BusyBee Overview April 28, consulting.de Architecture III (Domain Inspector) Inspector Domain Inspector DbspaceFullChec k 1 10m % /bin/alert.ksh /BusyBee/etc/BbWatchIfxCfg..xml SQL-Query (DB sysmaster) Write status information to logfile Check filling degree of Dbspaces /BusyBee/log/BbWatch..l og /bin/alert.sh Trigger external script if anyone of the configured thresholds is exceeded. Arguments delivered to external script: (1) Instance Name (2) Domain Name (3) Severity (Warning, Minor,...) (4) Messagetext Get configuration information from XML config file Slide 5

XML Configuration File I An individual XML Configuration File has to be created for each IBM IDS or DB2 UDB instance:  /BusyBee/etc/BbWatchIfxCfg..xml  /BusyBee/etc/BbWatchUdbCfg..xml Each Domain Inspector has a separate section inside this XML ConfigFile which contains individual settings:  Domain Inspector Enabled/Disabled  Time Interval (can be specified in sec, min, hours, days)  Threshhold Values (Warning, Minor, Critical, Fatal)  External Script to be triggered (Examples included)  Individual settings depending on the Domain Inspector BusyBee Overview April 28, consulting.de Slide 6

XML Configuration File II BusyBee Overview April 28, consulting.de 1 10m % /bin/alert.ksh 1 10m /bin/sendMail.ksh 3s 5s 10s 20s Slide 7

Domain Inspectors for IBM IDS I For the IBM Informx Dynamic Server the following Domain Inspectors are currently implemented: DbmStatusCheck (Is the Instance available) ? LongTxCheck (Is there a long transaction ongoing ?) ConnectCheck (Check Connection to databaseserver) DbspaceFullCheck (Check filling degree of dbspaces) CheckpointCheck (Check the duration of checkpoints) OnlineLogCheck (Parse the 'online.log' for configured patterns) LogFullCheck (Are the logical logs filled ?) MaxExtentCheck (Check number of extents per table/fragment) MaxPageCheck (Check the number of allocated pages) SessionLockCheck (Check number of locks per db session) BusyBee Overview April 28, consulting.de Slide 8

Domain Inspectors for IBM IDS II VirtualSegmentCheck (Check number of alloc. virt. SHM segm.) DbspaceDownCheck (Is any Dbspace in 'down' state ?) ChunkDownCheck (Is any Chunk in 'down' state ?) SessionMemoryCheck (Check allocated memory per db session) ForegroundWriteCheck (Check number of foreground writes) DeadLockCheck (Check number of deadlocks occured) ReadCacheCheck (Check the current read cache rate) WriteCacheCheck (Check the current write cache rate) SequentialScanCheck (Check for sequential scans on tables) ReadyQueueCheck (Check the utilization of the ready queue) BusyBee Overview April 28, consulting.de Slide 9

Domain Inspectors for IBM DB2 UDB Available in Q3/2003 BusyBee Overview April 28, consulting.de Slide 10

Alert Examples Here is an short excerpt of the BusyBee Logfile: :54:57 iif930 INFO BBWHIFX004 Inspecting Domain [DbmStatusCheck] :55:30 iif930 MINOR BBWHIFX008 Domain [VirtualSegmentCheck], Number of allocated Virtual SHM Segments is [4] :55:30 iif930 WARNING BBWHIFX025 Domain [WriteCacheCheck], Current Write Cache Rate is: [80.60] % :55:31 iif930 MINOR BBWHIFX006 Domain [DbspaceFullCheck], Dbspace [idxdbs] is [79]% full :55:31 iif930 CRITICAL BBWHIFX006 Domain [DbspaceFullCheck], Dbspace [datadbs] is [82] % full BusyBee Overview April 28, consulting.de Slide 11

SystemManagement Interface BusyBee could be easily integrated with existing SystemManagement Platforms like CA Unicenter, IBM Tivoli, HP/OpenView or BigBrother thru the 'userexit' mechanism, for example:  /usr/bin/sendOpenView.ksh This entry in the XML ConfigFile instructs BusyBee to call the script /usr/bin/sendOpenView.ksh as soon as anyone of the configured thresholds has been exceeded. Arguments to sendOpenView.ksh are:  Domain Name (like 'DbspaceFullCheck' or 'CheckpointCheck')  Severity (Warning, Minor, Critical, Fatal)  Instance Name (the name of the Informix or DB2 UDB instance)  Messagetext (The full text of the BusyBee message) BusyBee Overview April 28, consulting.de Slide 12

OS-/Databaseserver-Support BusyBee is available on the all UNIX based platforms where Python could be ported to. For popular platforms like AIX, HP/UX, Linux and Solaris there exists binary distributions of Python. BusyBee supports the following databaseservers on these platforms: IBM Informix IDS 7.x IBM Informix IDS 9.x IBM DB2 UDB 7.x (available in Q3/2003) IBM DB2 UDB 8.x (available in Q3/2003) BusyBee Overview April 28, consulting.de Slide 13

Future Plans For future releases of BusyBee the following enhancements are planned:  Add additional Domain Inspectors for IBM Informix Dynamic Server and IBM DB2 UDB  Support the OpenSource databaseserver MySQL  Provide a data collector module (BbPerf) which collects performance and operational data  Provide a web based interface for analyzing the data collected by BbPerf BusyBee Overview April 28, consulting.de Slide 14

BusyBee Links The following links might be intesting:  (BusyBee MainPage containing Documentation, FAQ, Release-History and Download Information)  (MainPage of the Python Project)  (Precompiled Python Binaries for the Solaris OS)  (Precompiled Python Binaries for the AIX OS)  For additional information feel free to contact me via BusyBee Overview April 28, consulting.de Slide 15