Revolutionize IT Operations Management with Real Time Big Data

Slides:



Advertisements
Similar presentations
NetApp OnCommand Management Software
Advertisements

Windows IT Pro magazine Datacenter solution with lower infrastructure costs and OPEX savings from increased operational efficiencies. Datacenter.
CA Infrastructure Management Solving IT’s Most Complex Problems.
System Center 2012 R2 Overview
DevOps and Private Cloud Automation 23 April 2015 Hal Clark.
Automating Datacenter Using System Center 2012 Harpreet Singh Rana Consultant Microsoft Corporation MGT328.
© 2009 VMware Inc. All rights reserved VMworld Update Ian Moore - Country Manager Ireland ie.linkedin.com/in/iantmooreiantmoore.
© 2014 VMware Inc. All rights reserved. DevOps using OpenStack Getting Started Trevor Roberts Jr., Sr. Technical Marketing Manager Santhosh Sundararaman,
AppDynamics Ohio User Group. What is ExactTarget? Software as a Service Marketing 500 million s sent a day 200 million web transactions a day.
IBM Bluemix Ecosystem Development Hands on Workshop Section 1 - Overview.
VMware vRealize Operations Management Pack for Citrix XenDesktop & XenApp.
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 1 Automate your way to.
System Center Lesson 4: Overview of System Center 2012 Components System Center 2012 Private Cloud Components VMM Overview App Controller Overview.
Capacity Planning Plans Capacity Planning Operational Laws
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Computing Facilities CERN IT Department CH-1211 Geneva 23 Switzerland t CF Agile Infrastructure Monitoring HEPiX Spring th April.
Cisco Consulting Services for Application-Centric Cloud Your Company Needs Fast IT Cisco Application-Centric Cloud Can Help.
1 Delivering on the Promise of a Virtualized Dynamic Data Center Hosted by GTSI and Cisco.
Module Objectives At the end of the module, you will be able to:
FlexPod Converged Solution. FlexPod is… A prevalidated flexible, unified platform featuring: Cisco Unified Computing System™ Programmable infrastructure.
1 Jason Shepard – Managing Principal – Cresna MCS Bernd Harzog – CEO – OpsDataStore Dave Wagner – CTO – OpsDataStore ITOM 1.1 Application Performance Management.
READ ME FIRST Use this template to create your Partner datasheet for Azure Stack Foundation. The intent is that this document can be saved to PDF and provided.
SAS® Viya™ Overview ANDRĖ DE WAAL, GLOBAL ACADEMIC PROGRAM
Platform as a Service (PaaS)
Delivering on the Promise of a Virtualized Dynamic Data Center
Run Azure Services in your datacenter
Service Assurance in the Age of Virtualization
Univa Grid Engine Makes Work Management Automatic and Efficient, Accelerates Deployment of Cloud Services with Power of Microsoft Azure MICROSOFT AZURE.
Agenda:- DevOps Tools Chef Jenkins Puppet Apache Ant Apache Maven Logstash Docker New Relic Gradle Git.
Organizations Are Embracing New Opportunities
Platform as a Service (PaaS)
Platform as a Service (PaaS)
BMC Integration Service Overview and Architecture
Infrastructure Health Assessment
Connecting the world of software delivery
Hybrid Management and Security
Microsoft Operations Management Suite Insight and Analytics
Docker Birthday #3.
StratusLab Final Periodic Review
StratusLab Final Periodic Review
Free Cloud Management Portal for Microsoft Azure Empowers Enterprise Users to Govern Their Cloud Spending and Optimize Cloud Usage and Planning MICROSOFT.
HPE Synergy.
Nimble Streamer Helps Media Content Providers Create Streaming Networks Cost-Effectively and Easily by Utilizing Azure’s Worldwide Scalability MICROSOFT.
Red Hat User Group June 2014 Marco Berube, Cloud Solutions Architect
ONAP Amsterdam Architecture
Cisco Hybrid Cloud Infrastructure
Key Metrics and Practices for Monitoring Virtualization Platforms
Oscar AP by Massive Analytic: A Precognitive Analytics Platform for Effortless Data-Driven Decisions. Now Available in Azure Marketplace MICROSOFT AZURE.
Designed for Big Data Visual Analytics, Zoomdata Allows Business Users to Quickly Connect, Stream, and Visualize Data in the Microsoft Azure Platform MICROSOFT.
Yellowfin: An Azure-Compatible Business Intelligence Platform That Connects People with Their Data for Better Decision Making MICROSOFT AZURE APP BUILDER.
Logsign All-In-One Security Information and Event Management (SIEM) Solution Built on Azure Improves Security & Business Continuity MICROSOFT AZURE APP.
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Microsoft Ignite NZ October 2016 SKYCITY, Auckland.
Adra ACCOUNTS: Transaction Matching Software Powered by the Microsoft Azure Cloud That Helps Optimize the Accounting and Finance Processes MICROSOFT AZURE.
Microsoft Virtual Academy
Cloud Analytics for Microsoft Azure
Microsoft Virtual Academy
Abiquo’s Hybrid Cloud Management Solution Helps Enterprises Maximise the Full Potential of the Microsoft Azure Platform MICROSOFT AZURE ISV PROFILE: ABIQUO.
AIMS for BizTalk, Built on the Microsoft Azure Platform, Empowers Enterprises to Automate Insight and Analytics and Boost Value Creation MICROSOFT AZURE.
Microsoft Virtual Academy
Cloud Computing: Concepts
Traditional Virtualized Infrastructure
Microsoft Virtual Academy
Monitor VMware with SC2012 SP1 Operation Manager & Veeam Microsoft Tools for VMware Integration & Migration Symon Perriman Michael Stafford Senior.
Microsoft Virtual Academy
SQL Server Data Mobility
How Dell, SAP and SUSE Deliver Value Quickly
Nolan Leake Co-Founder, Cumulus Networks Paul Speciale
Microsoft Virtual Academy
Presentation transcript:

Revolutionize IT Operations Management with Real Time Big Data Bernd Harzog Founder and CEO

Before Bernd Started OpsDataStore…. Strategy Consultant Product Selection Consultant 2

Our Questions for You Does every system and application that you depend upon work as well as you need it to all of the time? Are you running IT Operations as efficiently and as cost effectively as you need to? Is it easy for you to get IT data and analytics into the hands of key decision makers and business constituents?

Why Not?

Network Complexity

Virtualization Complexity

Application Complexity

What Has Not Worked?

= Blind Dinosaurs! Blind Dinosaur Frameworks made a promise that could not be kept – that one product can monitor everything Frameworks are out of date with respect to current application and infrastructure environments Frameworks stand no chance of keeping up with the accelerating pace of innovation Best of breed tools are replacing the frameworks =

-5.0% 11% share (of a $20B market) lost by the Big 4 went to new best of breed vendors (creating the problem OpsDataStore solves) -4.5% -2.5% Flat -2.0% +3.0% -14.0%

Frameworks Have Been Replaced by Best of Breed Intel Cisco UCS Cisco UCS Arista AppDynamics EMC Cirba AppEnsure AppNeta CSC CSC Big Panda NetApp CloudPhysics Kentik ExtraHop Apteligent OpenStack Netuitive StatsD GigaMon GigaMon Windows VMTurbo GigaMon GigaMon GigaMon INETCO Dynatrace Red Hat Chef Prelert CollectD Linux VMware Riverbed Virtual Inst. New Relic Dell/EMC Puppet Rocana CodaHale VMware Zenoss Sevone GigaMon Riverbed VMware Ansible Moogsoft Apptio ServiceNow Open Source Platforms Ops Mgmt. NPM IPM App Perf. Mgmt Cloud Auto Automation Analytics Financial Mgt. Service Mgt.

Best of Breed Results in Franken-Monitors! Network Monitor Storage Monitor Transaction Monitor Server Monitor Virtualization Monitor OS Monitor IT Operations Log Monitor Franken-Monitors are redundant siloed management tools that do not integrate with each other and that each store their data in their own proprietary datastores Franken-Monitors happened because customers bought best of breed point tools to address gaps left by IBM, BMC, HP and CA Franken-Monitors cannot cope with the rapid pace of change driven by Agile, DevOps, and hybrid/private clouds Franken-Monitors make it impossible for management to keep up with the pace of innovation With Franken-Monitors there is no architecture for management and monitoring Franken-Monitors cost you revenue, reputation and customer retention Container Monitor

An Increasing Pace of Innovation, Diversity, Complexity, and Rate of Change at all Layers of the Stack Rapidly arriving and changing code in production In many different languages In many different run-times and containers Compute Virtualization Network Virtualization Storage Virtualization Everything virtualized Many Clouds Your Cloud Hybrid Cloud Public Cloud

Data Driven IT Operations to the Rescue

The Architecture for Data Driven IT Operations Live Custom Dashboards – Specific to use cases, domains, and user requirements – Choice of BI Tools Visualization End-to-End Monitoring Capacity Analytics Automated Root Cause Automated Remediation IT Operations Analytics Cost Management Use Cases Data Driven IT Operations OpsDataStore Data Platform Physical and Virtual Storage Instrumentation Physical and Virtual Server Instrumentation Physical and Virtual Network Instrumentation Operating System Instrumentation Application and Transaction Instrumentation Data Sources Data Types Data from Management API’s Agent Data Wire Data Synthetic Data Manual and Configuration Data (CMDB)

Instrument for Response time (Latency), Throughput and Congestion at Every Layer Data Sources Transaction and application response time and throughput CPU, memory, network and disk contention (queuing) CPU, memory, network, and disk contention (queuing) Network performance and behavior of network users (apps) WAN performance and End User Experience Latency, throughput and contention Application OpsDataStore IT Operations Analytics Performance Management Capacity Management Service Troubleshooting Live Custom IT Dashboards Server OS Hypervisor Virtualization Network Router/WAN Storage Array

Evaluate Metrics based upon their Value, Breadth of Applicability and Cost to Implement Open Source/Free $ $$ Corvil A AppDynamics A Dynatrace A A Application S Server D Datastore N Network ExtraHop (ITR) A S N D Coda Hale, StatsD A ExtraHop (STD) S N D CollectD (PL) S N D Low Value of the Metric High Datastore HW D VMware VASA D VMware vCenter S D N CollectD S N Intel DCM S Netflow N SNMP N Narrow Breadth of Applicability Ubiquitous

The Solution OpsDataStore The Real-Time Platform for Data Driven IT Operations

Key OpsDataStore Features Open Ingest – collect data from any platform, management tool or API Dynamic Object Model – all data is related at ingest time, stored in a graph database and shown in a topology map Highly Scalable Real Time Back End – designed for infinite horizontal scalability, high ingest rate and low latency queries of metrics and relationships Continuous Data Transformation – into a form usable by BI tools Open Query Architecture – all data and topologies are accessible through ODBC/JDBC Easily Extensible User Interface - user interface (dashboards) built in the leading BI tool (Tableau)

OpsDataStore – Solution Overview Real-Time Fabric for Data Driven IT Operations Cross-Stack & End-To- End Troubleshooting Continuous Capacity Optimization Live Custom IT Dashboards

OpsDataStore Ecosystem and Open Source Strategy Current Collector Platforms VMware Linux Arista Cisco UCS Windows Intel EMC NetApp App Perf. Mgmt Riverbed New Relic AppDynamics Dynatrace AppNeta Apteligent Cirba Ops Mgmt. Zenoss VMware CloudPhysics VMTurbo IPM GigaMon Virtual Inst. INETCO AppEnsure ExtraHop Cloud Auto VMware Dell/EMC Red Hat CSC OpenStack Analytics Rocana Moogsoft Prelert Big Panda Netuitive NPM Sevone Riverbed GigaMon Kentik Open Source CodaHale CollectD GigaMon StatsD Automation Puppet Chef Ansible Financial Mgt. Apptio Service Mgt. ServiceNow OpsDataStore

OpsDataStore Product Architecture Continuous Ingest Configuration Response Time Continuous Processing Real-Time Query Throughput Errors Utilization Any Data Source Capacity AppDynamics Data Transformation Dynatrace Intel DCM VMware ExtraHop Aggregation Query Query Statistical Computation Data Collector SDK Baselining Object Model Anomaly Detection JDBC API ODBC API Streaming Writes RAM DB Graph Database & Low Latency Scale Out Time Series Database

OpsDataStore Object Model – Organizing Streams of IT Operations Data Transaction Application Tier Virtual Server Cluster Data Store Data Center Tenant Physical Server Objects, Metrics, Configuration Items, and Relationships through Time

Dynamic Environments Require Automatically Related Data Servers/Networks/Storage Virtualization Platform VM OS Apps Micro-Services Container JVM Attributes of Dynamic Behavior Continuous unrelated telemetry at each layer Micro-Services causes a proliferation in applications that come and go (Docker, etc.) VM’s and their networks move between hosts driven by automated operations Servers, networks and storage configured dynamically in software (automated provisioning) Implications of Unrelated Data Inconsistent manual tagging cannot keep up with changing relationships and produces erroneous data After the fact discovery cannot be run frequently enough Absence of accurate relationships makes timely root cause analysis impossible Only real-time dynamic topology mapping can keep up

Related Data – Datastore Latency, and the Response Times of the Transactions on those Datastores

Dynamic Map – 1 App on the Server – 1:50 PM

Dynamic Map – 5 Apps on the Server – 2:05 PM

Metrics from the Transaction to the Datastore

Root Cause – CPU Congestion on a Host Causing Slow Transaction Response Time

Root Cause Drill Down – Which VM is Causing the High Contention on the Host (Move it)

Scalable and Automated Capacity Analytics

OPEX Cost Analysis – Hosts Consuming the Most Power 600 550 550 500 450 Maximum Power Consumption (Watts) 400 350 300 250 200

See Anything You Want How you Want it in Tableau Build live dashboards in minutes in your choice of BI tool Empower requesters of IT data with self-service Improve IT decisions

Use Cases for OpsDataStore Platform for Data Driven IT Operations Platform for IT Operations Analytics Platform for end-to-end (transaction to hardware) monitoring and troubleshooting Platform for real-time and continuous capacity analysis Platform for live Custom IT Dashboards

www.opsdatastore.com bernd.harzog@opsdatastore.com Questions? www.opsdatastore.com bernd.harzog@opsdatastore.com Send me an email for a copy of the slides