1 EMC CONFIDENTIAL—INTERNAL USE ONLY SMI-S Performance Overview and Status 8/28/2014.

Slides:



Advertisements
Similar presentations
This slide deck is formatted to 1280 X 800, but some locations will only support 1024 X 768. To modify… Set resolution of slide show while creating it.
Advertisements

13,000 Jobs and counting…. Advertising and Data Platform Our System.
Concurrent programming: From theory to practice Concurrent Algorithms 2014 Vasileios Trigonakis Georgios Chatzopoulos.
EMC PROTECTION FOR MICROSOFT EXCHANGE SERVER 2010
1© Copyright 2013 EMC Corporation. All rights reserved. ACCELERATING MICROSOFT EXCHANGE PERFORMANCE WITH EMC XtremSW Cache EMC VNX Storage and VMware vSphere.
© 2010 VMware Inc. All rights reserved Confidential Performance Tuning for Windows Guest OS IT Pro Camp Presented by: Matthew Mitchell.
Capacity and Chargeback Virtual Appliance for VMware ESX October 23, 2007 Alex Bakman.
1 Magnetic Disks 1956: IBM (RAMAC) first disk drive 5 Mb – Mb/in $/year 9 Kb/sec 1980: SEAGATE first 5.25’’ disk drive 5 Mb – 1.96 Mb/in2 625.
Native Monitoring packsOps Mgr SP1Ops Mgr R2Ops Mgr 2012 Ops Mgr 2012 Feature PacksN/AOps Mgr 2012 Product Ship.
ARP Traffic Study Jim Rees, Manish Karir Research and Development Merit Network Inc.
XENMON: QOS MONITORING AND PERFORMANCE PROFILING TOOL Diwaker Gupta, Rob Gardner, Ludmila Cherkasova 1.
Predicting The Performance Of Virtual Machine Migration Presented by : Eli Nazarov Sherif Akoush, Ripduman Sohan, Andrew W.Moore, Andy Hopper University.
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 11 Managing and Monitoring a Windows Server 2008 Network.
F5 Application Designer Extensions F5 Management Pack
Control and monitoring of on-line trigger algorithms using a SCADA system Eric van Herwijnen Wednesday 15 th February 2006.
Virtual Desktop Infrastructure Solution Stack Cam Merrett – Demonstrator User device Connection Bandwidth Virtualisation Hardware Centralised desktops.
1. Outline Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models 2.
1 © Copyright 2009 EMC Corporation. All rights reserved. Agenda Storing More Efficiently  Storage Consolidation  Tiered Storage  Storing More Intelligently.
SharePoint Farm On Azure IAAS Prepared By : Prakhar Rastogi Premier Field engineer Microsoft India.
Virtualization Licensing Overview VMware and Windows Considerations Mike Matney-Data Center Architect Servers, Storage, and Virtualization.
Nagios and Mod-Gearman In a Large-Scale Environment Jason Cook 8/28/2012.
1 Storage Refinement. Outline Disk failures To attack Intermittent failures To attack Media Decay and Write failure –Checksum To attack Disk crash –RAID.
Report : Zhen Ming Wu 2008 IEEE 9th Grid Computing Conference.
Technology Expectations in an Aeros Environment October 15, 2014.
Computer System Architectures Computer System Software
A Multithreading C# Data Synchronization Program and Its Realization Course: ECE 1747H Parallel Programming Professor: Christiana Amza Student / Presenter:
Virtualization. Virtualization  In computing, virtualization is a broad term that refers to the abstraction of computer resources  It is "a technique.
1EMC CONFIDENTIAL—INTERNAL USE ONLY Why EMC for SQL Performance Optimization.
Improving Disk Latency and Throughput with VMware Presented by Raxco Software, Inc. March 11, 2011.
© 2007 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice BAC 7.x Sizing April 2008.
Uncovering the Multicore Processor Bottlenecks Server Design Summit Shay Gal-On Director of Technology, EEMBC.
Presented by: Mostafa Magdi. Contents Introduction. Cloud Computing Definition. Cloud Computing Characteristics. Cloud Computing Key features. Cost Virtualization.
SSS Test Results Scalability, Durability, Anomalies Todd Kordenbrock Technology Consultant Scalable Computing Division Sandia is a multiprogram.
MClock: Handling Throughput Variability for Hypervisor IO Scheduling in USENIX conference on Operating Systems Design and Implementation (OSDI ) 2010.
1 EMC CONFIDENTIAL—INTERNAL USE ONLY Performance Monitoring &Reporting Gathers all Key Performance Indicators necessary to identify performance problems.
DONE-08 Sizing and Performance Tuning N-Tier Applications Mike Furgal Performance Manager Progress Software
VLBI Storage Manager (VSM) Matteo Stagni – Mauro Nanni 0.
1© Copyright 2012 EMC Corporation. All rights reserved. EMC PERFORMANCE OPTIMIZATION FOR MICROSOFT FAST SEARCH SERVER 2010 FOR SHAREPOINT EMC Symmetrix.
Testing… Testing… 1, 2, 3.x... Performance Testing of Pi on NT George Krc Mead Paper.
Online Music Store. MSE Project Presentation III
© 2011 IBM Corporation Sizing Guidelines Jana Jamsek ATS Europe.
Consolidation and Optimization Best Practices: SQL Server 2008 and Hyper-V Dandy Weyn | Microsoft Corp. Antwerp, March
The Million Point PI System – PI Server 3.4 The Million Point PI System PI Server 3.4 Jon Peterson Rulik Perla Denis Vacher.
1EMC CONFIDENTIAL—INTERNAL USE ONLY FAST VP and Exchange Server 2010 Don Turner Consultant Systems Integration Engineer Microsoft TPM.
1© Copyright 2012 EMC Corporation. All rights reserved. EMC VNX5700, EMC FAST Cache, SQL Server AlwaysOn Availability Groups Strategic Solutions Engineering.
Authors: Danhua Guo 、 Guangdeng Liao 、 Laxmi N. Bhuyan 、 Bin Liu 、 Jianxun Jason Ding Conf. : The 4th ACM/IEEE Symposium on Architectures for Networking.
GigaSpaces XAP - Wiley Introscope Enterprise monitoring server Integration March 2008.
1 Agility in Virtualized Utility Computing Hangwei Qian, Elliot Miller, Wei Zhang Michael Rabinovich, Craig E. Wills {EECS Department, Case Western Reserve.
Web Technologies Lecture 13 Introduction to cloud computing.
Turn Bare Metal Into Silver Lining With SCVMM 2012, Today! Mark Rhodes OBS SESSION CODE: SEC313 (c) 2011 Microsoft. All rights reserved.
Lab Activities 1, 2. Some of the Lab Server Specifications CPU: 2 Quad(4) Core Intel Xeon 5400 processors CPU Speed: 2.5 GHz Cache : Each 2 cores share.
AMGA-Bookkeeping Carmine Cioffi Department of Physics, Oxford University UK Metadata Workshop Oxford, 05 July 2006.
1© Copyright 2012 EMC Corporation. All rights reserved. EMC BACKUP AND RECOVERY FOR MICROSOFT EXCHANGE AND SHAREPOINT 2010 SERVERS EMC Avamar, EMC VNX,
REMINDER Check in on the COLLABORATE mobile app Best Practices for Oracle on VMware - Deep Dive Darryl Smith Chief Database Architect Distinguished Engineer.
Remigius K Mommsen Fermilab CMS Run 2 Event Building.
Martin Pincott, Technical Director. unique requirements + special solutions.
By: Billy Geiger Jordan Howell Project 2. Contents 3 Servers Operating System Firewall Device Switch Server Rack UPS(Uninterruptible Power Supply)
Sergi Rubio Manrique “Archiving System at ALBA”. Tango Meeting. ALBA. October 16 th, MMVIII 1 Archiving ALBA Sergi Rubio Manrique.
The Docker Container Approach to Build Scalable and Performance Testing Environment Pankaj Rodge, VMware.
Virtualization OVERVIEW
Diskpool and cloud storage benchmarks used in IT-DSS
Distributed Network Traffic Feature Extraction for a Real-time IDS
Software Defined Storage
2016 Citrix presentation.
PES Lessons learned from large scale LSF scalability tests
Windows Server 2016 Software Defined Storage
Azure SQL Database - Managing your database on the cloud
Backup Monitoring – EMC NetWorker
Backup Monitoring – EMC NetWorker
Run time performance for all benchmarked software.
Presentation transcript:

1 EMC CONFIDENTIAL—INTERNAL USE ONLY SMI-S Performance Overview and Status 8/28/2014

2 EMC CONFIDENTIAL—INTERNAL USE ONLY Agenda Objectives of Testing Overview of results Takeaways Action items

3 EMC CONFIDENTIAL—INTERNAL USE ONLY Objectives Answer the FAQ – what’s the supported scalability of SMIs dedicated for ViPR. Study performance characteristics of ViPR operation when the provider is managing a single VMAX Start with an empty VMAX and build it up to near max limit At every step capture the response time of common operations Study performance characteristics of ViPR operations on a pool of VMAX arrays managed by a single provider Combine single large and multiple (4) smaller VMAX arrays to arrive at max supported scalability of a provider

4 EMC CONFIDENTIAL—INTERNAL USE ONLY Environment (no Bound Resources) SMI-S Provider ESX Server 12 Core Intel Xeon CPU 98 GB RAM Local disk Virtual Machine 2 vCPUs 16 GB Memory 50 GB Disk Space Inband connection to all VMAX though RDM with 6GK for each VMAX SMI-S Provider version: V Solutions Enabler version: V

5 EMC CONFIDENTIAL—INTERNAL USE ONLY Discovery and Metering Times at Various VMax Size (Single VMAX Single SMI-S Provider)

6 EMC CONFIDENTIAL—INTERNAL USE ONLY Metering and Monitoring CPU Character On SMI-S Metering and Discovery Do not appear to be CPU bound on SMI-S provider From logs ~ 90% of Time Metering and Discovery happen on SMI-S Provider Single 40 K VMax

7 EMC CONFIDENTIAL—INTERNAL USE ONLY Response time of common provisioning operations at various device count of a single VMAX array

8 EMC CONFIDENTIAL—INTERNAL USE ONLY Response time of common provisioning operations at various device count of a single VMAX array 300 Device Response time (sec) 9,300 Devices Response time (sec) 15,000 Devices Response time (sec) 25,000 Devices Response time (sec) 35,000 Devices Response time (sec) 40,000 Devices Response time (sec) CREATE_VOLUME EXPAND_VOLUME CREATE_VOLUME_SNAPSHOT DEACTIVATE_VOLUME_SNAPSHOT DEACTIVATE_VOLUME CREATE_VOLUME_EXPORTGROUP

9 EMC CONFIDENTIAL—INTERNAL USE ONLY Time to create a single large devices as reported by ViPR Talk to Rohini- meta volume set to create large devices - Important

10 EMC CONFIDENTIAL—INTERNAL USE ONLY 40K Devices / 4 VMAX Metering Metering Monitoring happen mostly sequentially Avg Metering time – 12:41 (single large Vmax (28 minutes) Avg Discovery time – 8:31 (single large Vmax (25 minutes) Note only 4 GK were used on Vmax

11 EMC CONFIDENTIAL—INTERNAL USE ONLY ~40K Devices High Level View of CPU usage for SMI-S Discovery and Metering every 1 hour Single VMAX (~40K devices) being created using ViPR 4 VMAX arrays (~40K devices) - Ingested

12 EMC CONFIDENTIAL—INTERNAL USE ONLY Single Provider managing multiple VMAX arrays - observations Hourly Discovery Discovery runs in parallel per array Hourly Metering Metering runs sequentially per array

13 EMC CONFIDENTIAL—INTERNAL USE ONLY Throughput analysis of snap operations Total projected 1709 snaps per day for a single provider Total goal per provider with 5 Arrays 24K Assuming ~5 VMAX per provider and total 12 providers in full scale deployment 20,508 snaps per day are projected Required throughput for SNAP not in ball park

14 EMC CONFIDENTIAL—INTERNAL USE ONLY Response time analysis of snap operations Response time degrades modestly when a single thread goes to each VMAX. 4 VMAX 1 thread each show 13% degrade in response time Response time degrades significantly when multiple threads go to a single VMAX. 4 VMAX 3 threads each show a 2.8 fold degradation in response time

15 EMC CONFIDENTIAL—INTERNAL USE ONLY Multiple VMAX Snap Time on single provider 4Vmax Single Threaded 4Vmax 3 threads each

16 EMC CONFIDENTIAL—INTERNAL USE ONLY Multiple Vmax SMI-S Character 4Vmax Single Threaded4Vmax 3 threads each

17 EMC CONFIDENTIAL—INTERNAL USE ONLY Multiple VMax Snap Times as Reported by ViPR Important note – Above times are a different test run from previous slide and result can not be compared.

18 EMC CONFIDENTIAL—INTERNAL USE ONLY 80K Devices 5 VMax Environment Metering and Discovery Time Avg Metering time – 42:50 Avg Discovery time – 27:42

19 EMC CONFIDENTIAL—INTERNAL USE ONLY Hi level view of CPU utilization of SMI-S Provider for 80K+ Devices for VMax

20 EMC CONFIDENTIAL—INTERNAL USE ONLY Take Aways Lab environment - Meter/Discovery 83,000 Devices on a single SMI-S provider was a pass Support 60,000 Devices in field from Meter/Discover with out increasing polling interval Lab Environment Response time degrades significantly with on SMI-S provider when concurrent operations are sent to same VMax Lab Environment – Snap throughput not in the in the ball park regardless of concurrency or number of arrays per SMI-S provider Ameer comment - (Is a different method needed to create snap - open Jira for this)

22 EMC CONFIDENTIAL—INTERNAL USE ONLY Response time analysis of snap operations Provider managing multiple arrays Total projected 1709 snaps per day for a single provider Assuming ~4 VMAX per provider and total 7 providers in a deployment, 17,090 snaps per day are projected Assuming ~1 VMAX per provider and total 18 providers in a deployment, 17,090 snaps per day are projected 33 VMAX at 100% scale snaps per day goal is 128,300 7x improvement is required to meet goal

23 EMC CONFIDENTIAL—INTERNAL USE ONLY Agenda Meter Only 5 VMax total ~80 K

24 EMC CONFIDENTIAL—INTERNAL USE ONLY Agenda Meter Only

25 EMC CONFIDENTIAL—INTERNAL USE ONLY Agenda Meter Only

26 EMC CONFIDENTIAL—INTERNAL USE ONLY Single Poll 40K Volumes 4 Vmax Objectives of Testing Over View of results Take Away

27 EMC CONFIDENTIAL—INTERNAL USE ONLY 40K Devices 4 Vmax MeterMonitor 6 hours SMI-S Objectives of Testing Over View of results Take Away