JBOD Enclosure Clustered Optionally clustered Infra srv-1 Gateway RDWEB RD Broker SQL 2X NIC 2x NIC Same workload as Infra-1 RD Lic Srv 2X.

Slides:



Advertisements
Similar presentations
Storage Design for Agile VDI Alex Danilychev, PhD.
Advertisements

4/11/2017 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
Windows Server 2012 R2 Software Defined Storage Lenovo ThinkServer HA Solutions Rui Freitas OEM Partner Strategist.
Installing and Configuring the Hyper-V Role
© 2010 VMware Inc. All rights reserved Confidential Performance Tuning for Windows Guest OS IT Pro Camp Presented by: Matthew Mitchell.
JBOD storage Server Message Block (SMB) PowerShell & SCVMM 2012 R2 Management Scale-out file server clusters Storage Space Hyper-V clusters.
Scale-Out File Server Clusters Storage Spaces Virtualization and Resiliency Hyper-V Clusters SMB Shared JBOD Storage PowerShell & SCVMM 2012 R2 Management.
Linux Clustering A way to supercomputing. What is Cluster? A group of individual computers bundled together using hardware and software in order to make.
Novell Server Linux vs. windows server 2008 By: Gabe Miller.
SUMS Storage Requirement 250 TB fixed disk cache 130 TB annual increment for permanently on- line data 100 TB work area (not controlled by SUMS) 2 PB near-line.
HelgeKlein.com Home of SetACL A scientific approach to XenApp farm sizing Helge Klein.
Efficiently store fewer bits. File1 File2 After Dedup: Before Dedup:5TB Chunk Store Non-Optimized Files Optimized file stubs Savings = 4TB 1TB.
Windows Server 2012 VDI/RDS Infrastructure and Management Adam Carter Product Marketing Manager Microsoft Corporation Dean Paron Group Program Manager.
Windows Server 2012 VDI/RDS Infrastructure and Management Adam Carter Product Marketing Manager Microsoft Corporation Dean Paron Group Program Manager.
Connection Broker Licensing Server Session Host Gateway Web Access database.
Implementing Failover Clustering with Hyper-V
1ConsistentPlatform Windows Azure Pack Service Providers Private Cloud Public Cloud DEVELOPMENT MANAGEMENTIDENTITYVIRTUALIZATIONDATA Azure Virtual Machines.
Gordon: Using Flash Memory to Build Fast, Power-efficient Clusters for Data-intensive Applications A. Caulfield, L. Grupp, S. Swanson, UCSD, ASPLOS’09.
\\fs\share File Server SMB Direct Client Application NIC RDMA NIC TCP/ IP SMB Direct Ethernet and/or InfiniBand TCP/ IP Unchanged.
Upgrading the Platform - How to Get There!
The Journey to the 2012 R2 wave The 2012 R2 wave File Based Storage Storage Management for Private Cloud Storage Spaces.
SAP on windows server 2012 hyper-v documentation
Robert Larson Delivery Architect Microsoft Corporation SESSION CODE: WSV316 David Lef Principal Systems Architect Microsoft Corporation.
1 Some Context for This Session…  Performance historically a concern for virtualized applications  By 2009, VMware (through vSphere) and hardware vendors.
WSV210 Dell Windows Server 2012 Greenfield Data Design: Hosted Service / Private Cloud Terry Storey Senior Global Architect Dell Corporation WSV210.
Windows Server 2012 VSP Windows Kernel Applications Non-Hypervisor Aware OS Windows Server 2008, 2012 Windows Kernel VSC VMBus Emulation “Designed for.
Windows RDMA File Storage
Hyper-V Storage Senthil Rajaram Senior PM Microsoft Corporation.
Denny Cherry Senior Database Administrator / Architect MVP, MCSA, MCDBA, MCTS, MCITP.
Nexenta Proprietary Global Leader in Software Defined Storage Nexenta Technical Sales Professional (NTSP) COURSE CONTENT.
Nexenta Proprietary Global Leader in Software Defined Storage Nexenta Technical Sales Professional (NTSP) COURSE CONTENT.
Enabling Technologies for Distributed and Cloud Computing Dr. Sanjay P. Ahuja, Ph.D FIS Distinguished Professor of Computer Science School of.
Describe the basics of the Hyper-V over SMB scenario, including the main reasons to implement it. Enumerate the most common performance bottlenecks.
Microsoft Azure Virtual Machines. Networking Compute Storage Virtual Machine Operating System Applications Data & Access Runtime Provision & Manage.
Dell Desktop Virtualization Solutions The Power to Do More Combining a comprehensive end-to-end portfolio of solutions, Dell leverages its expertise.
RD Connection Brokers Personal Desktop Pooled Desktops RD WEB Session Hosts VDI Corp LAN User login Get list of published apps & collections User.
DBI313. MetricOLTPDWLog Read/Write mixMostly reads, smaller # of rows at a time Scan intensive, large portions of data at a time, bulk loading Mostly.
CERN IT Department CH-1211 Genève 23 Switzerland t Evolution of virtual infrastructure with Hyper-V Juraj Sucik, Slavomir Kubacka Internet.
File Based Storage Block Storage VHDX Guest Clustering Guest Clustering with commodity storage Sharing VHDX files provides shared.
Microsoft Virtual Academy. Microsoft Virtual Academy First HalfSecond Half (01) Introduction to Microsoft Virtualization(05) Hyper-V Management (02) Hyper-V.
SODA File Server Physical Machine VMHost File Server App File CSV NTFS/REFS RDR Volume Partition Spaces SAS/SCSIIDE FCiSCSI JBODSAN Target FC SAN.
Clint Huffman Microsoft Premier Field Engineer (PFE) Microsoft Corporation SESSION CODE: VIR315 Kenon Owens Technical Product Manager Microsoft Corporation.
Consolidation and Optimization Best Practices: SQL Server 2008 and Hyper-V Dandy Weyn | Microsoft Corp. Antwerp, March
Hyper-V Performance, Scale & Architecture Changes Benjamin Armstrong Senior Program Manager Lead Microsoft Corporation VIR413.
Business and Partnering Opportunities: “Windows Server 8” Continuous Availability Designing Systems for Continuous Availability and Scalability Session.
What’s New with Windows Server 2012 and Microsoft System Center 2012 SP1 Vijay Tewari Principal Group Program Manager Microsoft Corporation.
Session Objectives And Takeaways A word on Perf & VDI architecture.
Status SC3 SARA/Nikhef 20 juli Status & results SC3 throughput phase SARA/Nikhef Mark van de Sanden.
MDC323B SMB 3 is the answer Ned Pyle Sr. PM, Windows Server
Including what’s new in Windows Server 2012 R2 Describe the basics of the Hyper-V over SMB scenario, focusing on the new capabilities in Windows Server.
Rick Claus Sr. Technical Evangelist,
Arne Wiebalck -- VM Performance: I/O
Enabling Technologies for Distributed Computing Dr. Sanjay P. Ahuja, Ph.D. Fidelity National Financial Distinguished Professor of CIS School of Computing,
Atlas Software Structure Complicated system maintained at CERN – Framework for Monte Carlo and real data (Athena) MC data generation, simulation and reconstruction.
RALPP Site Report HEP Sys Man, 11 th May 2012 Rob Harper.
Dell Desktop Virtualization Solutions The Power to Do More Combining a comprehensive end-to-end portfolio of solutions, Dell leverages its expertise.
Jérôme Jaussaud, Senior Product Manager
Simple to deploy, easy to manage Consistently rich experience, regardless of deployment model 1 Platform 1 Experience Pooled virtual machines Highest.
Network Virtualization Policy-Based Isolation QoS Performance Metrics Live & Storage Migrations Cross-Premise Connectivity Dynamic & Multi-Tenant.
Capacity Planning in a Virtual Environment Chris Chesley, Sr. Systems Engineer
Windows Server 2012R2 is the best platform for mission-critical SQL Server workloads (OLTP, DW, and BI) with better scalability, performance, and availability.
Brian Lauge Pedersen Senior DataCenter Technology Specialist Microsoft Danmark.
Module 4: Hyper-V for VDI
RD Role Service Scale Limitations
Windows Azure Migrating SQL Server Workloads
Design and Implement Cloud Data Platform Solutions
11/16/2018 6:17 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or.
12/3/2018 Desktop Virtualization Corey Hynes Kyle Rosenthal President Technical Lead HynesITe Inc Spider Consulting @windowspcguy.
TechEd /2/2019 8:21 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Building continuously available systems with Hyper-V
Presentation transcript:

JBOD Enclosure Clustered Optionally clustered Infra srv-1 Gateway RDWEB RD Broker SQL 2X NIC 2x NIC Same workload as Infra-1 RD Lic Srv 2X NIC 2X SAS HBA SAS Module 2X SAS HBA

1 Perf data is highly workload sensitive 2 Estimation based on dual Xeon E VSI Benchmarking, by Login VSI B.V.

1 Perf data is highly workload sensitive 2 Estimation based on dual Xeon E5-2690

1 Perf data is highly workload sensitive

JBOD Enclosure Pool VM 2X NIC 2x NIC Pool VM 10K disks … Raid10/equiv Pool VM 2X NIC 2x NIC Pool VM 10K disks … Raid10/equiv Clustered 2X NIC 2X SAS HBA SAS Module 2X SAS HBA 10K disks VHD storage 10K disks

1 Perf data is highly workload sensitive 2 VSI Benchmarking, by Login VSI B.V.

1 Perf data is highly workload sensitive 2 VSI Benchmarking, by Login VSI B.V.

1 Perf data is highly workload sensitive. Scale/Perf analysis 1 SMB load due to userVHDs: At ~2 IOPS/user, we need ~10,000 write IOPS for 5000 users (Write heavy) ~100 Kbits/sec per user  for 5000 users we have 0.5 Gbits/sec Storage size: Scenario-dependent, but 10gig/user seems reasonable We need about 50 TB of storage Overall network load We have the RDP traffic and the storage traffic due to userVHDs Total ~ 3 Gbits/sec: ~0.5 Gbits/sec due to userVHD ~2.5 Gbits/sec due to RDP

1 Perf data is highly workload sensitive

JBOD Enclosure Pool VM 2X NIC 2x NIC Pool VM 2X NIC 2x NIC Pool VM Clustered 2X NIC 2X SAS HBA SAS Module 2X SAS HBA 10K disks

1 Perf data is highly workload sensitive 2 VSI Benchmarking, by Login VSI B.V.

1 Perf data is highly workload sensitive

2 Cache size set to 1024Meg 3 VSI Benchmarking, by Login VSI B.V.

1 Perf data is highly workload sensitive

JBOD Enclosure Clustered PD VM 2X NIC 2x NIC Pool VM PD VM 2X NIC 2x NIC Pool VM PD VM Clustered 2X R-NIC 2X SAS HBA SAS Module 2X SAS HBA 10K disks

1 Perf data is highly workload sensitive 2 VSI Benchmarking, by Login VSI B.V.

1 Perf data is highly workload sensitive

Resolution Maximum number of monitors in VM setting x MB52 MB58 MB70 MB 1280 x MB85 MB95 MB115 MB 1600 x MB126 MB142 MB 1920 x MB150 MB168 MB 2560 x MB268 MB 1 Perf data is highly workload sensitive 2 High level heuristics

VDI Management servers About 2 hosts running VDI management workloads Minimal storage & network load Corp network (user traffic) RDP load on LAN ~2.5G/s,  2x 10G/s RDP load on WAN ~500Mb/s  2x 1G/s Pool & PD VMs on SMB ~35 clustered VDI 150 users/host SMB storage for userVHDs ~40TB SMB storage for Pool-VMs ~20TB SMB storage for PD-VMs ~100 TB Storage network 2x 40G (actual load ~34G)

2000 seat pool deployment, 14 R720s as the compute & storage nodes

SQL load during 2000 connections HA Broker load during the same period

2000 seat pool deployment, 14 R720s as the compute & storage nodes

DL585 G7, 4x 12 cores (AMD Opt 6172), 128 GB RAM Storage: Local array 24x RAID10 ~ 22 partitions created, so low load on this machine So what’s going on? There is a config setting to save a VM after some idle event/time, and then restore a VM when a connection arrives. This means reading ~500+ Meg of data right before user login We can reduce overall system load by starting all VMs ahead of time, just make sure that the save-delay option is disabled (one of our per collection config params) GoldVM reads/s = 800 Diff-disk reads/s = 225 User conn/login

Partition count: At 5:01:00PM, we have ~110 VMs Available memory Diff-disks: Reads/sec Diff-disks: Writes/sec GoldVM: Reads/sec Zero available memory DL585 G7, 4x 12 cores (AMD Opt 6172), 128 GB RAM Storage: Local array 24x RAID10 Partition count (max=228) ?

At 5:01:00PM, we have ~110 VMs Available memory At 5:01pm, we have ~110VMs Gold VM read/sec ~500 = 45% Diff-disk write/sec ~500= 45% Diff-disk read/sec ~130= 10% Total = 1130 IOPS, ~10IOPS/VM Just for the diff-disks: Total = = 630 Write IOPS: 500/630 = 80% Read IOPS: 130/630 = 20% DL585 G7, 4x 12 cores (AMD Opt 6172), 128 GB RAM Storage: Local array 24x RAID10 1 Perf data is highly workload sensitive 2 VSI Benchmarking, by Login VSI B.V.

Physical memory of guest-VMs Zero available memory

DL585 G7, 4x 12 cores (AMD Opt 6172), 128 GB RAM Storage: Local array 24x RAID10

Cluster IO reads/s Cluster Cache reads/s Disk IO reads/s

Green: disk reads/s CSV cache reads/s Partition count, 100VMs 1 Perf data is highly workload sensitive 2 VSI Benchmarking, by Login VSI B.V.

SMB client load under VSI 2 medium workload T=5:02:09pm, 95VMs (GREEN) Blue: Write Requests/sec = 750 Red: Read requests/sec = 2100 Cyan: Write bytes/sec = 25 MBytes Pink: Read bytes/sec = 60 MBytes Thin-red at ~70% is idle CPU 1 Perf data is highly workload sensitive 2 VSI Benchmarking, by Login VSI B.V.

82 VMs GPU0 VRAM: 1Gig Zero GPU VRAM Sys mem: 50Gig mem pages/s GPU 0,1 VRAM: 2Gig Sys mem: 28 Gig Zero sys mem mem pages/s 106 VMs SRV with 1x ATI V9800 GPUSRV with 2x ATI V9800 GPUs

The inbox VDI PowerShell scripting layer was tested to 5000 seats The inbox admin UI is design for 500 seats