Robert Larson Delivery Architect Microsoft Corporation SESSION CODE: WSV316 David Lef Principal Systems Architect Microsoft Corporation

Windows Server 2008 R2 Scalable Platform Enhancements iSCSI Breakthrough Performance Results Storage: Hyper-V Options and Best Practices A Real World Deployment: Microsoft IT’s Server Environment MSIT’s Hyper-V Deployment MSIT’s “Scale Unit” Virtualization Infrastructure Questions and Answers

Compute 256 processor core support Core Parking Advanced Power Management Storage 256 processor core IO scaling Dynamic Memory allocation iSCSI Multi-Core scaling (NUMA IO) Virtualization Hot Add Storage Intel EPT memory management support Live Migration Networking 256 processor core support NUMA awareness VMQ and Virtualization performance Windows Server 2008 R2 Scalable Platform: Efficient scaling across multi-core CPUs Intel® Xeon® Processor Hyper-V™ Intel® Ethernet Adapters

PHYSICALVIRTUAL Reliability, Scalability and Performance Extending the iSCSI platform iSCSI and Storage Enhancements in R2 iSCSI Multi-Core and Numa IO DPC redirection Dynamic Load Balancing Storage IO Monitoring CRC Digest Offload Support for 32 paths at boot time iSCSI Quick Connect Configuration Reporting Automated deployment iSCSI Server Core UI Management

Windows Server 2008 R2 Scalable Platform Enhancements iSCSI Breakthrough Performance Results Storage: Hyper-V Options and Best Practices A Real World Deployment: Microsoft IT’s Server Environment MSIT’s Hyper-V Deployment MSIT’s “Scale Unit” Virtualization Infrastructure Questions and Answers

RSS LRO LSO OS HW RSS Filesystem Volume Manager Class/Disk MSISCSI.SYS Port Driver (Storport) TCPIP.SYS NDIS MINIPORT iSCSI HBA miniport TCP Chimney NDIS MINIPORT OS HW iSCSI HBA LRO LSO Provided by: Microsoft Firmware/DriverHardware IHV MSISCSI.SYS

iSCSI Test Configuration – 2008 R2 IometerManagementSystem 1 Gbps Target SwitchCisco*Nexus* 5020 (10 GbE) Switch 10 Gbps per Target Adapter Intel® Ethernet Server Adapter X520 based on Intel® GbE Controller. 1 Gbps Target iSCSI Soft Targets Performance factors iSCSI initiator perf optimizations Network stack optimizations Receive Side Scaling (RSS) Intel Xeon 5500 QPI and integrated memory controller Intel® 82599: HW Acceleration, multi-core scaling with RSS, MSI-X Server Windows Server 2008 R2 Microsoft iSCSI Initiator Intel ®Xeon® Processor 5580, quad core, dual socket, 3.2 Ghz, 24GB DDR3, MTU 1500, Outstanding I/Os =20 Software Initiator LUN 1 LUN 2 LUN 3 LUN 4 LUN 5 LUN 6LUN 7LUN 8LUN 9 LUN 10 Single Port 10GbE * Other names and brands may be claimed as the property of others.

Intel® Xeon® Processor 5580 Platform, Windows Server 2008 R2 and Intel® GbE Adapter Breakthrough Performance at 10GbE 1,030,000 IOPs Single Port 10GbE line rate 10k IOPs per CPU point Performance for real world apps Future ready: Performance Scales 552k IOPs at 4k represents 3,100 Hard Disk Drives 400x a demanding database workload 1.7m Exchange mailboxes 9x transactions of large eTailers Jumbo frames: >30% CPU decrease is common for larger IO size (jumbo frames not used here) Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Microsoft and Intel products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual performance. Buyers should consult other sources of information to evaluate the performance of systems or components they are considering purchasing. Read/Write IOPs and CPU Test Read/Write IOPs and Throughput Test

2008 R2 Hyper-V iSCSI Test Configuration IometerManagementSystem 1 Gbps Target SwitchCisco*Nexus* 5020 (10 GbE) Switch 10 Gbps per Target Single 10 Gbps Port Host 1 Gbps Target iSCSI Soft Lab Targets iSCSI Direct connection iSCSI initiator runs in VM Microsoft VMQ and Intel VMDq Performance factors iSCSI initiator perf optimizations Microsoft network stack optimizations Hyper-V scaling Receive Side Scaling on host Microsoft VMQ Intel VMDq Virtual connection LUN 1LUN 2LUN 3LUN 4LUN 5LUN 6LUN 7LUN 8LUN 9LUN 10 Physical connection * Other names and brands may be claimed as the property of others.

iSCSI Performance with Intel® G NIC with VMDq, Intel® Xeon 5580 Platform, Windows Server 2008 R2 and R2 Hyper V Breakthrough Performance – Hyper-V Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Microsoft Intel products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual performance. Buyers should consult other sources of information to evaluate the performance of systems or components they are considering purchasing. Near native iSCSI performance Read/Write IOPs and Throughput Test

iSCSI Performance Test Conclusions  iSCSI protocol performance is only limited by the speed of the underlying bus and vendor implementation  iSCSI is ready for mission critical performance workloads  Use Receive Side Scaling to optimize for iSCSI performance in the host  Use VMQ/VMDq to optimize iSCSI performance within the VM for best IO scaling  VLANs offers logical separation of LAN/SAN traffic and additional performance isolation  Most applications use moderate IO and throughput

Windows Server 2008 R2 Scalable Platform Enhancements iSCSI Breakthrough Performance Results Storage: Hyper-V Options and Best Practices A Real World Deployment: Microsoft IT’s Server Environment MSIT’s Hyper-V Deployment MSIT’s “Scale Unit” Virtualization Infrastructure Questions and Answers

VHD VM 1 VM 3 VM 2 Each VM required 3 separate CSVs However in this case: 3 X 3 = 3

With 16 Cluster nodes sending I/O to single LUN…

CSV and Hyper-V Backup Protect from parent or within the guest VM? Answer – Both! Backup from Hyper-V Parent Partition Protect the virtual machine and associated VHDs Includes non-Windows servers Backup from Guest VM Protect application data SQL database Exchange SharePoint Files Same as protecting a physical server

Windows Server Hosts Windows Server Hosts Clients Fibre Channel switch Network  Increases uptime of Windows Server by providing multiple paths to storage  Increased server bandwidth over multiple ports  Automatic failure detection and failover  Dynamic load balancing  Works with Microsoft DSM provided inbox or 3 rd party DSMs (PowerPath, OnTAP DSM, etc. )

Always use active/active multipathing load balance policies (round robin, least queue depth) vs. failover mode. Follow vendor guidelines for timer settings Queuedepth, PDORemovePeriod, etc. as these settings will have a direct impact on ability to deliver max IO to VMs and controlling failover times Many array vendors include host utilities that automatically adjust settings to optimize for their array Example: Dell “hit kit” host integration kit Pay attention to spindle count for workload SSDs (Solid State Drives) change the game on this For NICs used for iSCSI in HBA mode with offload (iSOE), turn off TCP Chimney

Windows Server 2008 R2 Scalable Platform Enhancements iSCSI Breakthrough Performance Results Storage: Hyper-V Options and Best Practices A Real World Deployment: Microsoft IT’s Server Environment MSIT’s Hyper-V Deployment MSIT’s “Scale Unit” Virtualization Infrastructure Questions and Answers

MSIT’s Solution - The “Scale Unit” Virtualization Platform

Storage Scale Unit - History and New Design Principles

Storage Scale Unit - Deployment Details

Storage Scale Unit - Key Metrics

Tiers of Capacity Determining resource assignment and service levels TierDescriptionI/O ThresholdPrice 1Dedicated space> 5000 IOps > 80 MB/s Straight pass-through + consulting cost (per engagement) 2Shared R IOps MB/s 3x shared SU Pricing 3Shared R6< 500 IOps < 25 MB/s Standard SU Pricing

Element NameProvisioning Lock (No new presentations) Grow Lock (No volume growth) Mitigation (Start migrating servers and applications) Pool Oversubscription150%200%N/A Pool Written Capacity70%80%90% Avg. Performance Thresholds 60%70%80%

Scale Unit - Future Storage Opportunities

Windows Server 2008 R2 Scalable Platform Enhancements iSCSI Breakthrough Performance Results Storage: Hyper-V Options and Best Practices A Real World Deployment: Microsoft IT’s Server Environment MSIT’s Hyper-V Deployment MSIT’s “Scale Unit” Virtualization Infrastructure Questions and Answers

Sign up for Tech·Ed 2011 and save $500 starting June 8 – June 31 st You can also register at the North America 2011 kiosk located at registration Join us in Atlanta next year