Storage Spaces Direct: What are you waiting for?

Slides:



Advertisements
Similar presentations
Successfully migrate existing databases to Azure SQL Database
Advertisements

Secure Hyperconnectivity with TeamViewer and Windows technologies
From IT Pros to IT Heroes - with Azure DevTest Labs
Nested Virtualization: A game changer in Hyper-V and Azure
Azure on Steroids: Full Automation with PowerShell
Azure File Sync Setup, configuration and management
How To Deliver Apps Faster And Secure Them The Microsoft Way
6/5/2018 1:30 PM THR1029 Spend less time managing data and more time with customers: Quick tour of Outlook Customer Manager Welly Lee
THR3052 Tips and tricks: Build, deploy, and manage web apps powered by containers Ahmed Elnably Program Manager
Azure Cloud Shell Magic of Modern Command-line Management
Windows 10 and the cloud: Why the future needs hybrid solutions
Migrating your IaaS infrastructure from ASM to ARM without downtime
6/17/2018 3:33 PM THR3080 Real-world Value & Experiences with Nested Virtualization in Windows Server 2016 Todd J. Furst Microsoft Technology Center (MTC),
Lessons learned from deploying Windows Server 2016
Learning about Containers in the Real World
Matching Storage Spaces Direct Configurations to Your Workload
Lessons learned from moving to Microsoft Azure
Optimizing Microsoft OneDrive for the enterprise
Performing a Seamless Migration in Azure SQL DB
Dave Kawula’s Notes from the Field on Storage Spaces Direct
What a Real, Functioning DevOps Team Looks Like
“Enable, Invent & Adopt, Transform”
Virtual Machine Diagnostics in Microsoft Azure
SQL Server on Linux on All-Flash Arrays
Microsoft Ignite /31/ :08 AM
Understanding Windows Analytics Update Compliance
Workflow Orchestration with Adobe I/O
Find, try and get line-of-business apps on Microsoft AppSource
9/11/ :59 PM THR3021 Why Microsoft is updating the new OneDrive sync engine in a different way Hans Brender Cloud Productivity Evangelist Bright.
Azure Security in four steps
Group Policy in MDM: Dealing with ADMX backed policies
Automate all things! Microsoft Azure continuous deployment
Agile Planning with Visual Studio Team Services (VSTS)
Servicing Windows 10 in the Real World
9/22/2018 3:49 AM BRK2247 Learn from MVPs: Panel discussion on all things SharePoint and OneDrive © Microsoft Corporation. All rights reserved. MICROSOFT.
Azure PowerShell Aaron Roney Senior Program Manager Cormac McCarthy
Port your AWS Knowledge to Azure
Azure SQL Database: A Guided Tour
Continuous Delivery with Visual Studio Team Services
Azure Advisor: Optimization in the best way
11/27/2018 5:08 PM THR3057 Using a PowerShell release pipeline for a real-world service provider delivery in Microsoft Azure Niklas Åkerlund Lead Architect.
Microsoft products for non-profits
Microsoft Virtual Academy
Five cool things you can do with Windows PowerShell on Office 365
Securely pass passwords into your deployment
Microsoft Exchange: Through the eyes of MVPs (Panel discussion)
1/2/2019 5:18 PM THR3016 Customer stories: Plan and orchestrate large resource deployments on Azure infrastructure Igal Figlin Principal PM Manager – Azure.
MDM Migration Analysis Tool (MMAT)
Building continuously available systems with Hyper-V
Overview: Dynamics 365 for Project Service Automation
Understand your Azure cloud assets dependencies with BMC Discovery
Surviving identity management in a hybrid world
Sami Laiho AMA - Ask Me Anything
Breaking Down the Value of A Yammer Post: 20 Things to Do
Cool Microsoft Edge Tips and Tricks
When Bad Things Happen to Good Applications
Getting the most out of Azure resources with Azure Advisor
“Hey Mom, I’ll Fix Your Computer”
Business Continuity and the Microsoft Cloud
4/28/2019 3:30 AM THR1061 Learn how Dynamics 365, Office 365 and related applications work together to transform the workplace Donna Edwards Solution Architect.
Designing Bots that Fit Your Organization
Ask the Experts: Windows 10 deployment and servicing
Passwordless Service Accounts
Azure Networking inside and out
Digital Transformation: Putting the Jigsaw Together
WCF and .NET Framework Microservices in Containers
Diagnostics and troubleshooting in Azure App Service Support Center
Optimizing your content for search and discovery
Microsoft Virtual Academy
Microsoft Virtual Academy
Presentation transcript:

Storage Spaces Direct: What are you waiting for? 9/10/2018 10:26 PM THR4003 Storage Spaces Direct: What are you waiting for? Fredrik Nilsson Solution Architect Microsoft Cloud Solutions Dell EMC © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/10/2018 10:26 PM Azure Stack © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure Stack Underlaying HW 9/10/2018 10:26 PM Azure Stack Underlaying HW 1 Node (ASDK) 4 Node 8 Node 12 Node Dell EMC HPE Lenovo Servers (min config) 4 Dell PowerEdge R730xd 4 HPE Proliant DL380 4 Lenovi x3650 M5 Network switched Dell S4018-ON (TOR) and S3048-ON (BMC) HPE59xx and HPES900 AF (BMC) Lenovi RackSwitch (TOR and BMC) Storage Mix of SATA HHD, NVME and SSD depending on config Hardware Support Dell ProSupport HPE Proactive Care 24x7 4 hour response © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Why Storage Spaces Direct 9/10/2018 10:26 PM Why Storage Spaces Direct © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Organizations are drowning in data IT needs new storage solutions that are simpler, more streamlined, and more cost-effective than traditional approaches Exponential growth of data (Exabytes) 40,000 30,000 20,000 10,000 Source: IDC Digital Universe Study, 2012 *Estimated 2008 2010 2012 2014 2016 2018* 2020*

Software-Defined Storage (SDS) gains traction SDS hardware, software, services Server SAN Hyper-converged infrastructure (HCI) $22B annual spending by 2021 37% CAGR 2016–2021 Source: MarketsandMarkets, August 2016 $48B annual spending by 2026 28% CAGR 2016–2026 Source: Wikibon, 2015 122% CAGR Source: IDC, September 2016 SDS adopters improve operational agility, efficiency, and capacity utilization with the ability to easily define and redefine SANs that are virtual rather than physical.

9/10/2018 10:26 PM How do I do it then? © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Windows Server Storage Spaces Direct 9/10/2018 10:26 PM Windows Server Storage Spaces Direct © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Design Converged Hyper Converged 9/10/2018 10:26 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Network Design (trad.) Host Partition SMB 9/10/2018 10:26 PM Network Design (trad.) Host Partition VM Storage WS2012 R2 Hyper-V Host (with converged) Example 2 x 10GbE + 2 x 10GbE RDMA NICs SMB DCB policies configured for management, storage, migration, & clustering traffic Utilizes SMB Multichannel & SMB Direct Live Migration SMB Management Other Hyper-V Switch NIC Team TCP/IP RDMA © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Network Design (Converged) 9/10/2018 10:26 PM Network Design (Converged) Host Partition VM Storage WS2016 Hyper-V Host (with converged) Example 2 x 10GbE RDMA NICs Live Migration SMB Management Other Switch Enabled Teaming (SET) TCP/IP RDMA © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Network Design (iWARP) 9/10/2018 10:26 PM Network Design (iWARP) Host Partition VM Storage WS2016 Hyper-V Host (with converged) Example 2 x 10GbE RDMA NICs Management Storage SMB Management Storage Switch Enabled Teaming (SET) TCP/IP RDMA © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Switch Enabled Teaming (SET) 9/10/2018 10:26 PM Network Design (RoCE) Host Partition VM Storage WS2016 Hyper-V Host (with converged) Example 2 x 10GbE RDMA NICs Storage SMB Storage Management Switch Enabled Teaming (SET) TCP/IP RDMA © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/10/2018 10:26 PM N+1 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What about the disks then?

Fault tolerance and storage efficiency Two-way Mirror 50% Storage efficiency Failure tolerance 1 Minimum req Fault Domains 2 Data Copy

Three-way Mirror 33,3% Storage efficiency Failure tolerance 1 Minimum req Fault Domains 3 Data Copy

Dual parity ~50% Storage efficiency Failure tolerance 4 Minimum req Fault Domains 4 Data Parity bits

~50% - 80% Storage efficiency 9/10/2018 10:26 PM Dual parity ~50% - 80% Storage efficiency Failure tolerance 4 Minimum req Fault Domains 4 Data Parity bits © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Mirror-accelerated parity 33,3% - 80% Storage efficiency 9/10/2018 10:26 PM Mirror-accelerated parity 33,3% - 80% Storage efficiency Failure tolerance 2 Minimum req Fault Domains 4 Data Copy Data Parity bits Mirror Dual Parity © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Use Three-Way mirror 9/10/2018 10:26 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Updates to a S2D cluster Cluster Aware Updates 9/10/2018 10:26 PM Updates to a S2D cluster Cluster Aware Updates -MaxFailedNodes <Int32> © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

-MaxFailedNodes 9/10/2018 10:26 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/10/2018 10:26 PM Jumbo Packet Set-NetAdapterAdvancedProperty -Name “SMB1”, “SMB2” -RegistryKeyword “*JumboPacket” -RegistryValue 9014 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Manage Data Center Bridging (DCB) 9/10/2018 10:26 PM Manage Data Center Bridging (DCB) # Windows Server 2012R2 or Windows Server 2016 don’t support DCBX and therefore we need to disable this.   Set-NetQosDcbxSetting -Willing $FALSE © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Update HW timeout setting for Spaces port Set-ItemProperty -Path HKLM:\SYSTEM\CurrentControlSet\Services\spaceport\Parameters -Name HwTimeout -Value 0x00002710 –Verbose Restart-Computer –Force

MAP SMB Virtual Interfaces # Map virtual SMB interfaces to the physical adapter connected to the switch Set-VMNetworkAdapterTeamMapping -VMNetworkAdapterName "vEthernet (SMB1)" –ManagementOS –PhysicalNetAdapterName "SMB1" Set-VMNetworkAdapterTeamMapping -VMNetworkAdapterName "vEthernet (SMB2)" –ManagementOS –PhysicalNetAdapterName "SMB2“ Set-VMNetworkAdapterTeamMapping -VMNetworkAdapterName "vEthernet (SMB3)" –ManagementOS –PhysicalNetAdapterName "SMB3" Set-VMNetworkAdapterTeamMapping -VMNetworkAdapterName "vEthernet (SMB4)" –ManagementOS –PhysicalNetAdapterName "SMB4"

9/10/2018 10:26 PM What do you need? © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Deployment overview Update Firmware Install OS Install Drivers 9/10/2018 10:26 PM Deployment overview Update Firmware Install OS Install Drivers Join domain Install roles and features - Hyper-V role - Failover Cluster feature - DCB … Configure the Network Create cluster Reboot Enable-S2D Create Volumes © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Deploy Storage Spaces Direct (S2D) 9/10/2018 10:26 PM Deploy Storage Spaces Direct (S2D) # Install Windowes feature Install-WindowsFeature –Name Failover-Clustering,Hyper-v,Data-Center-Bridging –IncludeManagementTools -restart #Disable Dell Remote NDIS Compatible Device Invoke-Command -ComputerName $servers -ScriptBlock {Get-NetAdapter | where InterfaceDescription -eq "Remote NDIS Compatible Device" | Disable-NetAdapter -Confirm:$False} #Disable Disconnected adapters Invoke-Command -ComputerName $servers -ScriptBlock {Get-NetAdapter | where status -eq Disconnected | Disable-NetAdapter -Confirm:$False} #get Mellanox Adapters and rename to SMB# Invoke-Command -ComputerName $servers -ScriptBlock {Get-NetAdapter | where interfacedescription -Like Mellanox*} Get-NetAdapter –Name “SLOT 3” | Rename-NetAdapter –NewName “SMB2” -CimSession $servers Get-NetAdapter –Name “SLOT 3 2” | Rename-NetAdapter –NewName “SMB4” -CimSession $servers Get-NetAdapter –Name “SLOT 2” | Rename-NetAdapter –NewName “SMB1” -CimSession $servers Get-NetAdapter –Name “SLOT 2 2” | Rename-NetAdapter –NewName “SMB3” -CimSession $servers # Create new SETSwitch and Add Mellanox Adapters named SMB1,SMB2,SMB3 Invoke-Command -ComputerName $servers -ScriptBlock {New-VMSwitch -Name SETSwitch -EnableEmbeddedTeaming $TRUE -NetAdapterName "SMB1",”SMB2","SMB3" -AllowManagementOS $false} © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4 Node S2D Hybrid 4 PowerEdge R730xd 2 Intel Xeon E5-2690 v4 2.6GHz 9/10/2018 10:26 PM 4 Node S2D Hybrid 4 PowerEdge R730xd 2 Intel Xeon E5-2690 v4 2.6GHz 512 GB RAM 2 480GB Solid State Drive SATA Read Intensive MLC 6Gbps 2.5in 2 Mellanox ConnectX-3 Pro Dual Port 10 GbE 16 2TB 7.2K RPM SATA 6Gbps 512n 2.5in 8 1.92TB Solid State Drive SATA Mix Use MLC 6Gbps 2.5in 2 Dell Networking S4048 .\start-sweep.ps1 -b 4 -t 8 -o 120 -w 0 (4x10VM) © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

8 Node S2D All flash 8 PowerEdge R730xd 2 Intel Xeon E5-2650 v4 2.2GHz 9/10/2018 10:26 PM 8 Node S2D All flash 8 PowerEdge R730xd 2 Intel Xeon E5-2650 v4 2.2GHz 24 32 GB RDIMM 2 120GB Solid State Drive SATA Boot 6Gbps 2.5in 2 Mellanox ConnectX-3 Pro Dual Port 10 GbE 4 800GB Solid State Drive SATA Write Intensive 6Gbps 2.5in 8 3.84TB Solid State Drive SATA Read Intensive TLC 6Gbps 2.5in 2 Dell Networking S4048 .\start-sweep.ps1 -b 4 -t 8 -o 20 -w 0 (8x10 VM) © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

VMFleet #Vmfleet Setup 9/10/2018 10:26 PM VMFleet #Vmfleet Setup Get-ClusterNode |% { New-Volume -StoragePoolFriendlyName "S2D*" -FriendlyName $_ -FileSystem CSVFS_ReFS -StorageTierfriendlyNames Performance,Capacity -StorageTierSizes 1TB , 200GB } New-Volume -StoragePoolFriendlyName "*s2d*" -FriendlyName collect -FileSystem CSVFS_ReFS -StorageTierFriendlyNames Capacity -StorageTierSizes 1TB install-vmfleet.ps1 -source C:\Source #Copy DISKSPD.exe to C:\ClusterStorage\Collect\Control\Tools Copy .\DISKSPD.exe C:\ClusterStorage\Collect\Control\Tools #Prep a 2016 Core VHDX of 40GB fixed sixe #Build you fleet create-vmfleet.ps1 -basevhd 'C:\ClusterStorage\Collect\FleetImage.vhdx' -vms 10 -adminpass P@55w0rd! -connectuser HostAdmin -connectpass HostAdminPass set-vmfleet.ps1 -ProcessorCount 2 -MemoryStartupBytes 4GB -MemoryMinimumBytes 4GB -MemoryMaximumBytes 4GB #Start VMfleet .\Start-Vmfleet.ps1 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/10/2018 10:26 PM Summary © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Hardware Cerified systems Think through your design 9/10/2018 10:26 PM Hardware Cerified systems Think through your design Networking What we see is that customers that DIY often fail http://dell.com/storagespacesdirect © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Automation is key 9/10/2018 10:26 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure Stack Underlaying HW 9/10/2018 10:26 PM Azure Stack Underlaying HW 1 Node 4 Node 8 Node 12 Node How many Nodes can you use in a 4 node MAS? Do the calculation based on what we learned today. © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/10/2018 10:26 PM Fredrik Nilsson Solution Arcitect - Microsoft Cloud Solutions Microsoft MVP - CDM Twitter: @fredriknilsson_ Blog: moln1.wordpress.com E-Mail: Fredrik_Nilsson@Dell.com © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Please evaluate this session Tech Ready 15 9/10/2018 Please evaluate this session From your Please expand notes window at bottom of slide and read. Then Delete this text box. PC or tablet: visit MyIgnite https://myignite.microsoft.com/evaluations Phone: download and use the Microsoft Ignite mobile app https://aka.ms/ignite.mobileapp Your input is important! © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Questions?

9/10/2018 10:26 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.