Download presentation
Presentation is loading. Please wait.
1
Cluster Shared Volumes Reborn in Windows Server 2012
4/25/2017 4:07 PM WSV430 Cluster Shared Volumes Reborn in Windows Server 2012 Subhasish Bhattacharya Program Manager Microsoft Corporation Steve Wienfeld TMEA Microsoft Lead NetApp Corporation © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
2
Agenda Cluster Shared Volumes (CSV) in Windows Server 2012
Overview What’s changed in Windows Server 2012 New architecture Performance enhancements Improved Backup of volumes
3
What is Cluster Shared Volumes (CSV)
Clustered file system in Windows Server 2012 Layer of abstraction above NTFS All cluster nodes can read/write to the CSV volume LUN ownership by node abstracted from application Applications failover without drive ownership changes No dismounting and remounting of volumes Faster failover times (less downtime)
4
CSV Helps Address Management Complexity Challenges managing large numbers of LUN’s
Manageability Multi-path Masking several LUN’s Flexibility LUN - smallest unit of failover Capacity Poor SAN space utilization Scalability Complexity with drive letters
5
Cluster Shared Volumes as you know it Today Windows Server 2008 R2
First introduced in Windows Server 2008 R2 Only supported Hyper-V workload Focused v1 release targeted at enabling Hyper-V Implemented as file system mini-filter Intercepted and routed I/O
6
CSV Motivations for Windows Server 2012
Expand CSV to more workloads File Server in addition to Hyper-V Improve Backup Improved performance Direct I/O for more scenarios Support for Spaces storage virtualization Multi-subnet support
7
New CSV Architecture What it delivers
Improved interoperability with file system mini-filter drivers Better interoperability Anti-virus software Backup Software Application consistent distributed backups Removed external authentication dependencies Improved performance and resiliency No longer Active Directory dependencies Support for memory mapped files Allows volume encryption BitLocker encrypted volumes Integrated with new File System features Support for Offloaded Data Transfer (ODX) Spot-fixing integrated to do online correction
8
Under the hood CSV Architecture 4/25/2017 4:07 PM
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
9
Cluster Shared Volumes (CSV) I/O synchronization overview
Metadata Shared LUN Shared Storage VHD Read/Write Simultaneous read/write access on all Cluster Nodes Server side metadata synchronization - Avoids I/O interruptions
10
When do Metadata Updates Occur
Virtual Machine Creation/deletion Power on/off Mobility (live/storage migration) Extending dynamic VHD Renaming VHD Backup - Snapshot creation Key Takeaways Metadata updates - small operations, infrequent for VMs Parallel metadata updates - non-disruptive for applications
11
CSVFS Node 2 Node 1 Node 3 Direct I/O Coordination Node SAN LBFO/RDMA
Disk Volume Manager NTFS CSV File System Filter VM Share Server / SMB Node 2 MUP/RDBSS/SMB Node 1 Node 3 Direct I/O CSV VolumeMgr CSV Proxy File System Storage Connection Broken or not present Coordination Node CSVFS SAN LBFO/RDMA
12
Simplified Setup Configuring a CSV Disk
Failover Cluster Manager Storage view integration “Cluster Shared Volumes” container removed CSV integrated into Failover Cluster core feature No longer needs to be explicitly enabled Simple right-click to add to CSV That’s it!
13
Single Namespace Consistent view across the cluster
Single consistent file name space Files have same name and path on any cluster node Volumes exposed under “ClusterStorage” root directory VolumeX directory name can be renamed
14
CSV Namespace Mount Points
Used custom reparse points in Win2008 R2 Win2012 uses standard Mount Points Delivers better interoperability with: Performance Counters System Center Operations Manager Monitoring free space on CSV volumes Better interoperability with backup software
15
CSV Proxy File System CSV enabled volumes now appear as “CSVFS”
NTFS file system under the covers Enables applications to be CSV aware Ensures compatibility
16
Setting up Clustered Shared Volumes
4/25/2017 4:07 PM demo Setting up Clustered Shared Volumes Subhasish Bhattacharya Program Manager Clustering and High Availability © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
17
How CSV Enables Even Higher Availability
4/25/2017 4:07 PM Resiliency How CSV Enables Even Higher Availability © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
18
Fault Tolerant Application Handles CSV Resiliency
CSV provides I/O fault tolerance Transparently handles node, network, and HBA failures CSVFS virtualizes file handles to applications Volume Paused - I/O queued Reopens “true” files handles and remaps the “virtual” handles Volume Resumed – I/O completed Failover is transparent to application!
19
I/O Connectivity Fault Tolerance
4/25/2017 4:07 PM I/O Connectivity Fault Tolerance I/O Redirected via network VM running on Node 2 is unaffected Coordination Node SAN Connectivity Failure VHD VM’s can then be live migrated to another node with zero client downtime
20
Node Fault Tolerance New Coordinator Node Node Failure
4/25/2017 4:07 PM Node Fault Tolerance New Coordinator Node Node Failure VM running on Node 2 is unaffected Coordination Node Brief queuing of I/O while volume ownership is changed Volume relocates to a healthy node VHD
21
Network Fault Tolerance
4/25/2017 4:07 PM Network Fault Tolerance Metadata Updates Rerouted to redundant network VM running on Node 2 is unaffected Volume mounted on Node 1 Network Path Connectivity Failure VHD Fault-Tolerant TCP connections make a path failure seamless
22
Cluster Shared Volume Resiliency
4/25/2017 4:07 PM demo Cluster Shared Volume Resiliency Subhasish Bhattacharya Program Manager Clustering and High Availability © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
23
Continuously Available Scale out File Server Flexible storage choices for the private cloud
Cluster platform for a continuously available scale out file server Cluster-wide client access point Consistent cluster-wide file server configuration CSV cluster-wide file system Zero client downtime failover – both planned and unplanned downtime Accessing VHDs over SMB Hyper-V Cluster Single Logical Server (\\Foo\Share) Single File System Namespace Cluster Shared Volumes File Server Cluster
24
Maximized File System Availability From Hours to Seconds …
<3 sec of downtime Disk scanning process separated from repair process Online volume scanning Volume offline only to repair Based on number of errors to fix, not size of volume Zero offline time with CSV Chkdsk/Spotfix integrated
25
Improved CSV Performance
4/25/2017 4:07 PM Performance Improved CSV Performance © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
26
Cluster Shared Volumes Caching Improved CSV I/O Performance
Windows Cache Manager integration Buffered read and write I/O’s cached like traditional NTFS CSV Block Cache Read-Only cache for un-buffered I/O I/O which is excluded from Cache Manager Distributed cache consistent across cluster Huge value for Pooled VM VDI scenarios 512 MB recommended value Disabled by default No downtime to modify
27
Cluster Shared Volume Block Cache in action
4/25/2017 4:07 PM demo Cluster Shared Volume Block Cache in action Subhasish Bhattacharya Program Manager Clustering and High Availability © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
28
Redirected I/O Less Often CSV Optimizations
Direct I/O for more scenarios Delivers faster I/O performance and lower network overhead Direct I/O for all types of file opens Buffered Reads and Writes Better VM creation and copy performance New algorithm for I/O redirection detection Opportunistic Locking as distributed locking mechanism Block level I/O performance parity Direct I/O Remote file system (SMB) performance parity Redirected I/O
29
Block Level I/O Redirection High Performance fault condition I/O redirection
Disk Volume Manager NTFS CSV File System Filter VM Share Server / SMB Node 1 MUP/RDBSS/SMB Node 2 Storage Connection Broken or not present Coordination Node CSV VolumeMgr CSV Proxy File System CSVFS LBFO/RDMA Avoids traversing file system stack twice 2x performance over File System redirection
30
Redirected I/O Modes Multiple levels of CSV I/O redirection
Redirection on a per file basis Opening file for shared access File level redirected Volume redirection at top of CSV pseudo-file system stack Manually placing CSV in redirected mode Snapshot creation File System redirection Volume redirection at bottom of CSV pseudo-file system stack directly to bottom on coordinator Storage connectivity to volume lost Block redirection
32
SMB 3.0 Performance Improvements Inherit gains for CSV redirection performance
Improved Performance of refactored SMB 3.0 client (98%) Network transport optimizations TCP/IP – SMB multi-channel & NIC Teaming, TCP offloads, DC-TCP RDMA – Lowest network CPU overhead (cycles/byte)
33
High Speed CSV I/O Redirection SMB 3.0 integration
SMB multi-channel Traffic streamed across multiple networks Improved I/O performance in redirected mode SMB Direct (SMB 3.0 over RDMA) VM with I/O being redirected Coordinator Node X X CSV Streaming I/O Across Multiple Networks VHD
34
Performance Improvements – Recap CSV Redirected mode enhancement summary
Many Pieces Come Together for Radical Improvement I/O redirection needed less often CSV Block Level Redirection SMB multi-channel Direct (RDMA) Improved SMB performance ~2% off block
35
CSV Deployment Considerations
4/25/2017 4:07 PM Deployment CSV Deployment Considerations © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
36
Planning VM Density Per CSV Volume Deployment considerations
How many VMs per CSV volume? No CSV volume restrictions VMFS limitations do not apply to CSV CSV volume Metadata updates orchestrated server side and parallelized How many IOPS can your storage array handle?
37
Asymmetric Storage Configurations Deployment considerations
Tradeoff Between Storage Connectivity and Network Bandwidth Asymmetric node – Redirected I/O mode SMB multi-channel – I/O streamed in parallel Private interfaces used for cluster traffic if available Recommendation: Distribute CSV coordinator nodes across cluster
38
Backup CSV Backup 4/25/2017 4:07 PM
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
39
CSV Backup Key Wins Distributed Snapshots
Distributed app consistent snapshot creation across cluster Parallel Backups On same or different CSV volumes Cluster nodes Improved Interoperability Backup applications / requestors not required to be ‘CSV aware’ With filter drivers Non-disruptive backups CSV volume ownership does not change during backup Improved I/O performance Direct I/O mode for software snapshots
40
CSV Backup using NetApp SnapManager
Alex Jauch Architect, Microsoft Private Cloud NetApp
41
NetApp SnapManager® for Hyper-V
Policy-based Backup and Restore of Hyper-V VMs Protects VMs running on multiple Hyper-V clusters and/or nodes Single pane of glass for multi-host Hyper-V backups VMs grouped into “Datasets” for ease of backup administration Data-protection policies applied to datasets
42
CSV Backups in Windows Server 2012
Distributed application consistent VM backups Uses New ‘VSS CSV Writer’ and ‘VSS CSV Provider’ CSV value for Hyper-V backups Initializes VSS backup once on ‘backup node’ VSS providers only called on ‘backup node’ Faster backups, Fewer snapshots
43
Backup Architecture Backup Node Non Requestor Nodes “Host1” “Host2”
SMHV MMC Snap In PowerShell CLI Backup Node Non Requestor Nodes SMHV Service (VSS Requester) VSS Requester (no participation) VSS Service VSS Service Hyper-V writer CSV writer Hyper-V writer CSV writer CSV Providers CSV Providers Data ONTAP Hardware provider Hardware provider (no participation) VM1 VM3 “Host1” Demosvr-01 “Host2” Demosvr-02 VM2 VM4 VHD CSV iSCSI, FCP, FCoE Single Windows Volume Data ONTAP®
44
CSV Backup using NetApp SnapManager for Hyper-V
Backup Demo CSV Backup using NetApp SnapManager for Hyper-V Steve Wienfeld TMEA Microsoft Lead NetApp Corporation
45
Summary Key Takeaways INFRASTRUCTURE
CSV significantly enhanced in Windows Server 2012 Support for more workloads High performance Name a concern, it’s gone! CSV is a core infrastructure to enable your private cloud INFRASTRUCTURE as a SERVICE
46
Related Content WSV310 Windows Server 2012: Cluster-in-a-Box, RDMA, and More WSV324 Building a Highly Available Failover Cluster Solution with Windows Server 2012 from the Ground UP VIR301 Windows Server 2012 Hyper-V Storage VIR302 Enabling Disaster Recovery for Hyper-V Workloads Using Hyper-V Replica VIR304 Building Flexible Hyper-V Environments Windows Server 2012 Hyper-V Live Migration and Live Storage Migration VIR306 Hyper-V over SMB: Remote File Storage Support in Windows Server 2012 Hyper-V VIR401 Hyper-V High-Availability and Mobility: Designing the Infrastructure for Your Private Cloud Find Us Later at the “Availability” Booth
47
Resources Failover Clustering Blog Failover Discussion Forum
48
SIA, WSV, and VIR Track Resources
#TEWSV430 Talk to our Experts at the TLC Hands-On Labs DOWNLOAD Windows Server 2012 Release Candidate microsoft.com/windowsserver DOWNLOAD Microsoft System Center 2012 Evaluation microsoft.com/systemcenter
49
Resources Learning TechNet http://europe.msteched.com
Connect. Share. Discuss. Microsoft Certification & Training Resources TechNet Resources for IT Professionals Resources for Developers
50
Submit your evals online
4/25/2017 4:07 PM Evaluations Submit your evals online © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
51
4/25/2017 4:07 PM © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Similar presentations
