Download presentation
Presentation is loading. Please wait.
Published byMartin Powell Modified over 9 years ago
1
Continuously Available File Server: Under the Hood Claus Joergensen Principal Program Manager Microsoft Corporation WSV410
3
File Server Shared Storage Shared Storage Hyper-V Server App Server Web Server DB Server SQL Server IIS
4
Clustered File Server Application Servers Single File System Namespace Cluster Shared Volumes Single Logical File Server (\\fs\share) Data Center Network (Ethernet, InfiniBand or combination) *) Capabilities highlighted in orange are unique to Scale-Out File Server
5
title Setup and Configuration
8
title Cluster Shared Volumes
12
title Anatomy of a Scale-Out File Server
13
Get-ClusterGroup | ? {$_.GroupType -eq "ScaleoutFileServer"} | FL Name, OwnerNode, State, GroupType Name : smbsofs33 OwnerNode : FSF-260403-07 State : Online GroupType : ScaleoutFileServer Get-ClusterGroup | ? {$_.GroupType -eq "ScaleoutFileServer"} | Get-ClusterResource Name State OwnerGroup ResourceType ---- ----- ---------- ------------ Scale-Out File Server Online smbsofs33 Scale Out File Server smbsofs33 Online smbsofs33 Distributed Network Name
14
> smbsofs33 Server: stb-red-dc-01.stbtest.microsoft.com Address: 10.200.81.201 Non-authoritative answer: smbsofs33.ntdev.corp.microsoft.com Name: smbsofs33.ntdev.corp.microsoft.com Addresses: 2001:4898:0:fff:0:5efe:10.217.108.49 2001:4898:0:fff:0:5efe:10.217.108.103 2001:4898:0:fff:0:5efe:10.217.108.148 10.217.108.148 10.217.108.49 10.217.108.103
15
> smbsofs33 Server: stb-red-dc-01.stbtest.microsoft.com Address: 10.200.81.201 Non-authoritative answer: Name: smbsofs33.ntdev.corp.microsoft.com 2001:4898:0:fff:0:5efe:10.217.108.49 Addresses: 2001:4898:0:fff:0:5efe:10.217.108.49 2001:4898:0:fff:0:5efe:10.217.108.103 2001:4898:0:fff:0:5efe:10.217.108.148 10.217.108.148 10.217.108.148 10.217.108.49 10.217.108.103 > smbsofs33 Server: stb-red-dc-01.stbtest.microsoft.com Address: 10.200.81.201 Non-authoritative answer: Name: smbsofs33.ntdev.corp.microsoft.com 2001:4898:0:fff:0:5efe:10.217.108.103 Addresses: 2001:4898:0:fff:0:5efe:10.217.108.103 2001:4898:0:fff:0:5efe:10.217.108.148 2001:4898:0:fff:0:5efe:10.217.108.49 10.217.108.49 10.217.108.49 10.217.108.148 10.217.108.103
18
Scale-Out File Server Cluster Node A Node B SQL Server Node C Get-SmbWitnessClient | FL ClientName, FileServerNodeName, WitnessNodeName ClientName : SQLServer FileServerNodeName : A WitnessNodeName : B Move-SmbWitnessClient –ClientName SQLServer –DestinationNode C
19
Scale-Out File Server Cluster Node A Node B SQL Server Node C
20
Storage IO (FC, iSCSI, SAS) Metadata Mirrored Spaces Storage Link Failures SMB Client To SMB Server
21
title Scale-Out File Server Scalability and Performance
22
2x10Gbps
23
LocalRemote Overall throughput (MiBps)6,1006,000 Delta from local~2% LocalRemote ~2% Bottlenecked on 2x4Gbps FC
24
Individual VM Boot Time (in seconds) LocalRemote Minimum1819 Maximum3436 Average2325 Individual VM Boot Time (in seconds) EnabledDisabled Minimum1918 Maximum611141 Average29211 With CSV cache enabled, 90% booted in <40s
25
title SMB Transparent Failover
26
File Server Cluster Node A Node B \\fs1\share SQL Server
27
File Server Cluster Node A Node B \\fs1\share SQL Server
28
SMB Server SMB Client SMB Server User Kernel User Kernel Witness Service Witness Client Witness Protocol SMB Redirector File System Resume Key Filter SMB Server SMB 3.0 Operation replay State persistence User Kernel
29
SMB Server SMB Client SMB Server User Kernel User Kernel Witness Service Witness Client Witness Protocol SMB Redirector File System Resume Key Filter SMB Server SMB 3.0 Operation replay State persistence User Kernel
34
Volume Protection Database is being loaded from store All creates are held until complete (<3s) Namespace protection Local handles are being established All rename and create operations are blocked until complete (<60s) Create Protection Remote handles are being resumed All new creates are blocked until all handles are resumed or cancelled (<60s) Handles Cancelled Unclaimed handles are cancelled to release file create blackout
36
File Server Cluster Node A Node B \\fs1\share SQL Server
37
File Server Cluster Node A Node B \\fs1\share SQL Server
39
demo Claus Joergensen Principal Program Manager Windows File Server Team Scale-Out File Server
40
Cluster in a Box prototypes Quanta Wistron LSI HA-DAS MegaRAID ® and SAS controllers Quanta application servers, JBOD expansion, and 10GbE switch Mellanox IB FDR NICs and switch OCZ SAS SSDs Infrastructure Domain Controller server Power distribution unit 1GbE switch Keyboard & monitor MegaRAID ® is a registered trademark of LSI Corporation
41
File Server Shared Storage Shared Storage Hyper-V Server App Server Web Server DB Server SQL Server IIS
42
Breakout Sessions VIR306 Hyper-V over SMB2: Remote File Storage Support in Windows Server 2012 Hyper-V WSV303 Windows Server 2012 High-Performance, Highly-Available Storage Using SMB WSV310 Windows Server 2012: Cluster-in-a-Box, RDMA, and More WSV314 Windows Server 2012 NIC Teaming and Multichannel Solutions WSV322 Update Management in Windows Server 2012: Revealing Cluster- Aware Updating WSV330 How to increase SQL availability and performance using Window Server 2012 SMB 3.0 solutions WSV334 Windows Server 2012 File and Storage Services Management
43
Talk to our Experts at the TLC #TE(sessioncode) DOWNLOAD Windows Server 2012 Release Candidate microsoft.com/windowsserver Hands-On Labs DOWNLOAD Windows Azure Windowsazure.com/ teched
44
Connect. Share. Discuss. http://northamerica.msteched.com Learning Microsoft Certification & Training Resources www.microsoft.com/learning TechNet Resources for IT Professionals http://microsoft.com/technet Resources for Developers http://microsoft.com/msdn
45
Required Slide Complete an evaluation on CommNet and enter to win!
49
title Appendix
50
Server State PreservationState AffectedComments Preserved (for persistent handle timeout interval) – for transient/permanent network disconnects, server failovers In progress CREATEsReplay, duplicate resolved via GUID Opened file handlesFenced until client replays the open with same GUID. Includes support for Desired Access, Share modes Read/Write I/OsMust ensure all writes prior to failover are flushed before processing replay of reads or writes In-progress byte range locksReplay, duplicate resolved via sequence numbers Established byte range locksServer preserves, client does not replay Sticky timestampsOffice interop SMB2 FIDs describing open handlesOnly the persistent portion of SMB2 FID is needed Not preserved (client replays, etc) Enumeration of dir & EAsClient restarts enumeration (Win32 API compliant) CloseClient replays Change notification queue/blockClient handles this Oplock stateNot Continuously Available – only used by down- level SMB clients, which don’t use CA MixedIn progress lease breaksReplay if reconnect to same node. More complex if new node. Renegotiated on reconnect File and directory lease stateRenegotiated on open re-establishment. Write+Handle leases are preserved. SMB 3.0 Server User Kernel User Kernel SMB2 Redirector File System Resume Key Filter SMB2 Server SMB 3.0 Operation replay State persistence
51
State Preservation Action State AffectedComments Simple Replay of operation (requires server state to ensure correct operation) CREATE (file or directory)Using prior Create GUID, issue “re-open”. Read or Write I/OsReplay (after Create is reconnected). Rename/set DELETE_DISPOSITIONSMB2 FID or GUID used for open data handles, lease handles, opened for delete/rename handles. In progress byte range lock requestsReplay - duplicates resolved via sequence numbers FSCTLsReplay after re-open CloseReplay (re-open, then close), but re-open fails, is okay Attempt to replay, potentially renegotiate Directory Lease stateRenegotiation can cause directory cache flush. File Lease stateWrite+Handle leases preserved, all else could be renegotiated Cached file data & metadataWrite-Back data cache is preserved. May cause flush of metadata and/or read caches. Other ActionGranted byte range locksNo replay – server preserves. Enumeration State (dir and EAs)Start enumeration over, skip entries already returned. Change notification queue/blockComplete to app with error code to force re- enumeration/requeue. SMB 3.0 Server User Kernel User Kernel SMB2 Redirector File System Resume Key Filter SMB2 Server SMB 3.0 Operation replay State persistence
52
AreaFeature / capability Clustered File Server “Classic”Scale-Out Data management BranchCache Data de-duplication DFS Namespaces - Root DFS Namespaces - Leaf DFS Replication FSRM (Quota, Screening, Reporting) FSRM Classification File Server VSS Agent Folder Redirection Client Side Caching Apps Information Worker Not recommended Hyper-v SQL Server AreaFeature / capability Clustered File Server “Classic”Scale-Out SMB Capabilities SMB Transparent Failover SMB Scale-Out SMB Multichannel SMB Direct SMB Encryption File System NTFS ReFS CSVFS
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.