5 reasons to store your backups on ReFS 3.0 and Storage Spaces

Slides:



Advertisements
Similar presentations
Review DirectQuery in SSAS 2016, best practices and use cases
Advertisements

Understanding Office MAC: What Windows Admins need to know
Learn how the cloud is accelerating network transformation
C# and VB code-focused development with Visual Studio
2/20/2018 7:04 PM BRK1038 Meet Azure Information Protection customers and learn about their success stories Jeffrey Kalfut Strategy & Architecture Manager,
BRK1017 Taking your hybrid management and security strategy to the cloud with Operations Management Suite Jeremy Winter and Srini Chandrasekar.
Enterprise grade security in your Hadoop clusters on Azure
Microsoft Ignite /30/2018 9:28 PM BRK3174
Extending IT Best Practices to Microsoft Azure
Transform yourself and build your IT cloud career path
Deliver business insights with Microsoft Dynamics AX and Power BI
Microsoft Virtual Academy
Examine information management in Cortana Intelligence
Develop, debug and deploy containerized applications with Docker
Microsoft Ignite /22/2018 7:21 PM BRK2007
Operational Analytics in SQL Server 2016 and Azure SQL Database
Build interactive data analysis environments using Apache Spark
Microsoft /2/2018 3:42 PM BRK3129 Query Big Data using the Expanded T-SQL footprint with PolyBase in SQL Server 2016 Casey Karst Program Manager.
Use any Amazon S3 application with Azure Blob Storage
BRK3288-Discover data-driven apps that learn and adapt
Microsoft /4/ :15 PM THR2219 How Microsoft IT enables modern mobility with Windows 10 security and productivity features Rekha Nair IT Program.
Windows Server* 2016 & Intel® Technologies
Architecting Data Protection for Azure and Beyond with Rubrik
Configure and Manage Your Hybrid Cloud Environment at Scale
Conduct a successful pilot deployment of Microsoft Intune
Review the Nutanix Cloud Platform System Standard solution
Microsoft Ignite /11/2018 1:18 AM BRK4017
Microsoft /23/2018 1:11 AM BRK3180 Migrate CRM OnPremise organizations to CRM Online cloud using Dynamics Lifecycle Services (LCS) Aditya Varma Ganapathy.
Web development productivity with Visual Studio
Deep Dive into the Azure Container Service
Matching Storage Spaces Direct Configurations to Your Workload
Innovate with Microsoft BI in the enterprise
Red Hat OpenShift on Microsoft Azure
Elastic database patterns for SaaS applications in Azure
Microsoft Ignite /17/ :54 PM BRK2092
Microsoft Ignite /22/2018 3:27 PM BRK2121
Secure Remote Access to on-premises Web Apps using Azure AD
BRK2264 Move 13,000+ global Dynamics CRM users from on-premises to Online at Caterpillar Inc. Todd Byrne & John Finney 1 Business Unit Name Here.
Master Modern PaaS for the Enterprise with Azure App Service
BRK1018 Discover how Manulife and Rackspace manage their hybrid environments today Satya Vel Principal Program Manager Operations Management Suite + System.
Get Started with Common Data Model (CDM) and PowerApps
Microsoft Ignite /8/2018 3:50 PM BRK2112
Design Seamless Upgrades to SQL Server 2016 with Query Store
Microsoft /8/2018 4:45 PM BRK3062 BRK3062- Build smarter and scalable applications using Microsoft Azure Database Services Moshe Gutman CEO, GeoSafe.
9/11/2018 4:02 PM BRK2161 Maximize storage efficiency and conquer distributed file access with Windows Server and Azure Files Will Gries, PM Fabian Uhse,
Serverless Architecture in Azure
Bring new levels of visibility to your datacenter with Cisco Tetration
Microsoft Ignite /16/2018 2:39 PM BRK3307
Add intelligence to Dynamics AX with Cortana Intelligence suite
Use server-based personal desktops in Windows Server 2016
Monitor your Microservices with Application Insights
Business Continuity & Disaster Recovery
Azure SQL Data Warehouse Scaling: Configuration and Guidance
Accelerate Your Transition from Traditional IT to the Cloud
Deploy Windows 10 Mobile for the mobile workforce
Dive deep into ASP.NET Core 1.0
Explore web development with Microsoft ASP.NET Core 1.0
Microsoft Ignite /14/ :21 AM BRK2101
Migrate to CRM Online - Tips and Tricks
Determine your role in a managed service
Dive into Predictive Maintenance using Cortana Intelligence Suite
Secure your Active Directory to mitigate risk in the cloud
Project Springfield Fuzz your code before hackers do
Microsoft Ignite /22/2018 3:58 PM BRK2254
Automating Windows 10 and software deployments from the Cloud
Task recorder in Dynamics AX
TechEd /28/ :51 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
Learn how to use and customize the Dynamics AX interactive help system
Discussion Panel: Windows Server MVP Panel
Microsoft Virtual Academy
Presentation transcript:

5 reasons to store your backups on ReFS 3.0 and Storage Spaces Microsoft 2016 11/25/2017 3:56 PM THR3032 5 reasons to store your backups on ReFS 3.0 and Storage Spaces Anton Gostev VP, Product Management Veeam Software © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

“It saves time and disk space while reducing risk” Microsoft 2016 11/25/2017 3:56 PM The Real Game Changer Flemish Information Agency (Belgium government agency) “ReFS v3 for backup storage is technology C-level managers understand perfectly. It saves time and disk space while reducing risk and optimizing operational efficiency.” “It saves time and disk space while reducing risk” – Didier Van Hoye © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Typical Backup Storage Requirements 11/25/2017 3:56 PM Typical Backup Storage Requirements Scalability Backup size + Horizontal expandability Performance Backup performance (backup window and RPO) + Restore performance (RTO) Cost Disk space consumption by backup archive + Hardware costs Integrity Ensure consistency + Detect silent data corruption Reliability Recover from data corruption © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11/25/2017 3:56 PM Scalability © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Backup Size ReFS is built to scale 11/25/2017 3:56 PM Backup Size ReFS is built to scale The file system for the following decade (or two) 64-bit file system > most limits are 2^64 That is 18 billions billions of objects, or 16 EB data size (16,384 PB) No nasty NTFS limitations 64TB chkdsk volume limit of NTFS, max file fragments issues (FORMAT /L for 4096 FileRecords) © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Horizontal Expandability 11/25/2017 3:56 PM Horizontal Expandability Core feature of Storage Spaces Simple expansion [up to a few nodes] with classic Storage Spaces Storage Spaces Direct make it easy to go up to 16 nodes (but requires Datacenter licensing) 4PB maximum storage pool size But unlimited pools in the system (and unlimited number of spaces in pool) © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11/25/2017 3:56 PM Performance © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Backup Window Write performance Write I/O test 11/25/2017 3:56 PM Backup Window Write performance ReFS is perfect for fat and slow hard drives because it behaves like log-structured file system when data integrity streams are enabled, eliminating I/O blender effect Write I/O test How 100% 4KB random writes land to the disk © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Restore Performance Read performance Read I/O test 11/25/2017 3:56 PM Restore Performance Read performance ReFS is perfect for fat and slow hard drives because it was built to optimize reads via allocation and defrag policies (and again, enabling data integrity streams makes it even better for slow storage) Read I/O test How 100% random address requests land on the disk Perfect for running VMs directly from backup files! © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Backup File Management 11/25/2017 3:56 PM Backup File Management Accelerated full backup file transformations BlockClone API allows to create and modify files without actually moving data blocks around Up to 20x times faster performance By the way – the same API is used by Hyper-V 2016 to commit snapshots on ReFS © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Incremental Backup A1 A0 B0 C0 A2 C1 .vib 1 .vbk 1 40% 30% 60% 50% Incremental Backups .vib 1 A1 A0 B0 C0 .vbk 1 Full Backup 40% 30% 60% 50% .vib 2 A2 .vib 3 C1 Backup Repository

Synthetic Full Backup (Legacy) Incremental Backups .vbk 2 Synthetic Full 70% 80% 90% 60% A0 A1 A2 A2 B0 B0 C0 C1 C1 .vbk 1 .vib 1 .vib 2 .vib 3 Backup Repository

Synthetic Full Backup (ReFS) Incremental Backups A2 B0 C1 .vbk 2 Synthetic Full 60% A0 A1 A2 Fast clone reference to existing blocks B0 C0 C1 .vbk 1 .vib 1 .vib 2 .vib 3 ReFS Backup Repository

Storage Spaces for Even More Performance 11/25/2017 3:56 PM Storage Spaces for Even More Performance Automatic storage tiering (SSD/HDD) Backups land on SSD reducing backup window and accelerating restore from the latest restore points Works differently depending on Storage Spaces flavor Real-time tiering for Storage Spaces Direct  Scheduled task for classic Storage Spaces  © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11/25/2017 3:56 PM Cost © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Cost Hardware costs The case of missing ReFS dedupe? 11/25/2017 3:56 PM Cost Hardware costs General purpose servers and JBODs – enough said The case of missing ReFS dedupe? Pluggable architecture allows integrating software dedupe, which brings some unique benefits Disk space consumption by backup archive Raw disk space consumption by GFS backup archive rivals that of deduplicating storage appliances! Makes deduplication of encrypted backup files possible (matching data blocks are tracked by software) © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Synthetic Full Backup (ReFS) Incremental Backups A2 B0 C1 .vbk 2 Synthetic Full 60% A0 A1 A2 Fast clone reference to existing blocks B0 C0 C1 .vbk 1 .vib 1 .vib 2 .vib 3 ReFS Backup Repository

11/25/2017 3:56 PM Integrity © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Integrity Prevents data corruption Detects silent corruption 11/25/2017 3:56 PM Integrity Prevents data corruption ReFS ensures consistency with allocate-on-write, so that data blocks are never modified in-place. Enabled by default for metadata, and for file data with data integrity stream enabled. Detects silent corruption ReFS data integrity scanner detects and notifies you about silent data corruption aka “bit rot” © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11/25/2017 3:56 PM Reliability © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Reliability Production ready Proactive error correction 11/25/2017 3:56 PM Reliability Production ready Recommended file system for Hyper-V 2016 – enough said Proactive error correction Backing ReFS volume with Storage Spaces enables seamless error correction Automatic healing of corrupted data blocks Error correction uses mirror or parity copy of the affected block from another system © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Windows Server 2016: Pick any 5 11/25/2017 3:56 PM Windows Server 2016: Pick any 5 Scalability Backup size + Horizontal expandability Performance Backup performance (backup window) + Restore performance (RTO) Cost Disk space consumption by backup archive + Hardware costs Integrity Ensure consistency + Detect silent data corruption Reliability Recover from data corruption © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

How to Enable Data Integrity Stream 11/25/2017 3:56 PM How to Enable Data Integrity Stream Set-FileIntegrity X:\Backups\backup.vbk Get-FileIntegrity X:\Backups\backup.vbk © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Free IT Pro resources To advance your career in cloud technology Microsoft Ignite 2016 11/25/2017 3:56 PM Free IT Pro resources To advance your career in cloud technology Plan your career path Microsoft IT Pro Career Center www.microsoft.com/itprocareercenter Cloud role mapping Expert advice on skills needed Self-paced curriculum by cloud role $300 Azure credits and extended trials Pluralsight 3 month subscription (10 courses) Phone support incident Weekly short videos and insights from Microsoft’s leaders and engineers Connect with community of peers and Microsoft experts Get started with Azure Microsoft IT Pro Cloud Essentials www.microsoft.com/itprocloudessentials Demos and how-to videos Microsoft Mechanics www.microsoft.com/mechanics Connect with peers and experts Microsoft Tech Community https://techcommunity.microsoft.com © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Please evaluate this session 11/25/2017 3:56 PM Please evaluate this session Your feedback is important to us! From your PC or Tablet visit MyIgnite at http://myignite.microsoft.com From your phone download and use the Ignite Mobile App by scanning the QR code above or visiting https://aka.ms/ignite.mobileapp © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.