Veeam Roadshow - Better together: Veeam Backup & Replication & NetApp – full Performance with Snapshots Andreas Neufert, Solutions Architect Central EMEA.

Slides:



Advertisements
Similar presentations
VMware Site Recovery Manager on NetApp Storage
Advertisements

Storage-Virtualisierung: NetApp arbeitet für 2. Und für die Hälfte. Helmut Putzenlechner Systems Engineer NetApp Austria GmbH.
Copyright © 2012 DataCore Software Corp. – All Rights Reserved. Practical High Availability NAS Cost-effective, non-stop disk access for clustered file.
NetApp Confidential - Limited Use
Microsoft System Center Data Protection Manager Mat Young – Storage Technology Architect, Microsoft EMEA Justin Alderson – Storage Specialists Manager,
Remove the hurdles to offsite backup Highly efficient Automatically copies VMs to local or offsite storage location Validation and remediation.
Tag line, tag line Protection Manager 4.0 Customer Strategic Presentation March 2010.
Business Continuity Challenges App and Data Growth’s Impact on business continuity Increasing costsToo many complications, problems and mistakes.
Tarinoita älykkäistä levyjärjestelmistä Jyrki Rikalainen Sales Engineer Network Appliance Finland
Tag line, tag line SnapDrive for Windows 6.2 Customer Technical Presentation November 2009.
DataCore Software Proprietary Information Virtualize Your Storage! DataCore and Citrix Simple & Affordable Virtualization Unmatched Agility, Productivity.
1 Disk Based Disaster Recovery & Data Replication Solutions Gavin Cole Storage Consultant SEE.
Shared File Service VM Forum January, SFS Topics Targeted Usage Security Accessing CIFS Shares Availability & Protection Monitoring Pricing.
AGILE DATA ARCHITECTURE. Agile Data Architecture 2 Fit-for-purpose solution Enables self-service data management.
Seagate Hybrid Systems & Solutions
Information Means The World.. Enhanced Data Recovery Agenda EDR defined Backup to Disk (DDT) Tape Emulation (Tape Virtualization) Point-in-time Copy Replication.
Keith Burns Microsoft UK Mission Critical Database.
Virtual techdays INDIA │ September 2011 High Availability - A Story from Past to Future Balmukund Lakhani │ Technical Lead – SQL Support, Microsoft.
NetApp The perfect fit for Virtual Desktop Infrastructure
Veeam Availability Suite v8
Business Continuity and DR
Tag line, tag line N series Integrated Data Protection George Mobargha Technical Partner Manager IBM Global Alliance.
© 2006 DataCore Software Corp DataCore is Virtual Infrastructure Flexibility, Utilization, Productivity, Cost-Savings and Hardware Independence Simple.
DPM 2012 Centralized Management Express full backup of Hyper-V standalone VMs Data Source Extensibility Framework Certificate Based.
1© Copyright 2013 EMC Corporation. All rights reserved. EMC AVAMAR FOR NAS ENVIRONMENTS Backup, recovery, and disaster recovery for network-attached storage.
Modern Data Protection
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP 3PAR StoreServ 7000.
Double-Take Software Overview A Platform for Recoverability.
© 2010 IBM Corporation Kelly Beavers Director, IBM Storage Software Changing the Economics of Storage.
© 2010 IBM Corporation Storwize V7000 IBM’s Solution vs The Competition.
SnapManager 2.0 for Virtual Infrastructure Product Manager Lisa Haut-Mikkelsen Technical Marketing Engineer Amrita Das.
XenDesktop Built on FlexPod Flexible IT Infrastructure for Desktop Virtualization.
Whiteboard Development Develop whiteboard visually in this slide. Use PowerPoint drawing tools and assets copy/paste from previous slide. Duplicate as.
Offsite Backup Solutions Justin Paul Senior Virtualization Engineer / VMware vExpert –
Content from Analyst Day November 2004 NY Pressures on IT Groups Do more with less Keep running globally 24x7 Adapt rapidly to changes Maximize value.
Data Center Back-up: Data Sustainability on a Budget Mike DeNapoli Enterprise Systems Engineer Double-Take Software.
4/23/2017 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
VVT 2011 Vendredi 24 Juin Outils de Management NetApp.
James Bahn, NetApp VMworld 2013 SnapProtect for VMware Environments 1.
Engr. Gideon Fatunmbi 05/08/2015 FAS2200 Series Customer Presentation.
Microsoft Virtual Academy Module 8 Managing the Infrastructure with VMM.
Availability on Demand (Business Continuity and DR, and more…)
Microsoft Virtual Academy. Microsoft Virtual Academy First HalfSecond Half (01) Introduction to Microsoft Virtualization(05) Hyper-V Management (02) Hyper-V.
Cluster Shared Volumes Reborn in Windows Server 2012
VRanger 7.0 Key Features in vRanger Revision: 3. Near Continuous Data Protection (CDP) with recovery to any point-in- time in seconds to minutes Understanding.
Configuring, Managing and Maintaining Windows Server® 2008 Servers Course 6419A.
Backups Discussion document. Backup – End State Utilize Netapp -SnapManager for Virtual Infrastructure (SMVI) – currently deployed -All VMDKs will be.
Storage Netværk Mød Microsoft Feb 2005, Agenda Data Protection Server (opdatering) Microsoft og iSCSI Demo.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
NetApp: for the Cloud All Flash SDN © 2015 NetApp, Inc. All rights reserved. NetApp Confidential – Limited Use 1.
1 F5 BIG-IP and NetApp SnapMirror & SnapVault F5 is a NetApp Advantage Alliace Partner with continuous engagement across teams in product management, product.
From VMware to Proxmox Federico Calzolari Scuola Normale Superiore - INFN Pisa.
Why Rocket Arkivio May, Storage Trends and Data Growth © 2012 Rocket Software, Inc. All Rights Reserved.
William Durkin A Gourmet Menu of SQL Server High Availability Options.
Key Commvault Terms Virtual Server Agent (VSA) – Agent installed on Windows server that backs up VMware VM via VADP API. Vmware vSphere server – Physical.
CDP Technology Comparison CONFIDENTIAL DO NOT REDISTRIBUTE.
Veeam Availability Suite v9. Availability for the Always-On Enterprise.
Syncsort Confidential and Proprietary – do not copy or distribute 1 Name Title 1 ECX Enterprise Catalog Syncsort Confidential and Proprietary – do not.
Commvault and Nutanix October Changing IT landscape Today’s Challenges Datacenter Complexity Building for Scale Managing disparate solutions.
Continuous Availability for Business-Critical Data MetroCluster Technical Overview.
Data Availability for the Always-On Enterprise
Veeam Availability Suite v10: A Deeper Dive of What’s New
Delivering Modern Data Management
iSCSI Storage Area Network
Briefing: Leverage HPE Storage Solutions in Windows/Hyper-V
Microsoft Azure P wer Lunch
Using the Cloud for Backup, Archiving & Disaster Recovery
About ProLion CEO, Robert Graf Headquarter in Austria
Veeam Backup & Replication
DataOptimizer Transparent File Tiering for NetApp Storage Robert Graf
Presentation transcript:

Veeam Roadshow - Better together: Veeam Backup & Replication & NetApp – full Performance with Snapshots Andreas Neufert, Solutions Architect Central EMEA Veeam Software GmbH andreas.neufert@veeam.com +49 173 8393888 Dieter Unterseher Solutions Architect Data Protection NetApp Germany dieter.unterseher@netapp.com +49 151 12055719 Abstract: The always-on business requires strict and demanding uptimes, together with great protection and recovery performances. To fulfill these service levels with their stakeholders, IT departments need to leverage any modern technology able to improve their data availability. But this is not an easy task; protection activities during working hours have an impact on production performances, snapshots and their remote copies are powerful but sometimes cumbersome for restores, and application consistency is not always easy to obtain. As long as the different components of the datacenter are siloed and not deeply integrated, this is hardly going to change. A tight integration between the Data Availability solution and the storage is the best solution to solve these problems, and to dramatically improve the level of Data Availability. Veeam Backup & Replication v8 has introduced support for Netapp FAS and FlexArray storage arrays, and with this technical integration it can execute storage-assisted data protection operations: backups directly from storage snapshots can be executed more frequently, with less impact, even during production hours; and at the same time, Veeam technology offers a complete set of restore capabilities to dramatically minimize downtimes, and easily restore entire virtual machines, virtual disks, single files, or application items. The integration is complete, and can be used in any Netapp deployment scenario: both block (iSCSI, FC) and NFS volumes are supported, with 7-mode or Clustered-mode arrays. And the integration is seamless: Veeam Backup & Replication can read and run restores from primary snapshots, SnapMirror and SnapVault volumes, and also save its backups into SnapVault. A comprehensive integration to leverage all the power of Netapp and Veeam. In this session, you will learn about: how Veeam Backup & Replication integrates with Netapp arrays Veeam Backup from Storage Snapshots Veeam Explorer for Storage Snapshots Veeam Backup Vaulting

NetApp Data ONTAP Storage & Data Protection Techniques 11. Mar 2014 (collected by Dieter Unterseher, no guarantee)

NetApp Integrated Data Protection and Business Continuity Solutions Continuous Operations Availability Asynchronous Replication Synchronous Clusters MetroCluster™ Block-Level Incremental Backups Asynchronous SnapMirror® Cost SnapVault® Application Recovery SnapRestore® (currently not usable by Veeam) Daily Backup NetApp Software Architecture This slide shows that NetApp has data protection and business continuity solutions for all levels of availability requirements. Snapshot™ Copies Local Restore Remote Restore Remote Recovery – Low RTO Capability 11. Mar 2014 (collected by Dieter Unterseher, no guarantee)

Policy-Based Data Management NetApp Clustered ONTAP: Data Agility & Always on Non-virtualized Servers Virtualized Servers Big Data Content Servers Workloads & Users A A B B C C D D E E Policy-Based Data Management Performance Issue Resolved System Upgrade Needed Replication Copy Creation - Workload A All Actions Occur Without Disruption to Users Performance Issue - Workload D Backup Copy Creation - Workload C Unexpected Growth in Workload B Capacity Expansion Needed Unexpected Growth -Workload E Growth Issue Resolved Unified Data Network FCP FCoE iSCSI CIFS/SMB NFS/pNFS Clustered ONTAP A1 C1

The Era of the Always-On Business Employees departing nine-to-five Operations across time zones Connected along the value chain Customers online Internet of Things Access to all data and applications anytime Zero tolerance for data loss Recovery Time & Recovery Point Objective (RTPO) < 15min Data Center Applications, Data, Infrastructure Why we need a deep integration with storage? Because it’s the era of always-on business. This means zero tolerance for data loss, and the need to satisfy demanding RPO and RTO for all workloads, not only Tier-1 applications. This can only be achieved by joining forces of a modern data availability solution (Veeam) with a modern storage solution (Netapp).

Backup VMware VMware Backup Server Administration Load balancing No Agents on VMs and VMware!!! Application-Aware-Consistency +VSS +Pre-/Post-Scripts + Application Restore switches + Logfile Truncation after Backup Backup Server VMware ESX(i) vSphere vCD Administration VMware Change-Block-Tracking Info Load balancing SureBackup – automatic restore tests Repository Server VMware VADP API based Data Transport Direct SAN / Hotadd / Network Block Level Incremental Forever Backup Deduplication +Compression +Parallel Processing +I/O Control + Encryption Proxy Server VM Snapshot

Lower RPO times

RPO ? At Backup you need to transport data and consistency processing reduce performance of applications Veeam Backup Processing only 1-4x a day Solution: Use Storage Snapshots between the Backups 8 PM Backup 1 PM Snap 2 PM 3 PM 4 PM 5 PM 8 AM 9 AM 10 AM 11 AM 12 PM

Veeam Explorer for Storage Snapshots (VMware) Low RPO Snapshot Explorer for Storage Snapshots Full VM (array based) Guest files (17 file systems) Exchange Items SharePoint Items Active Directory Objects SQL Server Databases FAS Series Restore SnapMirror SnapVault Efficient Replication Low RTO Veeam Restore FAS Series Combine low RPOs of NetApp snapshot copies with low RTOs of Veeam Explorer for Storage Snapshots Fastest RTO File-level recovery for 17 different file systems Item-level restores for four Microsoft applications Support for NetApp Snapshot NetApp SnapMirror NetApp SnapVault This feature is included in Veeam Backup Free Edition. Application Items are limited for export only in Free Edition. Each and any NetApp Customer can use it for VMware Restore out of NetApp Scheduled Snapshots

Multiple restores from snapshots

Minimal VMware Snapshot lifetimes

Backup VMware with Storage Snapshots No Agents on VMs and VMware!!! Application-Aware-Consistency +VSS +Pre-/Post-Scripts + Application Restore switches + Logfile Truncation after Backup Backup Server VMware ESX(i) vSphere vCD Administration VMware Change-Block-Tracking Info Load balancing SureBackup – automatic restore tests Repository Server Block Level Incremental Forever Backup Direct out of Storage Snapshot with use of VMware Change-Block-Tracking Deduplication +Compression +Parallel Processing +I/O Control + Encryption Proxy Server X VM Snapshot Storage Snapshot

VMware Snapshot challenges Standard VM Backup With NetApp Integration VM snap lifetime VM snap lifetime I/O I/O Backup Backup t t VM snap VM snap commit VM snap VM snap commit Storage Snap Delete Storage Snap High Load at Snapshot committ at Storage Take a long time, sometime hours/days Faster commit with less data. Nearly instant VM Snapshot committ. Use of Storage Snapshot for Backup

Example of a standard VMware API backup from a slow storage ~34 min open VMware VM Snapshot at this example. Veeam uses parallel Disk backup to reduce time window but the Snapshot is open for a long time. This leads in a ~28min Snapshot commit with high IO at Storage and performance impact on the VM What happens when a VMware backup is executed on a Veeam+NetApp environment? A vSphere snapshot is created to guarantee application consistency Volume containing the virtual disk is identified NetApp snapshot of the volume is created vSphere snapshot is committed Backup starts from the NetApp snapshot, while the VM runs in Vmware without any snapshot open affecting its performances

With Veeam Backup from Storage Snapshots VM Snapshot is open for some seconds and can committed in some seconds. This works with FC/iSCSI … AND… NFS Datastores. What happens when a VMware backup is executed on a Veeam+NetApp environment? A vSphere snapshot is created to guarantee application consistency Volume containing the virtual disk is identified NetApp snapshot of the volume is created vSphere snapshot is committed Backup starts from the NetApp snapshot, while the VM runs in Vmware without any snapshot open affecting its performances

One console for Backup and Snapshot Orchestration

Veeam Snapshot Orchestrator Use Veeam as a NetApp Console Create manual snapshots directly from Veeam interface Schedule Snapshot-only “backup” jobs (lowest RPO) SnapMirror and SnapVault orchestration for single-pass backup into two destinations (instant “Backup Copy”) It is important to not hit the max number of Snapshots per NetApp Volume (hard limit 255, never plan more than 250) with multiple Veeam Jobs. So the following recommendations should be considered: VMware Datastore Level Scope is recommended for Veeam Jobs if you want to use Veeam NetApp Snapshot Orchestration. It is recommended to place only 1 VMware Datastore on a NetApp volume. If only Veeam Snapshot Orchestration is used, follow the NetApp recommendations for Datastore Size and VM count. But if Veeam Backups are created on top of Veeam NetApp Snapshot Orchestration, we highly suggest to use not more than 15TB of VMware used data on a single VMware Datastore, which lead in not more than 8TB Veeam single full backup files. It is technically possible to grow beyond that. If you process Application Consistent Snapshots, keep an eye on the processing time for it, it can take a while for volume snapshot creation. Less VM count (round about 40-60VMs) per Datastore is helpful.

Create manual snapshot Create a manual snapshot of a LUN or NFS export directly from the Veeam console

Scheduled snapshot creation Create a manual snapshot of a LUN or NFS export directly from the Veeam console

Configure secondary destination Create a manual snapshot of a LUN or NFS export directly from the Veeam console

Browse snapshot content Create a manual snapshot of a LUN or NFS export directly from the Veeam console

3-2-1 Backup Concept

Backup Concept 1 – ONTAP Storage + Veeam v8 SnapMirror SnapVault VMware Any standard storage incl. ONTAP Tape ONTAP Veeam Backup (v8) Every 1 day for 1 month Veeam Backup (= 30 Restore Points) + optional Grandfather- Father-Son (GFS) retention weekly 5 restore points monthly 12 restore points yearly 2 restore points to disk or tape Veeam Backup & Replication (Orchestration of NetApp Snapshots and Veeam Backup from Storage Snapshot) Every 10 min for 1 day crash consistent Snapshots (= 144) Every 4h for 1 week Application- Consistent & Application- Aware Snapshots (= 42) *.vbk Every 4h for 1 month SnapMirror/ SnapVault update (= 180 Snapshots) *.vbk

Restore from Snapshot/Backup Restore Source Restorable Objects Snapshot with VMware VMs Primary Snapshot SnapMirror/SnapVault Snapshot Crash Consistent or Application Consistent Veeam Backups On Disk On Tape (with Disk staging) Instant VM Recovery VM Recovery Win/Linux/Unix Instant File Level Recovery AD/Exchange/Sharepoint Single Object Restore SQL DB Restore … Same as above + MS SQL Single DB Restore with logfile roll forward (with enabled Veeam logfile backup) SureBackup (OnDemand Labs + automatic restore tests) Universal Application Item Recovery *.vbk You can use NetApp SnapManager and/or NetApp SnapCreator to complement Veeam for additional applications like Oracle, SAP, SAP HANA, DB2, Informix and others

Technical Recommendations for ONTAP+Veeam setups It is important to not hit the max number of Snapshots per NetApp Volume (hard limit 255, never plan more than 250) with multiple Veeam Jobs. So the following recommendations should be considered: VMware Datastore Level Scope is recommended for Veeam Jobs if you want to use Veeam NetApp Snapshot Orchestration. It is recommended to place only 1 VMware Datastore on a NetApp volume. If only Veeam Snapshot Orchestration is used, follow the NetApp recommendations for Datastore Size and VM count. But if Veeam Backups are created on top of Veeam NetApp Snapshot Orchestration, we highly suggest to use not more than 15TB of VMware used data on a single VMware Datastore, which lead in not more than 8TB Veeam single full backup files. It is technically possible to grow beyond that. If you process Application Consistent Snapshots, keep an eye on the processing time for it, it can take a while for volume snapshot creation. Less VM count (round about 40-60VMs) per Datastore is helpful.

NetApp System Requirements Firmware Data ONTAP 8.1 or higher (NetApp FAS, FlexArray (V-Series), Edge VSA and IBM N series) Supported Access Protocols NFS, iSCSI or Fibre Channel (FC) ONTAP-Modes 7-Mode or Clustered-ONTAP Cloning Use of traditional LUN Cloning possible, but FlexClone Licenses are recommended for 7 mode systems. SnapVault/SnapMirror Licenses If you want to use SnapVault or SnapMirror relevant NetApp licenses are needed. Data Plattform VMware VMDK

Veeam Licensing Licensed per virtualization host socket Restore out of NetApp Snapshot (Primary/SnapMirror/SnapVault) known as Veeam Explorer for NetApp SAN Snapshots (VMware) Veeam Backup Free Edition including Application Single Object Export (Enterprise Edition includes Application Single Object Restore to original places). Snapshots can be triggered manual or by non Veeam scheduler. Veeam Backup from NetApp Storage Snapshot and Veeam NetApp Snapshot Orchestration (VMware) Veeam Backup & Replication Enterprise Plus Edition or Veeam Essentials Enterprise Plus Edition or Veeam Availability Suite Enterprise Plus Edition

Virtualization backup from any storage to NetApp E-Series with Veeam

E-Series Storage as target for Veeam Backup & Replication E-Series EF-Series E-Series Tape VMware/ Hyper-V Veeam Backup Veeam Backup Copy Job Any Storage Daily Backup 30 RestorePoints + optional GFS retention weekly 5 restore points monthly 12 restore points yearly 2 restore points Veeam Backup & Replication (Veeam VMware VADP API based backup) Daily Backup 30 RestorePoints *.vbk *.vbk + optional Tape retention weekly 5 restore points monthly 12 restore points yearly 2 restore points *.vbk *.vbk

Restore from Backup Restore Source Restorable Objects *.vbk Veeam Backups On Disk On Tape (with Disk staging) *.vbk Instant VM Recovery VM Recovery Win/Linux/Unix Instant File Level Recovery AD/Exchange/Sharepoint Single Object Restore MS SQL Single DB Restore with Logfile Rollforward (with enabled Veeam logfile backup) SureBackup (OnDemand Labs + automatic restore tests) Universal Application Item Recovery

NetApp E-Series Lab Test (Munich) A lab performance test of the Availability for the Modern Data Center™ program at NetApp® Labs Munich shows backup speed does not serve as a limiting factor for the modern data center when customers use Veeam® Backup & Replication™ in combination with NetApp EF- or E-Series storage. EF-Series *.vbk VMware ESXi LAN (1Gbps) FibreChannel (16Gbps) B&R Server Proxy/Repository E- Series Read Direct SAN Write Dedup/Compr.

NetApp E-Series Lab Test (Munich) A single Veeam Backup & Replication server (2 year old Hardware) was able to scale to 700MB/s. A nearly linear performance increase was achieved when additional Veeam proxy/repository servers were added. Backup Speed 2100 MB/s 1400 MB/s 700 MB/s … 1 2 3 Proxy/Repository # 10h 5h 3,3h Backup time window for 24TB

NetApp System Requirements E-Series (or EF-Series) as Backup Target. 10k Disks or faster are suggested as Veeam use many random read/write streams. Use RAID5 or RAID10 for less than 16 drives. If you have more than 16 drives, use one big Dynamic Disc Pool (DDP) with all drives and create multiple (min4) Raid6 volumes (8+2) on this pool. DDP increases performance for Veeam workloads, because the load is spread over all disks. On the same time it reduces critical Raid status time when a disk failure occurs, because all disks are holding spare capacity and are used for fast RAID rebuilds.

Veeam Licensing Licensed per virtualization host socket. E-Series or EF-Series can be used as Backup Target with all Veeam Backup & Replication Versions.

Hyper-V

Hyper-V + Veeam + NetApp Veeams Backup processing is able to use Storage Snapshots of NetApp ONTAP and E/EF-Series Storage Systems. It uses NetApp Hardware VSS Provider Veeams own Change Block Tracking Technology for Hyper-V can be used for Change Block Tracking based Incremental Forever Backups (and VM Replicas). All Restore possibilities possible out of Veeam Hyper-V Backups (like VMware), but it is not possible to restore out of a NetApp Snapshot that contains Hyper-V VMs. All Veeams Advanced Features (SureBackup/OnDemand Labs/Selfe Service/…) are available, too.

Q&A Andreas Neufert, Solutions Architect Central EMEA Veeam Software GmbH andreas.neufert@veeam.com +49 173 8393888 Dieter Unterseher Solutions Architect NetApp Germany dieter.unterseher@netapp.com +49 151 12055719 Abstract: The always-on business requires strict and demanding uptimes, together with great protection and recovery performances. To fulfill these service levels with their stakeholders, IT departments need to leverage any modern technology able to improve their data availability. But this is not an easy task; protection activities during working hours have an impact on production performances, snapshots and their remote copies are powerful but sometimes cumbersome for restores, and application consistency is not always easy to obtain. As long as the different components of the datacenter are siloed and not deeply integrated, this is hardly going to change. A tight integration between the Data Availability solution and the storage is the best solution to solve these problems, and to dramatically improve the level of Data Availability. Veeam Backup & Replication v8 has introduced support for Netapp FAS and FlexArray storage arrays, and with this technical integration it can execute storage-assisted data protection operations: backups directly from storage snapshots can be executed more frequently, with less impact, even during production hours; and at the same time, Veeam technology offers a complete set of restore capabilities to dramatically minimize downtimes, and easily restore entire virtual machines, virtual disks, single files, or application items. The integration is complete, and can be used in any Netapp deployment scenario: both block (iSCSI, FC) and NFS volumes are supported, with 7-mode or Clustered-mode arrays. And the integration is seamless: Veeam Backup & Replication can read and run restores from primary snapshots, SnapMirror and SnapVault volumes, and also save its backups into SnapVault. A comprehensive integration to leverage all the power of Netapp and Veeam. In this session, you will learn about: how Veeam Backup & Replication integrates with Netapp arrays Veeam Backup from Storage Snapshots Veeam Explorer for Storage Snapshots Veeam Backup Vaulting