Beruflich Dokumente
Kultur Dokumente
Replication 9.5
Nutanix Best Practices
Copyright
Copyright 2018 Nutanix, Inc.
Nutanix, Inc.
1740 Technology Drive, Suite 150
San Jose, CA 95110
All rights reserved. This product is protected by U.S. and international copyright and intellectual
property laws.
Nutanix is a trademark of Nutanix, Inc. in the United States and/or other jurisdictions. All other
marks and names mentioned herein may be trademarks of their respective companies.
Copyright | 2
Veeam Backup & Replication 9.5
Contents
1. Executive Summary................................................................................ 4
2. Introduction..............................................................................................5
2.1. Audience........................................................................................................................ 5
2.2. Purpose..........................................................................................................................5
2.3. Synergistic Technologies............................................................................................... 5
5. Conclusion............................................................................................. 25
Appendix......................................................................................................................... 26
About the Authors............................................................................................................... 26
About Veeam...................................................................................................................... 26
About Nutanix......................................................................................................................27
List of Figures................................................................................................................28
List of Tables................................................................................................................. 29
3
Veeam Backup & Replication 9.5
1. Executive Summary
Veeam is the Premier Availability solution provider for Nutanix, which offers a highly scalable
virtualization platform for desktop, server, and big data deployments. This document makes
recommendations for the optimization and scaling of Veeam Backup & Replication 9.5, part of
the Veeam Availability Suite, with Nutanix and VMware vSphere and Microsoft Hyper-V. It shows
the scalability of the Nutanix Enterprise Cloud Platform and provides configuration information on
the scale-out capabilities of both Veeam Backup & Replication and Nutanix.
Veeam Backup & Replication 9.0 and later versions support a new backup method for vSphere,
called Direct NFS. Direct NFS enables faster backups and helps minimize network bandwidth
consumption. For Hyper-V 2016 environments, resilient change tracking (RCT) is available with
Nutanix storage, which can significantly shorten the backup window. Both of these new features
can increase backup performance and reduce backup windows.
1. Executive Summary | 4
Veeam Backup & Replication 9.5
2. Introduction
2.1. Audience
This best practice document is part of the Nutanix Solutions Library and is intended for
individuals responsible for the architecture, design, management, and support of Veeam Backup
& Replication on Nutanix systems. Consumers of this document should be familiar with VMware
vSphere, Microsoft Hyper-V, Veeam Backup & Replication, and Nutanix.
2.2. Purpose
This document covers the high-level best practices for Veeam Backup & Replication 9.5 with
Nutanix, using VMware vSphere 5.5 through 6.5 or Microsoft Hyper-V 2012 R2 and 2016. We
also take a high-level look at Veeam Backup & Replication’s planned support for the native
Nutanix hypervisor, AHV.
This best practice guide is focused on an optimized disk-to-disk backup architecture. Veeam
Backup & Replication has a number of architecture options, and this guide covers the jointly
developed best practices.
Version
Published Notes
Number
1.0 September 2017 Original publication.
2. Introduction | 5
Veeam Backup & Replication 9.5
Version
Published Notes
Number
Updated for AOS 5.5 and Veeam Backup & Recovery
1.1 January 2018
9.5 U3.
Updated recommendations regarding Enable Same
1.2 February 2018
Host Direct NFS mode.
2. Introduction | 6
Veeam Backup & Replication 9.5
For more detailed information on the Nutanix Enterprise Cloud Platform, please visit
Nutanix.com.
Component Description
The Nutanix Controller VM (CVM) runs the Acropolis
Distributed Storage Fabric and serves all the I/O operations for
Nutanix Controller VM the hypervisor and VMs running on that host. The CVM pools
and exports storage to the hypervisor using the appropriate
protocol.
As the “brain” of the solution, Veeam Backup Server is
responsible for job management and scheduling, indexing
Veeam Backup Server
tasks, and general orchestration of the backup and replication
environment. The Backup Server can be virtualized.
A backup proxy is a lightweight Veeam architecture component
that sits between the data source and the backup target,
processing jobs and delivering backup traffic. Backup proxy
tasks include retrieving VM data from production storage,
Veeam Backup Proxy
then compressing, deduplicating, and sending that data to the
backup repository. Using more than one virtualized (or physical)
backup proxy lets you easily scale your backup infrastructure
based on the size of your Nutanix system.
Component Description
These systems provide the memory, storing backup archives
and their related metadata for future restores. A repository may
be a Windows or Linux server, a third-party NAS device, or a
Veeam Repository deduplication appliance. Repositories can be virtual or physical,
depending on requirements and available hardware. If the
repository is virtual, create fault domain isolation by storing it
separately from the Nutanix cluster that holds production data.
Technology Description
VMware vStorage APIs for Data Protection (VADP) was
introduced with vSphere 4.0, and is available in all licensed
editions. It is the next-generation backup framework that
VMware VADP
enables efficient agent-free backups. Veeam Backup &
Replication 9.5 uses the VADP framework for high-performance
backups.
Changed Block Tracking (CBT) is a component of VADP that
enables efficient incremental VM backups. It enables Veeam
Backup & Replication to back up only changed data blocks,
vSphere CBT
thus greatly increasing backup performance and reducing
network bandwidth. Read operations occur locally, eliminating
the load on the network and on other Nutanix nodes.
New to Hyper-V 2016 is native Resilient Change Tracking
(RCT) for VHDX virtual disks. RCT enables Veeam Backup &
Replication 9.5 to efficiently back up VMs and minimize backup
Hyper-V 2016 RCT windows. RCT offers a major improvement over Hyper-V 2012
R2, where incremental backups on Nutanix needed a full disk
scan to identify changed blocks, thus requiring additional I/O
and much more time.
Technology Description
Microsoft VSS is the framework for application-consistent
backups for Windows OS. Built into the operating system, VSS
enables the creation of a consistent snapshot of application
data, such as Microsoft Exchange, SQL, Active Directory,
Microsoft VSS or the NTFS file system. Veeam can use VSS to ensure
application-consistent backups for VSS-aware applications. All
hypervisors support enabling VSS in backup jobs. Veeam uses
VSS in a completely agentless fashion, using the hypervisor
communication stack to the benefit of the guest OS.
Note: For additional and more detailed sizing considerations, please refer to the
official Veeam best practices, available at https://bp.veeam.expert/.
Physical backup proxies are supported, but not ideal. A general rule for a physical proxy is one
core per 50 VMs, but this number greatly depends on VM size and the number of concurrent
backups. Proper testing for your environment is critical to ensure that you can meet backup
windows and RPOs. You may need to upsize the Veeam Backup & Repository server for your
environment.
Direct NFS
Direct NFS has several advantages over other transport modes and offers the best performance
and shortest possible backup windows. Each Nutanix node needs a local Veeam backup
proxy VM, as shown in the diagram above. The backup proxy is dual homed, with one NIC on
the internal Nutanix vSwitch, and the other NIC on the same network or VLAN that the ESXi
management network uses. The Nutanix whitelist then allows the backup proxy to access the
NFS datastores via the 192.168.5.0 network. Finally, within Veeam Backup & Replication, you
can configure the “preferred networks” rule to use the Nutanix 192.168.5.0 network for backups.
See Veeam’s Specifying Preferred Networks for Data Transfer article for more details.
We recommend using DRS “should” rules to pin each backup proxy VM to its respective host. In
addition, each backup proxy VM should have a unique 192.168.5.x address. This unique address
ensures that there is no IP conflict on the internal network during maintenance operations where
two proxy VMs may be on the same host.
During backup jobs, the Veeam Backup & Replication status screen displays a message similar
to “Using backup proxy VMware Backup Proxy for disk hard disk 1 [nfs].” If you look at the more
verbose backup log file, you should see “Connected to NFS server: 192.168.5.2, port 2049” and
some additional NFS information.
To optimize backup traffic within the NFS backend of Nutanix, we recommend implementing a
Veeam proxy for each ESXi host and enabling Veeam’s Same Host Direct NFS mode (value =
2, as described below) in the registry.
HKEY_LOCAL_MACHINE\SOFTWARE\Veeam\Veeam Backup and Replication
Key: EnableSameHostDirectNFSMode
Type: REG_DWORD
Value = 2
Value options:
• 0 (default): Disabled.
• 1: Preferred Same Host. If a Direct NFS proxy exists on same host, Veeam waits for a free
task slot there. If a proxy on same host does not exist, Veeam uses another Direct NFS proxy
(on another host or physical server) or falls back to virtual appliance (hot-add) and finally to
network (NBD) mode. This mode is not recommended with Nutanix.
• 2: Same Host Direct NFS mode. Recommended for Nutanix. If there is no Direct NFS proxy
on the same host as the VM, it falls back to network mode (NBD).
For the best performance of network transport mode, the ESXi management VMkernel port
must use the dual 10 GbE NIC interfaces. Managing the ESXi host through the 1 GbE NICs
severely degrades backup performance. Rather than using the 1 GbE NICs, consider creating
an additional VMkernel port over an available 10 GbE NIC interface, then configuring the Veeam
preferred backup network to use this network.
• If using vSphere 6.0, use at least ESXi 6.0 Build 5572656 (6.0 patch 5) to avoid serious CBT
bugs. We recommend using the latest patch wherever possible. See VMware KB 2143832 for
ESXi build numbers.
• Use AOS 5.0.x or later for all vSphere environments. For vSphere 6.5, use AOS 5.1 or later.
• Deploy one Veeam proxy VM per ESXi host, each with a unique IP on the 192.168.5.x
network.
• Set EnableSameHostDirectNFSMode to 1 (Veeam Backup & Recovery 9.5 U3 and later).
• Create DRS “should” rules to pin each Veeam proxy VM to the appropriate node.
• If you are using a virtualized repository server, configure a second SCSI controller to use with
the VMware PVSCSI controller. Add the repository disks to this second controller.
• Always use the VMXNET3 NIC for Veeam Backup & Replication VMs.
• Use the latest VM hardware version for Veeam Backup & Replication VMs.
• If you are using the VMware Distributed Switch (recommended), use LBT load balancing.
• Right-size the proxy VM according to Veeam best practices for your environment.
• Connect the ESXi VMkernel, CVM, backup proxy, and repository via 10 GbE on the same
layer-2 network.
• Use Direct NFS. Do not use network transport mode unless the environment is very small with
small VM change rates.
• Do not use virtual appliance backup mode.
• Do not enable NBDSSL unless required. If NBDSSL is required, be prepared for the
performance impact. See the screenshot below.
• When configuring the Veeam VMware proxy, select Direct storage access and enable
Failover to network mode, as shown in the screenshot below.
• Configure a Veeam Backup & Replication global traffic rule to use the 192.168.5.0 network for
backups.
• Review Veeam logs to confirm that backup jobs really are using Direct NFS.
As with VMware environments, it’s critical for performance that the Hyper-V management
interface use the dual 10 GbE NICs. Nutanix requires that the Hyper-V management interface
and CVMs use the same layer-2 network. In addition, the Veeam Repository (VM or physical)
should also use the same layer-2 network for best performance. Introducing routing or other
network devices, such as a firewall, between the proxy agents and the repository can negatively
impact performance. The figure below shows the orange management network (10.10.10.x) on
which the Hyper-V management, CVM, and Veeam Repository reside.
Microsoft Hyper-V 2016 has built-in resilient change tracking (RCT). Using this feature, Veeam
Backup & Replication 9.5 can greatly reduce backup windows after completing the first full
backup job.
Note: Because Hyper-V 2012 R2 does not have a native RCT mechanism, every
backup job on Hyper-V 2012 R2 performs a full disk scan, no matter how small the
deltas from the last backup.
As the cluster uses more storage, more data moves to the cold tier in hybrid Nutanix clusters. In
Hyper-V 2012 R2 environments, this cold tier utilization can lead to reduced backup performance
over time.
Veeam Backup & Replication has its own CBT mechanism for Hyper-V 2012 R2, but this
mechanism is not available with Nutanix storage. We encourage customers to use Hyper-V 2016,
which is fully supported by Nutanix as of AOS 5.5. Check the Nutanix Support Portal for the latest
supported hypervisors and AOS versions. Refer to the Veeam Backup & Replication 9.5 Hyper-V
documentation for the requirements to enable RCT.
When backup products such as Veeam Backup & Replication start a backup, the process
engages VSS at the file share (container) level. To ensure reliable VSS performance at the
share level, Nutanix supports 50 or fewer VMs per container during backup operations. If you are
backing up more than 50 VMs, create additional containers as needed with fewer than 50 VMs
each. If a container does not have VMs to back up (as in a VDI environment), the 50 VM limit
does not apply, as such a backup does not invoke VSS on the container.
Note: This VSS support policy does not apply to in-guest VSS usage, which is
transparent to Nutanix. You can configure backup jobs for in-guest application
consistency as needed without restriction.
5. Conclusion
The Nutanix and Veeam Backup & Replication 9.5 solution provides the best of multiple worlds:
industry-leading performance with the ability to scale out your backup solution as you grow
your Nutanix clusters. Nutanix offers robust support of both VMware vSphere and Hyper-V
environments, allowing the customer to choose which hypervisor best meets their requirements.
Nutanix simplicity is a natural fit with the rapid deployment and architecture flexibility of Veeam
Backup & Recovery 9.5.
5. Conclusion | 25
Veeam Backup & Replication 9.5
Appendix
About Veeam
Veeam recognizes the new challenges companies across the globe face in enabling the Always-
On Enterprise, a business that must operate 24.7.365. To address this, Veeam has pioneered a
new market of Availability for the Always-On Enterprise by helping organizations meet recovery
time and point objectives (RTPO) of less than 15 minutes for all applications and data. Veeam
Availability Suite, which includes Veeam Backup & Replication, leverages virtualization, storage,
and cloud technologies that enable the modern data center to help organizations save time,
mitigate risks, and dramatically reduce capital and operational costs, while always supporting the
current and future business goals of Veeam customers.
Appendix | 26
Veeam Backup & Replication 9.5
About Nutanix
Nutanix makes infrastructure invisible, elevating IT to focus on the applications and services that
power their business. The Nutanix Enterprise Cloud OS leverages web-scale engineering and
consumer-grade design to natively converge compute, virtualization, and storage into a resilient,
software-defined solution with rich machine intelligence. The result is predictable performance,
cloud-like infrastructure consumption, robust security, and seamless application mobility for a
broad range of enterprise applications. Learn more at www.nutanix.com or follow us on Twitter
@nutanix.
Appendix | 27
Veeam Backup & Replication 9.5
List of Figures
Figure 1: Enterprise Cloud Platform.................................................................................. 8
28
Veeam Backup & Replication 9.5
List of Tables
Table 1: Document Version History.................................................................................. 5
29