Virtual Appliance Mode

Veeam’s Virtual Appliance (Hot-add) mode has become quite widespread as it is the default setting with Veeam Backup & Replication all-in-one deployment in a virtual machine (for details, see the Deployment Scenarios section of the User Guide). It is often used when Veeam is deployed in branch office configurations (ROBO).

This mode supports a 100% virtual deployment using direct storage access through VMware ESXi storage I/O stack having very little overhead. For example, in the case of a backup, the disk files from a VMware snapshot are mapped by VMware Disk Hot-Add to a virtual backup proxy server and later unmapped after backup/restore.

Note: For more information on how it works, refer to the section “Data Retrieval and Restore in Virtual Appliance Mode” of Veeam User Guide.

One example of where Virtual Appliance mode can be recommended for proxies is in highly dynamic environment where it can be difficult to maintain access to newly created datastores for Direct Storage Access. In such scenarios using Virtual Appliance mode for data transport will significantly reduce administrative overhead due to leveraging VMware Hot-Add.

Virtual Appliance mode should be used when it is not possible to leverage Direct Storage modes, for example in the case of local datastores, then using VMware Hot-Add will likely provide the optimal throughput.

When planning for the Virtual Appliance mode for a backup proxy consider the time required for actual hot-add operations (such as adding and removing VM disks from the source virtual machine) it can add up to 1-2 minutes per VM. For a backup job containing 100 virtual machines this could result in more than two hours of adding and removing disks with no actual data processing. To mitigate the issue enable parallel processing and process multiple disks from the same virtual machine simultaneously (using this transport mode).

Tip: It is recommended to benchmark how such operations affect the backup window by monitoring a test job in the vSphere console.

Veeam developed Direct Storage Access for NFS based datastores to overcome the problems with disk hot-add and release which causes significant stuns for NFS based VMs). Direct Storage Access should be used for all virtual and physical proxy deployment to backup and restore NFS datastore based VMs.

Pros

  • Using the Virtual Appliance mode for proxy servers enables a fully virtual deployment.

  • As the proxy will perform source side data deduplication and compression, this mode will provide satisfactory performance in environments running 1 GbE configurations.

Cons

  • If working in this mode the backup proxy will occupy the virtual infrastructure resources impacting consolidation ratio. This could ultimately require additional physical ESXi hosts and licensing.

  • This mode requires additional planning and configuration in the enterprise environments because of the additional large disk Hot-Add processes in VMware vSphere.

  • In situations with a high number of VMware clusters with individual datastores a minimum of one proxy per cluster is needed, this can increase management overhead.

Considerations and Limitations

Additional load is put on the vCenter Server and ESXi hosts as each disk is mapped and unmapped (disk hot-add) at the backup proxies.

Note: For more information see vCenter Server connection overview in the "Veeam Backup & Replication Server" section of this guide.

It may occur that VMware API reports that unmap and snapshot commit were done correctly but a snapshot file still remains on disk. These "orphaned snapshots" will grow over time and can fill up the datastore leading to downtimes (such situation is most likely to happen on NFS based storage). To mitigate the issue, Veeam implemented the following functionality:

  • Veeam Snapshot Hunter. This feature automatically initiates disk consolidation for VMs in the "Virtual machine disks consolidation is needed" state. For more information please see Snapshot Hunter section

  • Bypassing Virtual Disk Development Kit (VDDK) processing to overcome some limitations and performance challenges, in particular:

    • Veeam can back up multiple disks of VM in parallel on same proxy (default number is 4).
    • Typical "hot-add I/O bursts" during hot-add operations are mitigated by bypassing VMware VDDK during restores and replication.
    • When performing writes via hot-add and VDDK, excessive metadata updates on the VMFS datastore will occur. This significantly impacts performance for other workloads on the datastore, and slows down restore throughput. Bypassing VDDK helps overcoming this limitation

Note: For additional tips refer to the “Impact of Snapshot Operations” section of this guide.

Recommendations

  • You will need at least one type of (virtual) SCSI controller added to Proxy Server VM that is used somewhere at the VMs in your infrastructure to allow VMware to HotAdd the VM disks at backup.

  • Add an extra SCSI controller to allow for more VM disks processing in parallel (check the corresponding Veeam proxy settings, default value is 4). The limit for a single controller is the maximum number of devices per SCSI controller (15). Max SCSI controllers per VM is 4 = 60 disks max. Adding one additional SCSI controller is usually sufficient.

  • When deploying hot-add backup proxies avoid cloning existing VMs as this may lead to identical UUIDs and cause hot-add operations to fail.

  • You may re-use any existing Windows server VM (to save on licensing). The Veeam data mover process runs with ‘below normal’ priority by default.

    Note: Changed block tracking (CBT) will be disabled for these hot-add proxies. Consider that it may impact the backup window in case the said virtual machines should be included in backup or replication jobs.

    Specific client OS limitations for Hot-Add processing are documented in Veeam Backup & Replication Release Notes at https://www.veeam.com/veeam_backup_9_0_release_notes_en_rn.pdf and in the KB article at http://www.veeam.com/kb1054 .

    To test whether Hot-Add data transport mode is possible, refer to http://www.veeam.com/kb1184.

results matching ""

    No results matching ""