You are not logged in.
Hi,
when executing XSIBackup-DC 1.5.1.4 for a number VMs in one command with the options --replica=cbt --options=R --quiesce --config-backup --backup-how=hot , I received the following error message for the LAST ONE of the replicated VMs:
Error code 216 at file signal.c, line 216 | Error description: raised SIGTERM (11) (2) in job, total errors: 11, check error.log
Unfortunately, the error log only repeats the above error without giving any additional information beyond that already stated in the regular output of XSIBackup-DC:
2021-11-27T00:28:59 | Error code 216 at file signal.c, line 216 | Error description: raised SIGTERM (11) (2) in job, total errors: 11, check error.log
When having a look into the replicated directory, I can see that the files of the VM reporting the error have been replicated. However, I noticed that additional snapshot files (extension .vmsn) were present in the replicated directory from a previous replication. These superfluous files are not present in the original directory.
I have the impression that this error message is only a summary indicating the total amount of errors that occured in this backup session without representing an error by its own.
In any case, I wonder what the meaning of error code 216 is. Furthermore, I suggest to add some information to XSIBackup-DC so that it is clear what the meaning of this error is.
Best regards,
Peter
Hi,
when executing XSIBackup-DC 1.5.1.4 for a number VMs in one command with the options --replica=cbt --options=R --quiesce --config-backup --backup-how=hot , I received the following error message for one of the replicated VMs:
Error code 1522 at file common.c, line 1522 | Error description: error running command, returned: 1
The error log did not report any additional information than that available in the regular output of XSIBackup-DC.
When having a look into the replicated directory, I can see that the files of the VM reporting the error have been replicated. However, I noticed that additional snapshot files (extension .vmsn) were present in the replicated directory from a previous replication. These superfluous files were not present in the original directory.
Could it be that XSIBackup-DC tried to delete these files, but had some issues with deleting them?
In any case, I wonder what the meaning of error code 1522 is. Furthermore, I suggest to add some information to XSIBackup-DC so that it is clear what the meaning of the error.
Best regards,
Peter
I tried the setup of enabling CTK for selected disks only with an earlier version of XSIBackup-DC 1.5.x.x. Of course, I made sure that CTK was enabled for all those disks that formed part of the CBT-based replication with options --replica=cbt and --options=R, i.e. CTK was disabled only for disks excluded from backup/replication.
But the result was that XSIBackup-DC seemed to check whether CTK was enabled for all disks of the VM, irrespective of being part of the backup or not. Therefore, --replica=cbt did not work when having CTK disabled for the disks excluded from replication. Did you change the behavior for the present version of XSIBackup-DC so that the CTK enable check is indeed only performed on those disks which have been selected for backup/replication?
I do not worry about a potential performance overhead of CBT. My issue is that all changes are tracked in a ctk file until the next performed backup. But if I enable ctk for a disk that is never backed up (at least not by means of CBT), I wonder what happens with the ctk file for this disk on the long run. Any thoughts?
Is there a release version number in sight where VM registration via --options=R is also vailable when simply replicating without using CBT, when replicating by option --replica?
As mentioned in reply #3 above, I avoid CBT for particular VMs because they have large independent disks that are excluded from backup/replication. From your reply #4 I understood that you had no concerns to turn on CBT for such a VM, as the independent disks will be skipped.
I still have concerns when doing so: I understood from the CBT feature implemented in XSIBackup-DC that, as a pre-requisite, CTK needs to be enabled for all disks of the respective VM, even for disks that are excluded from backup/replication. This leads me to two dicussion points:
1. Is it really required to enable CTK also for disks that are excluded from backup/replication in order to use CBT in XSIBackup-DC? I have no idea why this limitation needs to be applied. Probably I have a wrong understanding of CTK/CBT or there is a limitation in XSIBackup-DC that is not really necessary and should be optimized: By a check whether CTK is enabled for the VM plus only for all those disks that are included in the backup, i.e. there is no need to enable CTK for disks that are skipped.
2. I understood that CTK tracks all changes applied to a disk since the last backup. I wonder about performance/disk usage if I enable CTK on a very large independent disk that is never backed up. Will the CTK file increase and increase? In fact, I am scared about turning on a feature used for tracking changes over usually limited time intervals if this time interval here is in fact unlimited.
What should I do in the meantime? I moved from XSIBackup Classic to XSIBackup-DC and try to reconstruct a similar setup where a registered replicated VM is backed up to a deduplicated repo. I have large independent disks that are not replicated, so I am not sure whether it is safe to turn on CTK also for these disks, although they are never replicated or otherwise incrementally backed up. (Their content is backed up via other means.)
Or will you add --options=R also for --replica within the next couple of weeks?
Hi,
Originally, I started with a CBT-based replication of a VM that is properly registered as _XSIREP VM by using options --replica=cbt and --options=R.
However, for some VMs, I disabled CBT and changed the options to --replica and --options=R. I deleted the previously generated _XSIREP VM and cleaned up everything related to CBT. I still would like to get the replicated VM registered, but without CBT.
Unfortunately, --options=R does not show any effect, although the replication takes place on the same ESXi host. I can successfully replicate the VM, but the replicated VM is not registered. I neither find an output concerning a failed registration in the regular log file nor in the error log.
Is it planned behavior that --options=R only works in conjunction with --replica=cbt or is this a result of a strange setup on my side that requires further investigation?
Best regards,
Peter
Hi,
In my present replication setup, I use options --replica=cbt and --options=R to create a replicated VM that is registered again.
This works with some restrictions as long as all disks assigned to the VM are ctk-enabled. However, I also have VMs which include some independent disks which are even excluded from the replication. As they are excluded, there is no need to enable ctk for them as the respective ctk files would never be used. So I disabled ctk for these independent disks and used option --exclude to ensure that the data of such disks does not need to be transferred.
As soon as I start replication, I receive the following error message:
2021-09-30T15:49:43 | Error code 149 at file esxi.c, line 149 | Error description: no matching CTK entry for disk: scsi0:1
-------------------------------------------------------------------------------------------------------------
/!\ There aren't any CTK files (-1), run --enable-cbt first, ignoring CBT flag
-------------------------------------------------------------------------------------------------------------The above finding, i.e. scsi0:1 being not ctk enabled and therefore having no CTK files, is correct. But exactly this disk is excluded from backup. The other disk, scsi0:0 is ctk enabled and a CTK file is available. Unfortunately, --replica=cbt does not seem to support such a scenario where not all disks are ctk enabled although all disks to be transferred are ctk enabled.
Did I miss something or would it be necessary to consider these circumstances properly?
Best regards,
Peter
I would assume that it implies a risk in performing hot backups if the memory state is not saved. But probably I did not fully understand the way how the hot backup/replication is performed. Therefore, I would appreciate if you could shed some light onto hot backups in conjunction with not considering the memory state.
Thanks a lot for this clarification!
Good to know that non memory snapshots are taken by xsibackup. Am I right that --backup-how=hot is equivalent to restoring the disk state at the point of the backup/replica, but the memory state is lost, like when switching of the VM without shutdown? However, this should have no impact on cold and warm backups, as the VM is shut down, thereby having no memory state at all.
From your comments I understood that it is NOT a requirement to start the ctk enabled or ctk reset VM after a change of the ctk settings. If this understanding is correct, I would recommend to start a VM after ctk actions only if the VM state prior ctk actions was running. Otherwise the VM should remain in off state.
However, if there is a way to circumvent this behavior by running the appropriate ctk actions by myself, this is fine.
With regard to --enable-cbt, I understand that the only action performed by xsibackup are ctk enable actions applied to the respective VM which can clearly also be done independent from xsibackup.
What needs to be done for --reset-cbt? Would be the correct replacement handling to disable ctk and then enable ctk again, and, in addition, to delete the .xsi folder within the VM folder?
Hi,
The xsibackup options --replica=cbt for replicating a VM and --options=R for registering the replicated VM can only be used if the VM is replicated to a destination path that is either mounted by the same ESXi host or, in case of using a remote path, when the destination system is also an ESXi host. This is quite clear, as registration of the replicated VM requires an ESXi host.
At present, it is already possible to register the replicated VM, even if it is stored on a remote system like a Synology NAS, as long as the disk at the remote system is mounted at the local ESXi host, for example by using NFS.
So it is possible to replicate and register the replicated VM on the same ESXi host, although the files are remote to the ESXi host.
I would like to improve performance by performing --replica=cbt by specifying the remote path and using xsibackup executed on the Synology NAS. However, once I specify the remote path, the remote xsibackup cannot register the replicated VM as the Synology NAS is not an ESXi host.
Therefore, I would like to process the --options=R in a separate step, after having performed the replication via remote path, were I specify the path to the replicated VM via the NFS drive of the Synology NAS mounted at the ESXi host.
Would this be feasible?
Best regards,
Peter
I believe that there is still some room for discussion with regard to --options=R (registration) in conjunction with a remote path. I will describe the situation in a new post so that we can close the thread here.
The same also applies to --reset-cbt were the VM is also started even if it was turned off before.
Hi,
when I use --enable-cbt on a running VM, the VM is stopped and afterwards started again. This is fine. However, if the VM is stopped (because of a previous shutdown, for example) prior to --enable-cbt, the VM will be started nevertheless.
Is it a requirement to start the VM for properly setting up CBT, or could this behavior optimzed so that only previously running VMs are started again after --enable-cbt?
Best regards,
Peter
Thanks for clarification. Just to make sure: When I run --replica as hot backup without shutting down the VM during replication, I assume that .vmsn contains the memory state of the machine. Therefore, the old .vmsn files are not of any use as I cannot revert the VM to a previous state, but the last .vmsn is essential if I want to continue right after the point of having performed the replication. Therefore, I can delete all "old" .vmsn files in the replicated VM directory, but should keep the last .vmsn file. Is this correct?
Unfortunately, the above-posted backup job does not work.
Prior to --backup=cbt, I have executed --enable-cbt on each _XSIREP VM. The following problems occur, for which I created separate posts to discuss them individually:
a) "VMs(^_XSIREP$)" cannot detect any of my VMs ending with _XSIREP,
b) When I replace the above VMs regexp by a long list of VMs, xsibackup reports that --enable-cbt has to be executed first (although I have done this), and
c) When I use a remote path working correctly with --replica=cbt, under --back=cbt the missing repo directory could not be created.
So further guidance is needed as how to backup as suggested above.
Hi,
When using --backup=cbt and specifying an NFS drive (mounted as datastore in ESXi) as backup destination, the repo directory is created.
In fact, the NFS drive is remote, and I can also specify a remote path, as xsibackup is availabkle on the NAS.
As long as I use --replica, the remote path works and missing directories are correctly created.
However, once I switch to --backup=cbt and specifying the same remote path that works with --replica, I receive the following error message:
Performing --backup action
-------------------------------------------------------------------------------------------------------------
ckup/repo-202109': Not a directory
-------------------------------------------------------------------------------------------------------------
2021-09-26T17:27:52 | Error code 3254 at file xsibackup.c, line 3254 | Error description: something went wrong creating the backup folder at: <nas>/backup/repo-202109
-------------------------------------------------------------------------------------------------------------
202109': Not a directory
-------------------------------------------------------------------------------------------------------------
2021-09-26T17:27:53 | Error code 4364 at file common.c, line 4364 | Error description: something went wrong creating the data folder at: <nas>/backup/repo-202109/data, error: Illegal seek
-------------------------------------------------------------------------------------------------------------
o-202109': Not a directory
-------------------------------------------------------------------------------------------------------------
2021-09-26T17:27:54 | Error code 4373 at file common.c, line 4373 | Error description: something went wrong creating the config backup folder at: <nas>/backup/repo-202109/cfgbak, error: Illegal seek
-------------------------------------------------------------------------------------------------------------In my setup, the same backup drive can be accessed from the ESXi via NFS mount locally or via a remote path.
What I can see is that, when using --backup=cbt and remote path, a file "repo-202109" is created, but not a directory. As already mentioned, when using --replica, the creation of directories works fine, meaningless whether I use the remote path or the local NFS mounted drive as destination. With --backup=cbt, I can only use a local path, not the remote path.
Best regards,
Peter
Hi,
In my backup scenario, I start with replicating my original VM with --replica=cbt and --options=R to receive a registered _XSIREP VM. Then, I would like to --backup=cbt the registered _XSIREP VM. Therefore, I ran --enable-cbt first on the _XSIREP VM. This seem to work fine.
Nevertheless, when starting --backup=cbt onto the _XSIREP VM, I receive the following error message:
be enabled, run --enable-cbt="<vm>_XSIREP" first
2021-09-26T17:29:33 | Error code 216 at file signal.c, line 216 | Error description: raised SIGTERM (11) (2) in job, total errors: 11, check error.logThe error.log does not report anything beyond this.
What did I miss? --replica-cbt works fine after having performed --enable-cbt on the respective VM, but this procedure does not seem to work when using --backup=cbt.
Best regards,
Peter
Hi,
What I am doing wrong when I want to backup VMs based on a regexp in back mode --backup=cbt?
I entered:
"VMs(^.*_XSIREP$)"to select all my CBT replicated and registered VMs which end with "_XSIREP". Nevertheless, I receive the following error message:
2021-09-26T17:22:31 | Error code 2882 at file xsibackup.c, line 2882 | Error description: could not find any VM in list: ^.*_XSIREP$, please check that the VM files existWhen I create a long list of all VMs separated by commas, I can backup them.
Best regards,
Peter
Hi,
My way of backing up the VMs is to first create a replica of the VMs by using --replica=cbt and --options:R to receive replicated _XSIREP VMs that are registered at the ESXi host.
Now I want to continue and make a deduplicated backup from the replicated _XSIREP VMs. Up to now, I used the --backup functionality.
However, I noticed that starting with XSIBackup-DC 1.5.1.0 there is also CBT support for backup, i.e. --backup=cbt. I searched the manual to find some more background information and impact on particularly using --backup=cbt instead of --backup, but I could only find detailed information in conjunction with --replica=cbt.
I would like to clarify the prerequisites for moving from --backup to --backup=cbt:
Is it sufficient to --enable-cbt on the _XSIREP VMs and to start backup with a fresh repository when switching to --backup=cbt?
I would create a new repo each month, e.g. like this:
REPODATE=`date +%Y%m`
"<path>/XSIBackup-DC/xsibackup" \
--backup=cbt \
"VMs(^_XSIREP$)" \
"root@<nas>:22:<volume>/backup/repo-$REPODATE" \
--compression=yes \
--config-backup \
--backup-how=cold \
--remote-path="/usr/bin/xsibackup"Is this setup recommendable? Particular drawbacks?
Best regards,
Peter
I run replica cbt with hot backup, so I assume it would be good to keep always the latest .vmsn file so that the replicated VM contains also the active state information. Is my understanding correct that in such a replicated VM only keeping the last .vmsn file makes sense? I wonder why all previous .vmsn files and all previous quiesce manifest .xml files are kept when there is already the next cbt cycle?
According to my understanding, the replicated VM does not allow to roll back to a previous CBT cycle. For this purpose, I would need to deduplicate backup the replicated VMs. Then I can access any CBT cycle. Is my understanding correct?
For the purpose of using the replicated (and registered) VM, I assume that none of quiesce manifest .xml file is necessary - they are only relevant for analysis. Is my understanding correct?
If I understood you correctly, you suggest to replicate the VM to the NAS by addressing the NAS destination by its NFS volume that is configured as datastore at the local ESXi host. This is exactly what I did.
However, my question was a kind of optimization: I understand that using xsibackup remotely on the NAS reduces load on the ESXi host so that a replication using the remote address of the NAS would increase performance. Therefore, my question arose whether it would be possible to use the remote address for the copy part and as soon as --options=R will result in VM registration, a local path of the NFS volume is specified so that the remotely stored VM will nevertheless be registered at the local ESXi host.
I got the point that a backup destination specified on a remote host having no ESXi functionality cannot lead to a registration of a replicated VM. However, in my setup, the backup destination is also accessible as an NFS drive at the ESXi host.
Of course, I continued in the present case by replacing the remote destination by a local path which results in storing the replicated VM on the same location as previously, but with the ability of being registered afterwards. Now I wonder whether there is a way of optimizing this setup.
I would prefer transferring the VM data via the remote path with xsibackup remotely executed on the NAS. And then, once the data are over there, I would like to register the replicated VM, but of course over the local path. Would this be somehow possible, e.g. bei running --options=R separately or whatever?
Or would this be a new feature request resulting in an option to specify the local path?