You are not logged in.
Thank you very much for this test script. It showed me that the authorization was all right, but the path to the backup folder was wrong. However, after changing the backup folder to the right location where my backup user has indeed write access (verified by your script, the test file was created), the already reported error did not vanish:
2019-07-15T21:25:07| Backup user is: backup
---------------------------------------------------------------------------------------------------------------------------------
2019-07-15T21:25:07| Backup program is: onediff
---------------------------------------------------------------------------------------------------------------------------------
2019-07-15T21:25:09| Remote OpenSSH version is: 7.4
---------------------------------------------------------------------------------------------------------------------------------
2019-07-15T21:25:09| Negotiated Cipher (server->client): aes128-ctr
2019-07-15T21:25:09| Negotiated Cipher (client->server): aes128-ctr
---------------------------------------------------------------------------------------------------------------------------------
2019-07-15T21:25:09| Service OpenSSH ready at server 192.168.4.10:22
---------------------------------------------------------------------------------------------------------------------------------
2019-07-15T21:25:09| Permission denied. Please use --link-srv=remote-IP:remote-port argument to exchange keys.
---------------------------------------------------------------------------------------------------------------------------------
As you know, the keys were already exchanged via link-srv.
My xsibackup rsa key is appended to the authorized_key file by sure. As a further test, I used the xsibackup rsa key as key for the root user at my ESXi on which xsibackup is running and performed "ssh <user_backup>@<ip_backup>". I could login without entering any credentials. The question is how I can debug this scenario.
Thank you very much for your quick reply. As already stated in my original post in the second and third paragraph, I already run the suggested command. Therefore, I wonder what I have missed from the manual, as I had already processed the allegedly missing step of your post:
I had already run ./xsibackup --link-srv=<ip_backup>:<port_backup> --backup-as=<user_backup> which caused the following output:
The local RSA key has already been added to the authorized_keys file at <ip_backup>:<port_backup>.
There is no need to add it again, you should be able to connect with XSIBackup to <ip_backup>:<port_backup> without any password.
Due to this output, I could not follow the manual further and, as a result, I wrote a post where I included all details what I have done so far to identify the problem. However, as ALL manual actions to access the backup destination worked fine, I had only the way to write a post. In particular, I can run ssh backup@<ip-address-backup-server> from the ESXi server with the same public key as stored in xsi-dir, and then I get immediate access without entering any credentials. Although authorized_keys at the destination backup system was already correctly setup, I nevertheless ran ./xsibackup --link-srv=<ip_backup>:<port_backup> --backup-as=<user_backup>, as I did not know which further tasks where included in this command. But I failed, and I could identify nothing in the manual that could help me to overcome the issue.
Hi,
From another post I learned that backup speed of xsibackup could be increased if the backup destination is addressed via SSH rather than via NFS.
Therefore, I added the provided xsibackup public key to the authorized_keys of the backup destination system at the appropriate backup user.
Additionally, I ran ./xsibackup --link-srv=<ip_backup>:<port_backup> --backup-as=<user_backup> which caused the following output:
The local RSA key has already been added to the authorized_keys file at <ip_backup>:<port_backup>.
There is no need to add it again, you should be able to connect with XSIBackup to <ip_backup>:<port_backup> without any password.
In my xsibackup command, I defined options --backup-as=<user_backup> --backup-point=<ip_backup>:<port_backup>:/path/to/backup/directory, but it failed:
2019-07-14T23:41:09| Backup user is: backup
---------------------------------------------------------------------------------------------------------------------------------
2019-07-14T23:41:09| Backup program is: onediff
---------------------------------------------------------------------------------------------------------------------------------
2019-07-14T23:41:11| Remote OpenSSH version is: 7.4
---------------------------------------------------------------------------------------------------------------------------------
2019-07-14T23:41:11| Negotiated Cipher (server->client): aes128-ctr
2019-07-14T23:41:11| Negotiated Cipher (client->server): aes128-ctr
---------------------------------------------------------------------------------------------------------------------------------
2019-07-14T23:41:11| Service OpenSSH ready at server <ip_backup>:<port_backup>
---------------------------------------------------------------------------------------------------------------------------------
2019-07-14T23:41:11| Permission denied. Please use --link-srv=remote-IP:remote-port argument to exchange keys.
---------------------------------------------------------------------------------------------------------------------------------
In another try, I installed the private/public key provided with xsibackup also as the keys for ESXi root on the host where xsibackup is installed. I verified that I could login at the backup system as <backup_user> without entering any credentials.
I am stuck at the moment, as all my manual actions work to access the backup system as the backup user without entering any credentials.
Is there any hint, especially as how to debug?
Best regards,
Peter
Hi,
I run xsibackup with backup-prog=onediff, backup-how=hot and snapshot=includememory,doquiesce over multiple virtual machines. Generally, it works fine, but for one virtual machine (a Windows server), the xsibackup log file reports:
2019-07-14T08:51:47| [winserver] info: VMWare Tools detected, taking snapshot QUIESCED(true)...
---------------------------------------------------------------------------------------------------------------------------------
2019-07-14T08:51:47| [winserver] info: round 1
---------------------------------------------------------------------------------------------------------------------------------
2019-07-14T08:54:05| [winserver] error DIFCRES1: create snapshot xsibackupdiff (1) failed
2019-07-14T08:54:05| [winserver] workaround: could not create quiesced snapshot, trying non-quiesced
2019-07-14T08:54:06| [winserver] warning DIFCRES3: non-quiesced snapshot taken as a workaround measure
---------------------------------------------------------------------------------------------------------------------------------
2019-07-14T08:54:06| [winserver] info: snapshot taken, quiescing status:
According to the error message, snapshot xsibackupdiff was not created. I checked ESXi, but found out that the allegedly not created snapshot was there. xsibackupdiff is the only snapshot there, as I started from a clean virtual machine where I had already consolidated all snapshots prior to performing the onediff backup.
The allegedly not created snapshot xsibackupdiff was created 14 July 2019, 10:54:06 +0200. So when I read the timestamps of ESXi and xsibackup correctly (they are both hosted on the same server), the error message from xsibackup appears one second before the snapshot xsibackupdiff was created.
The above log file excerpt concerns already the second try of the same virtual machine. Prior to the second run, I consolidated the snapshots/disks again so that I started from a virtual machine without any snapshot. Nevertheless, I ended up the same way.
The virtual machine is a windows server with the services set according to the post [url=https://33hops.com/troubleshooting-windows-snapshots-in-esxi.html]XSIBackup: troubleshooting Windows snapshots in ESXi[/url].
Worth to mention is that the problem only occurs with backup-how=hot. As soon as I switch to backup-how=warm, everything is fine.
Do you have any hints as how to overcome this error? Thank you very much.
Best regards,
Peter
Hi,
Is there any drawback when scheduling regular backups on a virtual machine via xsitools and also, probably in a less frequent interval, scheduling backups on the same virtual machine via onediff or xsidiff?
I assume that the snapshot mechanism used by onediff does only interfer with xsitools to the extent that the snapshot file will be stored in a xsitools date directory for each single differential backup instead of being deduplicated in the data directory. However, due to the short time interval between creating the snapshot and processing the xsitools based directory, the snapshot will be very small.
Furthermore, I do not assume that xsidiff somehow negatively interfers with xsitools.
Or would it be recommendable to chain the backups, i.e. perform onediff first and then process xsitools on the onediff copy of the virtual machine? The approach described in this post looks promising:
[url=https://33hops.com/xsibackup-pro-onediff-backup-retention-policy.html]How to use OneDiff and still keep a historic set of backups.[/url]
Up to now, I refrained from doing so because of backuping up to a Synology NAS which suffers from gaining full root access. I was a bit scared about executing xsibackup directly on the Synology NAS because of issues around the root access, please see post:
[url=https://33hops.com/forum/viewtopic.php?id=109]Backing up to Synology NAS (rsync)[/url]
Therefore, I made the Synology NAS locally available to the ESXi server via NFS and avoided executing xsibackup with xsitools in a chained setup.
However, the Synology NAS has enough memory so that I could run a VM in which I have full root access and where I can access the disks of the Synology NAS. This leads to my question: Are there very good reasons to perform xsitools directly on the Synology NAS once the onediff copy has been transferred to the Synology NAS?
Furthermore, I am not sure whether the NFS connection is the best choice. Would it be more recommendable to use an ssh connection to my Synology NAS like the xsibackup manual suggests when connecting to another ESXi Server (which the Synology NAS not is):
--backup-point
B) Full path in a remote ESXi host by using the following syntax: --backup-point="IP.OF.REMOTE.SERVER:PORT:/full/path/todatastore"
Best regards,
Peter
Hi,
xsibackup is a great tool with a lot of options and I am still working on a final configuration that automatically maintains a certain most recent set of backups without manually deleting old backups.
The xsibackup option backup-room is a nice tool to maintain an automatic backup solution that works fine with backups based on backup-prog=xsitools.
However, I would like to keep a most recent number of backup sets created with backup-prog=onediff. I understand the purpose of onediff as differential backup. It only requires data that were added to the previous backup. At the end of a backup cycle, the previous backup is updated to the recent state of the virtual machine that has been backed up with onediff. I appreciate that a onediff backup set is ready-to-use. This is the reason why I would not only keep the most recent version, but a few of them, for example four backup sets on a weekly basis.
I failed with the option date-dir=yes. Obviously, there would be conceptional problems by creating separate directories for each following backup runs, as onediff requires a previous backup set in order to perform its differential operation.
Nevertheless, I wonder whether there is a "best practice" to automatically keep a particular amount (e.g., four) of ready-to-use backup sets in regular intervals (e.g., weekly) based on bakup-prog=onediff.
I understand that full backups based on backup-prog=vmkfstools do not suffer from this problem, as I can use date-dir=yes and monitor available disk space via backup-room. However, it would be great if I could keep a certain number of full backup sets based on onediff.
Thanks for your comments!
Best regards,
Peter