Use SSHFS With rdiff-backup.

Do you like HowtoForge? Please consider supporting us by becoming a subscriber.
Submitted by stefbon (Contact Author) (Forums) on Fri, 2007-08-24 15:08. :: Backup

Use SSHFS With rdiff-backup

An excellent tool to create backups is rdiff-backup. It is based on SSH, and the feature of SSH to execute a command on a remote system, as long as you can log in to this machine with SSH.

Now I've been experimenting with SSHFS, and one of the things it can be used for is rdiff-Backup. Sshfs is a FUSE module, which allows you to mount the remote system. A normal backup looks like (assuming ssh access is ok):

rdiff-backup --preserve-numerical-ids 192.168.0.10::/home/sbon /srv/rdiff/backup/192.168.0.10/home/sbon

Now with SSHFS it looks like:

install --directory /srv/rdiff/mounts/192.168.0.10
sshfs -o ro 192.168.0.10:/ /srv/rdiff/mounts/192.168.0.10
rdiff-backup --preserve-numerical-ids /srv/rdiff/mounts/192.168.0.10/home/sbon /srv/rdiff/backup/192.168.0.10/home/sbon

It looks like this construction has only advantages:

- the backup process is slightly faster. I've done some testing and all of my cases the backup over sshfs was a little bit faster (5 a 10 %).
- with sshfs it is possible to mount the remote system read-only, which increases the security. This is not an optimal security measurement: this readonly flag should not be controlled on this system (where the backup is made) , but on the remote system. I've tried to find out how, but there is no way in the Ssh server to make access read-only. Somebody knowing a way to do it, please let me know.
- it is possible to make more than one backup using only one SSHFS mount. When all backups are done, the sshfs connection with the remote system can be caunmounted.
- there is no need for rdiff-backup to be installed on the remote system.

One possible disadvantage (I'm not sure yet) is that sshfs does not support extended attributes. At this moment [26 august 2007] I'm trying to find out for sure.
September 2007:
I've send an email about this to Miklos Szeredi, the writer of SSHFS. SSHFS lacks support of ACL's because the sftp-server in OpenSSH doesn't support it. According to M. Szeredi "the OpenSSH developers have been reluctant to add support for newer protocol versions".

Links:

SSHFS: http://fuse.sourceforge.net/sshfs.html
rdiff-backup: http://www.nongnu.org/rdiff-backup


Copyright © 2007 Stef Bon
All Rights Reserved.
add comment | view as pdf view as pdf | Display a printer-friendly version of this page. print |
Please do not use the comment function to ask for help! If you need help, please use our forum.
Comments will be published after administrator approval.
Faster than direct rdiff-backup?
Submitted by /dev/kev (not registered) on Fri, 2009-03-20 01:12.
I'm somewhat amazed that you found rdiff-backup to be faster over sshfs than rdiff-backup directly over ssh.

When rdiff-backup is running at each end of the ssh link, then the rdiff-backup processes can compute rolling checksums and exchange those to determine which files have changed (and where in the file the changes are). This is the main advantage (and the whole point, really) of the rsync algorithm.

But when using sshfs, rdiff-backup sees only two "local" files. It will then compute these rolling checksums on both files itself, by reading in each file. Surely this causes the entire file to be fetched by sshfs? And surely this will (in general) be slower than with an rdiff-backup process at the other end which is sending only checksums, not the whole file...

About the only time I can figure that sshfs access might be faster is during an initial backup, when none of the files actually exist in the backup, and so there are no rolling checksums to compute and compare.

reply | view as pdf view as pdf
SSHFS install issue on Debian
Submitted by andmalc (registered user) on Wed, 2007-09-05 00:21.

Thanks for this article on rdiff-backup and sshfs.  I'm already a fan of both but hadn't thought of using them together.

A note on installing sshfs on Debian (and maybe other distrols) that isn't mentioned in the docs or on the program's FAQ.  Your user account must be a member of the fuse group or you'll get

fusermount: failed to open /dev/fuse: Permission denied

So, do:

sudo adduser <username> fuse

newgrp fuse

sudo adduser <username> fuse

newgrp fuse

reply | view as pdf view as pdf
Permissions on /dev/fuse.
Submitted by stefbon (registered user) on Thu, 2007-09-06 20:34.

Hello,

 you're right about this. The user using sshfs must have enough permissions to write and to read /dev/fuse. There are various ways do that, you name one. Another is to change  the permissions of /dev/fuse:

crw-rw-rw- /dev/fuse

I prefer the latest, fuse is meant to be used by anyone. But that's my opinion. Anyway thanks for your comment,

 

Stef Bon

the Netherlands 

reply | view as pdf view as pdf
Sponsored Links: Unified Communications: Thoughts, Strategies and Predictions
Join the discussion.
www.seamlessenterprise.com

IP Convergence
Integrate your wireless and wireline networks.
Learn how from the experts at Sprint.
www.seamlessenterprise.com

Wireless & Wireline Integration
Thoughts, strategies and solutions: join the discussion
www.seamlessenterprise.com

Unified Communications 2009
Join the Discussion. Now.
www.seamlessenterprise.com

Red Hat Virtual Experience - a free virtual event. Dec. 9th