Hey all,
Currently I’m using an rsync script on my synology that I wrote myself in order to pull backups from my TrueNAS system. It automatically runs on a schedule, and has been working fine, with the exception of the speed.
The backup takes hours, even though this is a local network connection. Granted, it’s only a 1Gbps link, but in the end it should only be transferring a couple of gigabytes.
The folder it’s copying has a large number of big video files.
This is the actual command it runs - it runs a simple for loop and iterates over a few directories.
rsync -rvs --delete --exclude="*@eaDir*" rsync@10.13.37.3:"/mnt/Pool_1/${dirsCopy[$dir]}" "/volume1/${dirsCopy[$dir]}" --log-file=/var/log/backup.log
I expect the issue is that it’s having to go through and compare the entire filesystem for changes, which with a directory that’s 10+ terabytes in size will take a while.
I’ve been looking into the various command line options available with rsync, and the one that seems most likely to help is --inplace. My concern with that is that some data may end up in an inconsistent state if a file is in the middle of being copied to the source directory while the rsync job is running.
Open to any other tools that may do this job better / more quickly as well.