Jan Engelhardt wrote:
PS Before anybody says "use rsync", I was, but ... there are rather a lot of files. I had to give it 12 GB of swap space to build its list and it was taking well over 24 hours to run. I can't give it 24 hours :(
How much files would that be? The 355049 files I have make the rsync process take up 27 MB RSS (`ps u`). Considering that ftp4 for example has 3962138 files makes it roughly 301 MB. If it took 12 GB of swap (plus the regular RAM) would mean that you have nearly 160 MILLION files. (On 64bit it may be less)
There are 15 M files, occupying 183 GB. It actually seems to use a bit over 8 GB of swap space - 12 GB allows a safety margin. It is a 64-bit system. Perhaps there are other factors than just the number of files.
It if takes too long, remove the -c option.
I don't use the -c option :(
Or split it up by walking down some dirs, IOW
cd /source; for i in *; do rsync ... $i /target/$i done;
I was thinking about doing something like that, but the rsync doc says it can only preserve hardlinks if both files are in its source list. So it's a bit more complicated to see if I can find a usable subset. I guess --link-dest might help. Thanks, Dave -- Check the headers for your unsubscription address For additional commands send e-mail to suse-linux-e-help@suse.com Also check the archives at http://lists.suse.com Please read the FAQs: suse-linux-e-faq@suse.com