Mailinglist Archive: opensuse (2831 mails)

[Dave Howorth <dhoworth@xxxxxxxxxxxxxxxxx>]

Jan Engelhardt wrote:
> > PS Before anybody says "use rsync", I was, but ... there are rather a lot of
> > files. I had to give it 12 GB of swap space to build its list and it was taking
> > well over 24 hours to run. I can't give it 24 hours :(
>
> How much files would that be? The 355049 files I have make the rsync 
> process take up 27 MB RSS (`ps u`). Considering that ftp4 for example has 
> 3962138 files makes it roughly 301 MB. If it took 12 GB of swap (plus the 
> regular RAM) would mean that you have nearly 160 MILLION files. (On 
> 64bit it may be less)

There are 15 M files, occupying 183 GB. It actually seems to use a bit 
over 8 GB of swap space - 12 GB allows a safety margin. It is a 64-bit 
system. Perhaps there are other factors than just the number of files.

> It if takes too long, remove the -c option.

I don't use the -c option :(

> Or split it up by walking down some dirs, IOW
>
> cd /source;
> for i in *; do
>     rsync ... $i /target/$i
> done;

I was thinking about doing something like that, but the rsync doc says 
it can only preserve hardlinks if both files are in its source list. So 
it's a bit more complicated to see if I can find a usable subset. I 
guess --link-dest might help.

Thanks, Dave

--
Check the headers for your unsubscription address
For additional commands send e-mail to suse-linux-e-help@xxxxxxxx
Also check the archives at http://lists.suse.com
Please read the FAQs: suse-linux-e-faq@xxxxxxxx