[opensuse] Rsnapshot problems
Hi, For the past few months, I've been using Rsnapshot to to do backups of /home and /etc to an external hard drive. It's worked well. However, this week, it's started thrashing the hard drive, and appears to be making a 50GB backup (that's the size of the source, so an incremental backup will be much less) go on and on. When the 500GB target drive is half full, I intervene and kill the rsync process. Below is part of the logfile from this evening, but it's not very informative. Can anyone suggest where I should look, please? [28/Jan/2009:18:00:01] /usr/bin/rsnapshot daily: started [28/Jan/2009:18:00:01] echo 12893 > /var/run/rsnapshot.pid [28/Jan/2009:18:00:01] mv /media/VirtualMachines/Snapshots/daily.0/ /media/VirtualMachines/Snapshots/daily.1/ [28/Jan/2009:18:00:01] mkdir -m 0755 -p /media/VirtualMachines/Snapshots/daily.0/ [28/Jan/2009:18:00:01] /usr/bin/rsync -a --delete --numeric-ids --relative --delete-excluded --exclude-from=/home/bob/bin/excludedfiles --link-dest=/media/VirtualMachines/Snapshots/daily.1/localhost/ /home /media/VirtualMachines/Snapshots/daily.0/localhost/ [28/Jan/2009:20:12:14] /usr/bin/rsnapshot daily: ERROR: /usr/bin/rsync returned 20 while processing /home/ [28/Jan/2009:20:12:14] /etc/ skipped due to rollback plan [28/Jan/2009:20:12:14] /usr/share/fonts/ skipped due to rollback plan [28/Jan/2009:20:12:14] Rolling back "localhost/" [28/Jan/2009:20:12:14] /bin/rm -rf /media/VirtualMachines/Snapshots/daily.0/localhost/ [28/Jan/2009:20:12:22] /usr/bin/rsnapshot daily: ERROR: rsnapshot was sent TERM signal... cleaning up [28/Jan/2009:20:12:22] rm -f /var/run/rsnapshot.pid -- Registered Linux User #463880 FSFE Member #1300 GPG-FP: A6C1 457C 6DBA B13E 5524 F703 D12A FB79 926B 994E openSUSE 11.1, Kernel 2.6.27.7-9-default, KDE 3.5.10 Intel Core2 Quad Q9400 2.66GHz, 4GB DDR RAM, nVidia GeForce 9200GS -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Bob Williams wrote:
Hi,
For the past few months, I've been using Rsnapshot to to do backups of /home and /etc to an external hard drive. It's worked well.
However, this week, it's started thrashing the hard drive, and appears to be making a 50GB backup (that's the size of the source, so an incremental backup will be much less) go on and on. When the 500GB target drive is half full, I intervene and kill the rsync process.
Below is part of the logfile from this evening, but it's not very informative.
Can anyone suggest where I should look, please?
[28/Jan/2009:18:00:01] /usr/bin/rsnapshot daily: started [28/Jan/2009:18:00:01] echo 12893 > /var/run/rsnapshot.pid [28/Jan/2009:18:00:01] mv /media/VirtualMachines/Snapshots/daily.0/ /media/VirtualMachines/Snapshots/daily.1/ [28/Jan/2009:18:00:01] mkdir -m 0755 -p /media/VirtualMachines/Snapshots/daily.0/ [28/Jan/2009:18:00:01] /usr/bin/rsync -a --delete --numeric-ids --relative --delete-excluded --exclude-from=/home/bob/bin/excludedfiles --link-dest=/media/VirtualMachines/Snapshots/daily.1/localhost/ /home /media/VirtualMachines/Snapshots/daily.0/localhost/ [28/Jan/2009:20:12:14] /usr/bin/rsnapshot daily: ERROR: /usr/bin/rsync returned 20 while processing /home/ [28/Jan/2009:20:12:14] /etc/ skipped due to rollback plan [28/Jan/2009:20:12:14] /usr/share/fonts/ skipped due to rollback plan [28/Jan/2009:20:12:14] Rolling back "localhost/" [28/Jan/2009:20:12:14] /bin/rm -rf /media/VirtualMachines/Snapshots/daily.0/localhost/ [28/Jan/2009:20:12:22] /usr/bin/rsnapshot daily: ERROR: rsnapshot was sent TERM signal... cleaning up [28/Jan/2009:20:12:22] rm -f /var/run/rsnapshot.pid
Do df -h I bet you have filled up your root partition up. Then do a: du -hcs on /var/backup/snapshot You will find where all your disc space went. What happens is the default location for the backups /var/backup/snapshot is on the / root partition which is generally limited to 20G on opensuse. So one backup with a vmware or virtualbox image in your home folder pretty much fills it up. To solve this, just move the backup location to your /home partition. I keep mine at /home/backup/snapshots. Just to (as root) md /home/backup mv /var/backup/snapshots /home/backup Then edit your rsnapshot.conf and change the default location and your done. -- David C. Rankin, J.D.,P.E. Rankin Law Firm, PLLC 510 Ochiltree Street Nacogdoches, Texas 75961 Telephone: (936) 715-9333 Facsimile: (936) 715-9339 www.rankinlawfirm.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Thursday 29 January 2009 01:00:34 David C. Rankin wrote:
Bob Williams wrote:
Hi,
For the past few months, I've been using Rsnapshot to to do backups of /home and /etc to an external hard drive. It's worked well.
However, this week, it's started thrashing the hard drive, and appears to be making a 50GB backup (that's the size of the source, so an incremental backup will be much less) go on and on. When the 500GB target drive is half full, I intervene and kill the rsync process.
Below is part of the logfile from this evening, but it's not very informative.
Can anyone suggest where I should look, please?
[28/Jan/2009:18:00:01] /usr/bin/rsnapshot daily: started [28/Jan/2009:18:00:01] echo 12893 > /var/run/rsnapshot.pid [28/Jan/2009:18:00:01] mv /media/VirtualMachines/Snapshots/daily.0/ /media/VirtualMachines/Snapshots/daily.1/ [28/Jan/2009:18:00:01] mkdir -m 0755 -p /media/VirtualMachines/Snapshots/daily.0/ [28/Jan/2009:18:00:01] /usr/bin/rsync -a --delete --numeric-ids --relative --delete-excluded --exclude-from=/home/bob/bin/excludedfiles --link-dest=/media/VirtualMachines/Snapshots/daily.1/localhost/ /home /media/VirtualMachines/Snapshots/daily.0/localhost/ [28/Jan/2009:20:12:14] /usr/bin/rsnapshot daily: ERROR: /usr/bin/rsync returned 20 while processing /home/ [28/Jan/2009:20:12:14] /etc/ skipped due to rollback plan [28/Jan/2009:20:12:14] /usr/share/fonts/ skipped due to rollback plan [28/Jan/2009:20:12:14] Rolling back "localhost/" [28/Jan/2009:20:12:14] /bin/rm -rf /media/VirtualMachines/Snapshots/daily.0/localhost/ [28/Jan/2009:20:12:22] /usr/bin/rsnapshot daily: ERROR: rsnapshot was sent TERM signal... cleaning up [28/Jan/2009:20:12:22] rm -f /var/run/rsnapshot.pid
Do df -h
[23:02 barrowhillfarm~] #df -h Filesystem Size Used Avail Use% Mounted on /dev/sda2 5.0G 1.1G 3.6G 24% / udev 2.0G 252K 2.0G 1% /dev /dev/sda1 99M 16M 79M 17% /boot /dev/md0 917G 519G 352G 60% /home /dev/sda7 9.9G 233M 9.2G 3% /tmp /dev/sda5 9.9G 4.2G 5.3G 45% /usr /dev/sda6 9.9G 429M 9.0G 5% /var /dev/sda8 440G 320G 98G 77% /castor /dev/sda9 440G 312G 106G 75% /pollux /dev/sdj1 459G 135G 302G 31% /media/VirtualMachines
I bet you have filled up your root partition up. Then do a:
I don't think the root partition comes into it. Mine's only 5G, with 76% free.
du -hcs on /var/backup/snapshot
You will find where all your disc space went.
What happens is the default location for the backups /var/backup/snapshot is on the / root partition which is generally limited to 20G on opensuse. So one backup with a vmware or virtualbox image in your home folder pretty much fills it up.
To solve this, just move the backup location to your /home partition. I keep mine at /home/backup/snapshots. Just to (as root)
My snapshot folder is on an external drive, mounted at /media/VirtualMachines. This is a 500G drive, with 366G free. BTW, why backup to the same partition as the source files? Lose the source, you also lose the backup.
-- David C. Rankin, J.D.,P.E. Rankin Law Firm, PLLC 510 Ochiltree Street Nacogdoches, Texas 75961 Telephone: (936) 715-9333 Facsimile: (936) 715-9339 www.rankinlawfirm.com
-- Registered Linux User #463880 FSFE Member #1300 GPG-FP: A6C1 457C 6DBA B13E 5524 F703 D12A FB79 926B 994E openSUSE 11.1, Kernel 2.6.27.7-9-default, KDE 3.5.10 Intel Core2 Quad Q9400 2.66GHz, 4GB DDR RAM, nVidia GeForce 9200GS -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Thursday 29 January 2009 11:48:29 Bob Williams wrote:
On Thursday 29 January 2009 01:00:34 David C. Rankin wrote:
Bob Williams wrote:
Hi,
For the past few months, I've been using Rsnapshot to to do backups of /home and /etc to an external hard drive. It's worked well.
However, this week, it's started thrashing the hard drive, and appears to be making a 50GB backup (that's the size of the source, so an incremental backup will be much less) go on and on. When the 500GB target drive is half full, I intervene and kill the rsync process.
Well, I finally tracked it down to the following file file:///home/bob/.kde4/share/apps/carddecks/svg-oxygen/79/5_diamond.png which thought it was 900,000 TiB!!! Using the --progress option in rsync found the culprit. Bob -- Registered Linux User #463880 FSFE Member #1300 GPG-FP: A6C1 457C 6DBA B13E 5524 F703 D12A FB79 926B 994E openSUSE 11.1, Kernel 2.6.27.7-9-default, KDE 3.5.10 Intel Core2 Quad Q9400 2.66GHz, 4GB DDR RAM, nVidia GeForce 9200GS -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Bob Williams wrote:
On Thursday 29 January 2009 11:48:29 Bob Williams wrote:
On Thursday 29 January 2009 01:00:34 David C. Rankin wrote:
Bob Williams wrote:
Hi,
For the past few months, I've been using Rsnapshot to to do backups of /home and /etc to an external hard drive. It's worked well.
However, this week, it's started thrashing the hard drive, and appears to be making a 50GB backup (that's the size of the source, so an incremental backup will be much less) go on and on. When the 500GB target drive is half full, I intervene and kill the rsync process.
Well, I finally tracked it down to the following file
file:///home/bob/.kde4/share/apps/carddecks/svg-oxygen/79/5_diamond.png
which thought it was 900,000 TiB!!!
Using the --progress option in rsync found the culprit.
Bob
Glad you got it going again. rsnapshop is handy once you make friends with it. -- David C. Rankin, J.D.,P.E. Rankin Law Firm, PLLC 510 Ochiltree Street Nacogdoches, Texas 75961 Telephone: (936) 715-9333 Facsimile: (936) 715-9339 www.rankinlawfirm.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Hi! On Monday 02 February 2009 09:42:28 David C. Rankin wrote:
rsnapshop is handy once you make friends with it.
And if configured correctly even DAU usable. :) DAU meaning anybody whose knowledge starts email and stops at word processing. ;) Regards, Matthias
-- David C. Rankin, J.D.,P.E. Rankin Law Firm, PLLC 510 Ochiltree Street Nacogdoches, Texas 75961 Telephone: (936) 715-9333 Facsimile: (936) 715-9339 www.rankinlawfirm.com
-- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Monday 02 February 2009 09:36:05 Matthias Bach wrote:
Hi!
On Monday 02 February 2009 09:42:28 David C. Rankin wrote:
rsnapshop is handy once you make friends with it.
And if configured correctly even DAU usable. :) DAU meaning anybody whose knowledge starts email and stops at word processing. ;)
A group that I sometimes think I'm definitely a member of. Just when I think I'm getting the hang of some aspect of computing, the house of cards falls down!
Regards, Matthias
Bob -- Registered Linux User #463880 FSFE Member #1300 GPG-FP: A6C1 457C 6DBA B13E 5524 F703 D12A FB79 926B 994E openSUSE 11.1, Kernel 2.6.27.7-9-default, KDE 3.5.10 Intel Core2 Quad Q9400 2.66GHz, 4GB DDR RAM, nVidia GeForce 9200GS -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Monday 02 February 2009 08:42:28 David C. Rankin wrote:
Bob Williams wrote:
On Thursday 29 January 2009 11:48:29 Bob Williams wrote:
On Thursday 29 January 2009 01:00:34 David C. Rankin wrote:
Bob Williams wrote:
Hi,
For the past few months, I've been using Rsnapshot to to do backups of /home and /etc to an external hard drive. It's worked well.
However, this week, it's started thrashing the hard drive, and appears to be making a 50GB backup (that's the size of the source, so an incremental backup will be much less) go on and on. When the 500GB target drive is half full, I intervene and kill the rsync process.
Well, I finally tracked it down to the following file
file:///home/bob/.kde4/share/apps/carddecks/svg-oxygen/79/5_diamond.png
which thought it was 900,000 TiB!!!
Using the --progress option in rsync found the culprit.
Bob
Glad you got it going again. rsnapshop is handy once you make friends with it.
I actually found three more files reporting sizes orders of magnitude greater than the total storage capacity here. None were files that I had created, i.e. they were all part of the system. Co-incidentally, when I rebooted (I tend to leave this machine running 24/7) /dev/md0 (where /home is mounted) triggered another manual fsck, which required me to say yes to a very long list of inode problems. Presumably, the very big files could be explained by lots of hardlinks, but how a small file like the one above could grow that large when it's not even accessed (I don't play patience/solitaire), is beyond me. Anyway, rsnapshot is once again running well. :) Bob -- Registered Linux User #463880 FSFE Member #1300 GPG-FP: A6C1 457C 6DBA B13E 5524 F703 D12A FB79 926B 994E openSUSE 11.1, Kernel 2.6.27.7-9-default, KDE 3.5.10 Intel Core2 Quad Q9400 2.66GHz, 4GB DDR RAM, nVidia GeForce 9200GS -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
participants (3)
-
Bob Williams -
David C. Rankin -
Matthias Bach