Just curious what y'all use to back up your /home folder. I see that KDAR is no longar maintained so I'd like to move on to something that will be around when opensuse gets louder. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 * Kai Ponte <kai@perfectreign.com> [12-30-07 19:48]:
Just curious what y'all use to back up your /home folder.
pdumpfs http://0xcc.net/pdumpfs Description : pdumpfs is a simple daily backup system similar to Plan9's dumpfs which preserves every daily snapshot. pdumpfs is written in Ruby. You can access the past snapshots at any time for retrieving a certain day's file. Let's backup your home directory with pdumpfs! pdumpfs constructs the snapshot YYYY/MM/DD in the destination directory. All source files are copied to the snapshot directory for the first time. On and after the second time, pdumpfs copies only updated or newly created files and stores unchanged files as hard links to the files of the previous day's snapshot for saving a disk space. Author Satoru Takabayashi <satoru@namazu.org> Distribution: home:dmacvicar / SUSE_Linux_10.1 19:50 wahoo:~ > rpm -q pdumpfs pdumpfs-1.3-2.1 - -- Patrick Shanahan Plainfield, Indiana, USA HOG # US1244711 http://wahoo.no-ip.org Photo Album: http://wahoo.no-ip.org/gallery2 Registered Linux User #207535 @ http://counter.li.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) iD8DBQFHeD0ZClSjbQz1U5oRAijBAKCSiLVKjtxxJnxwQ3UbAOYUs6V4SACeO3Iq +d5p3rRJAHQ0SwG3q3+Y2fc= =dost -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Patrick Shanahan wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
* Kai Ponte <kai@perfectreign.com> [12-30-07 19:48]:
Just curious what y'all use to back up your /home folder.
pdumpfs http://0xcc.net/pdumpfs
Description : pdumpfs is a simple daily backup system similar to Plan9's dumpfs which preserves every daily snapshot. pdumpfs is written in Ruby. You can access the past snapshots at any time for retrieving a certain day's file. Let's backup your home directory with pdumpfs!
pdumpfs constructs the snapshot YYYY/MM/DD in the destination directory. All source files are copied to the snapshot directory for the first time. On and after the second time, pdumpfs copies only updated or newly created files and stores unchanged files as hard links to the files of the previous day's snapshot for saving a disk space.
Make sure you create a DVD from the latest day on a regular basis.... -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 30 Dec 2007 19:51:37 -0500 Patrick Shanahan <ptilopteri@gmail.com> wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
* Kai Ponte <kai@perfectreign.com> [12-30-07 19:48]:
Just curious what y'all use to back up your /home folder.
pdumpfs http://0xcc.net/pdumpfs
Description : pdumpfs is a simple daily backup system similar to Plan9's dumpfs which preserves every daily snapshot. pdumpfs is written in Ruby. You can access the past snapshots at any time for retrieving a certain day's file. Let's backup your home directory with pdumpfs!
pdumpfs constructs the snapshot YYYY/MM/DD in the destination directory. All source files are copied to the snapshot directory for the first time. On and after the second time, pdumpfs copies only updated or newly created files and stores unchanged files as hard links to the files of the previous day's snapshot for saving a disk space.
I'm curious... what's the restore functionality like? - -- Mark "Drunkenness is not an excuse for stupidity. If you're stupid when you're sober then that's one thing, but if you're sober when you're stupid, then you're just plain stupid!" ============================================== Powered by CentOS5 (RHEL5) -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHeVsxAHUWFbtwPigRAuUvAJ0dp/md2G7OCWVoIUEkgtARpU3vwACeOI1M c3IMg3I/7hRKNdENLFtHi80= =CV4C -----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 * Mark Weaver <mdw1982@mdw1982.com> [12-31-07 16:22]:
On Sun, 30 Dec 2007 19:51:37 -0500 Patrick Shanahan <ptilopteri@gmail.com> wrote:
pdumpfs http://0xcc.net/pdumpfs
....
I'm curious... what's the restore functionality like?
direct copy - -- Patrick Shanahan Plainfield, Indiana, USA HOG # US1244711 http://wahoo.no-ip.org Photo Album: http://wahoo.no-ip.org/gallery2 Registered Linux User #207535 @ http://counter.li.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) iD8DBQFHeV5/ClSjbQz1U5oRAtrcAKCoAPNZtVKhwXpP1iheK12cq/axrgCfXKol kc0B4M67wgVXeSHpEm7NVOM= =6dSB -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Kai Ponte wrote:
Just curious what y'all use to back up your /home folder.
I see that KDAR is no longar maintained so I'd like to move on to something that will be around when opensuse gets louder.
I use rsync to make nightly backups to a linux-formatted usb drive. Works like a charm. Joe -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Dec 30, 2007 7:48 PM, Kai Ponte <kai@perfectreign.com> wrote:
Just curious what y'all use to back up your /home folder.
I see that KDAR is no longar maintained so I'd like to move on to something that will be around when opensuse gets louder. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
If your needing a disk to disk solution: I use rdiff-backup for all of my non system backups. And as part of my nightly script I copy several of the more interesting system config files to a /config directory I created and include it in the nightly backup. One nice thing about rdiff-backup is it keeps the primary copy in vanilla form, then it has a series of diffs that allow it to recall older versions. On command line you can tell rdiff-backup how many backup revisions to keep. In my case I have a fair amount of corporate data, so I keep a local copy of the backup on a dedicated internal mirror (500GB I think), plus I send a copy of the backup data offsite. I do not want to have the offsite data unencrypted, so I actually use encfs locally to hold the backup data, then I use rsync from the raw encrypted dirs to my offsite location. (I am using a hosting company for the offsite storage, thus the desire to both transport and store the offsite date encrypted.) When I first set this up,it took about 2 months to fully replicate my offsite copy. I only let rsync run from 1am to 6am each night. Greg -- Greg Freemyer Litigation Triage Solutions Specialist http://www.linkedin.com/in/gregfreemyer First 99 Days Litigation White Paper - http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf The Norcross Group The Intersection of Evidence & Technology http://www.norcrossgroup.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Sunday 2007-12-30 at 16:48 -0800, Kai Ponte wrote:
Just curious what y'all use to back up your /home folder.
rsync to an external drive on usb, normally upowered. I'm thinking on using rdiff, which is more or less a variation of rsync.
I see that KDAR is no longar maintained so I'd like to move on to something that will be around when opensuse gets louder.
But I believe plain dar is. I found it to slow, though. I wish rsync could do a little compresion... - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHeFNytTMYHG2NR9URAikYAKCB4SSGIMO7M1YzAETkSnbBbCrouQCdEt7W p7QhdfJ2+4itEBjZVeh/fSw= =qxw/ -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Carlos E. R. wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
The Sunday 2007-12-30 at 16:48 -0800, Kai Ponte wrote:
Just curious what y'all use to back up your /home folder.
rsync to an external drive on usb, normally upowered. I'm thinking on using rdiff, which is more or less a variation of rsync.
I see that KDAR is no longar maintained so I'd like to move on to something that will be around when opensuse gets louder.
But I believe plain dar is. I found it to slow, though. I wish rsync could do a little compresion...
Compression is good until you get an erroneous bit. then it makes your life miserable. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Monday 2007-12-31 at 04:16 -0500, Aaron Kulkis wrote:
But I believe plain dar is. I found it to slow, though. I wish rsync could do a little compresion...
Compression is good until you get an erroneous bit.
then it makes your life miserable.
Did you ever use the old PCBackup for Dos, from PC Tools (Central Point Software)? I have backups made in 80 5¼ floppies and still recoverable. They are compressed, yes, but they also contain recovery data to repair read errors. In fact, they do have sectors with errors, and the software is able to get the whole good data out of them, about twenty years later. And it was so fast I barely had time to label one floppy before it asked for the next one. We don't have such a tool in Linux. The technology is out there somewhere, but I don't know of a tool that can record (and do it fast) removable media compressed with recovery data designed to bypass the common types of media errors. Think of a DVD with a .tgz archive... a scratch, an error, and the entire archive is useless. I'm not talking of state of the art maximum compression: only some compression. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHeZSJtTMYHG2NR9URArjIAKCJbU9k2deS8dd32rNNq32P3OADhQCfUUHi IAiPEar1BPChZVpcF5bgj9A= =FdAQ -----END PGP SIGNATURE-----
On Mon, December 31, 2007 5:16 pm, Carlos E. R. wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
The Monday 2007-12-31 at 04:16 -0500, Aaron Kulkis wrote:
But I believe plain dar is. I found it to slow, though. I wish rsync could do a little compresion...
Compression is good until you get an erroneous bit.
then it makes your life miserable.
Did you ever use the old PCBackup for Dos, from PC Tools (Central Point Software)? I have backups made in 80 5¼ floppies and still recoverable. They are compressed, yes, but they also contain recovery data to repair read errors. In fact, they do have sectors with errors, and the software is able to get the whole good data out of them, about twenty years later. And it was so fast I barely had time to label one floppy before it asked for the next one.
We don't have such a tool in Linux. The technology is out there somewhere, but I don't know of a tool that can record (and do it fast) removable media compressed with recovery data designed to bypass the common types of media errors. Think of a DVD with a .tgz archive... a scratch, an error, and the entire archive is useless.
I'm not talking of state of the art maximum compression: only some compression.
That is an excellent observation. The other items mentioned are all either command-line (ugh!) or scripted. This seems like an area ripe for exploration. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Monday 2007-12-31 at 17:27 -0800, Kai Ponte wrote: ...
We don't have such a tool in Linux. The technology is out there somewhere, but I don't know of a tool that can record (and do it fast) removable media compressed with recovery data designed to bypass the common types of media errors. Think of a DVD with a .tgz archive... a scratch, an error, and the entire archive is useless.
I'm not talking of state of the art maximum compression: only some compression.
That is an excellent observation.
The other items mentioned are all either command-line (ugh!) or scripted.
And those do not have the perfomance of the old pcbackup, even without considering the interface. No on the fly compression with error recovery data, and on the fly recovery, tailored for the backup media. The only close thing is par and par2, but they are terribly slow.
This seems like an area ripe for exploration.
Indeed! There are more professional tools, like "amanda", for instance. But I didn't find it suitable. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHei7wtTMYHG2NR9URAiHXAJ9FYVuU5HXzW3Db9xjCVBtJE/cZmwCeOzSp fs5qPFLyq9ca5PiJ2bwb7rY= =KipY -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Mon, 2007-12-31 at 03:26 +0100, Carlos E. R. wrote:
But I believe plain dar is. I found it to slow, though. I wish rsync could do a little compresion...
??? $man rsync ... The rsync remote-update protocol allows rsync to transfer just the differences between two sets of files across the network connection ... -z, --compress compress file data during the transfer ... 'just the differences' means (a) it doesn't transfer files that haven't changed and (b) it only sends changed blocks within files. Plus it can compress the transmitted blocks. Cheers, Dave -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Monday 2007-12-31 at 13:24 -0000, Dave Howorth wrote:
On Mon, 2007-12-31 at 03:26 +0100, Carlos E. R. wrote:
But I believe plain dar is. I found it to slow, though. I wish rsync could do a little compresion...
???
$man rsync ... The rsync remote-update protocol allows rsync to transfer just the differences between two sets of files across the network connection ... -z, --compress compress file data during the transfer ...
I know that, but that's not what I want. I want compressed storage. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHeRK8tTMYHG2NR9URAhj8AKCQjOZgrlvSnO1G/LhRAtaW2fYe8ACfQBX7 IVNA6pAPD28FnoW/OjC2vgs= =65RT -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Monday 31 December 2007 08:02, Carlos E. R. wrote:
The Monday 2007-12-31 at 13:24 -0000, Dave Howorth wrote: ...
$man rsync ...
I know that, but that's not what I want. I want compressed storage.
Rdiff-backup seems good. I've been using it (via Keep, which I _DO NOT_ recommend) and it has saved my butt once, in a big way. Because of Keep's problems, I also have over a year's worth of hourly snapshots of my project. (Thank good for capacious disk drives!) Keep's problems include: - Your scheduling options are ignored and it runs hourly - Your retention options are ignored and all backups are kept - The magnitude of the retained backups makes it impossible for Keep to perform a restore. - Several KDE programs, most notable KMail, are locked out of editing and sending during the period each hour when Keep (via one of the KDE low-level components) runs rdiff-backup. - Keep runs rdiff-backup at at point in the hour determined by when you logged in. - Keep doesn't run rdiff-backup when you're not logged in to KDE (maybe a good thing, maybe not). I'd schedule rdiff-backup some other way, probably cron.
-- Cheers, Carlos E. R.
Randall Schulz -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Monday 31 December 2007 08:34, Randall R Schulz wrote:
On Monday 31 December 2007 08:02, Carlos E. R. wrote:
The Monday 2007-12-31 at 13:24 -0000, Dave Howorth wrote: ...
$man rsync ...
I know that, but that's not what I want. I want compressed storage.
Rdiff-backup seems good. ...
I guess I should have mentioned that rdiff-backup keeps the most recent version of the backed-up files as a snapshot (not compressed) but keeps the history in gzip-compressed, delta-encoded form, so the histories are very compact yet access to the latest snapshot is as easy as copying the files from the backup area (which _is_ maintained in directory hierarchy isomorphic to the one that is being backed up).
...
Randall Schulz -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Mon, 2007-12-31 at 17:02 +0100, Carlos E. R. wrote:
The Monday 2007-12-31 at 13:24 -0000, Dave Howorth wrote:
On Mon, 2007-12-31 at 03:26 +0100, Carlos E. R. wrote:
But I believe plain dar is. I found it to slow, though. I wish rsync could do a little compresion...
???
$man rsync ... The rsync remote-update protocol allows rsync to transfer just the differences between two sets of files across the network connection ... -z, --compress compress file data during the transfer ...
I know that, but that's not what I want. I want compressed storage.
Ah, sorry for the misunderstanding. I guess you've explored using a compressed filesystem? Cheers, Dave -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Monday 2007-12-31 at 22:02 -0000, Dave Howorth wrote:
I know that, but that's not what I want. I want compressed storage.
Ah, sorry for the misunderstanding. I guess you've explored using a compressed filesystem?
Of course, but there is no such thing in Linux. Ok, there are a few, but either they are read only, or only accept a limited size and number of files. A read/write compressed filesystem for general use does not exist in Linux, AFAIK. For backup use it would be sufficient if files were compressed, a bit at least; things like email compress a lot easily. Yea, I know, storage is cheap nowdays. But compressing is even cheaper, and in my country next year they'll charge 12..13€ extra per HD unit as kind of multimedia tax, to pay the authors of the songs I never buy nor copy nor listen to. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHeYXUtTMYHG2NR9URAvlVAJ42YzgXIi3AcXy0tdbbYV31n2Ef9gCdGGui 0i19TuUMSWzx4pyk4bbqnDA= =fldP -----END PGP SIGNATURE-----
Carlos E. R. wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
The Monday 2007-12-31 at 13:24 -0000, Dave Howorth wrote:
On Mon, 2007-12-31 at 03:26 +0100, Carlos E. R. wrote:
But I believe plain dar is. I found it to slow, though. I wish rsync could do a little compresion...
???
$man rsync ... The rsync remote-update protocol allows rsync to transfer just the differences between two sets of files across the network connection ... -z, --compress compress file data during the transfer ...
I know that, but that's not what I want. I want compressed storage.
Compressed storage is great and all, right up until your media has one more erroneous bits in a block than the error-detecting-and-correcting code can correct. In uncompressed data, it's an headache. In compressed data, it's practically unrecoverable -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On December 30, 2007 04:48:33 pm Kai Ponte wrote:
Just curious what y'all use to back up your /home folder.
I see that KDAR is no longar maintained so I'd like to move on to something that will be around when opensuse gets louder.
I keep a 500Gb USB drive and use rsync to copy all my data over periodically. -- Bob Smits bob@rsmits.ca A: Because it messes up the order in which people normally read text. Q: Why is top-posting such a bad thing? A: Top-posting. Q: What is the most annoying thing on usenet and in e-mail? -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Kai Ponte wrote:
Just curious what y'all use to back up your /home folder.
I see that KDAR is no longar maintained so I'd like to move on to something that will be around when opensuse gets louder.
I currently use a custom bash script that does mysql and subversion dumps, generates a list of files to backup from a set of simple exclusion and inclusion rules, tars the lot and generates a tar image on DVD. I am working on a Perl script that does all the above with a bit more control on what mysql and subversion dumps are created and maintains a mysql database so I can locate which files are on which DVD. Tried KDar, and found it only really useful for generating Dar command lines for scripting purposes, but IMHO Dar itself is a bit clumsy and slow. Rsync is very powerful but I do not think it suitable for removable media which is my personal preference as a backup solution for home use. As a server admin I would deploy rsync alongside a removable media option. (Personal experience with the particular version of Murphys law for backups suggests when you really need them your backup is toast, and it is a good idea to have a fallback option of some sort :-) ). - -- ============================================================================== I have always wished that my computer would be as easy to use as my telephone. My wish has come true. I no longer know how to use my telephone. Bjarne Stroustrup ============================================================================== -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (GNU/Linux) Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org iD8DBQFHeMvwasN0sSnLmgIRAmwwAKC4+jUQ0+v6ov2Ti+ggzeKNRC+WqACfeW88 20VmBgnkcmqDKN2Lw3PRbyY= =ExSC -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Kai Ponte wrote:
Just curious what y'all use to back up your /home folder.
I do an rsync backup every 24 hours on to a 500Gb RAID array. /Per Jessen, Zürich -- http://www.spamchek.com/ - your spam is our business. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Sun, 2007-12-30 at 16:48 -0800, Kai Ponte wrote:
Just curious what y'all use to back up your /home folder.
At home I just use rsync to update a copy. At work I use dirvish (www.dirvish.org) to make multiple copies. I also use rdiff-backup, which is similar but different :) Cheers, Dave -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 30 Dec 2007 16:48:33 -0800 Kai Ponte <kai@perfectreign.com> wrote:
Just curious what y'all use to back up your /home folder.
I see that KDAR is no longar maintained so I'd like to move on to something that will be around when opensuse gets louder.
Perl :) - -- Mark "Drunkenness is not an excuse for stupidity. If you're stupid when you're sober then that's one thing, but if you're sober when you're stupid, then you're just plain stupid!" ============================================== Powered by CentOS5 (RHEL5) -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHeVgoAHUWFbtwPigRAvHTAJ940Qdugef7RjpamZZgC9Ynb+NIvgCaAxtt 8kXpew1hC0nU7nYehPKS9yg= =VN1F -----END PGP SIGNATURE-----
participants (12)
-
Aaron Kulkis -
Carlos E. R. -
Dave Howorth -
G T Smith -
Greg Freemyer -
Joe Sloan -
Kai Ponte -
Mark Weaver -
Patrick Shanahan -
Per Jessen -
Randall R Schulz -
Robert Smits