[opensuse] Maximum tar file size
I need a simple system for regular backups. The easiest would be to make one big tar file out of my home directory and copy it to an external disk via scp. But is there a max size limit for tar files? Can I trust tar and make one big tar file, e.g. 25 GB of my entire home directory? Janus -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Sat February 10 2007 08:42, Janus wrote:
I need a simple system for regular backups. The easiest would be to make one big tar file out of my home directory and copy it to an external disk via scp.
But is there a max size limit for tar files? Can I trust tar and make one big tar file, e.g. 25 GB of my entire home directory?
Hi Janus, I tried what you're contemplating here and was not at all satisfied, the principal reason being huge tarballs are sluggish to deal with when it comes time to recover something inadvertently broken or lost. I now use rsync to create mirrored snapshots of directories and partitions by scheduled script as well as via commandline whenever I need one. rsync will default to ssh2 protocol when you use it to sync a remote target to a local source. And it's reasonably easy to use, with practice. Examples: rsync -av /home/carl/ /mnt/homebak --> the 'a' is for 'archive' (means preserve all the original attributes); 'v' is verbose so you can observe progress; the trailing '/' on source means 'do not copy the directory, itself, just everything underneath it; no trailing '/' seems to be required for local targets... works for me ;-) rsync -av --delete /home/carl/ /mnt/homebak --> same as above, but truly 'syncs' a target to the source by deleting files and directories which no longer exist on the source. rsync -av /home/carl/ username@hostname:~/carlbackup/ --> will default to ssh2; will prompt for a password if needed --> add the '--delete' parameter to maintain a true 'mirror' of the source (items deleted locally since the last 'snapshot' will be deleted at the target.) Of course, YMMV and all that... hth & regards, Carl -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Saturday 10 February 2007 05:42, Janus wrote:
I need a simple system for regular backups. The easiest would be to make one big tar file out of my home directory and copy it to an external disk via scp.
But is there a max size limit for tar files? Can I trust tar and make one big tar file, e.g. 25 GB of my entire home directory?
I cannot answer that question, but I've been VERY happy with DAR and KDar doing my backups and splitting them into 2GB slices. -- kai Free Compean and Ramos http://www.perfectreign.com/?q=node/46 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Saturday 10 February 2007 15:32, Kai Ponte wrote:
I cannot answer that question, but I've been VERY happy with DAR and KDar doing my backups and splitting them into 2GB slices.
KDar never worked for me on SUSE10.0, but I will give a a new try once I get 10.2 installed on my workstation. Handy for backup to DVDs. Can I ask you why you choose 2 GB slices? Is 2 still a magic number on Linux? Janus -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Saturday 10 February 2007 13:42, Janus wrote:
On Saturday 10 February 2007 15:32, Kai Ponte wrote:
I cannot answer that question, but I've been VERY happy with DAR and KDar doing my backups and splitting them into 2GB slices.
KDar never worked for me on SUSE10.0, but I will give a a new try once I get 10.2 installed on my workstation. Handy for backup to DVDs.
Can I ask you why you choose 2 GB slices? Is 2 still a magic number on Linux?
Um, for some reason, K3B can't make a DVD out of one 4.7GB file. I don't quite understand why - something to do with math, and I suck at math. In any case, I can put two 2 GB files on a DVD without a problem. -- kai Free Compean and Ramos http://www.perfectreign.com/?q=node/46 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Kai Ponte wrote:
On Saturday 10 February 2007 13:42, Janus wrote:
On Saturday 10 February 2007 15:32, Kai Ponte wrote:
I cannot answer that question, but I've been VERY happy with DAR and KDar doing my backups and splitting them into 2GB slices.
KDar never worked for me on SUSE10.0, but I will give a a new try once I get 10.2 installed on my workstation. Handy for backup to DVDs.
Can I ask you why you choose 2 GB slices? Is 2 still a magic number on Linux?
Um, for some reason, K3B can't make a DVD out of one 4.7GB file. I don't quite understand why - something to do with math, and I suck at math.
In any case, I can put two 2 GB files on a DVD without a problem.
It has something to do with the file format. I use a 4 GB slice. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Saturday 10 February 2007 21:53, James Knott wrote:
Um, for some reason, K3B can't make a DVD out of one 4.7GB file. I don't quite understand why - something to do with math, and I suck at math.
In any case, I can put two 2 GB files on a DVD without a problem.
It has something to do with the file format. I use a 4 GB slice.
The key is that using standard iso, the largest file size allowed is 2 GB. If you have files larger than that, use UDF. There is a checkbox for this in k3b. Bryan -- *************************************** Powered by Kubuntu Linux 6.06 KDE 3.5.2 KMail 1.9.1 This is a Microsoft-free computer Bryan S. Tyson bryantyson@earthlink.net *************************************** -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Saturday 2007-02-10 at 16:06 -0800, Kai Ponte wrote:
Can I ask you why you choose 2 GB slices? Is 2 still a magic number on Linux?
Um, for some reason, K3B can't make a DVD out of one 4.7GB file. I don't quite understand why - something to do with math, and I suck at math.
It is not k3b's fault: there is a size limit for files inside an iso9660 filesystem. Nothing much to do with math ;-)
In any case, I can put two 2 GB files on a DVD without a problem.
You could probably increase the size to something near 2.2 GiB. Another posibility is to burn non iso images, like ext3 or xfs, for instance, that don't have that limitation - provided dar can handle them, which I don't know. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) Comment: Made with pgp4pine 1.76 iD8DBQFFzommtTMYHG2NR9URAtdwAKCPRFuaii213pxEOMKUbyKBauLDRwCfcYDs K1rdGhB3dXwdTvmR/jwBLgk= =LcBv -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Saturday 10 February 2007 19:06, Kai Ponte wrote:
Um, for some reason, K3B can't make a DVD out of one 4.7GB file. I don't quite understand why - something to do with math, and I suck at math. In any case, I can put two 2 GB files on a DVD without a problem.
Files in an ISO filesystem can be no larger than 2 GB. If you want to burn a DVD with larger files, use UDF. Bryan *************************************** Powered by Kubuntu Linux 6.06 KDE 3.5.2 KMail 1.9.1 This is a Microsoft-free computer Bryan S. Tyson bryantyson@earthlink.net *************************************** -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Bryan S. Tyson wrote:
On Saturday 10 February 2007 19:06, Kai Ponte wrote:
Um, for some reason, K3B can't make a DVD out of one 4.7GB file. I don't quite understand why - something to do with math, and I suck at math. In any case, I can put two 2 GB files on a DVD without a problem.
Files in an ISO filesystem can be no larger than 2 GB. If you want to burn a DVD with larger files, use UDF.
How would you select UDF in KDar? -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
James, I use kdar and what I do is I select DVD 4.7 and then I reduce the size to 4.0 and it works great. Then to restore you just load the last one and select and restore. No in relation with the topic of this thread, the maximal file size depends on three variables: 1. the operating system 2. the file system 3. the tar version. You can overcome limitation in the file system piping the output. For example you can tar to stout and redirect to a file and also the stderr. tar -cp -ppPv --posix -f - /home/me/ 2> MeLogFile > MeTarFile or :-) tar --create --preserve-permissions --preserve-order --absolute-names --verbose --verify --posix -f --to-stdout /home/me 2> MeTarFile.log MeTarFile.tar Restoring is the opposite xf - < MeTarFile Ciao -=terry(Denver)=- On Sun, 2007-02-11 at 08:53 -0500, James Knott wrote:
Bryan S. Tyson wrote:
On Saturday 10 February 2007 19:06, Kai Ponte wrote:
Um, for some reason, K3B can't make a DVD out of one 4.7GB file. I don't quite understand why - something to do with math, and I suck at math. In any case, I can put two 2 GB files on a DVD without a problem.
Files in an ISO filesystem can be no larger than 2 GB. If you want to burn a DVD with larger files, use UDF.
How would you select UDF in KDar?
-- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Teruel de Campo MD wrote:
James,
I use kdar and what I do is I select DVD 4.7 and then I reduce the size to 4.0 and it works great. Then to restore you just load the last one and select and restore.
I already do that. My question was about using UDF with KDar as a means of allowing more than 4 GB slices. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
James, You can unchecked slicing and it will produce a single file or select custom and it will slice it in anything you want. The only reason of slicing is to be able to fit into dvd. The 4.7 number is more virtual than real. udf will allow you to use slices > 2Gb (B was comparing it with the iso)but it will not increase the size of the dvd ;-) The 4.7 is total manufactures disk capacity in decimal notation. When you use binary notation, you include the logical format (udf etc) and any error management system you can loose easily 0.5 GB. In summary manufactures total capacity do not express YOUR data capacity. Furthermore total capacity also varies according the quality of the media. So your alternatives include : double density media, lan storage or tape which is what I use for backups. Ciao -=terry(Denver)=- On Sun, 2007-02-11 at 10:25 -0500, James Knott wrote:
Teruel de Campo MD wrote:
James,
I use kdar and what I do is I select DVD 4.7 and then I reduce the size to 4.0 and it works great. Then to restore you just load the last one and select and restore.
I already do that. My question was about using UDF with KDar as a means of allowing more than 4 GB slices.
-- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Sunday 11 February 2007 10:25, James Knott wrote:
I already do that. My question was about using UDF with KDar as a means of allowing more than 4 GB slices.
According to wikipedia the maximum file size in UDF is 16EiB (1 exbibyte = 2 to the 60th power bytes = 1,152,921,504,606,846,976 bytes = 1,024 pebibytes) However if you are burning to DVD, obviously you are constrained by the capacity of one disc. Bryan -- ************************************** Powered by Mandriva Linux 2007 KDE 3.5.4 KMail 1.9.4 This is a Microsoft-free computer Bryan S. Tyson bryantyson@earthlink.net ************************************** -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Sunday 11 February 2007 08:53, James Knott wrote:
How would you select UDF in KDar?
I think in KDar you do not select a filesystem type. All you do is select the size of your "slices." If your slices are up to 2 GB, you can burn them to CD with ISO filesystem. If your slices are larger than 2 GB, when you begin burning in K3b, check "Generate UDF structures" on the Filesystem tab. Bryan -- ************************************** Powered by Mandriva Linux 2007 KDE 3.5.4 KMail 1.9.4 This is a Microsoft-free computer Bryan S. Tyson bryantyson@earthlink.net ************************************** -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Bryan S. Tyson wrote:
On Sunday 11 February 2007 08:53, James Knott wrote:
How would you select UDF in KDar?
I think in KDar you do not select a filesystem type. All you do is select the size of your "slices." If your slices are up to 2 GB, you can burn them to CD with ISO filesystem. If your slices are larger than 2 GB, when you begin burning in K3b, check "Generate UDF structures" on the Filesystem tab.
The next thing is to find some way to pass that parameter to K3B from KDar. The K3B manual isn't useful in that regard. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Monday 12 February 2007 18:46, James Knott wrote:
Bryan S. Tyson wrote:
On Sunday 11 February 2007 08:53, James Knott wrote:
How would you select UDF in KDar?
I think in KDar you do not select a filesystem type. All you do is select the size of your "slices." If your slices are up to 2 GB, you can burn them to CD with ISO filesystem. If your slices are larger than 2 GB, when you begin burning in K3b, check "Generate UDF structures" on the Filesystem tab.
The next thing is to find some way to pass that parameter to K3B from KDar. The K3B manual isn't useful in that regard.
If I remember correctly, kdar asks you what you want to do with the slices after they are made. I think there are options that you can tell it to do. A script maybe? I used to have them saved to another hard drive which I used for backup. Not using it presently so I am not sure. Bob S. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Bob S wrote:
On Monday 12 February 2007 18:46, James Knott wrote:
Bryan S. Tyson wrote:
On Sunday 11 February 2007 08:53, James Knott wrote:
How would you select UDF in KDar?
I think in KDar you do not select a filesystem type. All you do is select the size of your "slices." If your slices are up to 2 GB, you can burn them to CD with ISO filesystem. If your slices are larger than 2 GB, when you begin burning in K3b, check "Generate UDF structures" on the Filesystem tab.
The next thing is to find some way to pass that parameter to K3B from KDar. The K3B manual isn't useful in that regard.
If I remember correctly, kdar asks you what you want to do with the slices after they are made. I think there are options that you can tell it to do. A script maybe? I used to have them saved to another hard drive which I used for backup. Not using it presently so I am not sure.
Bob S.
I couldn't find any such thing in KDar, only K3B. If I knew what the parameter to use UDF was, it would be a simple matter to apply it in KDar. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Monday 12 February 2007 22:46, James Knott wrote: .<snip>...........
The next thing is to find some way to pass that parameter to K3B from KDar. The K3B manual isn't useful in that regard.
If I remember correctly, kdar asks you what you want to do with the slices after they are made. I think there are options that you can tell it to do. A script maybe? I used to have them saved to another hard drive which I used for backup. Not using it presently so I am not sure.
Bob S.
I couldn't find any such thing in KDar, only K3B. If I knew what the parameter to use UDF was, it would be a simple matter to apply it in KDar.
OK, I just reinstalled kdar. Go to Settings >configure > slices, and you will see a box entitled "Command to run after writing each slice". That should do it. Not sure you have to have the the "Pause between slices" checkbox checked. Let us know how you made out or if that works. Bob S -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Bob S wrote:
On Monday 12 February 2007 22:46, James Knott wrote:
.<snip>...........
The next thing is to find some way to pass that parameter to K3B from KDar. The K3B manual isn't useful in that regard.
If I remember correctly, kdar asks you what you want to do with the slices after they are made. I think there are options that you can tell it to do. A script maybe? I used to have them saved to another hard drive which I used for backup. Not using it presently so I am not sure.
Bob S.
I couldn't find any such thing in KDar, only K3B. If I knew what the parameter to use UDF was, it would be a simple matter to apply it in KDar.
OK, I just reinstalled kdar. Go to Settings >configure > slices, and you will see a box entitled "Command to run after writing each slice". That should do it. Not sure you have to have the the "Pause between slices" checkbox checked.
Let us know how you made out or if that works.
I know about that box. My question was what is the parameter that goes in that box, so that UDF is selected when K3B starts up, so that I don't have to manually select UDF in K3B. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Wednesday 14 February 2007 08:52, James Knott wrote:
Bob S wrote:
On Monday 12 February 2007 22:46, James Knott wrote:
.<snip>...........
I couldn't find any such thing in KDar, only K3B. If I knew what the parameter to use UDF was, it would be a simple matter to apply it in KDar.
OK, I just reinstalled kdar. Go to Settings >configure > slices, and you will see a box entitled "Command to run after writing each slice". That should do it. Not sure you have to have the the "Pause between slices" checkbox checked.
Let us know how you made out or if that works.
I know about that box. My question was what is the parameter that goes in that box, so that UDF is selected when K3B starts up, so that I don't have to manually select UDF in K3B.
Sorry, can't help any further. Thought you just needed to know where the appropriate command should be inserted. Thought I saw something about invoking UDF 4 or 5 emails back in this thread. Hopefully some guru will jump in and offer the needed advice/info. Bob S. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Sun, 2007-02-11 at 23:51 -0500, Bryan S. Tyson wrote:
If your slices are up to 2 GB, you can burn them to CD with ISO filesystem. If your slices are larger than 2 GB, when you begin burning in K3b, check "Generate UDF structures" on the Filesystem tab.
In the above statement, replace "CD" with "DVD." Bryan -- *************************************** Powered by Fedora Linux 6 Gnome 2.16.0 Evolution 2.8.0 This is a Microsoft-free computer Bryan S. Tyson bryantyson@earthlink.net *************************************** -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Janus <lister@janus.dk> writes:
... But is there a max size limit for tar files?
Yes. The maximum size of a tar file is the same as the maximum size of a file in the file system. These sizes are listed in the Reference documentation, section "Large File Support in Linux".
Can I trust tar and make one big tar file, e.g. 25 GB of my entire home directory?
Yes. There shouldn't be any problem with files up to 2 TB, see the documentation. -- A.M. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Saturday 10 February 2007 21:53, Alexandr Malusek wrote:
Yes. The maximum size of a tar file is the same as the maximum size of a file in the file system. These sizes are listed in the Reference documentation, section "Large File Support in Linux".
Thanks. I use ext3 as my file system, but I am not sure about the block size c.f.: http://www.novell.com/documentation/opensuse102/ However, a 25 GB tar should be no problem. Janus -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
participants (10)
-
Alexandr Malusek -
Bob S -
Bryan S. Tyson -
Bryan Tyson
-
Carl Hartung -
Carlos E. R. -
James Knott -
Janus -
Kai Ponte -
Teruel de Campo MD