* Lew Wolfgang <wolfgang@sweet-haven.com> [10-10-22 20:01]:
On 10/10/22 15:12, Patrick Shanahan wrote:
* Patrick Shanahan <paka@opensuse.org> [10-10-22 17:48]:
* Carlos E. R. <robin.listas@telefonica.net> [10-10-22 17:25]:
On 2022-10-10 22:43, Patrick Shanahan wrote:
* Lew Wolfgang <> [10-10-22 15:30]:
On 10/10/22 12:07, David C. Rankin wrote: > On 10/7/22 18:01, Lew Wolfgang wrote: ...
> There is a coreutils utility called 'split' that allows you to slice > large files into smaller files by lines or bytes and it also has a > --filter=command option to filter through a shell script which would > give you the ability to umount/mount new JBOD devices between parts of > the original being written. Yes, split is great and would work, but we're not going to need it this time. and once more, dar will accomplish all that for you very quickly, especially using the gui AFAIK, dar doesn't store full independent files on the disk, that can be just read or copied directly from the (backup) disk without using dar for recovery.
AFAIU He wants the files saved as the same files, complete, not split, not changed. DAR will store files rather than compress files. files stored are identical copies, complete and not split unless told to do so.
but "dar" is necessary to access the files.
Right, we wouldn't want that. The files have to be accessible by any host with a SATA interface, including possibly Windows, without having to install dependencies for this requirement.
according to wikipedia, dar is available for windows. https://en.wikipedia.org/wiki/Dar_(disk_archiver) and a browser/extractor plugin for mc and the gui leaves you with a copy of the script used to archive. may give you pointers on writing your own scrip.
We've started writing scripts to handle our rather unique requirement. Looks like we'll have one master script that will take the file inventory from the four separate RAID directories and figure out how to parse the files to the destination disks, then pass the file list to four secondary scripts to do the actual simultaneous transfers, prompting the user to swap disks when ready. The transfer scripts, since they know how many whole files will fit on the disk, will stop before the disk-full condition. The scripts will mount/unmount the disks as appropriate to make the process as foolproof as possible.
It should be interesting, I'll let you know how it works out.
tks, -- (paka)Patrick Shanahan Plainfield, Indiana, USA @ptilopteri http://en.opensuse.org openSUSE Community Member facebook/ptilopteri Photos: http://wahoo.no-ip.org/piwigo paka @ IRCnet oftc