Lew Wolfgang wrote:
Hi Folks,
I'm anticipating a requirement where I'll have lots of data on a large RAID-6 partition. The data consists of many 7-GB files that were uploaded over several Ethernet channels.
The files then need to be copied to individual "JBOD" disks plugged into the same chassis as the RAID-6 array. Alas, there is more data on the RAID-6 then will fit on one JBOD disk, so I've got to come up with a process that will copy the files to a disk, then stop when the disk is full, prompt the operator to unmount and remove the JBOD, then plug in another one, and mount to continue the process. Repeat until all the data are copied to as many JBOD's as it takes.
I think I can convince tar to write to multiple volumes and prompt to change media, but I don't want to treat the JBOD's as character devices, or like a tape drive in other words. I'd like to take any one of the disks in a series and mount them on another host and read the files without having to load the other disks in that series.
I'm thinking a fancy shell script is called for here. I bet that rsync should be leveraged to allow restarting from an aborted copy process.
Any ideas? It seems to be a common requirement, maybe someone's done it already?
Pseudo-code: while more-to-do do prompt to mount new disk while rsync raid6:file disk:file do file=file+1 done prompt to unmount current disk done -- Per Jessen, Zürich (16.2°C) Слава Україні! Slava Ukraini!