Mailinglist Archive: opensuse (3073 mails)
| < Previous | Next > |
Re: [opensuse] Best filesystem type for HUGE directories?
- From: "Greg Freemyer" <greg.freemyer@xxxxxxxxx>
- Date: Thu, 3 Jan 2008 17:48:20 -0500
- Message-id: <87f94c370801031448r39b4f2der4297ea201048726c@xxxxxxxxxxxxxx>
On Jan 3, 2008 2:04 PM, Carlos E. R. <robin.listas@xxxxxxxxxxxxxx> wrote:
Testing now on a native reiser. I'll play with samba tomorrow.
FYI: I guess that extra $ was to make sure I knew what I was doing. I
copied the above a little to literally the first time and created a
few hundred /Zero* files. Easy enough to delete. Glad you gave them
a nice easy to identify name.
Greg
--
Greg Freemyer
Litigation Triage Solutions Specialist
http://www.linkedin.com/in/gregfreemyer
First 99 Days Litigation White Paper -
http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf
The Norcross Group
The Intersection of Evidence & Technology
http://www.norcrossgroup.com
--
To unsubscribe, e-mail: opensuse+unsubscribe@xxxxxxxxxxxx
For additional commands, e-mail: opensuse+help@xxxxxxxxxxxx
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
The Thursday 2008-01-03 at 13:00 -0500, Greg Freemyer wrote:
I have a Windows based app we run at our office.
It sometimes creates directories with literally millions of small
files in one directory. Using a local drive with NTFS it is taking
hours to do simple things in that directory.
I'm thinking of sitting up a dedicated Samba Server to serve just the
data drive out to this windows server.
If I did that, what would be the best choice of filesystem? ReiserFS?
I know it has been optimized for lots of small files, but I'm not
sure about the couple million in one directory scenario.
Reiserfs will be very happy with millions of files in a single directory.
You can try it yourself, creating and deleting such files with a script
and timing the operation: I did so myself to verify.
Like:
$DONDE=/Somewhere
time for X in `seq 1 1000`;
do
for Y in `seq 1 1000`;
do
dd if=/dev/zero of=$DONDE/Zero_$X"_"$Y bs=1k count=1 2> /dev/null
done
echo $X thousands
done
(You can add timings in there)
Testing now on a native reiser. I'll play with samba tomorrow.
FYI: I guess that extra $ was to make sure I knew what I was doing. I
copied the above a little to literally the first time and created a
few hundred /Zero* files. Easy enough to delete. Glad you gave them
a nice easy to identify name.
Greg
--
Greg Freemyer
Litigation Triage Solutions Specialist
http://www.linkedin.com/in/gregfreemyer
First 99 Days Litigation White Paper -
http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf
The Norcross Group
The Intersection of Evidence & Technology
http://www.norcrossgroup.com
--
To unsubscribe, e-mail: opensuse+unsubscribe@xxxxxxxxxxxx
For additional commands, e-mail: opensuse+help@xxxxxxxxxxxx
| < Previous | Next > |