Mailinglist Archive: opensuse (3073 mails)

["Greg Freemyer" <greg.freemyer@xxxxxxxxx>]

On Jan 4, 2008 4:10 AM, Rafa Grimán <rafagriman@xxxxxxxxx> wrote:
> Hi :)
>
>
> El Thursday 03 January 2008, Greg Freemyer escribió:
> > All,
> >
> > I have a Windows based app we run at our office.
> >
> > It sometimes creates directories with literally millions of small
> > files in one directory.  Using a local drive with NTFS it is taking
> > hours to do simple things in that directory.
> >
> > I'm thinking of sitting up a dedicated Samba Server to serve just the
> > data drive out to this windows server.
> >
> > If I did that, what would be the best choice of filesystem?  ReiserFS?
> >  I know it has been optimized for lots of small files, but I'm not
> > sure about the couple million in one directory scenario.
>
>
> We've got customers with over millions (yes, millions) of files in each
> directory (XFS in these cases). It works like a charm.
>
> But ... I do not recommend directories with over 10 thousand files for
> Windows. We've seen Windows very limited when it has to list a directory with
> over 10 thousand files, no matter what filesystem you are using on the Samba
> server.
>
> You can try locally and see the same thing happens:
>         1.- create a directory on your Windows machine
>         2.- populate it with +10000 files
>         3.- try to browse it
>         4.- Good luck ;)
>
>    Rafa
I wish I had more control to keep the count down, but I have a Windows
3rd party app that will TIFF a PST file (in total).

We need to do that fairly regularly, and a single PST can generate a
milllion+ TIFFs on occasion.  When this happen we see our speeds drop
drastically (as you describe) because all those TIFFs are in one big
dir.  If you work from the CMD prompt you can at least move around the
drive.  If you're using the explorer you can get stuck for hours at a
time just because you clicked in the wrong place.

Greg
-- 
Greg Freemyer
Litigation Triage Solutions Specialist
http://www.linkedin.com/in/gregfreemyer
First 99 Days Litigation White Paper -
http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf

The Norcross Group
The Intersection of Evidence & Technology
http://www.norcrossgroup.com
--
To unsubscribe, e-mail: opensuse+unsubscribe@xxxxxxxxxxxx
For additional commands, e-mail: opensuse+help@xxxxxxxxxxxx