Mailinglist Archive: opensuse (3073 mails)

[Rafa Grimán <rafagriman@xxxxxxxxx>]

Hi :)

El Friday 04 January 2008, Greg Freemyer escribió:
> On Jan 4, 2008 4:10 AM, Rafa Grimán <rafagriman@xxxxxxxxx> wrote:
> > Hi :)
> >
> > El Thursday 03 January 2008, Greg Freemyer escribió:
> > > All,
> > >
> > > I have a Windows based app we run at our office.
> > >
> > > It sometimes creates directories with literally millions of small
> > > files in one directory.  Using a local drive with NTFS it is taking
> > > hours to do simple things in that directory.
> > >
> > > I'm thinking of sitting up a dedicated Samba Server to serve just the
> > > data drive out to this windows server.
> > >
> > > If I did that, what would be the best choice of filesystem?  ReiserFS?
> > >  I know it has been optimized for lots of small files, but I'm not
> > > sure about the couple million in one directory scenario.
> >
> > We've got customers with over millions (yes, millions) of files in each
> > directory (XFS in these cases). It works like a charm.
> >
> > But ... I do not recommend directories with over 10 thousand files for
> > Windows. We've seen Windows very limited when it has to list a directory
> > with over 10 thousand files, no matter what filesystem you are using on
> > the Samba server.
> >
> > You can try locally and see the same thing happens:
> >         1.- create a directory on your Windows machine
> >         2.- populate it with +10000 files
> >         3.- try to browse it
> >         4.- Good luck ;)
> >
> >    Rafa
>
> I wish I had more control to keep the count down, but I have a Windows
> 3rd party app that will TIFF a PST file (in total).
>
> We need to do that fairly regularly, and a single PST can generate a
> milllion+ TIFFs on occasion.  When this happen we see our speeds drop
> drastically (as you describe) because all those TIFFs are in one big
> dir.  If you work from the CMD prompt you can at least move around the
> drive.  If you're using the explorer you can get stuck for hours at a
> time just because you clicked in the wrong place.


We have the same problem you describe with a customer here :( Can you use 
scripting? Can you talk to the ISV to modify the app?

In our case ... there's nothing to do because the ISV doesn't want to modify 
the app. And we can't use scripting because there's an MS-SQL Server that 
stores the files path to the SMB/Linux server.

   Rafa

-- 
"We cannot treat computers as Humans. Computers need love."

rgriman@xxxxxxxxx
--
To unsubscribe, e-mail: opensuse+unsubscribe@xxxxxxxxxxxx
For additional commands, e-mail: opensuse+help@xxxxxxxxxxxx