Linda Walsh wrote:
Per Jessen wrote:
No, that's true, that's not an issue here either - I was out looking for reason why directory access seems to have slowed down over time, and just happened on this apparent anomaly.
I don't suppose you had a look at the fragmentation level as I last mentioned?
No, afaik there are no such utilities for JFS.
I have a 600Gb filesystem mounted on /var - key directories under /var are:
/var/spool/postfix-in/{incoming,active} with 2 levels of hashing. On a busy day or after delays, each subdir might easily reach 10.000 files. 99% small files of less than 100Kb. (emails).
/var/spool/elsewhere/dir{0,1,2,3...1000}/maildirs - each such maildir might have 100.000 files.
So you are creating/destroying what? 10k files/day or 100k files/day? what?
It varies quite a bit, but at least 200.000 new written, and the same deleted. Last week we had a couple of days with 800-900.000 a day.
If you've been running that file system @ 85-90% full for some time and lots of file creates and destroys, most old file systems aren't good about consolidating space (like not shrinking directories that would free up 3mg of space).
It's probably running at 85% full for a year or more. As I think I said, it's essentially a fifo buffer for lots of small files. The "working set" is about 4 days worth of traffic, but the filesystem has lots of other stuff. (mysql for instance).
but most could be helped by dumping the disk contents to another disk, then, since some file systems aren't good about cleaning up and consilidating free space -- (leaving random bits of allocated space laying around...), it might be most prudent to re-mkfs your file system.
Yes that is an interesting idea.
rsync isn't the best tool to copy off files -- you might try 'cp -au', for example, -- will only copy files with newer times (unless your target machine is far away over a slow link).
The target is about 40cm away over GigE :-)
If you really need to slow rsync down, besides doing both: 1) nice -19 ionice -c3, you could limit rsync to only run on 1 of the cpu's (normally since it has a client and sender they'll more often than not fall onto separate cores.
So: 2) sudo nice -19 ionice -c3 taskset -c1 rsync....
3) There's also the "--bwlimit" switch to rsync, but I doubt that bw is your problem, -- likely rsync is having to alot of seeking and comparing of metadata.
Yeah, I don't see bandwidth being the issue either. I'm also not sure if rsync is really the culprit here, but it's worth a try to see what it does. Thanks for all your input! /Per -- Per Jessen, Zürich (6.5°C) http://www.dns24.ch/ - free dynamic DNS, made in Switzerland. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org