9.2 64Bit + RAID = very slow NFS transfer and high load??
Hello! Situation: a dual opteron 9.2 server with SATA-RAID (3Ware - driver: 3w-9xxx) and a dual opteron 9.0 accessing the RAID with NFS. I'm moving data from the "client" (9.0) to the server with mv command. Load on client is nothing. Load on server is 2.5-3 and yet there is nothing running there; Top has nfsd process at the top with 1-2 % CPU. Computers are connected via Gigabit ethernet. Data transfer rate is very slow: 2.2Mb/s! The problem is not at the client end as we had the same kind of results transferring data from another (RH) server to the new SuSE 9.2. Installed kernel is 2.6.8-24.11 (default SMP-kernel from SuSE). The RAID driver is also from SuSE 9.2 (I could not find information about which. Any ideas? Any pointers to check? We really do not have any idea what is slowing down the server? -- HG
On Monday 04 April 2005 12:35 am, Hugo wrote:
Are you commited to that controller? Do you have the option of jumpering it to be simple sata controller(s) without using the raid portion, and then using software raid? I have several servers using raid, and in each case with high-end servers the software raid outperforms the harware built into the controllers. O just jumper the controllers to use them as a standard controller and chuckle at the my folly for buying them in the first place.. -- _____________________________________ John Andersen
Hi! On Apr 5, 2005 5:23 AM, John Andersen <jsa@pen.homeip.net> wrote:
No, not easily. I have lot's of data there... BTW, I'm using LVM in between the RAID and the partitions - but that should not make any difference, right? -- Hugo.
On Monday 04 April 2005 09:53 pm, Hugo wrote:
Should not make a difference as i understand it, although it should not be necessary. Are you sure the raid is not degraded (disk went bad)? Thats too obvious to miss, so I assume its not the case. -- _____________________________________ John Andersen
Hi! On Apr 5, 2005 9:02 AM, John Andersen <jsa@pen.homeip.net> wrote:
The RAID is out only "hard disk". So some part of it is reserved for boot, but rest of the partitions are on LVM so that we can adjust the sizes as needed later on. No, the hard disks seem fine. -- Hugo.
At 02:13 PM 4/5/2005 +0300, Hugo wrote:
I have situation which is completely different, uses different hardware and disks, but the same effect as you: Write access to my RAID array is about 2mb/s, sequential reads 22mb/s, random reads about 11-12 mb/s. I'm using SuSE 9.2 pro with a Compaq SmartArray 2P / 3200 SCSI RAID controller and a stack of 8 SCSI drives, 18 GB 10,000 RPM. I boot from a separate IDE drive. The raid array is set up as three ReiserFS filesystems each in its own logical volume. I can't explain it. I did finally install a daemon that writes events to the messages log file generated my the RAID controller. But that's specific to the Compaq controller. Do you have something like that for the SATA RAID controller you are using? -T [Men] The Ideal Man should talk to us as if we were goddesses, and treat us as if we were children. He should refuse all our serious requests, and gratify every one of our whims... --Oscar Wilde --... ...-- -.. . -. ----. --.- --.- -... tpeters@nospam.mixcom.com (remove "nospam") N9QQB (amateur radio) "HEY YOU" (loud shouting) WEB ADDRESS http//www.mixweb.com/tpeters 43° 7' 17.2" N by 88° 6' 28.9" W, Elevation 815', Grid Square EN53wc WAN/LAN/Telcom Analyst, Tech Writer, MCP, CCNA, Registered Linux User 385531
On Tue, 2005-04-05 at 20:18 +0200, Anders Norrbring wrote:
It has been a while since I setup one of these controllers but I seem to recall that there are some settings as to how to set the preferred read/write preferences. Some controllers allow this. You may want to go back into the raid setup and see if this is available. -- Ken Schneider UNIX since 1989, linux since 1994, SuSE since 1998 * Only reply to the list please* "The day Microsoft makes something that doesn't suck is probably the day they start making vacuum cleaners." -Ernst Jan Plugge
The Monday 2005-04-04 at 11:35 +0300, Hugo wrote:
Any ideas? Any pointers to check? We really do not have any idea what is slowing down the server?
Just one idea. You can check, locally, the transfer speed of the raid setup. Perhaps you can also setup a non-raid partition, export it through nfs, and check the speed from the client. Then you could know what is the problem: one, two, or the combination. -- Cheers, Carlos Robinson
Hi! On Apr 6, 2005 9:57 PM, Carlos E. R. <robin1.listas@tiscali.es> wrote:
The problem is local (did some runs with bonnie++). And we've been able to correct the situation a little. We managed to get read speeds to the same decade than what 3ware gives out. Write speeds are still a little too slow, but much much better. No major source of problem was identified. (I actually do not know the details anymore... this was out of my leaque :-) but read-ahead settings needed to be fixed in all the right places. But still the loads seem to be up. The situation now seems to be so that if there are lot's of processes, then the processors do not spend time in i/O waits, but if there are not that many processes and processors can idle, then they will still spen uptp 80% in I/O wait (not idle). The setup we have is - 8 disks in SATA-RAID visible to the SuSE as one large Logical Disk. - /boot is on it's own partition on the RAID - everything else is configured as one LVM - on that LVM we have separate partitions for / (root), /swap, /var and /loca (almost all of the rest) Is there something fundamentally wrong with this? Or should this kinf of setup work OK? -- Hugo.
On Monday 04 April 2005 12:35 am, Hugo wrote:
Are you commited to that controller? Do you have the option of jumpering it to be simple sata controller(s) without using the raid portion, and then using software raid? I have several servers using raid, and in each case with high-end servers the software raid outperforms the harware built into the controllers. O just jumper the controllers to use them as a standard controller and chuckle at the my folly for buying them in the first place.. -- _____________________________________ John Andersen
Hi! On Apr 5, 2005 5:23 AM, John Andersen <jsa@pen.homeip.net> wrote:
No, not easily. I have lot's of data there... BTW, I'm using LVM in between the RAID and the partitions - but that should not make any difference, right? -- Hugo.
On Monday 04 April 2005 09:53 pm, Hugo wrote:
Should not make a difference as i understand it, although it should not be necessary. Are you sure the raid is not degraded (disk went bad)? Thats too obvious to miss, so I assume its not the case. -- _____________________________________ John Andersen
Hi! On Apr 5, 2005 9:02 AM, John Andersen <jsa@pen.homeip.net> wrote:
The RAID is out only "hard disk". So some part of it is reserved for boot, but rest of the partitions are on LVM so that we can adjust the sizes as needed later on. No, the hard disks seem fine. -- Hugo.
At 02:13 PM 4/5/2005 +0300, Hugo wrote:
I have situation which is completely different, uses different hardware and disks, but the same effect as you: Write access to my RAID array is about 2mb/s, sequential reads 22mb/s, random reads about 11-12 mb/s. I'm using SuSE 9.2 pro with a Compaq SmartArray 2P / 3200 SCSI RAID controller and a stack of 8 SCSI drives, 18 GB 10,000 RPM. I boot from a separate IDE drive. The raid array is set up as three ReiserFS filesystems each in its own logical volume. I can't explain it. I did finally install a daemon that writes events to the messages log file generated my the RAID controller. But that's specific to the Compaq controller. Do you have something like that for the SATA RAID controller you are using? -T [Men] The Ideal Man should talk to us as if we were goddesses, and treat us as if we were children. He should refuse all our serious requests, and gratify every one of our whims... --Oscar Wilde --... ...-- -.. . -. ----. --.- --.- -... tpeters@nospam.mixcom.com (remove "nospam") N9QQB (amateur radio) "HEY YOU" (loud shouting) WEB ADDRESS http//www.mixweb.com/tpeters 43° 7' 17.2" N by 88° 6' 28.9" W, Elevation 815', Grid Square EN53wc WAN/LAN/Telcom Analyst, Tech Writer, MCP, CCNA, Registered Linux User 385531
participants (6)
-
Anders Norrbring -
Carlos E. R. -
Hugo -
John Andersen -
Ken Schneider -
Tom Peters