[Bug 668392] New: Using md raid yields to high system load
https://bugzilla.novell.com/show_bug.cgi?id=668392 https://bugzilla.novell.com/show_bug.cgi?id=668392#c0 Summary: Using md raid yields to high system load Classification: openSUSE Product: openSUSE 11.3 Version: Final Platform: x86-64 OS/Version: openSUSE 11.3 Status: NEW Severity: Major Priority: P5 - None Component: Kernel AssignedTo: kernel-maintainers@forge.provo.novell.com ReportedBy: munderl@tnt.uni-hannover.de QAContact: qa@suse.de Found By: --- Blocker: --- User-Agent: Opera/9.80 (X11; Linux x86_64; U; de) Presto/2.7.62 Version/11.01 We upgraded some servers from 11.0 and 11.1 to 11.3 and recognized that they have become very slow when it comes to i/o operations. All of them use a md-raid1. The i/o performance is not only low on the md-raid itself but influences all i/o to any disk (even external scsi raids). We first recognized an md-resync taking months to complete because of just syncing with << 1 MB/s. Setting the min sync speed to 20 MB/s pushed it up to just 10 MB/s while the machine nearly stopped responding. System load is >3 with nearly no other process running. We also investigated our other 11.3 servers using md-raid1 and found that all behave poor. We have a internal webserver and mysql running on on md-raid with load >3 but nearly no access to the webserver or db. top always shows high load, but all other cpu values (even wa) are nearly 0 (except idle...). Then found that a lot of processes accessing the disks are in D state - they seem to wait for the disk. nmon shows 100% disk usage with only 5MB/s. This also happens when accessing an external raid which has nothing to do with the internal software raid. We removed one of the two disks of the md-raid1 with no performance increase. We then totally removed the md-raid and got full performance again and 0.00 load. After this we tried to use dm-raid for one of the machine which has bios-support for this. Using two mirror disk with this software raid also gives no performance problems. So just md seems to be effected. I'm totally stuck here because I can not find anyone else in the internet having this problem. But as we have it at least on 3 machines and only since we upgraded to 11.3 there must be a problem somewhere. Hardware has not changed. All machines have sata-drives but with different controllers (ahci/sata_mv). Reproducible: Always Steps to Reproduce: 1. Install md-raid1. 2. Boot openSUSE 11.3 3. Start several processes performing some i/o. 4. Start top and watch load go high (>3) and machine becoming slow Actual Results: Hmm. Except the raid1 there is no special setup involved. Expected Results: Give the same i/o results has without md like in 11.0. I don't know what you need on additional information. There is no error message involved, just this high load (with wa% low) and a lot of processes jumping on and off D state. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c1
Marco Munderloh
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c2
--- Comment #2 from Marco Munderloh
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c3
--- Comment #3 from Marco Munderloh
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c4
--- Comment #4 from Marco Munderloh
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c
Jeff Mahoney
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c5
Neil Brown
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c6
Marco Munderloh
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c7
--- Comment #7 from Marco Munderloh
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c8
Neil Brown
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c9
--- Comment #9 from Neil Brown
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c10
Marco Munderloh
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c11
Neil Brown
https://bugzilla.novell.com/show_bug.cgi?id=668392
https://bugzilla.novell.com/show_bug.cgi?id=668392#c12
Neil Brown
participants (1)
-
bugzilla_noreply@novell.com