[Bug 425999] New: System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB - openSUSE Bugs - openSUSE Mailing Lists

newer
[Bug 413075] New: hardcoded...

[Bug 425999] New: System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB

older
[Bug 420335] New: Kde swapped from...

bugzilla_noreply＠novell.com

12 Sep 2008 12 Sep '08

17:19

https://bugzilla.novell.com/show_bug.cgi?id=425999 Summary: System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB Product: openSUSE 10.3 Version: Final Platform: x86-64 OS/Version: openSUSE 10.3 Status: NEW Severity: Major Priority: P5 - None Component: Xen AssignedTo: cgriffin@novell.com ReportedBy: p.chiu@rl.ac.uk QAContact: qa@suse.de Found By: Customer We have recently bought 4 servers each with dual Intel E5440 quadcore cpus, 32GB memory, Areca ARC-1220 PCI-Express SATA RAID controller and 6 x 1TB WD WD1000FYPS disks. 2 of the 1TB SATA drives are set up in RAID-1, and 4 others in RAID-5. The RAID-1 storage is partitioned into / (100GB), /spare (100GB), swap (50GB), and /data (remaining 700GB in xfs). They are all installed with OpenSUSE 10.3 x86-64 and patched with the latest updates from download.opensuse.org. 3 of them are enabled with XEN. With xen enabled kernel running (2.6.22.18-0.2-xen x86_64), a simple dd command, eg. dd if=/dev/zero of=/data/dummy bs=1024k count=10000 to make a 10GB file will cause the system to hang a few minutes later. This problem happens on all the 3 servers with xen enabled kernel running, but NOT on the non-xen kernel running server. There is no error recorded in the system log. Furthermore, by trial and error, I found out that by reducing the physical memory size on the server to 4GB, the server seems to be quite happy to complete the dd and the subsequent bonnie++ tests targetted to it. I shall be grateful for any insight to explain this problem and the offer of a proper solution. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

Show replies by date

bugzilla_noreply＠novell.com

17 Sep 17 Sep

23:05

New subject: [Bug 425999] System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB

https://bugzilla.novell.com/show_bug.cgi?id=425999 Jason Douglas changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |lbendixs@novell.com, jdouglas@novell.com, | |ksrinivasan@novell.com, dcollingridge@novell.com AssignedTo|cgriffin@novell.com |jbeulich@novell.com -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

18 Sep 18 Sep

09:14

New subject: [Bug 425999] System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB

https://bugzilla.novell.com/show_bug.cgi?id=425999 User jbeulich@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=425999#c1 Jan Beulich changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO Info Provider| |p.chiu@rl.ac.uk --- Comment #1 from Jan Beulich 2008-09-18 03:14:05 MDT --- We'll need kernel and hypervisor messages up until and including the point of hang. Generally, I would also recommend trying 11.0 rather than continuing with 10.3. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

10:03

New subject: [Bug 425999] System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB

https://bugzilla.novell.com/show_bug.cgi?id=425999 User p.chiu@rl.ac.uk added comment https://bugzilla.novell.com/show_bug.cgi?id=425999#c2 Peter Chiu changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |p.chiu@rl.ac.uk Status|NEEDINFO |NEW Info Provider|p.chiu@rl.ac.uk | --- Comment #2 from Peter Chiu 2008-09-18 04:03:50 MDT --- Thanks for your response Jan. The kernel did not record any error. The system just hang without any warning. The symptom suggests that the xen-enabled kernel does not work stably when the physical memory is over 8GB or more. Does that ring any bell to you? Since the report of the fault a week ago, we have been running our xen-kernel okay with 4GB on 3 VMs and 4GB on the physical server (with 16GB removed). We are happy with the current state. But I suspect you guys maybe interested in knowing this kind of problem. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

11:42

New subject: [Bug 425999] System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB

https://bugzilla.novell.com/show_bug.cgi?id=425999 User jbeulich@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=425999#c3 Jan Beulich changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO Info Provider| |p.chiu@rl.ac.uk --- Comment #3 from Jan Beulich 2008-09-18 05:42:53 MDT --- No, this does not sound like a general problem, and I don't think the system really dies completely silently (either kernel or hypervisor likely generate some message(s)). As stated in #1, we'll need to see all messages from a crashed session. If that would prove that there are indeed none, we'd give you instructions on how to examine system state when hung. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

22 Sep 22 Sep

17:46

New subject: [Bug 425999] System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB

https://bugzilla.novell.com/show_bug.cgi?id=425999 User p.chiu@rl.ac.uk added comment https://bugzilla.novell.com/show_bug.cgi?id=425999#c4 Peter Chiu changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW Info Provider|p.chiu@rl.ac.uk | --- Comment #4 from Peter Chiu 2008-09-22 11:46:23 MDT --- Created an attachment (id=240964) --> (https://bugzilla.novell.com/attachment.cgi?id=240964) tar gziped file containing messages, xend-debug and xend.log -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

23 Sep 23 Sep

09:15

New subject: [Bug 425999] System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB

https://bugzilla.novell.com/show_bug.cgi?id=425999 User jbeulich@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=425999#c5 Jan Beulich changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO Info Provider| |p.chiu@rl.ac.uk --- Comment #5 from Jan Beulich 2008-09-23 03:15:22 MDT --- I assume by 'messages' you mean /var/log/messages. In any case, what you provided is specifically not what we asked for - for one, the hypervisor messages are missing completely, and there is no proof that the kernel didn't generate output when dying (which normally wouldn't end up on disk for obvious reasons). If the system dies, the only way to reliably collect these messages is via serial cable (if in doubt about there being any messages, the 'sync_console' command line option [debugging only!] may also need to be given to Xen). -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

09:25

New subject: [Bug 425999] System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB

https://bugzilla.novell.com/show_bug.cgi?id=425999 User p.chiu@rl.ac.uk added comment https://bugzilla.novell.com/show_bug.cgi?id=425999#c6 --- Comment #6 from Peter Chiu 2008-09-23 03:25:01 MDT --- Hi Jan, The messages file is indeed the /var/log/messages. Can you please be more explicit as to how to collect the kernel and hypervisor messages you need. You mentioned about the serial cable, and the sync_console command, can you elaborate in details how to do that. I have (wrongly) assumed all kernel messages are stored in /var/log/messages and the /var/log/xen/xend-debug and xend.log. Peter -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

13:51

New subject: [Bug 425999] System Hang on a moderate IO load under XEN enabled kernel and memory over 10GB

https://bugzilla.novell.com/show_bug.cgi?id=425999 User jdouglas@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=425999#c7 --- Comment #7 from Jason Douglas 2008-09-23 07:51:03 MDT --- (In reply to comment #6 from Peter Chiu)

Can you please be more explicit as to how to collect the kernel and hypervisor messages you need.

You mentioned about the serial cable, and the sync_console command, can you elaborate in details how to do that.

Instructions for collecting kernel and hypervisor messages can be found here: http://en.opensuse.org/How_to_Capture_Xen_Hypervisor_and_Kernel_Messages_usi... There are no instructions specifically geared towards openSUSE 10.3, but one of the two examples at the bottom of the page should probably work. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

5703

Age (days ago)

5714

Last active (days ago)

Download

8 comments

1 participants

tags

participants (1)

bugzilla_noreply＠novell.com