https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c1 Charles Arnold changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO CC| |jfehlig@novell.com, | |pmillett@novell.com InfoProvider| |carlos@keysoft.pt QAContact|qa@suse.de |jdouglas@novell.com --- Comment #1 from Charles Arnold 2010-11-29 15:44:18 UTC --- Please list the current installed versions of the Xen RPMs in your dom0 (rpm -qa | grep xen) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c3 James Fehlig changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO CC| |cyliu@novell.com InfoProvider| |carlos@keysoft.pt --- Comment #3 from James Fehlig 2010-11-30 22:55:40 UTC --- I see your dom0 and 11.3 x86 domU are updated. I tried a simple save followed by a restore of 11.3 32-bit domU and did not see any issues. My test machine has same xen packages and same dom0/domU kernel versions. Does explicitly doing a save followed by restore work on either of the 32bit domUs? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c5 --- Comment #5 from Carlos Costa e Silva 2010-12-03 19:11:59 WET --- Worse, tuesday tried a save and restore of the 11.2 x86 domU. xm restore: failed. xm list showed the domU as started with 0 time. xm destroy: ok xm start: said domU started. xm list: hanged. A backup task [a shell script] that was running at the same time: stalled with 100% cpu in chmod on the same disk the vm disk was located. Found a kernel BUG message in /var/log/messages and had to push the reset button on the dom0. As this is a production machine, can't do too many tests ending with pushing the reset button :) Dec 1 04:14:08 zeus kernel: [542982.653504] BUG: soft lockup - CPU#3 stuck for 61s! [chown:2557] Dec 1 04:14:08 zeus kernel: [542982.653504] Modules linked in: nls_utf8 cifs ip6t_LOG xt_tcpudp xt_pkttype xt_physdev ipt_LOG xt_limit tun af_packet usbbk gntdev netbk blkbk blkback_pagemap blktap domctl xenbus_be evtchn raw coretemp bridge stp llc bonding ip6t_REJECT nf_conntrack_ipv6 ip6table_raw xt_NOTRACK ipt_REJECT xt_state iptable_raw iptable_filter ip6table_mangle nf_conntrack_netbios_ns nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 ip_tables ip6table_filter ip6_tables x_tables loop dm_mod i2c_i801 8250_pnp iTCO_wdt i3200_edac 8250 iTCO_vendor_support e1000 floppy pcspkr r8169 sr_mod sg i2c_core serial_core edac_core button ext4 jbd2 crc16 usbhid hid raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid0 uhci_hcd ehci_hcd sd_mod usbcore xenblk cdrom xennet edd raid1 fan ahci libata scsi_mod thermal processor thermal_sys hwmon Dec 1 04:14:08 zeus kernel: [542982.653504] CPU 3 Dec 1 04:14:08 zeus kernel: [542982.653504] Modules linked in: nls_utf8 cifs ip6t_LOG xt_tcpudp xt_pkttype xt_physdev ipt_LOG xt_limit tun af_packet usbbk gntdev netbk blkbk blkback_pagemap blktap domctl xenbus_be evtchn raw coretemp bridge stp llc bonding ip6t_REJECT nf_conntrack_ipv6 ip6table_raw xt_NOTRACK ipt_REJECT xt_state iptable_raw iptable_filter ip6table_mangle nf_conntrack_netbios_ns nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 ip_tables ip6table_filter ip6_tables x_tables loop dm_mod i2c_i801 8250_pnp iTCO_wdt i3200_edac 8250 iTCO_vendor_support e1000 floppy pcspkr r8169 sr_mod sg i2c_core serial_core edac_core button ext4 jbd2 crc16 usbhid hid raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid0 uhci_hcd ehci_hcd sd_mod usbcore xenblk cdrom xennet edd raid1 fan ahci libata scsi_mod thermal processor thermal_sys hwmon Dec 1 04:14:08 zeus kernel: [542982.653504] Dec 1 04:14:08 zeus kernel: [542982.653504] Pid: 2557, comm: chown Tainted: G W 2.6.34.7-0.5-xen #1 S3210SH/S3210SH Dec 1 04:14:08 zeus kernel: [542982.653504] RIP: e030:[<ffffffff800794d2>] [<ffffffff800794d2>] smp_call_function_many+0x1b2/0x230 Dec 1 04:14:08 zeus kernel: [542982.653504] RSP: e02b:ffff8800908dfde8 EFLAGS: 00000202 Dec 1 04:14:08 zeus kernel: [542982.653504] RAX: ffff88000204a7c0 RBX: ffff88000204f680 RCX: 0000000000000000 Dec 1 04:14:08 zeus kernel: [542982.653504] RDX: ffff880002044000 RSI: 0000000000000200 RDI: 0000000000000000 Dec 1 04:14:08 zeus kernel: [542982.653504] RBP: 0000000000000003 R08: ffff88000204f6f0 R09: 0000000000000200 Dec 1 04:14:08 zeus kernel: [542982.653504] R10: 0000000000007ff0 R11: 0000000000000246 R12: ffffffff80751100 Dec 1 04:14:08 zeus kernel: [542982.653504] R13: ffff880021f17e80 R14: ffff88000204f6b0 R15: ffff880021f17bc0 Dec 1 04:14:08 zeus kernel: [542982.653504] FS: 00007f3ebe3ff700(0000) GS:ffff880002044000(0000) knlGS:0000000000000000 Dec 1 04:14:08 zeus kernel: [542982.653504] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033 Dec 1 04:14:08 zeus kernel: [542982.653504] CR2: 00007f3ebdf595b0 CR3: 00000000007b7000 CR4: 0000000000002660 Dec 1 04:14:08 zeus kernel: [542982.653504] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Dec 1 04:14:08 zeus kernel: [542982.653504] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Dec 1 04:14:08 zeus kernel: [542982.653504] Process chown (pid: 2557, threadinfo ffff8800908de000, task ffff88015e69e1c0) Dec 1 04:14:08 zeus kernel: [542982.653504] Stack: Dec 1 04:14:08 zeus kernel: [542982.653504] ffff8801df4ac138 01ffffff800ea0ca 0000000000000000 ffff880021f17bc0 Dec 1 04:14:08 zeus kernel: [542982.653504] <0> ffff88015e69e1c0 ffff88015e69e7ec ffff880021f17c20 000000000000002a Dec 1 04:14:09 zeus kernel: [542982.653504] <0> ffff8801df430800 ffffffff800242f4 0000000000000000 ffff880021f17bc0 Dec 1 04:14:09 zeus kernel: [542982.653504] Call Trace: Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff800242f4>] arch_exit_mmap+0x44/0xa0 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff800f5e98>] exit_mmap+0x38/0x1c0 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff800414c5>] mmput+0x25/0x100 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff800481c9>] exit_mm+0x109/0x130 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff80048325>] do_exit+0x135/0x3a0 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff80048755>] do_group_exit+0x55/0x110 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff80048822>] sys_exit_group+0x12/0x20 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff80007438>] system_call_fastpath+0x16/0x1b Dec 1 04:14:09 zeus kernel: [542982.653504] [<00007f3ebdf595e8>] 0x7f3ebdf595e8 Dec 1 04:14:09 zeus kernel: [542982.653504] Code: 00 e8 83 52 39 00 0f ae f0 4c 89 f7 e8 b8 f2 f9 ff 80 7c 24 0f 00 0f 84 d4 fe ff ff f6 43 20 01 0f 84 ca fe ff ff 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 e9 ba fe ff ff 0f 1f 00 4c 89 e2 4c 89 ee 89 Dec 1 04:14:09 zeus kernel: [542982.653504] Call Trace: Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff800242f4>] arch_exit_mmap+0x44/0xa0 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff800f5e98>] exit_mmap+0x38/0x1c0 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff800414c5>] mmput+0x25/0x100 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff800481c9>] exit_mm+0x109/0x130 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff80048325>] do_exit+0x135/0x3a0 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff80048755>] do_group_exit+0x55/0x110 Dec 1 04:14:09 zeus kernel: [542982.653504] [<ffffffff80048822>] sys_exit_group+0x12/0x20 Dec 1 04:14:10 zeus kernel: [542982.653504] [<ffffffff80007438>] system_call_fastpath+0x16/0x1b Dec 1 04:14:10 zeus kernel: [542982.653504] [<00007f3ebdf595e8>] 0x7f3ebdf595e8 -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c10 --- Comment #10 from Chunyan Liu 2010-12-09 03:47:16 UTC --- OK. I forgot to set XENDOMAINS_AUTO_ONLY=false. Now I can reproduce the bug. I'll investigate that. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c12 --- Comment #12 from Chunyan Liu 2010-12-13 09:57:38 UTC --- Change following line of /etc/init.d/xendomains: xm restore "$dom" >/dev/null 2>&1 to xm restore "$dom" can work well. You can have a try. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c14 --- Comment #14 from Carlos Costa e Silva 2010-12-14 00:58:24 WET --- Also, I've removed the few installed things in the domU and can now upload both the domU disk and the xm save file somewhere for your testing. disk0.raw.bz2: 584M (1.8G sparse, 20G size), save.bz2: 26M Just say where the files can be uploaded to. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c16 --- Comment #16 from Chunyan Liu 2010-12-16 09:01:56 UTC --- (In reply to comment #14)

Also, I've removed the few installed things in the domU and can now upload both the domU disk and the xm save file somewhere for your testing. disk0.raw.bz2: 584M (1.8G sparse, 20G size), save.bz2: 26M

Just say where the files can be uploaded to.

Well, those files are really too large. I think you can put it to a network place (for example, dropbox) and give me the address. Then I can get it. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c18 --- Comment #18 from Carlos Costa e Silva 2010-12-20 23:19:33 WET --- Nothing very special about the shared folder: it contains soft links to iso images used to create domUs. In this case, /var/lib/xen/images/shared/openSUSE-11.3-DVD-i586.iso is a soft link to the 11.3x32 dvd iso. I removed the entry from the domU and it seems to show no relevant changes. Now that I have a test dom0, I can do some more tests... While trying the change (removing xvdb cdrom), something very strange is going on: xm start domU -> ok rcxendomains stop -> domU saved rcxendomains start -> domU restore fails (start always fails after the first stop [save]) rcxendomains stop -> nothing rcxendomains start -> domU restore succeeds [most of the time, otherwise it always succeeds after a few more stop/starts]. After this, restarted the system and the domU failed to restore at startup. After five rcxendomains stop/start, the domU started ok. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c20 --- Comment #20 from Carlos Costa e Silva 2011-01-27 17:25:14 WET --- Downloaded and installed libxenguest.so.4.0.0 to the test dom0 and it seems the problem is solved: - before updating libxenguest restore failed. - updated libxenguest, did a dozen save/restores of the domU and not one failed. After a restart, the domU also restored ok. I'm glad the bug was finally reproducible and solved (I was wondering if there was some bad juju on my dom0's :) Good work, thanks. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c22 --- Comment #22 from Chunyan Liu 2011-02-15 07:43:47 UTC ---

From the log, the restore process seems to be normal till last line. Could you attach the whole xend.log?

-- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c24 --- Comment #24 from Chunyan Liu 2011-02-16 06:06:46 UTC ---

Ah, I assumed those 'batch' error lines meant something, but looking at successful restores of the other domU's the lines are there also. That error lines are just expected which indicates no more pages to load and will goto finish part.

Looking more carefully at the log, I don't see differences between a failed restore and a successfull one (for the other domU's)... Cannot see any problem from xend.log. Is that issue reproducible?

-- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c26 --- Comment #26 from Jason Douglas 2013-04-17 04:15:48 MDT --- This is a very old bug. Is there a reason it is still open? If not, can we close it out? Thanks! -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=653788 https://bugzilla.novell.com/show_bug.cgi?id=653788#c28 James Fehlig changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |UPSTREAM --- Comment #28 from James Fehlig 2013-04-18 06:33:11 UTC --- Wow, openSUSE11.3? It is no longer maintained. We have Xen 4.2 now in 12.3! Even if we produced a fix, there would be no mechanism to release it. Closing as UPSTREAM since there have been no reports of this issue on newer xen releases. Please open a new bug against 12.{1,2,3} if the problem persists. Thanks! -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.