[Bug 779965] New: boot error: snapshot target support missing from kernel
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c0 Summary: boot error: snapshot target support missing from kernel Classification: openSUSE Product: openSUSE 12.2 Version: Final Platform: i686 OS/Version: openSUSE 12.2 Status: NEW Severity: Normal Priority: P5 - None Component: Basesystem AssignedTo: bnc-team-screening@forge.provo.novell.com ReportedBy: mathias.froehlich@f-i.de QAContact: qa-bugs@suse.de Found By: --- Blocker: --- User-Agent: Mozilla/5.0 (X11; Linux i686; rv:15.0) Gecko/20100101 Firefox/15.0 When booting up 12.2 after live upgrade via zypper with a LVM snapshot volume exisiting in the root VG, the boot process is going in an infinite loop saying: snapshot target support missing from kernel? Reproducible: Always Steps to Reproduce: 1. configure system to boot using LVM volume(s), create snapshot of root volume 2. boot with systemd 3. see error loop on console Actual Results: system unable to boot Expected Results: system boot into runlevel "multi-user" -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c kk zhang <kkzhang@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kkzhang@suse.com AssignedTo|bnc-team-screening@forge.pr |fcrozat@suse.com |ovo.novell.com | -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c1 Frederic Crozat <fcrozat@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |mathias.froehlich@f-i.de --- Comment #1 from Frederic Crozat <fcrozat@suse.com> 2012-09-18 12:05:25 UTC --- does it work if you boot with sysvinit ? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c2 --- Comment #2 from Mathias Fröhlich <mathias.froehlich@f-i.de> 2012-09-19 07:49:35 UTC --- (In reply to comment #1)
does it work if you boot with sysvinit ?
Hi, no, it's not working. I think the problem is in the kernel. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c3 Frederic Crozat <fcrozat@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- AssignedTo|fcrozat@suse.com |nfbrown@suse.com --- Comment #3 from Frederic Crozat <fcrozat@suse.com> 2012-09-19 08:21:28 UTC --- maybe neil will have a clue ;) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c4 --- Comment #4 from Neil Brown <nfbrown@suse.com> 2012-09-20 06:46:46 UTC --- Presumably dm-snapshot.ko is missing from the initrd. Can you boot the machine at all? Maybe the 'rescue' option from an install DVD then mount the root filesystem and 'chroot' into it. If you can get that far, try mkinitrd -m dm-snapshot and see if it will boot properly then. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c5 --- Comment #5 from Mathias Fröhlich <mathias.froehlich@f-i.de> 2012-09-20 08:37:16 UTC --- Hi, not an option as even the rescue system isn't able to activate the root volume of the rootvg since it is kind of linked to the snapshot volume: linux:~ # vgchange -ay Can't process LV preupgrade: snapshot target support missing from kernel? 2 logical volume(s) in volume group "system" now active linux:~ # mount /dev/system/ home swap linux:~ # lvs LV VG Attr LSize Origin Snap% Move Log Copy% Convert home system -wi-a- 44.00m preupgrade system swi--- 7.50g root root system owi--- 7.50g swap system -wi-a- 1.10g Maybe you should add the correct module in the initrd of the initial installationsystem? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c6 Mathias Fröhlich <mathias.froehlich@f-i.de> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|mathias.froehlich@f-i.de | --- Comment #6 from Mathias Fröhlich <mathias.froehlich@f-i.de> 2012-09-20 09:07:45 UTC --- When manually probing the dm-snapshot module in rescue I'm able to activate the root volume and fix the initrd: linux:~ # modprobe dm-snapshot linux:~ # vgchange -ay 4 logical volume(s) in volume group "system" now active linux:~ # mount /dev/system/root /mnt/ linux:~ # mount /dev/sda1 /mnt/boot/ linux:~ # mount -o bind /dev /mnt/dev/ linux:~ # mount -o bind /sys/ /mnt/sys/ linux:~ # mount -o bind /proc/ /mnt/proc/ linux:~ # chroot /mnt/ linux:/ # mkinitrd -m dm-snapshot Kernel image: /boot/vmlinuz-3.4.6-2.10-default Initrd image: /boot/initrd-3.4.6-2.10-default Root device: /dev/system/root (mounted on / as ext4) modprobe: Module dm_snapshot_origin not found. WARNING: no dependencies for kernel module 'dm-snapshot-origin' found. Kernel Modules: hwmon thermal_sys thermal processor fan dm-mod dm-snapshot scsi_dh scsi_dh_hp_sw scsi_dh_emc scsi_dh_rdac scsi_dh_alua scsi_transport_spi mptbase mptscsih mptspi linear Features: acpi dm plymouth block lvm2 resume.userspace resume.kernel After reboot it's working...until next kernel update I believe. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c7 Neil Brown <nfbrown@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |ASSIGNED --- Comment #7 from Neil Brown <nfbrown@suse.com> 2012-09-20 09:48:32 UTC --- Excellent! I'll try to figure out the correct fix so it'll be present before the next kernel update :-) I'll let you know when I have something for you to try, but it probably won't be for a week or more. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c8 flo gleixner <gleixner@bib-bvb.de> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |gleixner@bib-bvb.de --- Comment #8 from flo gleixner <gleixner@bib-bvb.de> 2012-09-25 22:40:08 UTC --- Hi, this is probably related: after live upgrade with zypper, one lvm2 mirrored volume did not show up and the backup script using lvm2 snapshots did not work any more. I could solve the issues by editing /etc/sysconfig/kernel and adding a file to /etc/modules-load.d and therefore adding the missing modules but this change surprised me. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c9 --- Comment #9 from Neil Brown <nfbrown@suse.com> 2012-09-25 23:33:46 UTC --- Hi, could you (both) please provide the output of dmsetup table lsmod when the lvm2 device is assembled properly and working? I have half an idea what is going wrong - having the above should help me sort it out exactly. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c10 --- Comment #10 from flo gleixner <gleixner@bib-bvb.de> 2012-09-26 05:46:42 UTC --- Created an attachment (id=507085) --> (http://bugzilla.novell.com/attachment.cgi?id=507085) output from dmsetup table and lsmod -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c11 Neil Brown <nfbrown@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|ASSIGNED |NEEDINFO InfoProvider| |gleixner@bib-bvb.de --- Comment #11 from Neil Brown <nfbrown@suse.com> 2012-09-26 07:54:32 UTC --- Well I've found something that looks wrong, and looks like it would explain your symptoms, but it looks like it has been wrong for a long time so I'm surprised that previous releases worked... What version of openSUSE did you live-update from? Anyway, in /lib/mkinitrd/scripts/setup-dm.sh, just near the bottom, it says: save_var root_dm it should also say save_var dm_modules Could you please add that line, remove any other configuration changes you have made to work around the problem, run "mkinitrd" and see if you can then boot successfully. (I can't set NEEDINFO to both of you, so I'll just choose one - I'd like to hear from both if possible). -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c12 --- Comment #12 from flo gleixner <gleixner@bib-bvb.de> 2012-09-26 08:59:24 UTC --- since it's a server i dont want to reboot now, but i run mkinitrd without the suggested fix, and it includes the dm_mirror and dm_snapshot kernel modules. But: on another fresh booted 12.2 system i cannot create a snapshot. lsmod |grep dm_ shows dm_mod only, and after running lvcreate -s unsuccessfully the dm_* modules are the same as before -> i suggest the lvm2 commands should load these modules? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c13 --- Comment #13 from Mathias Fröhlich <mathias.froehlich@f-i.de> 2012-09-26 12:33:43 UTC --- (In reply to comment #11)
Well I've found something that looks wrong, and looks like it would explain your symptoms, but it looks like it has been wrong for a long time so I'm surprised that previous releases worked...
What version of openSUSE did you live-update from?
Anyway, in /lib/mkinitrd/scripts/setup-dm.sh, just near the bottom, it says:
save_var root_dm
it should also say
save_var dm_modules
Could you please add that line, remove any other configuration changes you have made to work around the problem, run "mkinitrd" and see if you can then boot successfully.
(I can't set NEEDINFO to both of you, so I'll just choose one - I'd like to hear from both if possible).
Hi, this seems to work, the snapshot module is now included into initrd: linux:~ # chroot /mnt/ linux:/ # mkinitrd Kernel image: /boot/vmlinuz-3.4.6-2.10-default Initrd image: /boot/initrd-3.4.6-2.10-default Root device: /dev/system/root (mounted on / as ext4) modprobe: Module dm_snapshot_origin not found. WARNING: no dependencies for kernel module 'dm-snapshot-origin' found. Kernel Modules: hwmon thermal_sys thermal processor fan vmxnet3 vmw_pvscsi dm-mod dm-snapshot scsi_dh scsi_dh_hp_sw scsi_dh_emc scsi_dh_rdac scsi_dh_alua scsi_transport_spi mptbase mptscsih mptspi linear Features: acpi dm plymouth block lvm2 resume.userspace resume.kernel What about the warning for dm_snapshot_origin? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c14 flo gleixner <gleixner@bib-bvb.de> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |ASSIGNED InfoProvider|gleixner@bib-bvb.de | --- Comment #14 from flo gleixner <gleixner@bib-bvb.de> 2012-09-26 17:15:02 UTC --- I think the problem is not the initrd and not the upgrade. I tried this: Installed a (virtual) machine using opensuse 12.2 DVD, lvm based partitioning. Inside the vm i tried to create a snapshot - it failed with the message: snapshot: Required device-mapper target(s) not detected in your kernel Did a zypper ref && zypper up && reboot -> no change. But after modprobe dm-snapshot i can create the snapshot. So i created a snapshot of the root volume and rebuilt the initrd -> dm_snapshot got installed inside the initrd and then i rebooted. Result: VM cannot boot and spits "Can't process VL root_snap: snapshot target is missing from kernel?" So i assume, lvm2 commands should load devicemapper modules but fail to do that. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c15 --- Comment #15 from flo gleixner <gleixner@bib-bvb.de> 2012-09-26 21:48:52 UTC --- I think i have a solution: I installed the sources: zypper ar --refresh http://download.opensuse.org/source/distribution/12.2/repo/oss/ opensuse_sources_12.2 zypper si lvm2 Build the rpm and installed it: cd /usr/src/packages rpmbuild -bb SPECS/lvm2.spec cd RPMS/x86_64 rpm -i --force lvm2-2.02.84-26.5.1.x86_64.rpm and now it works: a "lvcreate -s" does a "modprobe dm_snapshot". I think the host where the rpm was build misses /sbin/modprobe. Or something else is broken. If you do a "strings /sbin/lvcreate |grep modprobe" you get nothing on the broken binary and /sbin/modprobe on the working one. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c16 Neil Brown <nfbrown@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|ASSIGNED |NEEDINFO CC| |nfbrown@suse.com InfoProvider| |maintenance@opensuse.org --- Comment #16 from Neil Brown <nfbrown@suse.com> 2012-09-27 01:16:38 UTC --- Ahh... fantastic. Thanks for finding that. The problem is that "lvm2.spec" contains %build MODPROBE_CMD=/sbin/modprobe \ %configure --prefix=/ \ .... Where as in 12.1 it was: %build CFLAGS="$RPM_OPT_FLAGS" MODPROBE_CMD=/sbin/modprobe \ ./configure --prefix=/ \ The 12.2 version apparently doesn't work and configure is run without MODPROBE_CMD being set properly, with exactly the results you see. I'll fix it by making it %build export MODPROBE_CMD=/sbin/modprobe %configure --prefix=/ \ The "save_var dm_modules" fix is an effective work around, but doesn't fix the real problem. Nevertheless the handling of dm_modules is somewhat untidy - I'll fix that. The 'dm-snapshot-origin' message is not overly significant. I'll make it go away, but it isn't a sign of any real problem (the dm-snapshot module provides both dm-snapshot and dm-snapshot-origin which are used as different parts of the snapshot implementation). Hi maintenance: I've submitted a maintenance request (136149). Do I still need to NEEDINFO to you? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c17 --- Comment #17 from Bernhard Wiedemann <bwiedemann@suse.com> 2012-09-27 19:00:07 CEST --- This is an autogenerated message for OBS integration: This bug (779965) was mentioned in https://build.opensuse.org/request/show/136271 Factory / device-mapper -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c18 Marcus Meissner <meissner@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |RESOLVED CC| |meissner@suse.com InfoProvider|maintenance@opensuse.org | Resolution| |FIXED --- Comment #18 from Marcus Meissner <meissner@suse.com> 2012-09-29 11:40:51 UTC --- if everything is correct, it is not necessary to NEEDINFO us. But please do so if you have any questions. -> resolved/fixed -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c19 Neil Brown <nfbrown@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jengelh@inai.de --- Comment #19 from Neil Brown <nfbrown@suse.com> 2012-10-02 07:51:36 UTC --- Hi Jan, If you are also jengelh@medozas.de, then it looks like you introduced this bug. I thought I would let you know in case you made a similar changes to any other package. X=y \ ./configure .... cannot be safely changed to X=y \ %configure .... If it wasn't you: my apologies for disturbing you. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c20 --- Comment #20 from Jan Engelhardt <jengelh@inai.de> 2012-10-02 10:39:46 CEST --- CFLAGS=foo %configure ... should be working, since %configure expands to something that contains CFLAGS="${CFLAGS:-%optflags}" ; export CFLAGS ; \ -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c21 --- Comment #21 from Jan Engelhardt <jengelh@inai.de> 2012-10-02 10:46:11 CEST --- Looking at sr#136271 - indeed. Variables do need to be exported before %configure. In case of CFLAGS and CXXFLAGS that's automatic, but not so for MODPROBE_CMD. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c22 --- Comment #22 from Neil Brown <nfbrown@suse.com> 2012-10-02 11:05:09 UTC --- The important point is the trailing slash. X=y \ ./configure .... is equivalent to X=y ./configure .... which tells bash to export X=y just for the command './configure'. This behaviour is explained in "SIMPLE COMMAND EXPANSION" in the 'bash' man page. X=y \ %configure .... becomes X=y CFLAGS=..... ; export CFLAGS ; ./configure .... so now "X=y" is not part of the same commands as "./configure", so the automatic export doesn't happen. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c23 --- Comment #23 from Swamp Workflow Management <swamp@suse.de> 2012-10-04 20:09:10 UTC --- openSUSE-RU-2012:1292-1: An update that has one recommended fix can now be installed. Category: recommended (low) Bug References: 779965 CVE References: Sources used: openSUSE 12.2 (src): device-mapper-1.02.63-26.8.1, lvm2-2.02.84-26.8.2, lvm2-clvm-2.02.84-26.8.2 -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c24 Yarny Yarny <Yarny@public-files.de> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |Yarny@public-files.de --- Comment #24 from Yarny Yarny <Yarny@public-files.de> 2012-12-15 23:22:37 UTC --- *** Bug 779445 has been marked as a duplicate of this bug. *** http://bugzilla.novell.com/show_bug.cgi?id=779445 -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c25 --- Comment #25 from Bernhard Wiedemann <bwiedemann@suse.com> 2013-10-21 14:00:17 CEST --- This is an autogenerated message for OBS integration: This bug (779965) was mentioned in https://build.opensuse.org/request/show/204121 Factory / lvm2 -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=779965 https://bugzilla.novell.com/show_bug.cgi?id=779965#c26 --- Comment #26 from Yarny Yarny <Yarny@public-files.de> 2013-11-02 23:01:21 UTC --- Hi, I observed a similar bug and reported it under bug 779445. It is possibly a duplicate of this bug. Bug 779445 reappeared in current openSUSE 13.1. Since I cannot verify if this bug also reappeared I just reopened bug 779445. I just want to let you know about this, in case you want to check if this bug also reappeared in current openSUSE 13.1. I hope that's OK. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
participants (1)
-
bugzilla_noreply＠novell.com