[Bug 825150] New: Latest nfs-kernel-server update umounts /dev, /proc
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c0 Summary: Latest nfs-kernel-server update umounts /dev, /proc Classification: openSUSE Product: openSUSE 12.3 Version: Final Platform: x86-64 OS/Version: Linux Status: NEW Severity: Critical Priority: P5 - None Component: Basesystem AssignedTo: bnc-team-screening@forge.provo.novell.com ReportedBy: jengelh@inai.de QAContact: qa-bugs@suse.de CC: nfbrown@suse.com, fcrozat@suse.com Found By: Beta-Customer Blocker: No 20:50 ares07:../Factory/icu # zypper up Loading repository data... Reading installed packages... The following packages are going to be upgraded: MPlayer libXext-devel libXext6 libXfixes-devel libXfixes3 libXrender-devel libXrender1 libXt-devel libXt6 libXv-devel libXv1 libxcb-composite0 libxcb-damage0 libxcb-devel libxcb-dpms0 libxcb-dri2-0 libxcb-glx0 libxcb-randr0 libxcb-record0 libxcb-render0 libxcb-res0 libxcb-screensaver0 libxcb-shape0 libxcb-shm0 libxcb-sync0 libxcb-xevie0 libxcb-xf86dri0 libxcb-xfixes0 libxcb-xinerama0 libxcb-xprint0 libxcb-xtest0 libxcb-xv0 libxcb-xvmc0 libxcb1 nfs-client nfs-kernel-server subversion subversion-perl ... (33/40) Installing: libxcb-dpms0-1.9-2.4.1 ...............................[done] (34/40) Installing: libxcb-damage0-1.9-2.4.1 .............................[done] (35/40) Installing: libxcb-composite0-1.9-2.4.1 ..........................[done] (36/40) Installing: nfs-kernel-server-1.2.7-2.6.1 ........................[done] Additional rpm output: redirecting to systemctl try-restart nfsserver Job for nfsserver.service failed. See 'systemctl status nfsserver.service' and 'journalctl -n' for details. (37/40) Installing: subversion-perl-1.7.10-2.8.1 .........................[done] Additional rpm output: warning: Failed to read auxiliary vector, /proc not mounted? warning: Failed to read auxiliary vector, /proc not mounted? warning: Failed to read auxiliary vector, /proc not mounted? warning: Failed to read auxiliary vector, /proc not mounted? warning: Failed to read auxiliary vector, /proc not mounted? warning: Failed to read auxiliary vector, /proc not mounted? warning: Failed to read auxiliary vector, /proc not mounted? warning: Failed to read auxiliary vector, /proc not mounted? 21:00 ares07:/ # command mount -t proc proc /proc mount: wrong fs type, bad option, bad superblock on proc, missing codepage or helper program, or other error In some cases useful info is found in syslog - try dmesg | tail or so 21:00 ares07:/ # dmesg | tail [2357722.754225] nfsd: last server has exited, flushing export cache [2357727.571685] warning: process `radvd' used the deprecated sysctl system call with 3.12.16.-2.1. I have no idea what ate /dev and made it impossible to mount /proc, but it smells like systemd's use of shared subtrees might play a role. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c1 --- Comment #1 from Jan Engelhardt <jengelh@inai.de> 2013-06-15 15:17:31 CEST --- syslog was able to collect some more kernel messages. Jun 15 20:51:05 ares07 useradd[28888]: failed adding user 'statd', data deleted Jun 15 20:51:06 ares07 systemd[1]: Reloading. Jun 15 20:51:06 ares07 systemd[1]: [/usr/lib/systemd/system/radvd.service:6] Unknown lvalue 'EnvironmentFile-' in section 'Service'. Ignoring. Jun 15 20:51:10 ares07 systemd[1]: Reloading. Jun 15 20:51:10 ares07 systemd[1]: [/usr/lib/systemd/system/radvd.service:6] Unknown lvalue 'EnvironmentFile-' in section 'Service'. Ignoring. Jun 15 20:51:10 ares07 automount[1565]: lookup_init:136: lookup(yp): map auto.direct: Local domain name not set Jun 15 20:51:15 ares07 systemd[1]: Reloading. Jun 15 20:51:15 ares07 systemd[1]: [/usr/lib/systemd/system/radvd.service:6] Unknown lvalue 'EnvironmentFile-' in section 'Service'. Ignoring. Jun 15 20:51:15 ares07 systemd[1]: Stopping LSB: Start the kernel based NFS daemon... Jun 15 20:51:15 ares07 kernel: [2357722.754225] nfsd: last server has exited, flushing export cache Jun 15 20:51:15 ares07 rpc.mountd[2789]: Caught signal 15, un-registering and exiting. Jun 15 20:51:15 ares07 nfsserver[29046]: Shutting down kernel based NFS server: nfsd statd mountd idmapdumount: The: not found Jun 15 20:51:15 ares07 nfsserver[29046]: umount: Please: not found Jun 15 20:51:15 ares07 nfsserver[29046]: umount: Is: not found Jun 15 20:51:20 ares07 kernel: [2357727.571685] warning: process `radvd' used the deprecated sysctl system call with 3.12.16.-2.1. Please? Is? Lack of quoting? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c2 --- Comment #2 from Jan Engelhardt <jengelh@inai.de> 2013-06-15 15:21:45 CEST --- More information before I reboot this machine... The "Is" and "Please" may come from this part of the init script if [ $warned = no ] ; then echo echo "NFS: The usage of 'bind=' in /etc/exports is deprecated." echo "NFS: Is it no longer needed and may cease to work." echo "NFS: Please remove these settings." warned=yes fi >&2 Note that no one will be able to see this message, because systemctl won't show it. But I do have had bind= entries in /etc/exports so far. /srv/nfs4 \ 10.10.0.0/24(rw,fsid=0,no_root_squash,no_subtree_check) \ ::1(rw,fsid=0,subtree_check,no_root_squash) /srv/nfs4/home \ 10.10.0.0/24(rw,bind=/home,no_root_squash,no_subtree_check) \ ::1(rw,no_root_squash,subtree_check) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c3 --- Comment #3 from Neil Brown <nfbrown@suse.com> 2013-06-15 16:44:38 UTC --- I hadn't expected that ... Yes, the "Please" and "Is" that you see is an error (not exactly quoting, but similar) and is one of the things that the update was trying to fix. Those lines were incorrectly put in /run/nfs/bind.mounts by the old nfs-utils, and when you did the upgraded "/etc/init.d/nfsserver stop" was called which tried to unmount all of them. One of the incorrect lines is empty and unfortunately umount -l '' will unmount all filesystems!! (except root). This is why your /dev and /proc disappeared. I haven't figured out why you cannot remount them yet. However a reboot should fix things. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c4 Jan Engelhardt <jengelh@inai.de> changed: What |Removed |Added ---------------------------------------------------------------------------- CC|fcrozat@suse.com | --- Comment #4 from Jan Engelhardt <jengelh@inai.de> 2013-06-15 19:15:24 CEST --- mount(8) turns `umount -l ""` into `umount -l "/"`. strace says: 1382 umount("/", MNT_DETACH) = 0 That is bad — mount should pass the empty string directly to the kernel and let the syscall fail, and handle the failure like any other. My reasoning is that because / is then detached from the namespace, so attempting to mount anything in the dying vfsmount will always fail. (Therefore no systemd issue here.) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c5 Neil Brown <nfbrown@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |maintenance@opensuse.org --- Comment #5 from Neil Brown <nfbrown@suse.com> 2013-06-16 18:21:11 UTC --- Hi Maintenance: It seems that the recent nfs-utils update for openSUSE-12.3 has a problem. The problem is really in the earlier version. If a particular configuration is in effect (bind= in /etc/exports) then running "rcnfsserver stop" will unmount all filesystems! This has probably been happening ever since it was released but as it only happens at shutdown time, no-one noticed. However installing an update causes "rcnfsserver restart" to be run which does the "stop" then a "start" which causes the problem. So after an update everything might be unmounted. The problem can be simply fixed by a reboot, but avoiding that need would obviously be best. So: can we either disable the current update, or expedite a new release? As it is the *new* rcnfsserver which is run, I can put something in to stop old state causing a problem. In particular that patch below will cause updates to happen without incident. Index: nfsserver.init =================================================================== --- nfsserver.init (revision 93e3962c070c76f4afcb3b3cca91f2df) +++ nfsserver.init (working copy) @@ -118,7 +118,7 @@ nfs4_unbind_mounts() { sort -r -k2 $NFSD_BIND_MOUNTS | while read src mountpoint crap; do - umount -l "$mountpoint" + [ -n "$mountpoint" ] && umount -l "$mountpoint" done > $NFSD_BIND_MOUNTS } I tried branching "openSUSE:12.3:Update:Test/mdadm" but it didn't like that, so I branched "openSUSE:12.3:Update/mdadm" and created a maintenance request from there (179220). Just to clarify: the problem is caused by the earlier nfs-utils writing garbage to /run/nfs/bind.mounts, and particularly writing a blank line. If bind.mounts contains a blank line, the above "nfs4_unbind_mounts" function runs umount -l '' which surprisingly unmounts everything. If it is possible to prevent people using the current update, either by disabling it or replacing it, that would be great. Thanks. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c6 --- Comment #6 from Jan Engelhardt <jengelh@inai.de> 2013-06-16 21:08:44 CEST --- This does not happen on SLE 11, because umount rejects the empty string in util-linux-2.19.1-6.33.47.1. So we do have some lower version boundary on the problem. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c Ye Yuan <yyuan@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |yyuan@suse.com AssignedTo|bnc-team-screening@forge.pr |nfbrown@suse.com |ovo.novell.com | -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c7 --- Comment #7 from Jan Engelhardt <jengelh@inai.de> 2013-06-18 04:53:12 CEST --- For the records, Karel Zak reports on the `umount -l ""` matter:
Fixed, commit 7ba207e781c7af3945d3a718651b87425685131e . The patch will be available in util-linux >= 2.23.2
-- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c8 Benjamin Brunner <bbrunner@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|maintenance@opensuse.org | --- Comment #8 from Benjamin Brunner <bbrunner@suse.com> 2013-06-18 05:25:08 CEST --- Neil, is there a reason why we need the mdadm-update together with the nfs-utils? If not, could you open two separate maintenancerequests, please (with the changes for mdadm.changes, see the declined-message from mr#179220) We'll prepare the nfs-utils update as fast as possible. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c9 --- Comment #9 from Neil Brown <nfbrown@suse.com> 2013-06-18 04:29:54 UTC --- mdadm and nfs-utils are completely unrelated. Sorry if I did something that made them seem to be connected. There is no rush for mdadm. Thanks. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c10 --- Comment #10 from Benjamin Brunner <bbrunner@suse.com> 2013-06-18 07:05:54 CEST --- Ah ok, I was a little bit confused because of comment #5
I tried branching "openSUSE:12.3:Update:Test/mdadm" but it didn't like that, so I branched "openSUSE:12.3:Update/mdadm" and created a maintenance request from there (179220).
Could you reopen your request again, please? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c11 --- Comment #11 from Neil Brown <nfbrown@suse.com> 2013-06-18 05:34:11 UTC --- Did I write that? So I did. Sorry - don't know what I was thinking. And request 179220 seems to have both mdadm and nfs-utils in it... how would I have managed that? Could "osc mr" have done that? I've just done an 'osc sr' which seems to have successfully create rq 179545, but complained about it not being a maintenance request. Should I do it again with "osc mr" ?? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c12 --- Comment #12 from Benjamin Brunner <bbrunner@suse.com> 2013-06-18 07:56:17 CEST --- The new submission looks good, thanks. In general 'osc mr' without specified package opens a maintenancerequest which includes all packages of your branch-project. So if you do an osc mbranch of mdadm and nfs-utils and open a maintenancerequest in this subproject, both packages are included. And if you try to open a sr against e.g. openSUSE:12.3:Update it generates automatically a mr. I hope I could help you a little. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c13 --- Comment #13 from Jan Engelhardt <jengelh@inai.de> 2013-06-18 11:02:52 CEST --- If in doubt, just do single-package branching and submission via `osc branch` and `osc sr` as usual. That works remarkably well for maintenance too. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c14 --- Comment #14 from Benjamin Brunner <bbrunner@suse.com> 2013-06-19 04:02:42 CEST --- Could someone test the packages from 'http://download.opensuse.org/repositories/openSUSE:/Maintenance:1789/openSUS...', please? I'll release it as soon as I get a positive response Thanks. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c15 --- Comment #15 from Jan Engelhardt <jengelh@inai.de> 2013-06-19 20:48:58 CEST --- 1789 fixes the issue. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c16 Benjamin Brunner <bbrunner@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |FIXED --- Comment #16 from Benjamin Brunner <bbrunner@suse.com> 2013-06-20 04:41:43 CEST --- Thanks for verifying. I released the update. Resolved fixed. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c17 --- Comment #17 from Swamp Workflow Management <swamp@suse.de> 2013-06-20 03:04:22 UTC --- openSUSE-RU-2013:1054-1: An update that has one recommended fix can now be installed. Category: recommended (important) Bug References: 825150 CVE References: Sources used: openSUSE 12.3 (src): nfs-utils-1.2.7-2.10.1 -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=825150 https://bugzilla.novell.com/show_bug.cgi?id=825150#c Jan Engelhardt <jengelh@inai.de> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|RESOLVED |VERIFIED -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
participants (1)
-
bugzilla_noreply＠novell.com