[Bug 792324] New: directory access on nfs4 mount hangs
https://bugzilla.novell.com/show_bug.cgi?id=792324 https://bugzilla.novell.com/show_bug.cgi?id=792324#c0 Summary: directory access on nfs4 mount hangs Classification: openSUSE Product: openSUSE 12.2 Version: Final Platform: x86-64 OS/Version: openSUSE 12.2 Status: NEW Severity: Normal Priority: P5 - None Component: Network AssignedTo: bnc-team-screening@forge.provo.novell.com ReportedBy: martin@oneiros.de QAContact: qa-bugs@suse.de Found By: --- Blocker: --- User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/17.0 Firefox/17.0 I have an nfs4 mount from an 12.2 client to a 12.2 server. The problem showed up in that updatedb hangs. An lsof of that process showed an access to an nfs4 mount (see also bug 792323). Further testing shows that an ls -la on a directory on that mount hangs: mmap(NULL, 337515, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fa33f0a9000 close(3) = 0 lstat("/lucien-raid/bitflu/", {st_mode=S_IFDIR|0775, st_size=4096, ...}) = 0 lgetxattr("/lucien-raid/bitflu/", "security.selinux", 0x937e40, 255) = -1 EOPNOTSUPP (Operation not supported) lgetxattr("/lucien-raid/bitflu/", "system.posix_acl_access", 0x0, 0) = -1 EOPNOTSUPP (Operation not supported) socket(PF_FILE, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3 connect(3, {sa_family=AF_FILE, sun_path="/var/run/nscd/socket"}, 110) = 0 sendto(3, "\2\0\0\0\v\0\0\0\7\0\0\0passwd\0", 19, MSG_NOSIGNAL, NULL, 0) = 19 poll([{fd=3, events=POLLIN|POLLERR|POLLHUP}], 1, 5000) = 1 ([{fd=3, revents=POLLIN|POLLHUP}]) recvmsg(3, {msg_name(0)=NULL, msg_iov(2)=[{"", 7}, {"", 8}], msg_controllen=0, msg_flags=MSG_CMSG_CLOEXEC}, MSG_CMSG_CLOEXEC) = 0 close(3) = 0 socket(PF_FILE, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3 connect(3, {sa_family=AF_FILE, sun_path="/var/run/nscd/socket"}, 110) = 0 sendto(3, "\2\0\0\0\1\0\0\0\2\0\0\0000\0", 14, MSG_NOSIGNAL, NULL, 0) = 14 poll([{fd=3, events=POLLIN|POLLERR|POLLHUP}], 1, 5000) = 1 ([{fd=3, revents=POLLIN|POLLHUP}]) read(3, "\2\0\0\0\1\0\0\0\5\0\0\0\2\0\0\0\0\0\0\0\0\0\0\0\5\0\0\0\6\0\0\0"..., 36) = 36 read(3, "root\0x\0root\0/root\0/bin/bash\0", 28) = 28 close(3) = 0 socket(PF_FILE, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3 connect(3, {sa_family=AF_FILE, sun_path="/var/run/nscd/socket"}, 110) = 0 sendto(3, "\2\0\0\0\f\0\0\0\6\0\0\0group\0", 18, MSG_NOSIGNAL, NULL, 0) = 18 poll([{fd=3, events=POLLIN|POLLERR|POLLHUP}], 1, 5000) = 1 ([{fd=3, revents=POLLIN|POLLHUP}]) recvmsg(3, {msg_name(0)=NULL, msg_iov(2)=[{"", 6}, {"", 8}], msg_controllen=0, msg_flags=MSG_CMSG_CLOEXEC}, MSG_CMSG_CLOEXEC) = 0 close(3) = 0 socket(PF_FILE, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3 connect(3, {sa_family=AF_FILE, sun_path="/var/run/nscd/socket"}, 110) = 0 sendto(3, "\2\0\0\0\3\0\0\0\2\0\0\0000\0", 14, MSG_NOSIGNAL, NULL, 0) = 14 poll([{fd=3, events=POLLIN|POLLERR|POLLHUP}], 1, 5000) = 1 ([{fd=3, revents=POLLIN|POLLHUP}]) read(3, "\2\0\0\0\1\0\0\0\5\0\0\0\2\0\0\0\0\0\0\0\0\0\0\0", 24) = 24 read(3, "root\0x\0", 7) = 7 close(3) = 0 openat(AT_FDCWD, "/lucien-raid/bitflu/", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 3 getdents(3, ^CProcess 23500 detached I can access other dirs on /lucien-raid; the server also has no problems accessing the exported directory. Here's an ls -la of /lucien-raid
l /lucien-raid/ insgesamt 40 drwxr-xr-x 7 root root 4096 17. Sep 2011 ./ drwxr-xr-x 28 root root 4096 28. Nov 21:01 ../ drwxrwxr-x 8 root root 4096 24. Aug 2011 bitflu/ drwx------ 2 root root 16384 30. Jul 2011 lost+found/ drwxr-xr-x 4 root root 4096 6. Aug 2011 lucien/ drwxr-xr-x 11 ms users 4096 29. Aug 2010 medien/ drwxrwxrwt 2 root root 4096 25. Nov 08:22 tmp/
I can stat dirs in /lucien-raid/bitflu/ Reproducible: Always Steps to Reproduce: 1. 2. 3. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c1
Jiaying ren
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/17.0 Firefox/17.0
I have an nfs4 mount from an 12.2 client to a 12.2 server. The problem showed up in that updatedb hangs. An lsof of that process showed an access to an nfs4 mount (see also bug 792323). Further testing shows that an ls -la on a directory on that mount hangs:
mmap(NULL, 337515, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fa33f0a9000 close(3) = 0 lstat("/lucien-raid/bitflu/", {st_mode=S_IFDIR|0775, st_size=4096, ...}) = 0 lgetxattr("/lucien-raid/bitflu/", "security.selinux", 0x937e40, 255) = -1 EOPNOTSUPP (Operation not supported) lgetxattr("/lucien-raid/bitflu/", "system.posix_acl_access", 0x0, 0) = -1 EOPNOTSUPP (Operation not supported)
Hi~ Martin,have you installed ntfs-3g and ntfsprogs? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
rpm -qa|fgrep ntfs
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c2
Martin Schröder
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c
Jiaying ren
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c
Philipp Thomas
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c3
Neil Brown
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c4
Martin Schröder
1/ what sort of filesystem is it on the server (ext3? ext4? btrfs? etc)
mount devtmpfs on /dev type devtmpfs (rw,relatime,size=3924728k,nr_inodes=981182,mode=755) tmpfs on /dev/shm type tmpfs (rw,relatime) tmpfs on /run type tmpfs (rw,nosuid,nodev,relatime,mode=755) devpts on /dev/pts type devpts (rw,relatime,gid=5,mode=620,ptmxmode=000) /dev/mapper/system-root on / type ext4 (rw,relatime,data=ordered)
cat /etc/exports /raid/raid 192.168.17.0/24(root_squash,sync,rw,subtree_check,crossmnt) rpm -qa|fgrep nfs
ext4 it's an lvm on raid5 proc on /proc type proc (rw,relatime) sysfs on /sys type sysfs (rw,relatime) tmpfs on /sys/fs/cgroup type tmpfs (rw,nosuid,nodev,noexec,relatime,mode=755) cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,release_agent=/lib/systemd/systemd-cgroups-agent,name=systemd) cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset) cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpuacct,cpu) cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory) cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) cgroup on /sys/fs/cgroup/net_cls type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=33,pgrp=1,timeout=300,minproto=5,maxproto=5,direct) tmpfs on /var/run type tmpfs (rw,nosuid,nodev,relatime,mode=755) tmpfs on /media type tmpfs (rw,nosuid,nodev,noexec,relatime,mode=755) tmpfs on /var/lock type tmpfs (rw,nosuid,nodev,relatime,mode=755) debugfs on /sys/kernel/debug type debugfs (rw,relatime) hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime) securityfs on /sys/kernel/security type securityfs (rw,relatime) mqueue on /dev/mqueue type mqueue (rw,relatime) /dev/sda1 on /boot type ext3 (rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=ordered) /dev/mapper/system-space on /space type ext4 (rw,relatime,data=ordered) /dev/mapper/system-home on /home type ext4 (rw,relatime,data=ordered) /dev/mapper/raid-backup on /raid/backup type ext4 (rw,relatime,stripe=64,data=ordered) /dev/mapper/raid-raid on /raid/raid type ext4 (rw,relatime,stripe=64,data=ordered) proc on /raid/raid/bitflu/proc type proc (rw,relatime) /dev/mapper/raid-nelson--home on /raid/nelson/home type xfs (ro,relatime,attr2,logbsize=128k,sunit=256,swidth=512,noquota) nfsd on /proc/fs/nfsd type nfsd (rw,relatime) rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime) none on /var/lib/ntp/proc type proc (ro,nosuid,nodev,relatime) limal-nfs-server-perl-1.6.3-5.1.2.x86_64 yast2-nfs-common-2.21.4-1.1.1.noarch nfsidmap-0.24-17.1.2.x86_64 yast2-nfs-client-2.21.6-1.1.1.noarch nfs-kernel-server-1.2.6-2.12.1.x86_64 limal-nfs-server-1.6.3-5.1.2.x86_64 nfs-client-1.2.6-2.12.1.x86_64
2/ can you get a tcpdump trace of traffic when running "ls" in the mount? i.e. run tcpdump -o /tmp/dump -s 0 host server-IP
on the client, then run 'ls' in another window, then interrupt the tcpdump and attach the resulting /tmp/dump file.
Done. Also dmesgs from client and server. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c5
--- Comment #5 from Martin Schröder
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c6
--- Comment #6 from Martin Schröder
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c7
--- Comment #7 from Martin Schröder
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c
Martin Schröder
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c
Martin Schröder
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c8
Martin Schröder
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c9
Martin Schröder
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c10
Neil Brown
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c11
Martin Schröder
The client it performing a "LOOKUP" of the name "proc" in the directory /lucien-raid/bitflu/
and that lookup is hanging. So something is going wrong on the NFS server.
What is 'proc'?
Thanks, that's probably the problem. On the server I have this mountpoint: proc on /raid/raid/bitflu/proc type proc (rw,relatime) /raid/raid/bitflu/ is a chroot environment. And here's the relevant line from /etc/exports: /raid/raid 192.168.17.0/24(root_squash,sync,rw,subtree_check,crossmnt) Methinks /raid/raid/bitflu/proc is not exported. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c12
Neil Brown
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c13
--- Comment #13 from Neil Brown
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c14
--- Comment #14 from Neil Brown
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c15
Neil Brown
https://bugzilla.novell.com/show_bug.cgi?id=792324
https://bugzilla.novell.com/show_bug.cgi?id=792324#c16
Neil Brown
participants (1)
-
bugzilla_noreply＠novell.com