Mailinglist Archive: opensuse (1986 mails)
| < Previous | Next > |
[opensuse] Can't write to NFS share after growing it to 15TBytes.
- From: Michael Marti <michael.marti@xxxxxxxxxx>
- Date: Tue, 18 Nov 2008 12:47:28 +0000
- Message-id: <0344EF5B-DA82-432C-BAAB-7208B5726E24@xxxxxxxxxx>
Dear list members
I have an NFS server (SuSE 10.1) exporting a 15T filesystem. On the NFS server itself the filesystem appears to work correctly for read and write access. On the NFS client machines (e.g. SuSE 10.0) however only read access to the NFS share seems to work, while writing to the NFS server always fails, reporting that there would be no space left on the device:
epp michael/test> df -h | grep exppraid
exppraid:/export/raid
15T 4.8T 10T 33% /exppraid
epp michael/test> pwd
/exppraid/michael/test
epp michael/test> cp /boot/vmlinux-2.6.13-15.18-smp.gz .
cp: closing `./vmlinux-2.6.13-15.18-smp.gz': No space left on device
epp michael/test> ls -l
total 0
-rw-r--r-- 1 michael epp 0 2008-11-18 12:02 vmlinux-2.6.13-15.18-smp.gz
The filesystem that I am exporting on the NFS is a logical volume. We just increased the size of this filesystem from 5.5TB to 15TB. The 5.5TB filesystem did not exhibit this problem while the 15T filesystem never allowed for NFS writes. We did not change any other configuration of server or client, which indicates that the issue is indeed related to the size of the filesystem exported via nfs. We also use mac os x NFS clients (os version 10.4 server), which exhibit the exact same problem when accessing the SuSE 10.1 NFS server. More detail on the configuration of the SuSE server and client can be found in the end of this e-mail.
Any idea what could cause this problem and how it can be solved? What should be done to further diagnose this issue?
Best regards,
Michael Marti.
###################
## NFS server config ##
###################
SuSE 10.1
Linux exppraid 2.6.16.54-0.2.5-smp #1 SMP Mon Jan 21 13:29:51 UTC 2008 x86_64 x86_64 x86_64 GNU/Linux
rpms: nfs-utils-1.0.7-36; yast2-nfs-client-2.13.3-12; nfsidmap-0.12-16; yast2-nfs-server-2.13.3-12; portmap-5beta-747
/etc/exports: /export/raid/ *.expp.ist.utl.pt(rw,insecure,async)
exppraid:~ # nfsstat
Server rpc stats:
calls badcalls badauth badclnt xdrcall
334 0 0 0 0
Server nfs v2:
null getattr setattr root lookup readlink
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
read wrcache write create remove rename
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
link symlink mkdir rmdir readdir fsstat
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
Server nfs v3:
null getattr setattr lookup access readlink
0 0% 3 0% 7 2% 131 39% 152 45% 0 0%
read write create mkdir symlink mknod
0 0% 2 0% 5 1% 0 0% 0 0% 0 0%
remove rmdir rename link readdir readdirplus
5 1% 0 0% 2 0% 0 0% 3 0% 0 0%
fsstat fsinfo pathconf commit
23 6% 1 0% 0 0% 0 0%
Client rpc stats:
calls retrans authrefrsh
10 0 0
Client nfs v2:
null getattr setattr root lookup readlink
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
read wrcache write create remove rename
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
link symlink mkdir rmdir readdir fsstat
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
Client nfs v3:
null getattr setattr lookup access readlink
0 0% 4 57% 0 0% 0 0% 0 0% 0 0%
read write create mkdir symlink mknod
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
remove rmdir rename link readdir readdirplus
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
fsstat fsinfo pathconf commit
0 0% 3 42% 0 0% 0 0%
###################
## NFS client config ##
###################
SuSE 10.0
Linux epp 2.6.13-15.18-smp #1 SMP Tue Oct 2 17:36:20 UTC 2007 i686 athlon i386 GNU/Linux
rpms: nfsidmap-0.10-2; nfs-utils-1.0.7-13; yast2-nfs-client-2.12.3-2; yast2-nfs-server-2.12.1-2; portmap-5beta-735
/etc/mtab:
nfsd /proc/fs/nfsd nfsd rw 0 0
exppraid:/export/raid /exppraid nfs rw,addr=192.168.2.203 0 0
epp:~ # nfsstat
Server rpc stats:
calls badcalls badauth badclnt xdrcall
50 0 0 0 0
Server nfs v2:
null getattr setattr root lookup readlink
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
read wrcache write create remove rename
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
link symlink mkdir rmdir readdir fsstat
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
Server nfs v3:
null getattr setattr lookup access readlink
2 4% 12 25% 0 0% 1 2% 15 31% 0 0%
read write create mkdir symlink mknod
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
remove rmdir rename link readdir readdirplus
0 0% 0 0% 0 0% 0 0% 1 2% 2 4%
fsstat fsinfo pathconf commit
9 18% 6 12% 0 0% 0 0%
Client rpc stats:
calls retrans authrefrsh
660 0 0
Client nfs v2:
null getattr setattr root lookup readlink
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
read wrcache write create remove rename
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
link symlink mkdir rmdir readdir fsstat
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
Client nfs v3:
null getattr setattr lookup access readlink
0 0% 140 21% 11 1% 112 17% 74 11% 4 0%
read write create mkdir symlink mknod
5 0% 253 38% 10 1% 0 0% 0 0% 0 0%
remove rmdir rename link readdir readdirplus
8 1% 0 0% 3 0% 0 0% 0 0% 22 3%
fsstat fsinfo pathconf commit
11 1% 3 0% 0 0% 1 0%
--
----------------------------------------------------------------------------
Michael Marti
Instituto Superior Técnico
Av. Rovisco Pais
1049-001 Lisboa
Portugal
----------------------------------------------------------------------------
--
To unsubscribe, e-mail: opensuse+unsubscribe@xxxxxxxxxxxx
For additional commands, e-mail: opensuse+help@xxxxxxxxxxxx
I have an NFS server (SuSE 10.1) exporting a 15T filesystem. On the NFS server itself the filesystem appears to work correctly for read and write access. On the NFS client machines (e.g. SuSE 10.0) however only read access to the NFS share seems to work, while writing to the NFS server always fails, reporting that there would be no space left on the device:
epp michael/test> df -h | grep exppraid
exppraid:/export/raid
15T 4.8T 10T 33% /exppraid
epp michael/test> pwd
/exppraid/michael/test
epp michael/test> cp /boot/vmlinux-2.6.13-15.18-smp.gz .
cp: closing `./vmlinux-2.6.13-15.18-smp.gz': No space left on device
epp michael/test> ls -l
total 0
-rw-r--r-- 1 michael epp 0 2008-11-18 12:02 vmlinux-2.6.13-15.18-smp.gz
The filesystem that I am exporting on the NFS is a logical volume. We just increased the size of this filesystem from 5.5TB to 15TB. The 5.5TB filesystem did not exhibit this problem while the 15T filesystem never allowed for NFS writes. We did not change any other configuration of server or client, which indicates that the issue is indeed related to the size of the filesystem exported via nfs. We also use mac os x NFS clients (os version 10.4 server), which exhibit the exact same problem when accessing the SuSE 10.1 NFS server. More detail on the configuration of the SuSE server and client can be found in the end of this e-mail.
Any idea what could cause this problem and how it can be solved? What should be done to further diagnose this issue?
Best regards,
Michael Marti.
###################
## NFS server config ##
###################
SuSE 10.1
Linux exppraid 2.6.16.54-0.2.5-smp #1 SMP Mon Jan 21 13:29:51 UTC 2008 x86_64 x86_64 x86_64 GNU/Linux
rpms: nfs-utils-1.0.7-36; yast2-nfs-client-2.13.3-12; nfsidmap-0.12-16; yast2-nfs-server-2.13.3-12; portmap-5beta-747
/etc/exports: /export/raid/ *.expp.ist.utl.pt(rw,insecure,async)
exppraid:~ # nfsstat
Server rpc stats:
calls badcalls badauth badclnt xdrcall
334 0 0 0 0
Server nfs v2:
null getattr setattr root lookup readlink
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
read wrcache write create remove rename
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
link symlink mkdir rmdir readdir fsstat
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
Server nfs v3:
null getattr setattr lookup access readlink
0 0% 3 0% 7 2% 131 39% 152 45% 0 0%
read write create mkdir symlink mknod
0 0% 2 0% 5 1% 0 0% 0 0% 0 0%
remove rmdir rename link readdir readdirplus
5 1% 0 0% 2 0% 0 0% 3 0% 0 0%
fsstat fsinfo pathconf commit
23 6% 1 0% 0 0% 0 0%
Client rpc stats:
calls retrans authrefrsh
10 0 0
Client nfs v2:
null getattr setattr root lookup readlink
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
read wrcache write create remove rename
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
link symlink mkdir rmdir readdir fsstat
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
Client nfs v3:
null getattr setattr lookup access readlink
0 0% 4 57% 0 0% 0 0% 0 0% 0 0%
read write create mkdir symlink mknod
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
remove rmdir rename link readdir readdirplus
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
fsstat fsinfo pathconf commit
0 0% 3 42% 0 0% 0 0%
###################
## NFS client config ##
###################
SuSE 10.0
Linux epp 2.6.13-15.18-smp #1 SMP Tue Oct 2 17:36:20 UTC 2007 i686 athlon i386 GNU/Linux
rpms: nfsidmap-0.10-2; nfs-utils-1.0.7-13; yast2-nfs-client-2.12.3-2; yast2-nfs-server-2.12.1-2; portmap-5beta-735
/etc/mtab:
nfsd /proc/fs/nfsd nfsd rw 0 0
exppraid:/export/raid /exppraid nfs rw,addr=192.168.2.203 0 0
epp:~ # nfsstat
Server rpc stats:
calls badcalls badauth badclnt xdrcall
50 0 0 0 0
Server nfs v2:
null getattr setattr root lookup readlink
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
read wrcache write create remove rename
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
link symlink mkdir rmdir readdir fsstat
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
Server nfs v3:
null getattr setattr lookup access readlink
2 4% 12 25% 0 0% 1 2% 15 31% 0 0%
read write create mkdir symlink mknod
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
remove rmdir rename link readdir readdirplus
0 0% 0 0% 0 0% 0 0% 1 2% 2 4%
fsstat fsinfo pathconf commit
9 18% 6 12% 0 0% 0 0%
Client rpc stats:
calls retrans authrefrsh
660 0 0
Client nfs v2:
null getattr setattr root lookup readlink
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
read wrcache write create remove rename
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
link symlink mkdir rmdir readdir fsstat
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
Client nfs v3:
null getattr setattr lookup access readlink
0 0% 140 21% 11 1% 112 17% 74 11% 4 0%
read write create mkdir symlink mknod
5 0% 253 38% 10 1% 0 0% 0 0% 0 0%
remove rmdir rename link readdir readdirplus
8 1% 0 0% 3 0% 0 0% 0 0% 22 3%
fsstat fsinfo pathconf commit
11 1% 3 0% 0 0% 1 0%
--
----------------------------------------------------------------------------
Michael Marti
Instituto Superior Técnico
Av. Rovisco Pais
1049-001 Lisboa
Portugal
----------------------------------------------------------------------------
--
To unsubscribe, e-mail: opensuse+unsubscribe@xxxxxxxxxxxx
For additional commands, e-mail: opensuse+help@xxxxxxxxxxxx
| < Previous | Next > |