[opensuse] low NFS performance. Misconfiguration or protocol limitation?
Hello, I was trying to debug a low nfs throughput configuration between suse servers and the NAS/SAN storage systems and I was astonished by the low performance. Then I setup my pc (opensuse 11.3) as a nfs server and mount it through the loopback interface to discard network issues and again the numbers were surprisingly low. Let me show the results, the first test is using /var/lib/xen/images (using ext4) and the second test is the same directory exported by nfs (version 3) and mounted on /media/nfs. Changing application blocksize or network buffers makes no big difference. The final system is for mail queues and mail storage so there will a lot of small files on average. Any idea about were the bottleneck or misconfiguration could be? # grep nfs /proc/mounts nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 localhost:/var/lib/xen/images /media/nfs nfs rw,relatime,vers=3,rsize=262144,wsize=262144,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=127.0.0.1,mountvers=3,mountport=56451,mountproto=udp,addr=127.0.0.1 0 0 pm>show Current configuration is: The base number of files is 30000 Transactions: 10 Files range between 500 bytes and 9.77 kilobytes in size Working directory: /var/lib/xen/images Block sizes are: read=512 bytes, write=512 bytes Biases are: read/append=-1, create/delete=10 Using Unix buffered file I/O Random number generator seed is 42 Report format is verbose. pm>run Creating files...Done Performing transactions..........Done Deleting files...Done Time: 4 seconds total 1 seconds of transactions (10 per second) Files: 30010 created (7502 per second) Creation alone: 30000 files (10000 per second) Mixed with transactions: 10 files (10 per second) 0 read (0 per second) 0 appended (0 per second) 30010 deleted (7502 per second) Deletion alone: 30010 files (30010 per second) Mixed with transactions: 0 files (0 per second) Data: 0.000000 bytes read (0.000000 bytes per second) 149.58 megabytes written (37.40 megabytes per second) pm>set location /media/nfs pm>run Creating files...Done Performing transactions..........Done Deleting files...Done Time: 1156 seconds total 1 seconds of transactions (10 per second) Files: 30010 created (25 per second) Creation alone: 30000 files (26 per second) Mixed with transactions: 10 files (10 per second) 0 read (0 per second) 0 appended (0 per second) 30010 deleted (25 per second) Deletion alone: 30010 files (3751 per second) Mixed with transactions: 0 files (0 per second) Data: 0.000000 bytes read (0.000000 bytes per second) 149.58 megabytes written (132.50 kilobytes per second) -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Thu, 2010-12-09 at 07:23 +0000, mailing lists wrote:
Any idea about were the bottleneck or misconfiguration could be?
# grep nfs /proc/mounts nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 localhost:/var/lib/xen/images /media/nfs nfs rw,relatime,vers=3,rsize=262144,wsize=262144,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=127.0.0.1,mountvers=3,mountport=56451,mountproto=udp,addr=127.0.0.1
On 11.2 I think NFS is reasonable. I don't know about 11.3. But I have 'noatime' instead of 'relatime'. And 'rsize=8192,wsize=8192' instead of 'rsize=262144,wsize=262144'. -- Roger Oberholtzer OPQ Systems / Ramböll RST Ramböll Sverige AB Krukmakargatan 21 P.O. Box 17009 SE-104 62 Stockholm, Sweden Office: Int +46 10-615 60 20 Mobile: Int +46 70-815 1696 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
participants (2)
-
mailing lists
-
Roger Oberholtzer