[opensuse] [SLE] Slow transfers from Linux Server
From what I can see ipv6 is enabled on the server, (there appears to be a field with an ipv6 address in it in the ifconfig output). Would
John,
Ok, I've tested again with both samba and SFTP. Samba is
significantly quicker than SFTP with the iso file copying in ~5-6
minutes instead of the 35+ being shown by SFTP. But looking at top
whilst the processes are running the system is doing virtually nothing
during both transfers, (both smbd and sshd during the respective
transfers are peaking at <5% CPU usage, (the system has an Athlon64
3400+ (like Sunny ;) )). At the Windows end the system was running at
about 40% system utilization according to Process Explorer.
Running the transfer on plain disk instead of off of the Raid array
does not seem to make much of a difference in the transfer rates.
this make much of a difference in performance?
Tim
On 3/13/07, John Andersen
On Tuesday 13 March 2007, Tim Hempstead wrote:
Accessing the system via samba from a Windows XP box seems quite slow as does accessing it via SFTP, (a sustained SFTP transfer using Filezilla peaked at 310kb/s .... a 670MB iso image has just taken 35+ minutes to transfer across between them).
Doesn't sftp require encrypting the file for sending? Samba should outperform sftp.
From the Bonnie figures I am guessing the issue is more likely to lie on the networking side rather than the disk side?
Ipv6 turned off?
You are getting less than 100megabit Cat5 performance.
I just copied a 350meg iso across 100mbit network via samba in under 10 minutes. It pegged my linux nic at 7.4 meg for the duration according to gkrellm.
So i would put that file on flat disk space (no raid) and copy it with samba to see if the problem is in the disk or the network. You definitely want to get sftp out of the picture.
-- _____________________________________ John Andersen
-- Tim Hempstead thempstead@gmail.com -- Tim Hempstead thempstead@gmail.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On Tuesday 13 March 2007, Tim Hempstead wrote:
John,
Ok, I've tested again with both samba and SFTP. Samba is significantly quicker than SFTP with the iso file copying in ~5-6 minutes instead of the 35+ being shown by SFTP. But looking at top whilst the processes are running the system is doing virtually nothing during both transfers, (both smbd and sshd during the respective transfers are peaking at <5% CPU usage,
Hmmm, thats more improvement that even I would have expected. Is top showing you the Nice time too? Perhaps the processing has been niced out of the display? But to avoid getting side tracked, does that performance live up to your expectations when running under samba? Can we rule out problems with the hard drive array as well as the network? If so, it sounds like an encryption problem somewhere, and the windows side looks guilty to me. I've never had much luck compressing an ISO, is your sftp trying to use compression in addition to encryption? ----------------------- Interesting (and perhaps unrelated) side note regarding ssh: somewhere along the way (in the last month or so) ssh connections started treating the "UseDNS yes" parameter differently than in the past on one of my servers, either that or bind is horked. The symptom taking was 30 seconds to connect, and from there on running at normal speed. 30 seconds tipped me off to the fact that it was waiting for dns to time out. UseDNS causes it to reverse map the dns to see that it gets something that resolves back to the machine trying to connect. With out host entries on the dns server for local machines it was taking forever. Adding entries to hosts fixed it. Turning off UseDNS would have also been an option. -- _____________________________________ John Andersen
Its certainly strange, the samba transfer rate is more the sort of
level I was expecting. Top is supposedly showing nice time as well,
and running a straight sar instead also gave the same results.
Disabling ipv6, UseDNS(*), compression on the SFTP windows client all
made little or no difference. Interestingly changing to another sftp
client on the wintel end, (the sftp from the putty suite instead of
filezilla) appears to run quicker but with occasional large slowdowns
with very high CPU usage on the client, (but not the server) ...
transfer using this was 12mins, not great but better than before
I think that you are correct and that this is a client issue not a
problem with the linux server.
Cheers
Tim
(*) although this isn't the problem here I think I may be encountering
this elsewhere so cheers for that too :)
On 3/13/07, John Andersen
On Tuesday 13 March 2007, Tim Hempstead wrote:
John,
Ok, I've tested again with both samba and SFTP. Samba is significantly quicker than SFTP with the iso file copying in ~5-6 minutes instead of the 35+ being shown by SFTP. But looking at top whilst the processes are running the system is doing virtually nothing during both transfers, (both smbd and sshd during the respective transfers are peaking at <5% CPU usage,
Hmmm, thats more improvement that even I would have expected.
Is top showing you the Nice time too? Perhaps the processing has been niced out of the display?
But to avoid getting side tracked, does that performance live up to your expectations when running under samba? Can we rule out problems with the hard drive array as well as the network?
If so, it sounds like an encryption problem somewhere, and the windows side looks guilty to me. I've never had much luck compressing an ISO, is your sftp trying to use compression in addition to encryption?
----------------------- Interesting (and perhaps unrelated) side note regarding ssh: somewhere along the way (in the last month or so) ssh connections started treating the "UseDNS yes" parameter differently than in the past on one of my servers, either that or bind is horked.
The symptom taking was 30 seconds to connect, and from there on running at normal speed. 30 seconds tipped me off to the fact that it was waiting for dns to time out.
UseDNS causes it to reverse map the dns to see that it gets something that resolves back to the machine trying to connect. With out host entries on the dns server for local machines it was taking forever. Adding entries to hosts fixed it. Turning off UseDNS would have also been an option.
-- _____________________________________ John Andersen
-- Tim Hempstead thempstead@gmail.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
participants (2)
-
John Andersen
-
Tim Hempstead