sftp connection time-outs

I am having problems when using sftp to retrieve files from a remote location. It starts the transfer then after a while it will stop and then I get the message: Read from remote host <host name>: Connection timed out Connection closed. Any ideas? Thanks! Robert