Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
All ssh based large file transfers stall
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Networking & Security
View previous topic :: View next topic  
Author Message
JanErik
Guru
Guru


Joined: 28 Oct 2002
Posts: 447
Location: Finland

PostPosted: Thu May 10, 2012 7:14 pm    Post subject: All ssh based large file transfers stall Reply with quote

I have a problem on my file server that all ssh based (scp, rsync, rdiff-backup) file transfers stall on large files. It does not work in either direction.
Over NFS transfers works fine.

Seems it stopped working after I updated the machine last weekend after running a few months without update.

I have tried a different NIC, cable and switch port. Have run revdep-rebuild and python-updater. Also re-emerged libssh and openssh without any improvement.
Back to top
View user's profile Send private message
swimmer
Veteran
Veteran


Joined: 15 Jul 2002
Posts: 1276
Location: Netherlands

PostPosted: Thu May 10, 2012 11:35 pm    Post subject: Reply with quote

Same here - I even had to switch my rdiff-backup config from ssh to NFS :-/

The only visible change I could see was the switch from openssh 5.9_p1-r4 to 6.0_p1 .... but there was only *one* change in the sshd_config so far ...
Code:
# Allow client to pass locale environment variables #367017
AcceptEnv LANG LC_*
Back to top
View user's profile Send private message
PaulBredbury
Watchman
Watchman


Joined: 14 Jul 2005
Posts: 7020

PostPosted: Fri May 11, 2012 4:00 am    Post subject: Reply with quote

Try openssl 1.0.0j instead. Then recompile openssh.

The 1.0.1 series seems buggy.
Back to top
View user's profile Send private message
furanku
l33t
l33t


Joined: 08 May 2003
Posts: 873
Location: Hamburg, Germany

PostPosted: Sat May 12, 2012 7:54 am    Post subject: Reply with quote

Same here. Going back to openssl-1.0.0j and reemerging/restarting openssh did not solve the issue.
Back to top
View user's profile Send private message
enigma59
n00b
n00b


Joined: 20 Jun 2008
Posts: 13

PostPosted: Sat May 12, 2012 1:26 pm    Post subject: Reply with quote

I have the same issue doing something as simple as

Code:
cat largefile | ssh localhost cat > another_large_file


stalls it if largefile is sufficiently large, I used 4mb. Downgrading to openssh-5.9_p1-r4 works correctly while openssh-6.0_p1 doesn't.

Edit: Just found this bug that has more discussion https://bugs.gentoo.org/show_bug.cgi?id=414401
Back to top
View user's profile Send private message
JanErik
Guru
Guru


Joined: 28 Oct 2002
Posts: 447
Location: Finland

PostPosted: Sat May 12, 2012 5:05 pm    Post subject: Reply with quote

Downgrading to openssh-5.9_p1-r4 solved the problem.
Back to top
View user's profile Send private message
Ant P.
Veteran
Veteran


Joined: 18 Apr 2009
Posts: 1917
Location: UK

PostPosted: Mon May 14, 2012 2:35 pm    Post subject: Reply with quote

Found a less intrusive workaround from a post on gentoo-user: setting "TcpRcvBufPoll no" in sshd_config fixed it for me.

Last edited by Ant P. on Mon May 14, 2012 11:59 pm; edited 1 time in total
Back to top
View user's profile Send private message
wazoo42
Apprentice
Apprentice


Joined: 13 Apr 2004
Posts: 158

PostPosted: Mon May 14, 2012 7:30 pm    Post subject: Reply with quote

Ant P.s solution worked for my as well, while the different versions of openssl/openssh did not. One small note, sshd did not like "No" and I had to change it to "no".
Back to top
View user's profile Send private message
Ant P.
Veteran
Veteran


Joined: 18 Apr 2009
Posts: 1917
Location: UK

PostPosted: Mon May 14, 2012 11:59 pm    Post subject: Reply with quote

My bad, "no" is correct. Fixed.
Back to top
View user's profile Send private message
swimmer
Veteran
Veteran


Joined: 15 Jul 2002
Posts: 1276
Location: Netherlands

PostPosted: Tue May 15, 2012 8:29 am    Post subject: Reply with quote

Ant P. wrote:
Found a less intrusive workaround from a post on gentoo-user: setting "TcpRcvBufPoll no" in sshd_config fixed it for me.
That's the solution indeed! (At least for me)

Thank you very much Ant P. for sharing :)
Back to top
View user's profile Send private message
depontius
Advocate
Advocate


Joined: 05 May 2004
Posts: 2156

PostPosted: Tue May 15, 2012 12:25 pm    Post subject: Reply with quote

Ant P. wrote:
Found a less intrusive workaround from a post on gentoo-user: setting "TcpRcvBufPoll no" in sshd_config fixed it for me.


Is there a way to do this from the client side? I can certainly do this on those systems which I administer, but not on my employer's systems, which I don't.
_________________
.sigs waste space and bandwidth
Back to top
View user's profile Send private message
Havin_it
l33t
l33t


Joined: 17 Jul 2005
Posts: 990
Location: Edinburgh, UK

PostPosted: Tue Jun 05, 2012 11:54 am    Post subject: Reply with quote

depontius wrote:
Ant P. wrote:
Found a less intrusive workaround from a post on gentoo-user: setting "TcpRcvBufPoll no" in sshd_config fixed it for me.


Is there a way to do this from the client side? I can certainly do this on those systems which I administer, but not on my employer's systems, which I don't.


Depends how you are using SSH, but I've found that invoking it with compression ("-C") prevents the hangs I've been seeing in most cases. For rsync the arg you need is -c, for unison it's -sshargs="-C".

I also found in my case that file-size is not an issue, but it appears that certain files would always hang at a certain point (according to progress displays in rsync and unison) which makes me think that some byte[-sequence] is the trigger. Anyone else who is doing multi-file transfers, I'd welcome your own findings on that one, here or in the bug-report.
Back to top
View user's profile Send private message
hydrapolic
n00b
n00b


Joined: 07 Feb 2008
Posts: 69

PostPosted: Thu Jun 07, 2012 1:58 pm    Post subject: Reply with quote

Ant P. wrote:
Found a less intrusive workaround from a post on gentoo-user: setting "TcpRcvBufPoll no" in sshd_config fixed it for me.


thanks, this fixed the problem :)

EDIT:
net-misc/openssh-6.0_p1-r1 fixes the issue, so no need to set "TcpRcvBufPoll no" anymore (bug 414401) :) Thanks
Back to top
View user's profile Send private message
Dan
Veteran
Veteran


Joined: 25 Oct 2005
Posts: 1301

PostPosted: Wed Jun 13, 2012 7:40 pm    Post subject: Reply with quote

Thanks guys. I been googling "scp stalled", on and off for a few days and trying all kinds of sysctl settings. Thanks for the real solution!
_________________
- Failure is not an option. It's bundled with your software.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Networking & Security All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum