emerge sync - problem

Message

Mudi · Post by **Mudi** » Wed Jan 19, 2005 3:48 am

For some reason, whenever I emerge --sync, my computer seems to disconnect itself from rsync intentionally. At some random point during the sync, it gives me

Code: Select all

io timeout after 31 seconds - exiting
rsync error: timeout in data send/receive (code 30) at io.c(153)

About 30 seconds later, it stops with

Code: Select all

rsync: connection unexpectedly closed (2387123 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(359)
>>> retry ...

Sometimes in the ten retries it has it will end up chugging through the whole tree, but more often something gets corrupted (apparently) and it refuses to do anything else, I have to do a web-rsync. I couldn't find anything on the forum search, is this a known/resolved issue?

Thanks

EDIT: if system stats needed:

Pentium II
Vanilla kernel 2.6.10r1 (though it did the same thing in previous kernels)
Portage newest version (unless emerge --update --pretend world is lying)
192MB memory

Mudi · Post by **Mudi** » Wed Jan 19, 2005 4:02 am

Heh, thats weird, I did a web-rsync this time and it deleted my entire portage tree...

I guess I'll download a snapshot and decompress it into the right place... that was weird...

Mudi · Post by **Mudi** » Wed Jan 19, 2005 4:07 am

Umm... the snapshot for 1/18/2005 is only 1.1M? That can't be right.. take it down before someone else kills their gentoo!

And now I realize I triple-posted there... sorry, heh

JjcampNR · Post by **JjcampNR** » Wed Jan 19, 2005 5:39 am

This problem has shown up in other posts as well, for example we've been discussing it here as well: http://forums.gentoo.org/viewtopic.php? ... 37#1989637

It looks like it's not a localized problem but one that is causing problems for a bunch of people. Perhaps we can get a developer to take a look at this?

--Josh

vectorsigma · Post by **vectorsigma** » Wed Jan 19, 2005 5:51 am

I'm having a similar problem. I haven't synced in about 2 months, and when I try emerge-webrsync it just sits there and does nothing.

vonhelmet · Post by **vonhelmet** » Wed Jan 19, 2005 12:03 pm

Explanation and fix here. See my post at the bottom of the page.

I've requested that a mod put up a sticky or something on the front page to alert people to this problem before we get drowned in threads about it.

mattheweast · Post by **mattheweast** » Wed Jan 19, 2005 12:41 pm

as I understand it, this fix will not work for those experiencing the RSYNC problem outlined at the top of this post. i.e.

io timeout after 31 seconds - exiting
rsync error: timeout in data send/receive (code 30) at io.c(153)

The fix outlined seems to be for the problem with the portage snapshot?

Is this correct?

vonhelmet · Post by **vonhelmet** » Wed Jan 19, 2005 12:50 pm

mattheweast wrote:as I understand it, this fix will not work for those experiencing the RSYNC problem outlined at the top of this post. i.e.

io timeout after 31 seconds - exiting
rsync error: timeout in data send/receive (code 30) at io.c(153)

The fix outlined seems to be for the problem with the portage snapshot?

Is this correct?

Sorry, yes, my post was intended as a solution to the problem in the post directly above mine.

However, it could be that the rsync problem is the root of the webrsync problem I've described (though I don't know that). My solution will also allow you to update the portage tree in the event that rsync doesn't work, though it is more treating the symptoms than the cause.

mattheweast · Post by **mattheweast** » Wed Jan 19, 2005 3:39 pm

Thanks for that. Seems that there are two distinct problems here: 1. where emerge sync times out, but "emerge-websync" or "rm -rf /usr/portage/* && emerge sync" works successfully 2. Where neither work.

for problem 2, see the fix above.

for problem 1, there is a good thread on it here: http://forums.gentoo.org/viewtopic.php?t=276881.

EDIT: see also bug (UPSTREAM) at http://bugs.gentoo.org/show_bug.cgi?id=49933

JackDog · Post by **JackDog** » Wed Jan 19, 2005 8:40 pm

Just an FYI, any of the above "solutions" or any other relating to the io problems with rsync have not been fixed here or on any forum topic I have seen. Only some computers that I adminsitrate have this strange io issue wrt rsync. Updating rsync, its configs, any of its deps have no effect. I am currently installing another distribution on some of these machines because I cannot keep them up to date in an efficient manner otherwise. Its not a recent issue, One of my machines has had this problem for 18 months. Sometimes it syncs, sometimes it doesnt.

BlinkEye · Post by **BlinkEye** » Wed Feb 09, 2005 9:27 am

any update on this issue? it's so annyoing - and even though i first thought it was a kernel/hardware issue (ethernet device) i'm not able to find any kernel which doesn't have the problem. tried 12 version, from 2.6.9 until 2.6.11!

and it only happens on one box

[EDIT] i just emerged net-misc/rsync-2.6.3 on the box in question. i have a private rsync mirror - so i synced several times - so far it seems to be working (the rsync mirror however still uses net-misc/rsync-2.6.0-r3)! [/EDIT]

mattheweast · Post by **mattheweast** » Wed Feb 09, 2005 10:16 am

Since the downgrade of rsync in x86 I've had no repetitions of this issue.

transient · Post by **transient** » Wed Feb 09, 2005 10:28 am

If it keeps occuring, change the rsync timeout value in /etc/make.conf to some nice high value.